While these items can't be equipped or consumed, they can be dropped, sold to vendors, or just scrapped.
There is junk in every nook and cranny of The Commonwealth. Seeing that Fallout 4 takes place in the aftermath of a nuclear war, you can expect to encounter many items that used to be useful before the war but are just junk now.