It has to do with quest items that are junk, which count toward the material counter but can't be scrapped. It doesn't have to do with perks, glitches or mods (for me at least), it's just bethesda sucking.
Sorry for the massive necro-post, I found the real solution to this problem and I'm posting it on all these threads.