I have a dirty secret too. But once in a while I'll let them out of the basement.
But I know what you mean - I don't understand why thing should be guilty pleasures - if I want to listen to the Disney Love Songs CD at my desk then nobody is going to make me feel guilty about it.
I think the problem people have with my tastes is that I used to be a goth and a mosher back in the 2000s and they can't see past this still, so to see a play list with Marilyn Manson followed by Disney Greatest Hits then some Rammstein is confusing for some people.
Stop the presses I even appreciate Lady Gaga