yes, that is definitely a downside when you don't or are unable to take advantage of the perks. That is where negotiating your salary comes into play though. If you know that you are not going to be staying for dinner then negotiate up for that extra $2000-3000 to get it back.

i feel the same way about taxes though. I pay them and half the things they go to I never use. I wish I could negotiate them with them government better :)