Toothbrushing at Work

I was driving to lunch the other day and I was listening to Jim Rome as he was ripping on guys that brush there teeth at work and keep a toothbrush in their desk drawers. Well, guess what? I do that! And I don’t really understand what’s wrong with it. Do you get annoyed if a coworker brushes their teeth after lunch? I really don’t want to be the annoying guy in the office, but I also don’t want to smell like a Subway Sandwich all afternoon. I kind of feel like someone told me I'm the stinky kid in class.