I've had a zit hit that area before. I was pretty worried, too. I ended up just popping the blasted thing and I never got another one. An easy test would be to look at the shaft of your, uh, "Cash n' Prizes", especially when erect and seeing if there are small white bumps similar to the ones that appear on girls' nipples on the sides at the base of the shaft.
If there are, I wouldn't worry too much about a doctors appointment, you just need a better cleaning agenda than some. Hit that area with a washcloth in the shower, don't be afraid to be rough as long as you're not going nuts. (Pun unintended.)