well, breasts feel kind've lumpy in general, and nipples have a funny texture, too.
But really, he told you to do push ups? I have no idea what he thought that would accomplish.
If you're concerned, it's a good thing to bring up with a doctor.... a better doctor.