I'm glad you got him to the doctor! People who tell you that you should know when your child has an ear infection are full of it! Never you mind about them!
I have 6 children and it is very difficult to tell. Sometimes babies just play with their ears because they like it, sometimes they won't let you touch them because they are in a bad mood. The only way to really know is to have a professional take a look, and I'm glad you did.
Best of luck to you, and don't let others take you down. Even with my 6th child, I run into new things here and there. Every child is different.
There are a lot of successful first borns walking around to prove that first time mom's have natural instincts to know what they are doing most of the time