A lot of people are disappointed with their first time when they think it is going to be something magical. The truth is, your first time might be a lot like every other time. There probably won't be unicorns and rainbows on your ceiling. And you know what? That's ok. It can be great if you want it to be, just don't get all of these high expectations from things you see in movies. If you are in the mood, relaxed, and comfortable with your partner, you can have a very nice time with your partner, even if doesn't have that "Hollywood magic." I have been with virgins and non-virgins, and honestly, if I did not know their sexual history beforehand, I would not have been able to tell you who was a virgin and who was not. So don't worry about impressing your partner as far as all of that goes. Unless he is a real jerk, he will help you and guide you whenever you need it anyway.
If you feel inadequate and like men will get bored with you in general, not just in bed, then therapy is always an option to help you boost your self esteem. Keep in mind that men are people too. They're a lot like we are, nothing to be afraid of. There are men out there who are like you and who want someone like you, and there are also men out there who are not like you and are not looking for someone like you, and that's ok too.