I have been dealing with this problem all my life. When I first became sexually active it really bothered me, although it didn't stop me. I only had one guy make a comment on it, and he actually thought he hurt me during sex and something was hanging out of my vagina. He was a virgin who hadn't seen any porn, so I don't even count that. Not to get graphic, but I have had men that love large inner labia. One of my ex-boyfriends used to suck on them and call them "porn star" lips.
My left one is longer than my right one, and my current boyfriend sucks on the right one more, trying to make it just as big. He is very understanding about it. The bottom line, like everyone before this said, just learn to be comfortable with yourself. If you are with someone you trust (which you should trust them if you are going to have sex with them) there shouldn't be any problems.