Bacterial vaginosis causing infertility ?

So I had a fiance for 4.5 years. We never wore protection because we wanted a child. I never became pregnant, but I didn't think much of it. Now that I am married to a different man, we have been together for 7 months now, I really want to have kids, and it just hasn't happened yet. He has two kids with two previous women, so I'm starting to get the hint that it's me, not him. I love his children, but as a women, I want my "own". I will be 23 years old soon, and that sounds young, but after 6 years of unprotected sex, I'm starting to get worried. About 5 months ago, my doctor put me on pre-natal vitimans, and I have been taking them religously. I was treated for bacterial vaginosis and a yeast infection, my doctor said that this could possibly be preventing the pregnancy. I took the antibiotics and returned the next month, only to find out the BV had returned. She put me on stronger antibiotics for a longer period of time. I haven't went back yet to get it checked, but I'm not having the symptoms I was having before, so I am assuming it is gone. I was also told, cause since I've been with my husband I have been having bad pain in my vaginal wall during sex, that the pockets on either side of my cervix were not formed right. One is shorter than it should be, she says this is causing the pain, but not likely causing the infertility. I just really want to have children with my husband, and I get really depressed about this issue. Please offer any of your advice! Thank you so.... much in advance!