No, you wont have any problems with that.
I have a friend that has the same thing like you do and she has 4 kids and never had any problems and she got pregnant on her own without any help....Its just that when she was pregnant with all her 4 pregnancies, her belly almost never showed....it was like she wasn't ever pregnant....everyone would ask her "are you sure you are pregnant"...lol...and she had to explain to everyone that she had a uterus way in the back of her belly.
So yea i think you won't have any problems with that, but if I wore you I would ask by doctor for sure!
Good Luck sweety and God Bless!