It is possible that something is medically wrong, but it is much too soon to jump to any conclusions like that. Make sure you let your ob-gyn know that you are trying to conceive. She will be able to make sure everything looks ok.
Usually, a fertility specialist will not even see you unless you have been trying to conceive for more than one year. We're only at peak fertility a couple of days a month after all.
It also depends on what kind of birth control you just got off. If it was something like Depo, that can take up to 18 months to get of your system so that you can conceive.