I am 23, and in july I found out I have stage 2 endometriosis, and that having children will most likely be difficult if I am able to conceive at all. Even after hearing this, my husband at first still wanted to wait to conceive like we had planned, but after many heart-to-hearts, we came to a decision together and are both ttc with our whole hearts. My point to this, is that even knowing I only have a short time to conceive, if I am able to at all, my husband's thoughts and feelings were so important to me. I wouldn't have tried to have a baby without his wanting it too.
Your marriage is the most important thing, and I am sure you didn't get married only to have children. My advice is to stay honest with your husband, because you don't want to end up alone or at the least hurt your marriage by bringing a child into it when that isn't something both of you are ready for. It wouldn't be fair to your husband or child, just try to talk to him honestly about how you feel! Good luck, I know how lonely it is to want a baby and your husband isn't sure...Take care and I hope you make the right decision