If your boyfriend has a condition that causes infertility, thus you quit taking your pills, why are you concerned with pregnancy? Didn't you quit because you felt safe?
Reality, you can get pregnant on your period. The chances of quitting the pill 2 days before your period and getting pregnant (and having symptoms) within a week are slim to none.
It takes about 6 days for implantation on your uterus and you couldn't have a single symptom until then. Besides the fact that you were taking birth control pills... Add to that your boyfriend's condion... It doesn't seem likely.
However, if you are concerned about pregnancy, by all means take a test. If you do not wish to become pregnant, despite your boyfriend's possible inability to make you pregnant.