This is taken off of the planned parenthood site:
it is unlikely that taking the pill during early pregnancy will increase the risk of defects in the fetus. However, the likelihood of tubal pregnancy is greater if you become pregnant while taking the progestin-only pill.
I've also been to several other sites that say the same thing so if you've only taken them for 2 weeks, i'd say you're pretty safe.