Yeah...I guess I would've.
Did you say the two waiting days (meaning the days you were taking the last week of pills)? If this is correct, then you should be okay. Were you bleeding at this point?
If you're freaking out about pregnancy, you can get a test and see what's up. I'm sure you're fine...but I would just make sure to dot my i's and cross my t's and be protected if this ever happens again.
When you get on your first month of pills (going back on the BC), make sure to use condoms because your body generally isn't protected until the first week (I always do the first month with condoms, to be sure).