You should have carried on taking them.
If you used a back up method for the first 7 days of starting the pill then it is unlikely you would be pregnant, but your cycle would be messed up from starting hormones mid cycle.
By not continuing you will have messed up your cycle further.
If I were you, to set your mind at ease, I would take a pregnancy test just to be sure.
If it is negative then start your next pack of pills (the day really is irrelevant they just say sunday to help you remember which day to take the pill on).
Use condoms or abstein for the first 7 days of pill taking.
Then stick religiously to the pill schedule for continued protection.
If you start taking b/c pills on the first day of your period you do not need to use a back up methods for the first 7 days.