hi, no u need NOT worry because u r only fertile for a few days AND THOSE DAYS r middle cycle so having sex before or after your period is highly unlikely to get u pregnant , the QUESTION IS about your periods, r they regular
next is do u want to be pg
if not pick a better birth control like IUD and u don't have to worry about pills every day on time
good luck