This is no problem at all. As long as you take your pill at AROUND the same time every day, you are fine. I used to take my pill every night before I went to bed. Sometimes that was 10 pm, sometimes it was 3 am. Of course, that's not a very good practice, but birth control pills work in a way that raises your hormones over long periods of time. If you forget your pill for a few hours, you will still have sufficient hormone levels to keep you from ovulating.
If you are taking a combined oral contraceptive pill (meaning it contains estrogen and a synthetic form of progesterone) then you actually have a 12 hour window to take your pill before it begins to loose its efficacy. If you are on a progestin-only pill, you only have 3 hours.
I would suggest setting an alarm on your phone or something to remind you to take the pill every day. That way you can never be late!