No, you are fine.
Choose a time when you can take it at the same time every day. I took mine at bedtime. The pill pack was right on my nightstand and I took them every night at 9pm. If your schedule changes often, a different time would work better for you.
My best friend took hers in the morning after she brushed her teeth. She kept her pills next to her tooth brush to remind her. A girl I worked with kept hers in her purse because she was always staying at her boyfriend's house and that way they'd always be handy.
Find a way that works for you. An hour or two does not make the pill less effective.