I had the same thing happen with a car crash and whiplash. I have just recieved another concussion and the doctors tell me the same thing, rest and time. I am very active and they have told me to not play any sports that i could recieve a 2nd as that is the worst.
They said golf is ok, to do when you are ready. Its very frustrating.