Try to drink more during the day. You should have a minimum of 6-8 glasses of water in the day to keep yourself hydrated. Try to get it all in at least couple hours before bedtime tho so that you don't have to pee all night lol.
There are many medical reasons why you could have terrible thirst from diabetes to drug side effects, even tho I don't know why it only occurs at night. My best bet though is that you are just not staying well hydrated. We don't think to drink during the winter months because it is cooler, but you can become dehydrated just as easily.
If drinking more during the day doesn't help after a week or two of upping your water intake, you should probably see your doctor.