Hand and feet can feel pretty cold, babies don't have the best circulation.
Generally they are happiest if the room they are in is about 22-26 degrees celcius.
If heating is not a viable option (like if you are outside, or don't want to be restricted to the one room of your house!) try a warm little hat. Babies lose most heat through their heads.