The minimum temperature that a babies room should be is 68 F but 72 F would be even better.
When babies are really young they can feel colder than adults do because they have a harder time regulating their temperature.
So even if you feel a bit warmer the baby or newborn baby will likely feel even cooler because the temperature cannot be regulated by them in their bodies.
During winter it's best to keep the baby in a footed pajamas or other pajamas to help keep them warm because babies under a year old cannot sleep with blankets.
Blanket sleepers are good for keeping the baby warm at night but I always kept my babies room at 72 F because I loved it that way myself.
Anything below 72 F feels cold to me so I'm sure it would feel cooler to my babies.