If not warmed up in time a person can die when their body temperature drops 70 F or below and that can happen in warmer weather or even cold temperatures.
It takes awhile though before someone will actually die of being too cold though.
A human body can withstand being outside in cold temperatures that are way below freezing such as the temperatures as long as you're bundled up in layers and can warm up eventually.