To be able to freeze to death the temperature outside needs to be around 35 F or below for a good period of time such as 24 hours or longer.
You'd also have to not have any way to bundle up or stay warm so as long as you dress properly for the weather it's unlikely that you'd freeze to death in a few days.
But even when you're still bundled up properly your body temperature can still drop and then you would die of hypothermia.
When your body temperature drops to around 95 F and below your body starts to shut down and when you can't get warm after that within the same day then you're likely to die of hypothermia.
When the temperature gets below freezing then you're likely to die of hypothermia within the same day or overnight especially if you do not have blankets or the proper coats or other dressing to keep your body warm.