The windshield washing fluid you buy in stores should be suited for a cold climate and not freeze since it contains antifreeze which prevents the windshield washer fluid from freezing.
If your windshield washer fluid is freezing then it might not be the kind suited for the winter or is home made windshield washer fluid.