Yes the wind chill can cause water to freeze and can also cause water pipes to freeze if they're not protected from the cold wind.
The cold wind cools the water or water pipes faster just like it does our bodies so it makes the temperature feel much colder than it is.
And yes water and water pipes can freeze when it's above freezing but the wind chill makes it feel colder so always leave water dripping in faucets when it's really cold or there is a cold wind chill and insulate and protect water pipes.