Yes applying ice directly to your skin can cause frost bite and burn your skin which can take awhile to heal up and can be painful.
I tried applying ice directly to my skin before and it burned my skin and gave me frostbite so always make sure you put the ice in some plastic or in a washcloth before making contact with your skin with the ice.