When I had my ears pierced I was advised to rub some ointment on the ear if it started itching and let it air out as well.
Rubbing some Ointment on it can help stop the itchiness of the ear since it's often the dryness of your ears skin that's causing the itching sensation, and you can combat that with the right antibiotic ointment.