Yes condoms can sometimes cause irritation for both males and females.
Sometimes a male may be allergic to the condoms and then the condom could cause irritation to the mans penis and may even cause a painful rash on the mans penis.
Especially for scented condoms.
Also the condoms can cause irritation and infections in the woman's vagina as well as I had scented condoms cause irritation and an infection in my Vagina when I was first getting into sex.
That is when I was around 18 and wasn't ready to be a mother yet so I just wanted the sex and not a baby and my boyfriend at the time used scented condoms and they caused irritation inside my vagina so yes it's possible.
The irritation and infection went away within a few weeks.