Well Muppets or puppets can't really be gay since they're not real human beings so technically no they're not gay.
However the writer of Bert and Ernie sketches has said that he's written them to be a gay couple so I guess they are indeed gay but it doesn't really matter.
I never thought they were gay but just friendly roommates since they always had separate beds and most gay couples would sleep in the same bed.