If the yeast infection is not going away or you're experiencing some other problems then yes an urgent care center can help you with a yeast infection.
I would first try some home remedies to get rid of the yeast infection and if they don't help then it would be recommended to see a doctor or go to the urgent care center.
I would recommend seeing your normal doctor first as it will be much cheaper than urgent care but if you're having problems with the yeast infection then urgent care can certainly help.