Urgent Care and an ER room visit are different so no Urgent Care visits are not considered to be ER visits.
The average out of pocket cost for an Urgent Care Visit is between $71.00 $125.00 for basic care and then there's additional costs for shots, X Rays etc.
Urgent Care though is almost always cheaper than an emergency room visit and Urgent Care centers are kind of like a hospital and clinic in one and are meant for things that need urgent treatment but are not a real emergency.
So if your area has an Urgent Care center and your treatment is not needed as in an emergency then the Urgent Care center would be the best place to go.
Urgent Care in my experience has been cheaper, faster and better for non emergency care.