Most cases of elbow pain go away on their own within a few days to a week and are not serious and usually requires no medical attention.
But if the elbow pain lasts longer than 7 to 10 days or you notice the pain getting worse or swelling then you should see a doctor about it.
A doctor or an urgent care center or even an emergency room visit should be done if the pain gets worse or swelling, or redness that gets worse happens.
If you have a fever along with the elbow pain then you should go to the doctor, urgent care center or emergency room to be checked out.
You can try using an ice pack on the elbow to get rid of the pain and if the pain doesn't go away then a doctors visit would be a good idea.