Your fever should begin to break once the cold chills start and if you're under covers trying to stay warm and you start to sweat from being covered up then most likely your fever is breaking or is already broke.
If your temperature is back to 98.6 F which is a normal body temperature then your fever is gone.