If it's a small window air conditioner I would remove it and close the window to to prevent your heating from escaping and cold air leaking out your window causing your heating bills to go up.
If the window air conditioner is a big heavy one then I'd leave it and put a cover on the outside and on the inside of it and seal around it to prevent air leaks.