You can lower your heating bills by turning down the thermostat a few degrees to a tolerable temperature.
Also check for drafts around doors and windows and seal out those drafts. Put large blankets such as moving blankets over windows to stop drafts.
Stopping those drafts will make your home warmer and lower your heating bills.
Also check for and add any insulation to your walls and attic and even floors if needed. The more heat you keep in and the more cold air you keep out the less your furnace will have to work saving on your heating bills.