A heat pump is much cheaper to run than natural gas if your electric rates are lower than your natural gas or propane rates.
However if it gets colder than 30 F then your heat pump may not be able to keep up. Most heat pumps though have a heat strip that kicks in when it gets cold enough that the heat pump itself can't keep the house warm.
Then your electric bill will rise.