Living off the grid means that the house you're living in is not connected to the grid.
When you live off the grid you're living in a self sufficient manner which means that you're producing your own electricity, creating your own heat such as through chopping wood for firewood, using well water etc.
Basically if you're not connected to Utilities such as electricity, natural gas, sewer, public water etc then you're living off the grid.