Yes if a pilot light goes out on a natural gas furnace or other natural gas appliance the gas should shut off.
That's the purpose of the Thermocouple.
The thermocouple in the furnace is a safety device that detects the heat from the pilot light and then shuts the gas off to the pilot should the pilot light flame go out.
This is to prevent gas buildup in the furnace and to prevent an explosion.