An alarm is a measure of resources responding to an incident.
In a fire department a "1 alarm" fire could be:
3 fire engines
1 ladder truck
1 battalion chief
Each additional alarm would add further resources to the response such as:
2 more engines
1 more truck
1 more chief
The more alarms, the greater the incident, and therefore the increased number of resources.