Yes puppies do normally bleed when they lose their teeth and the bleeding will naturally stop on it's own without you having to do anything.
So if you notice your puppy bleeding when they lose their teeth there's nothing to worry about and the bleeding will stop soon.
Also most puppies will even swallow their teeth when they lose them which is also harmless and normal as well.