A puppy could drink some water at 2 weeks of age but usually they will not be ready to drink any water out of a bowl at 2 weeks of age and will still be nursing on their mothers milk for nutrition and when they get the milk the puppy doesn't need water.
If the puppy does decide to drink some water out of the bowl at 2 weeks then it's okay and it won't harm them but it's unlikely that the puppy will be ready to drink water from a bowl at that age.
Most puppies don't begin to drink water from a bowl until 4 weeks of age which is usually when the mother begins to wean them off her milk supply.
Then they eventually start learning to drink water from the bowl like their mother does.
Some puppies may not be ready to drink water fully until 5 or 6 weeks of age either which is okay but just keep a bowl of water out for the mother and puppies to drink and they will drink the water when they are thirsty and are ready to drink the water.