While you can give a puppy at 2 weeks of age a little bath you really should wait until the puppy is at least 4 to 5 weeks old before giving the puppy their first bath.
Unless your puppy gets into mud or gets dirty some other way then bathing your puppy once per month is good enough since if you bathe the puppy more often than that then you risk drying out the puppies skin.