If your baby is hungry then they will usually wake you up at night by crying and alert you to the need for a bottle of formula.
If the baby does not wake up at night for a feeding then you can let them sleep through the night.
If the baby is under 6 months of age then you might want to wake the baby to try to feed them just to make sure the baby is getting enough to eat.
If the baby is not hungry they will reject the bottle and that's okay but if they are hungry they will take the bottle and drink the formula.
Don't put the baby to bed with a bottle though as it could affect the babies teeth and possibly choke them in their sleep.
Once the baby is 6 months old and older they can usually sleep through the night without the need for a middle of the night feeding.
Just try to feed them a bottle of formula before bed and if they've drank some formula they should be good to go until the morning.