Wasps hate the scent of Peppermint Oil and will leave the area as well as stop coming back to the area where you spray Peppermint Oil.
Mix around 4 cups of water with 1 tablespoon of Peppermint oil to make a spray in a spray bottle and then spray the wasps with the Peppermint Oil spray and spray there nests as well.
The wasps will leave the area and stay away.
You should also go to the store and get some Wasp Spray that kills Wasps on contact and then continue to spray the area with Peppermint Oil spray to keep the wasps away from your house or anywhere else you don't want them.
If you continue to spray Peppermint Oil any new wasps that try to come near the area will be deterred because the wasps hate the scent of Peppermint Oil and will not make a nest or hang out near the area.