For a good VPS hosting provider I highly recommend going with
https://hawkhost.com Hawk Host Web Hosting.
But instead of a standard VPS server you should sign up for hawkhost cloud hosting which acts the same as a VPS server but with a cloud server you can easily scale your resources on the server as your website grows.
Hawk Host does accept paypal as payment and you can get cloud hosting from Hawk Host for $5.00 per month which is about what you would pay for VPS hosting but Cloud Hosting is much more reliable and easier to scale up as your website traffic grows.