Yes even with a VPN it's possible to get caught Torrenting although the VPN does help hide your IP address to make it harder for you to be caught when Torrenting.
I once got caught a few years ago with another ISP using a VPN and Torrenting because the ISP still knows that you're connecting to a Torrent and downloading stuff.
Although the Torrent servers are not able to see your real IP address your ISP can still see your own IP address and know that you're Torrenting.
So the VPN can protect you from the authorities finding out it's you doing the Torrenting but your ISP can still find out and terminate your internet service if they catch you.
Still it's a good idea to use a VPN when torrenting.