The reason people say that life is too short to safely remove a USB drive is because it's a waste of time to really wait until the USB drive is safely ejected.
When you use the eject feature on the USB drive it takes awhile to go through the USB drive and eject it through the computer.
When USB drives first came out you really did need to use the safely eject option to remove the USB drive without corrupting files on it.
However the new USB drives now don't need to be safely ejected before you remove them.
I never have safely ejected my USB drives now that I have the newer USB drives and the files have been just fine.
I do keep backups of the files on other hard drives, in the cloud storage etc.
But it's fine to just unplug the USB drive and then plug it back in when needed without safely ejecting it.
That is where that saying life is too short to wait for the USB drive to be safely ejected as it takes awhile and it's not worth waiting on.