...
However, if you rent a VPS, and you mine, you'll probably be kicked in a matter of hours/minutes
Not necessarily ....
A few months ago I tried some mining on VPS from DigitalOcean for a test. I delegated 3 out of 4 cpu to mining and they kept mining for a month without any interruption from provider site. The effects were not stunning - after all, the parameters of inexpensive VPS are not perfect, but I found out that it is completely possible...