Most VPS these days should offer you fullcontrol, where you can configure it however you want and even install RDP program. Since you ask this question on Bitcoin Forum, i also expect you want provider which accept Bitcoin. In that case, i would recommend you to check
https://bitcoin-vps.com/ which list various provider along with it's region and some pros/cons.
Anyway, i've seen some member mention Contabo and RackNerd whenever someone talk about cheap and somewhat reliable VPS. You might want to check those provider first.