I wrote a tutorial here on the forum. It's for Amazon EC2 but you can use it for a VPS too. Just ignore the EC2 specific things like security zones, creating a data volume etc. The actual install, compile, configure is going to be the same. An EC2 instance is just a fancy VPS with per hour billing.
https://bitcointalk.org/index.php?topic=130533.0