What is the current contents of your bitcoin.conf? Specifically, what settings did you use to enable the RPC server?
It'll most likely be an incorrect setting in your conf, or it'll be some weird firewall issue... note that you would need to check OS, router, VPS and/or ISP firewall setups as any of those could be filtering the connections to that port.