I tried to set up bitcoin toward that port by changing the number in the settings, but it didn't work.
Bitcoin doesn't have an option to change its own port. Possibly by doing this you told Bitcoin to use a proxy, which would cause you to be unable to connect (since you don't actually have a proxy).