Your rig is rack mount case or open air frame?
Normally I put PSU in place which is easy for connecting cables to all GPUs and risers.
Another note is PSU's fan side should direct to outer of rig because in some case if the loading is high, the hot air from PSU should not flow to MB or GPUs.
Its an open air.
Here is the image:
Can I
rotate the PSU and have fan on
sideways (originally HX1200i's fan is on top)?
How about placing the PSU
sideways out? Meaning fan is throwing air out in the open space (refer image):