b1naryn1ghtmar3, Welcome to the Forum.
When we were first planning our farm we did a lot of research on power distribution and Heat / Cooling and our happy to share our findings with you.
Power Distribution:22 units @ 3,600watts = approx 79,200 (+/- 10% to 12% leakage) watts just for SP-35's (H-$7.92, D-$190.08, W-$1,330.56, M-$5,702.40, A-$69,379.20 US @ .10 ($/kWh)
(Cooling not including in this calculation)
The "Heavy Power" standard for the United States is 3-phase voltages of 208, 220, 230, 440, 460 480
79 Kw Line to Line voltage for 220 with power factor of 1 is approx. 207.321 Amps
79 Kw Line to Line voltage for 480 with power factor of 1 is approx. 95.0222 Amps
(Note: Calculation assistance
http://www.rapidtables.com/calc/electric/KW_to_Amp_Calculator.htm)
PDU RESEARCH: We narrowed it down to 3 companies Raritan.com, Tripplite.com and APC.com (now a Schneider Electric Company). We went with Raritan PX family of intelligent iPDUs for the individual outlet switching, monitoring and high amperage per unit. They are a little expensive but we have found that they more than paid for themselves with the expanded flexibility.
HUBS: as for your question on Hubs; I would not use a "HUB" it is a broadcast device all communication to all ports. A "Switch" allows communication to be directed on a port-by-port basis. The Sp-35's use 10/100mbs Ethernet so make sure so make sure your switch can handle 10/100/1000. We went with
http://www.BROCADE.com switches and routers (note: we had them already and they are very expensive but I would buy them again if we were starting this project from scratch).
COOLING: We have found setting COLD/HOT isle worked best for us. Cold Isle is referencing "Conditioned Air" in the front of SP-35 (estimate approx. 93dB) and Hot Isle is the exhaust heat out of the back of the unit (estimate approx 82 dB). We Opted for Air & Evap. Cooling in Louisville, Ky. (Mid-West of the US). Another option working into the Fall/Winter is to Evacuate the Hot Side back into the office (People Conditioned Air) or just Out-Side to the environment). We opted for "Containment or Container" based Cold/Hot instead of Data Center philosophy of cool the hot air and blow it up (Loop or Circle or Air).
INTERNET BANDWIDTH: We have a 100/100mb Fiber Internet Connection and the "Server Farm" is only a small fraction of the UP/Down Load connection, most internet traffic is "East/West" (Server to Server), "North" is Internet or Crypto Authentication and "South" is to the secure servers. With 22 Sp-35's a Low bandwidth connection ranging of 10/1, 15/2, 35/5 or 50/5 connect will be more than plenty. I never scrimp on "Bandwidth up or down", I can always use more. [/li][/list]
NOTE: There are a number of Tools out in the Free or Open Source pool that will help you SSH, Monitor, Control or Adjust the Sp-35's in your stable.
NOTE 2: Our next generation is/will be Containerized @ 1.2Mw - 1.4Mw each and placed approx 80'-100' underground for cooling. Heat evacuation is one of our biggest issues/concerns.
You might want to move this discussion to SP-TECH Forum where you will have a greater pool of experts to supply information to help you succeed in your new venture. Spondoolies-Tech official forum (
https://bitcointalk.org/index.php?topic=521520.0)
https://bitcointalk.org/index.php?topic=521520.0 We are happy to help you any way we can and we hope this help You.
Thank you for your time in advance,
/s/ TuffToad
Disclosure: We have no financial interest in any company or product that has been discussed in this post
