200+ GPU in a container - Cooling possible ? Some Feedbacks ?

[DougWislon]

Hi all  

I would like to get some feedbacks (if there are) of data system cooling engineers or pro miners that already thought or created a small GPU mine in a container ?

I've looked at the Envion one (https://www.facebook.com/envion.org/videos/envion-mobile-mining-operations/1930469803947689/). They have a clever passive cooling solution for asics as they plug tubes and pipes directly at the exhaust of each asic but they do no show their plans for GPU mining rigs.

for 200 to 250 GPUs I was thinking of 3 cased fans at the bottom 50cm or 60cm (20 or 24 inches) each on one side of the container that would drag the outside air inside and 3 others at the roof that would suck the air out. Note that container might be in a sheltered place that have temperatures arrround 5 to 10 degrees C (41 to 50 F) . What is your opinion ? What would you do to cool such a massive rig ?

Also what about the air condensation ?

[1714970368]

1714970368

[1714970368]

1714970368

[1714970368]

1714970368

[philipma1957]

Hi all  

I would like to get some feedbacks (if there are) of data system cooling engineers or pro miners that already thought or created a small GPU mine in a container ?

I've looked at the Envion one (https://www.facebook.com/envion.org/videos/envion-mobile-mining-operations/1930469803947689/). They have a clever passive cooling solution for asics as they plug tubes and pipes directly at the exhaust of each asic but they do no show their plans for GPU mining rigs.

for 200 to 250 GPUs I was thinking of 3 cased fans at the bottom 50cm or 60cm (20 or 24 inches) each on one side of the container that would drag the outside air inside and 3 others at the roof that would suck the air out. Note that container might be in a sheltered place that have temperatures arrround 5 to 10 degrees C (41 to 50 F) . What is your opinion ? What would you do to cool such a massive rig ?

Also what about the air condensation ?

yeah  200 gpus pulling 200 watts each = 40000 watts

you need  to move a lot of air  give me about 5 minutes to get a number

okay  17000 watts with 3200 cfm of fan  will stay cool  in this setup


https://www.youtube.com/watch?v=HKlXarvBv5M


it has 2x 1600 cfm fans   

so if you have 6x cfm fans like this  on the roof

 https://www.homedepot.com/p/Master-Flow-1600-CFM-Power-Gable-Mount-Attic-Fan-EGV6/205924917


you will pull 10000 cfm

I would lift the container of the ground   and have vents in the floor of the container

[smaxz]

you can liken cooling a room with air to pumping water through a chamber.

the size/placement of the inlet, exhaust and most importantly the chamber itself as well as the components that need the airflow to reach them are all vital factors.

just throwing a cfm fan rating around is pretty short sighted.

its good to guess though how hot is your garage these days philip?

[philipma1957]

you can liken cooling a room with air to pumping water through a chamber.

the size/placement of the inlet, exhaust and most importantly the chamber itself as well as the components that need the airflow to reach them are all vital factors.

just throwing a cfm fan rating around is pretty short sighted.

its good to guess though how hot is your garage these days philip?

85 f

as I am only running 2500 maybe 2600 watts at home for the summer

I did help Marvell2 with his garage venting and he had more then 350 gpus IIRC

he has issues in the summer as pulling in replacement air is hard for his setup.

[nsummy]

what sort of setup do you have now?  The answer to your question will depend a lot on whether these cards are in servers, or sitting in the open, or whatever.  Do you need this thing to be mobile or are you just wanting a separate building?

To be honest I just looked at the Envion website and its an obvious scam, so I wouldn't put too much stock into that mobile building they show in the videos.  All smokes and mirrors.  

[tg88]

If the external temperature is 5 to 10 ° C you will not have any problems, just use an input fan and an output fan.

Sorry, I do not know how to write well in English, but I have a container with almost 100 gpus and it works very well.

The air exchange is constant:



This is my container:








I have never had problems with air condensation, the outside temperature here ranges from 0 to 30 ° C.

[DougWislon]

Thanks for feedbacks !

Using both or your suggestions :

> container is lifted and floor of the container is grating with one boxed fan ( https://powerstarelectricals.co.uk/industrial-extractor-exhaust-axial-blower-ventilation-wall-mounted-plate-fan-151-p.asp ) under each shelf (one shelf is 24 GPUs on 2 floors - each floor is 12 GPUs) with each shelf let the air go through (metal grating shelfs)

> At the opposite one boxed fan on the roof to exhaust air so air is going through the shelfs end components

@tg88 when temp outside are 30 ° C what temp inside the container ? is it closed also in summer? what temperature for your GPUs ? Thanks for the drawing and pics  !


@nsummy it's for a project that would need to be mobile. Have experience on 200 Gpu small farm but in a regular warehouse not in a container. Yes GPUs would be sitting in the open.

[tg88]

@tg88 when temp outside are 30 ° C what temp inside the container ? is it closed also in summer? what temperature for your GPUs ? Thanks for the drawing and pics !

Always 4 ° C more.
Outside Temperature 10 °C | inside 14 °C
Outside Temperature 30 °C | inside 34 °C

I keep it closed even in the summer.

I mine Ethereum and use AMD GPUS RX 4xx and RX 5xx and they work at 72 ° C.

inside temp 15 °C fan speed + - 20% | 40%
inside temp 30 °C fan speed + - 50% | 70%
inside temp 34 °C fan speed + - 70% | 100%

[Regulater]

If you are building a shipping container full of rigs. What you will do is cut air ways into the sides at every rig position. Then have exhaust fans cut into the top evenly spaced. The air will be pulled in through the sides ran through the rig then pulled out the top. Make sure to have the shelving right against the wall of the container too, to make sure the air goes through the unit.

[smutboy420]

If you are building a shipping container full of rigs. What you will do is cut air ways into the sides at every rig position. Then have exhaust fans cut into the top evenly spaced. The air will be pulled in through the sides ran through the rig then pulled out the top. Make sure to have the shelving right against the wall of the container too, to make sure the air goes through the unit.

I would also do it it that way were every rig has its exhaust air directly ducted out of the container and keep the hoses or ducting as short as can be so to get the most heat out of the container as you can without it radiating back into the room.   Then have makeup air coming into the container. Threw and inlet duct. Try to keep the incoming makeup air so its being pulled in from another side as the side all the massive amounts of hot air is going to be blown out at.

It will also help keep the heat down if you paint it a color that will reflect as much sun off the container so it doesn't become a big solar powered hot box on warm summer days.   

[tg88]

I forgot to comment, my container is protected from sunlight. It stands under trees.

[DougWislon]

I forgot to comment, my container is protected from sunlight. It stands under trees.

Thanks for detailed feedback about temperatures.

What is the size of your container ? 10 or 20 FT ?

[tg88]

What is the size of your container ? 10 or 20 FT ?

20 ft.

[powerminingfarm]

OP, did you manage to manufacture the container?

[curt999]

Container is overkill build a wooden box 8'x4'x8' with mesh floor and twin 3000cfm fans one each side I ran 200 cards in something like this I built for 400$ out of scrap wood.

[curt999]

https://imgur.com/a/b7hnsdA

cold side is in center then two hot sides..exhaust fans force air flow through cards..ran this all summer cards were 65 when ambient was 90 deg F

[powerminingfarm]

Seems to be pretty fire proof and weather resistant. 

[umine]

Hi all  

I would like to get some feedbacks (if there are) of data system cooling engineers or pro miners that already thought or created a small GPU mine in a container ?

I've looked at the Envion one (https://www.facebook.com/envion.org/videos/envion-mobile-mining-operations/1930469803947689/). They have a clever passive cooling solution for asics as they plug tubes and pipes directly at the exhaust of each asic but they do no show their plans for GPU mining rigs.

for 200 to 250 GPUs I was thinking of 3 cased fans at the bottom 50cm or 60cm (20 or 24 inches) each on one side of the container that would drag the outside air inside and 3 others at the roof that would suck the air out. Note that container might be in a sheltered place that have temperatures arrround 5 to 10 degrees C (41 to 50 F) . What is your opinion ? What would you do to cool such a massive rig ?

Also what about the air condensation ?

The cold is not a problem at all (Confirmed at temps above -27C outside). Except for you plan to place the container at far north.
To keep GPU temps below 70C the incoming air temp should not exceed 35C under the corresponding air flow. There are enough information about how to calculate the airflow. It's generally depends on total rig heat producing.

About air condensation: The condensate can appear on ONLY COLD surfaces. GPUs / ASICs are HOT when working

[codegnome]

This is very interesting and inspiring topic. At the moment I have only a few working graphics, but who knows what the future will bring.
In the rich version, you can simply install an air conditioner, it is not a big cost with 200 graphics cards.
These cards could be combined into one liquid system. From acquired heat you could heat some rooms or buildings, obtaining additional benefits.

[umine]

This is very interesting and inspiring topic. At the moment I have only a few working graphics, but who knows what the future will bring.
In the rich version, you can simply install an air conditioner, it is not a big cost with 200 graphics cards.
These cards could be combined into one liquid system. From acquired heat you could heat some rooms or buildings, obtaining additional benefits.

Liquid cooling is a great solution. But at first the price is too high, then carrying out maintenance becomes much more harder, the safety reduces.
It would be superior to create the system that collects the heat of aircooled GPUs \ ASICs and transfer the heat to indirect heating boiler for example