12 GPU rig... but how???

[SealTx]

In this discussion: https://bitcointalk.org/index.php?topic=1541084.msg19319534#msg19319534

There is an example and a tiny bit of talk about a rig that controls 12 GPUs

The idea is that the builder uses PCIe Switches for 9 of the cards and the other three are on board:

Using common MSI Z270-A Pro + Celeron G3900 + 4GB RAM +3 x PCI-E Switches (9 GPU's connected to switch and 3 GPU direct to motherboard). Power Subsystem - two HP common slot PSU 1200W + 160W Pico PSU (for motherboard and switches)
Sorry for bad photo and my English)
http://i.piccy.info/i9/8ec902e393a819cd6e28da0c657ce61b/1496350066/143938/1150706/_A5855D8E973CE290DECE4AFFBDA4CD5B935F4D51AF5C4080C2_pimgpsh_fullsize_distr.jpg

Does anyone have experience making the CPU / bios / whatever to detect 12... or maybe 18 GPU's?

TIA!

[NotFuzzyWarm]

In this discussion: https://bitcointalk.org/index.php?topic=1541084.msg19319534#msg19319534
There is an example and a tiny bit of talk about a rig that controls 12 GPUs
The idea is that the builder uses PCIe Switches for 9 of the cards and the other three are on board:

Using common MSI Z270-A Pro + Celeron G3900 + 4GB RAM +3 x PCI-E Switches (9 GPU's connected to switch and 3 GPU direct to motherboard). Power Subsystem - two HP common slot PSU 1200W + 160W Pico PSU (for motherboard and switches)
Sorry for bad photo and my English)
<pic snipped>

Does anyone have experience making the CPU / bios / whatever to detect 12... or maybe 18 GPU's?
TIA!

Someone might know how-to but NOT here.   This is Bitcoin-only and that means ASIC rigs only.
Now if you post in the ALTCOIN area https://bitcointalk.org/index.php?board=160.0 you might get answers.

[dimka890]

In this discussion: https://bitcointalk.org/index.php?topic=1541084.msg19319534#msg19319534

There is an example and a tiny bit of talk about a rig that controls 12 GPUs

The idea is that the builder uses PCIe Switches for 9 of the cards and the other three are on board:

Using common MSI Z270-A Pro + Celeron G3900 + 4GB RAM +3 x PCI-E Switches (9 GPU's connected to switch and 3 GPU direct to motherboard). Power Subsystem - two HP common slot PSU 1200W + 160W Pico PSU (for motherboard and switches)
Sorry for bad photo and my English)
http://i.piccy.info/i9/8ec902e393a819cd6e28da0c657ce61b/1496350066/143938/1150706/_A5855D8E973CE290DECE4AFFBDA4CD5B935F4D51AF5C4080C2_pimgpsh_fullsize_distr.jpg

Does anyone have experience making the CPU / bios / whatever to detect 12... or maybe 18 GPU's?

TIA!

12 gpu under linux works fine! Somewhere read that with 12+ gpu in single motherboard you'll have troubles, but i make rackmount frame for rig and there 12 gpu optimal. At next week want to test 4 PCI-E switches in old motherboard (HP Pro 3130)

[SealTx]

@dimka890 Thanks! I will try with a bunch of 1070's I have on the way.

@NotFuzzyWarm sry... wrong board. Maybe a mod can move the thread? Thanks!

[dimka890]

@dimka890 Thanks! I will try with a bunch of 1070's I have on the way.

@NotFuzzyWarm sry... wrong board. Maybe a mod can move the thread? Thanks!

Some chinese sellers say that switches does not work with Nvidia GPUs, but if you can test it will be good. Unfortunatly i don't have any nvidia cards.
P.S. I saw at aliexpress switches 1-> 4 PCI-E, there is no mention of nvidia cards, maybe 1-> 4 switch will be work fine

[SealTx]

@dimka890 Thanks! I will try with a bunch of 1070's I have on the way.

@NotFuzzyWarm sry... wrong board. Maybe a mod can move the thread? Thanks!

Some chinese sellers say that switches does not work with Nvidia GPUs, but if you can test it will be good. Unfortunatly i don't have any nvidia cards.
P.S. I saw at aliexpress switches 1-> 4 PCI-E, there is no mention of nvidia cards, maybe 1-> 4 switch will be work fine

Ah, okay... thanks. Nvidia is all I can buy at the moment. I will tell you what I discover

[Vaccinus]

wait for asrock h110 pro btc come with supported 13 gpu slot, you just plug and play, no mod no anything to do, they are still tweakign it, still brand new motherboard, cost $150 or so

[realter]

@dimka890 Thanks! I will try with a bunch of 1070's I have on the way.

@NotFuzzyWarm sry... wrong board. Maybe a mod can move the thread? Thanks!

Some chinese sellers say that switches does not work with Nvidia GPUs, but if you can test it will be good. Unfortunatly i don't have any nvidia cards.
P.S. I saw at aliexpress switches 1-> 4 PCI-E, there is no mention of nvidia cards, maybe 1-> 4 switch will be work fine

I'm waiting 1->4 and try.
And m2->pcie for 9 nvidia gpu on asus prime z270a

For 13 and more gpu remeber if you have problem with 1gpu -  you have problem with all gpu on rig

Sorry for english.

[dimka890]

Please write here feedback about 1-4 switches, it's very interest.
P.S. Where you are frome?

[realter]

Please write here feedback about 1-4 switches, it's very interest.
P.S. Where you are frome?

Russia, Togliatti

[Xeon_Xeon]

How about 14 GPU's? 

[QuintLeo]

Yes, riser-rig miners, ASRock has heard your complaints about the shortage of H81 (keep in mind that when Intel stops making a chipset, board makers CAN'T make more of the boards using that chipset once they run out of stock of that chipset) and has a MONSTER of a replacement/upgrade that is apparently fairly close to release.

 They DO need to figure out and fix whatever caused their demo to crash and burn first, though - perhaps add 1 or 2 more MOLEX to the MB for PCI-E slot power I'd guess....

 There is already a longish thread specifically about the H110 BTC Pro though....