Pica (OP)
Newbie
Offline
Activity: 8
Merit: 0
|
|
July 22, 2020, 12:41:51 PM |
|
I not find the way for work for more than 9 GPUs. All are there work fine, but never more than 9 together. I connect the 10 GPU and the rig directly no boot. The motherboard is connected with 2 molex + 1 sata with the same power supply. The risers are power supply no more than 2 for every sata line. The Bios (the lastest 1.60) is configured according to the manual instruccion.
I´m going crazy Anybody help me ? Thank you.
Regards, Pica.
My rig is: - AsRock H110 Pro BTC+ - Pentium G4400 - 8Gb. Ram - USB 3.0 32Gb. - 12 x TUF 3 RX 5700XT O8G GAMING (115 w each) - 12 x Riser v009s - 2 x eVGA 1000w - HiveOS 0.6-147@200720
|
|
|
|
jgonzi
Member
Offline
Activity: 639
Merit: 19
|
|
July 22, 2020, 02:50:17 PM |
|
The Radeon are not 115W … they are more in the Wall... Also you have to consider Risers + Fans … You are really in the limit limit of the PSU
And also I hope your cards don't die soon... this is the worst 5700XT in terms of memory heat...
This is the reason why Asus make the TUF EVO... for the mistake of the memory disipator... I hope you try to make some mods in the backplate or something...
|
|
|
|
Pica (OP)
Newbie
Offline
Activity: 8
Merit: 0
|
|
July 22, 2020, 03:25:39 PM |
|
The Radeon are not 115W … they are more in the Wall... Also you have to consider Risers + Fans … You are really in the limit limit of the PSU
And also I hope your cards don't die soon... this is the worst 5700XT in terms of memory heat...
This is the reason why Asus make the TUF EVO... for the mistake of the memory disipator... I hope you try to make some mods in the backplate or something...
Thank for your reply. The power supply is not the problem, because the GPU idle is - 30w. Directly no boot with 10 GPUs. With 9 GPUs boot and work fine. I haven't problem of temperture, the rest of the GPUs (9) work fine at 48C core and 82C memory whit fan at 50% and room temperture of 22-24C
|
|
|
|
Pica (OP)
Newbie
Offline
Activity: 8
Merit: 0
|
|
July 22, 2020, 03:55:10 PM |
|
The Radeon are not 115W … they are more in the Wall... Also you have to consider Risers + Fans … You are really in the limit limit of the PSU
And also I hope your cards don't die soon... this is the worst 5700XT in terms of memory heat...
This is the reason why Asus make the TUF EVO... for the mistake of the memory disipator... I hope you try to make some mods in the backplate or something...
At the wall #1 PSU (4 GPUs) = 580w and #2 PSU (5 GPUs + System) = 840w
|
|
|
|
JayDDee
|
|
July 22, 2020, 06:30:16 PM |
|
First make sure all the HW works independently. Test all GPUs, risers and PCIe slots in different combinations.
Try booting plain Ubuntu live.
Also describe the boot failure in more detail. Does it fail while booting the OS or does it fail before that? Any console messages?
|
|
|
|
geck
Member
Offline
Activity: 145
Merit: 10
|
|
July 22, 2020, 08:43:46 PM |
|
I currently have it running 12 gpus. I didn't need to change anything in the bios, however sometimes when it crashes and i do a power cycle, it will not boot up. I'm able to get it to boot by turning off half the rig to get into bios, and disable csm compatability (uefi only, no legacy). For some reason that setting gets toggled sometimes when the rig crashes. HTH!
|
|
|
|
Pica (OP)
Newbie
Offline
Activity: 8
Merit: 0
|
|
July 22, 2020, 09:08:33 PM |
|
First make sure all the HW works independently. Test all GPUs, risers and PCIe slots in different combinations.
Try booting plain Ubuntu live.
Also describe the boot failure in more detail. Does it fail while booting the OS or does it fail before that? Any console messages?
All the HW work fine independently. The system no boot with more than 9 GPUs. Fail before the BIOS post screen.
|
|
|
|
Pica (OP)
Newbie
Offline
Activity: 8
Merit: 0
|
|
July 22, 2020, 09:19:29 PM |
|
I currently have it running 12 gpus. I didn't need to change anything in the bios, however sometimes when it crashes and i do a power cycle, it will not boot up. I'm able to get it to boot by turning off half the rig to get into bios, and disable csm compatability (uefi only, no legacy). For some reason that setting gets toggled sometimes when the rig crashes. HTH!
What GPUs did you has? You are a lucky man!
|
|
|
|
JayDDee
|
|
July 23, 2020, 01:10:06 AM |
|
All the HW work fine independently. The system no boot with more than 9 GPUs. Fail before the BIOS post screen. That doesn't leave much. Power is still the first suspect.
|
|
|
|
jgonzi
Member
Offline
Activity: 639
Merit: 19
|
|
July 23, 2020, 11:12:39 AM |
|
The CPU cannot handle all this quantity of GPU... put less GPU... some time that help… with 10 or 11 can work but not 12...
|
|
|
|
geck
Member
Offline
Activity: 145
Merit: 10
|
|
July 23, 2020, 12:37:36 PM |
|
I currently have it running 12 gpus. I didn't need to change anything in the bios, however sometimes when it crashes and i do a power cycle, it will not boot up. I'm able to get it to boot by turning off half the rig to get into bios, and disable csm compatability (uefi only, no legacy). For some reason that setting gets toggled sometimes when the rig crashes. HTH!
What GPUs did you has? You are a lucky man! 10x rx5700 and 2x radeon vii. I have the same cpu and ram amount as you. also try different pcie speeds, mine are set to 2x
|
|
|
|
bigassboy
|
|
July 23, 2020, 05:10:56 PM |
|
I'm running 10 cards due to the psu limitation, so far its been smooth. never had to change anything on the bios except for auto start..
|
|
|
|
|
Pica (OP)
Newbie
Offline
Activity: 8
Merit: 0
|
|
July 24, 2020, 12:44:11 AM |
|
I currently have it running 12 gpus. I didn't need to change anything in the bios, however sometimes when it crashes and i do a power cycle, it will not boot up. I'm able to get it to boot by turning off half the rig to get into bios, and disable csm compatability (uefi only, no legacy). For some reason that setting gets toggled sometimes when the rig crashes. HTH!
What GPUs did you has? You are a lucky man! 10x rx5700 and 2x radeon vii. I have the same cpu and ram amount as you. also try different pcie speeds, mine are set to 2x 2x is the same Gen2 ? Thanks
|
|
|
|
John-234
Newbie
Offline
Activity: 3
Merit: 0
|
|
September 09, 2020, 05:43:09 PM |
|
Did you ever find an answer to this...I'm having the same EXACT thing happen.
The only difference is that I have 2 1600Watt PSU's
Can only get 9 going
|
|
|
|
miner29
|
|
September 09, 2020, 06:11:52 PM |
|
You may try to make the boot delay longer. It may be the bus just needs a second or two more time to fully register everything. I usually use a 6 second delay if the bios supports a delay on boot.
And it is NOT thr cpu....i have sevral of these running 13 gpus for last several years no issue. (g4400 cpuj
|
|
|
|
John-234
Newbie
Offline
Activity: 3
Merit: 0
|
|
September 09, 2020, 09:01:20 PM |
|
Tried delaying the boot by 8 seconds and...nothing
|
|
|
|
miner29
|
|
September 10, 2020, 02:25:41 AM |
|
Check all thesein bios:
set VTd INTEL VIRTUALIZATION to DISABLE. set ONBOARD AUDIO/SOUND (AZALIA) to DISABLE. set IEEE1394 to DISABLE. set PCI-E SUBSYSTEM/LANES to x8/x4/x4 set ONBOARD GRAPHICS to DISABLE. set PCI-E GENERATION to GEN2. set CPU FREQUENCY SCALING to DISABLE. set CPU PERFORMANCE MODE to ENABLE. set FAST BOOT to DISABLE. set CSM to ENABLE.
|
|
|
|
John-234
Newbie
Offline
Activity: 3
Merit: 0
|
|
September 10, 2020, 03:38:59 PM |
|
My first born child will be named Miner 29
Disable CSM in the bios worked!
Thank you!
|
|
|
|
miner29
|
|
September 11, 2020, 01:00:58 PM |
|
Glad it helped.
|
|
|
|
|