Bitcoin Forum
May 06, 2024, 07:51:17 PM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 [2] 3 4 »  All
  Print  
Author Topic: 19 GPU in one Motherboard  (Read 6797 times)
mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 12, 2017, 11:11:51 AM
 #21

If I tried to use 4GB RAM and a G3900 Celeron CPU with a 19 GPU rig like this, I would probably have a bad time right? I've got 9 GPUs on these specs right now, and wondering how long I'll be able to go on like this.

Bitrated user: mikespax.
The Bitcoin software, network, and concept is called "Bitcoin" with a capitalized "B". Bitcoin currency units are called "bitcoins" with a lowercase "b" -- this is often abbreviated BTC.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1715025077
Hero Member
*
Offline Offline

Posts: 1715025077

View Profile Personal Message (Offline)

Ignore
1715025077
Reply with quote  #2

1715025077
Report to moderator
Metroid
Sr. Member
****
Offline Offline

Activity: 2142
Merit: 353


Xtreme Monster


View Profile
September 12, 2017, 11:53:27 AM
 #22

If I tried to use 4GB RAM and a G3900 Celeron CPU with a 19 GPU rig like this, I would probably have a bad time right? I've got 9 GPUs on these specs right now, and wondering how long I'll be able to go on like this.

You would have to check the cpu usage, as long as 19 gpu's are working and cpu usage is less than 80% then is okay.

This mobo has usefull feature that shows what is wrong with PCIE! Smiley

Its far from plug and play but we actually dont have that many issues with stability of systems and if something goes wrong with pcie we see it.

cReepas

He is talking about hotplug gpu's.

BTC Address: 1DH4ok85VdFAe47fSVXNVctxkFhUv4ujbR
mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 12, 2017, 12:09:01 PM
 #23

Currently, my 9x GPU rig has CPU1: 13.7% and CPU2: 90%

Also using 2.3 GB of 3.8 GB of ram.

So I should probably invest in some upgrades for more GPUs yeah?

Bitrated user: mikespax.
arielbit
Legendary
*
Offline Offline

Activity: 3416
Merit: 1059


View Profile
September 12, 2017, 03:11:05 PM
 #24

what we need is not a motherboard that have lots and lots of pcie...

what we need is an interface that can manage many cards where we can plug and play cards without turning off the system..where cards that have a problem would hang or stop separately without affecting the whole system so other cards will keep on mining.

with that kind of interface we can use almost any board out there..that interface should have a software management and hardware switches(like for disabling power) for the plug and play feature.

This mobo has usefull feature that shows what is wrong with PCIE! Smiley

Its far from plug and play but we actually dont have that many issues with stability of systems and if something goes wrong with pcie we see it.

cReepas

my old 775 motherboard circa 2006-2007..has led that shows connection state if connected..it doesn't show error color light but i can identify 1 out of 4 gpu is not mining by simply touching the gpus, the one that is not hot is not mining.
mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 23, 2017, 10:59:17 PM
 #25

As soon as I plug in the 14th GPU, I can't get this thing to boot. Any ideas?

Bitrated user: mikespax.
Vann
Hero Member
*****
Offline Offline

Activity: 1036
Merit: 606



View Profile
September 23, 2017, 11:06:02 PM
 #26

As soon as I plug in the 14th GPU, I can't get this thing to boot. Any ideas?

What cards and OS?
mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 23, 2017, 11:08:54 PM
 #27

1080ti nvOS G3930 4GB ram

using an SD card on a card reader, two 2400w server PSUs and one 1600w ATX as the main PSU.

Seems no matter what I do, 14th card results in completely not booting at all, no bios or anything. Right back up when I remove one slot. Got another 4GB ram on the way already. Computer is stupid slow when I try to do anything on 13 cards, but seems to be mining stable so far.

Bitrated user: mikespax.
siforek
Full Member
***
Offline Offline

Activity: 140
Merit: 100


View Profile
September 23, 2017, 11:35:22 PM
 #28

As soon as I plug in the 14th GPU, I can't get this thing to boot. Any ideas?

Like no post? Not even to bios? I was going to say make sure you're powering everything. Depending on how you've got things connected you might have the 14th GPU on it's own in the 3rd PSU slots. If so are they getting power from 3rd PSU?
mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 23, 2017, 11:37:58 PM
 #29

2nd and 3rd server PSUs are powering all GPUs

Does not boot to bios. Screen does not register a signal.

Doesn't matter which slots are plugged in and which are empty, the 14th one just kills it.

Is this getting to look like a bad motherboard or one that I may have already damaged from improper initial configurations?

Bitrated user: mikespax.
Vann
Hero Member
*****
Offline Offline

Activity: 1036
Merit: 606



View Profile
September 23, 2017, 11:54:04 PM
 #30

2nd and 3rd server PSUs are powering all GPUs

Does not boot to bios. Screen does not register a signal.

Doesn't matter which slots are plugged in and which are empty, the 14th one just kills it.

Is this getting to look like a bad motherboard or one that I may have already damaged from improper initial configurations?

If 13 GPU's are working, I doubt it's a bad motherboard. More likely it's a Nvidia driver limitation.
jyakulis
Sr. Member
****
Offline Offline

Activity: 468
Merit: 250


J


View Profile
September 24, 2017, 12:04:35 AM
 #31

If I tried to use 4GB RAM and a G3900 Celeron CPU with a 19 GPU rig like this, I would probably have a bad time right? I've got 9 GPUs on these specs right now, and wondering how long I'll be able to go on like this.

You would have to check the cpu usage, as long as 19 gpu's are working and cpu usage is less than 80% then is okay.

This mobo has usefull feature that shows what is wrong with PCIE! Smiley

Its far from plug and play but we actually dont have that many issues with stability of systems and if something goes wrong with pcie we see it.

cReepas

He is talking about hotplug gpu's.

Yes, I'm curious as well. What kind of CPU are you using for this build?

bitcoin address: 35CezzikPXjx4QmTgpeU3ByQ42s8mVcbaF
huynhdat1989
Member
**
Offline Offline

Activity: 101
Merit: 10


View Profile
September 24, 2017, 12:10:23 AM
 #32

Hello,

i just wanted to say, that we managed to get running with no big problems 19 GPUs in one Motherboard.

MOBO: Asus B250 Mining Expert

GPUs: 13x ASUS STRIX GTX 1060 6 GB + 6x ASUS MINING P106

MAIN PSU: 2400W
Secondary PSU (for powering pcie extenders and mobo) 750W
We have also 3th PSU in video, but in reality you need only main and secondary PSU.
16GB RAM

NO HDD just one 32GB FAST USB. SYSTEM [OS] nvOC easy-to-use Linux Nvidia Mining v0019

In windows we were able to get all cards do device manager, but mining was not running Sad

https://drive.google.com/drive/u/1/folders/0B4y5D_zzH1oeLWpIcGtQOXI1MUU

will post tomorow more videos and detailed analysis of mobo with manual how to do that.

Best regards

cReepas

(Invictus Mining Team)


It sounds great but useless because any gpu or any component has problem, you need to restart all the system.
- GPU hang for long time running.
- Failed Risers
- Unstable Power Supply.

It could use for your hobby. But I would avoid any motherboard over than 7 gpus, you might check all large farms, they only use 4 to 7 gpus for every rig.
Vann
Hero Member
*****
Offline Offline

Activity: 1036
Merit: 606



View Profile
September 24, 2017, 12:13:58 AM
Last edit: September 24, 2017, 12:24:30 AM by Vann
 #33

2nd and 3rd server PSUs are powering all GPUs

Does not boot to bios. Screen does not register a signal.

Doesn't matter which slots are plugged in and which are empty, the 14th one just kills it.

Is this getting to look like a bad motherboard or one that I may have already damaged from improper initial configurations?

Also the B250 chipset only supports up to 12 dedicated PCI-E lanes natively. The rest of the PCI-E slots use a PCI-E expansion chip. Nvidia cards are notorious for having PCI-E compatibility problems when using expansion chips, which is why they don't work with those x1 to 3 x1 PCI-E expansion cards.



 
Metroid
Sr. Member
****
Offline Offline

Activity: 2142
Merit: 353


Xtreme Monster


View Profile
September 24, 2017, 01:08:33 AM
 #34

I wonder how Asus b250 mining expert compares to biostar b250 btc pro. I still think the Asus b250 mining expert is way better than the biostar in everything.

BTC Address: 1DH4ok85VdFAe47fSVXNVctxkFhUv4ujbR
Metroid
Sr. Member
****
Offline Offline

Activity: 2142
Merit: 353


Xtreme Monster


View Profile
September 24, 2017, 01:13:53 AM
 #35

Seems no matter what I do, 14th card results in completely not booting at all

You must be doing something wrong or you must not have done something right to make it to work properly, its one or the other, The asus b250 mining expert should have no problem booting all 16 cards, 8 amd and 8 nvidia on windows.

BTC Address: 1DH4ok85VdFAe47fSVXNVctxkFhUv4ujbR
mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 24, 2017, 05:43:28 PM
Last edit: September 24, 2017, 06:06:44 PM by mikespax
 #36

Just got off the phone with OP. Smiley There's some sort of hardware limitation on 13 GPUs. I guess P106s work because they have no outputs, and supposedly AMD cards may also work because they have different drivers.

So yeah I need either P106 cards or AMD cards. I'm not yet sure how to run both AMD and NVDA on nvOS though. But perhaps I will put in some orders for Vega 64s to mix with my 1080tis.

Bitrated user: mikespax.
yatta
Member
**
Offline Offline

Activity: 93
Merit: 10


View Profile
September 25, 2017, 08:58:38 AM
 #37

I do have the same issue.
13 rx 560 boots fine, when i add 14 it does not boot. No screen signal, no keyboard signal, nothing.

ETH 0xe3c8d2587e03ac3bdcb86794b8227c000db54d25
Metroid
Sr. Member
****
Offline Offline

Activity: 2142
Merit: 353


Xtreme Monster


View Profile
September 25, 2017, 12:02:40 PM
 #38

I do have the same issue.
13 rx 560 boots fine, when i add 14 it does not boot. No screen signal, no keyboard signal, nothing.


Linux?

BTC Address: 1DH4ok85VdFAe47fSVXNVctxkFhUv4ujbR
Vann
Hero Member
*****
Offline Offline

Activity: 1036
Merit: 606



View Profile
September 25, 2017, 12:23:20 PM
 #39

From this graphic, when using more than 8 cards, Asus is recommending using a maximum of 8 Nvidia and 11 AMD cards due to I/O space and driver compatibility on Windows.



BBT tweeted the Powercolor Red Dragon RX 570 cards he ordered for a 19 card build with this board came in, so he should do a livestream setup in the next couple of days.

mikespax
Full Member
***
Offline Offline

Activity: 362
Merit: 102


View Profile
September 25, 2017, 11:21:28 PM
 #40

I ordered a 19 gpu, 3 psu frame from this guy on eBay btw.

http://www.ebay.es/itm/322780828479

Bitrated user: mikespax.
Pages: « 1 [2] 3 4 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!