Bitcoin Forum
December 03, 2016, 09:42:59 AM *
News: Latest stable version of Bitcoin Core: 0.13.1  [Torrent].
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 [16] 17 18 19 20 21 22 23 24 25 26 »
  Print  
Author Topic: Mining rig extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS]  (Read 155627 times)
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 07, 2012, 10:10:00 PM
 #301

Don't anyone ever accuse me of under-sizing my wiring. Grin Each PSU puts out about 200 amps of 12vdc, across 2 negative and 2 positive terminals. I couldn't find a consistent reference across the internet as to what size wire to use - some said 10 gauge was fine, and others said no you must use 2 AWG, with varying opinions in between. So I eventually went with 6 AWG battery cable, and split it across both terminals, like so:


Lots of solder and a bit of flame to make this work.


Special connectors to fit the PSUs I have.


Plugged into the PSU.

The next thing to do is get some copper bus bar and shrink tubing or similar and start hooking it all up as soon as I have the new frame in my grubby hands.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
1480758179
Hero Member
*
Offline Offline

Posts: 1480758179

View Profile Personal Message (Offline)

Ignore
1480758179
Reply with quote  #2

1480758179
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
PatrickHarnett
Hero Member
*****
Offline Offline

Activity: 518



View Profile
April 09, 2012, 09:29:04 PM
 #302

Guys, check out the pure awesome radiating from this thing. What a beast.



Quoted so the pic gets more air time.  Drool
Spotswood
Sr. Member
****
Offline Offline

Activity: 362



View Profile WWW
April 09, 2012, 11:03:09 PM
 #303

That thing is a beast!!!!   What are the outer dimensions if I might ask?

Its only 17 by 41 inches.  One of the key features of this tray is its flexibility.  The placement of all the floor "beams" are adjustable (horizontally), along with the vertical placement of the PCI and extra GPU support beams.  Plus all manor of hardware can be attached to all of those t-slots.   Grin


















Inspector 2211
Sr. Member
****
Offline Offline

Activity: 383



View Profile
April 10, 2012, 12:12:54 AM
 #304

Its only 17 by 41 inches.  One of the key features of this tray is its flexibility.  The placement of all the floor "beams" are adjustable (horizontally), along with the vertical placement of the PCI and extra GPU support beams.  Plus all manor of hardware can be attached to all of those t-slots.   Grin

Why not simply bolt all ground connections to this aluminum frame? It probably sports lower resistance than traditional power cables. Only relatively short stub ground cables would go to the graphics cards, and, of course, the conventional +12V cables.

Thoughts?
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 10, 2012, 03:55:13 AM
 #305

Its only 17 by 41 inches.  One of the key features of this tray is its flexibility.  The placement of all the floor "beams" are adjustable (horizontally), along with the vertical placement of the PCI and extra GPU support beams.  Plus all manor of hardware can be attached to all of those t-slots.   Grin

Why not simply bolt all ground connections to this aluminum frame? It probably sports lower resistance than traditional power cables. Only relatively short stub ground cables would go to the graphics cards, and, of course, the conventional +12V cables.

Thoughts?
I've been considering that. Not exactly sure how well the angle connectors will conduct current though, some seem to be plastic, and others are bolted with a metal connector. It would suck to have the slightest loose connection, which is why I was considering copper busbar.

BTW, I could use some help in determining the correct sizing of the bus bar, as well as the best way to attach things to it. Each PSU is good for 200 amps, and there probably won't be more than 4 of them (or 5 at the most), so 800 to 1000 amps at 12 vdc. I can use crimp connectors on the 6 AWG wire, and then bolt the connectors to the bus with copper bolts, but how should I connect the dozens of little 16-18 AWG wires that go to the 6/8-pin connectors? Perhaps each connector could have its of pair of bolts, and each bolt gets 3 conductors using ring terminals? Like so:

        ===X==*=*=*=*==X==*=*=*=*==X==*=*=*=*==X==*=*=*=*==X===

= is Busbar
X is large power terminal
* is small load terminal

Also, I have been in contact with Advantech about getting a VT-d capable host board, but it will run me about a grand, including the Xeon E3-1225 and 8 GB of RAM . Sad has anyone been able to test the "multiple x sessions" theory to see if it would work for many video cards (instead of VT-d)? I think an earlier poster mentioned that they were going to test it, but I'm not sure who and whether it ever happened.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
Spotswood
Sr. Member
****
Offline Offline

Activity: 362



View Profile WWW
April 10, 2012, 04:19:08 AM
 #306

...
I've been considering that. Not exactly sure how well the angle connectors will conduct current though, some seem to be plastic, and others are bolted with a metal connector. It would suck to have the slightest loose connection, which is why I was considering copper busbar.
...
The t-slot extrusions are anodized.  All of the angle brackets are cast aluminum.  

ARapalo
Member
**
Offline Offline

Activity: 93


View Profile
April 10, 2012, 04:21:52 AM
 #307

This thread/concept is quite awesome. I skimmed some of it, I'll have to go back and try to read every page.

Did majority of people that tried this backplane actually get at least 8 GPUs working?
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 10, 2012, 04:37:56 AM
 #308

This thread/concept is quite awesome. I skimmed some of it, I'll have to go back and try to read every page.

Did majority of people that tried this backplane actually get at least 8 GPUs working?
I am the only one (that I know of) that has tried this. Although, Bigpiggy01 has a different board that works similarly, that he has gotten to work with more than 8 GPUs using IOMMU.

...
I've been considering that. Not exactly sure how well the angle connectors will conduct current though, some seem to be plastic, and others are bolted with a metal connector. It would suck to have the slightest loose connection, which is why I was considering copper busbar.
...
The t-slot extrusions are anodized.  All of the angle brackets are cast aluminum. 
Cool. Maybe it will be sufficient then to use as my ground plane.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
tnkflx
Sr. Member
****
Offline Offline

Activity: 346


View Profile
April 10, 2012, 07:32:00 AM
 #309

This thread/concept is quite awesome. I skimmed some of it, I'll have to go back and try to read every page.

Did majority of people that tried this backplane actually get at least 8 GPUs working?
I am the only one (that I know of) that has tried this. Although, Bigpiggy01 has a different board that works similarly, that he has gotten to work with more than 8 GPUs using IOMMU.

8 GPUs is not a problem. Going above that is Smiley

| Operating electrum.be & us.electrum.be |
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 10, 2012, 01:07:20 PM
 #310

This thread/concept is quite awesome. I skimmed some of it, I'll have to go back and try to read every page.

Did majority of people that tried this backplane actually get at least 8 GPUs working?
I am the only one (that I know of) that has tried this. Although, Bigpiggy01 has a different board that works similarly, that he has gotten to work with more than 8 GPUs using IOMMU.

8 GPUs is not a problem. Going above that is Smiley
I know, he has it working with 11 GPUs.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
tnkflx
Sr. Member
****
Offline Offline

Activity: 346


View Profile
April 10, 2012, 02:06:21 PM
 #311

This thread/concept is quite awesome. I skimmed some of it, I'll have to go back and try to read every page.

Did majority of people that tried this backplane actually get at least 8 GPUs working?
I am the only one (that I know of) that has tried this. Although, Bigpiggy01 has a different board that works similarly, that he has gotten to work with more than 8 GPUs using IOMMU.

8 GPUs is not a problem. Going above that is Smiley
I know, he has it working with 11 GPUs.

Do you have a link to his setup somewhere?

| Operating electrum.be & us.electrum.be |
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 10, 2012, 02:09:11 PM
 #312

This thread/concept is quite awesome. I skimmed some of it, I'll have to go back and try to read every page.

Did majority of people that tried this backplane actually get at least 8 GPUs working?
I am the only one (that I know of) that has tried this. Although, Bigpiggy01 has a different board that works similarly, that he has gotten to work with more than 8 GPUs using IOMMU.

8 GPUs is not a problem. Going above that is Smiley
I know, he has it working with 11 GPUs.

Do you have a link to his setup somewhere?
https://bitcointalk.org/index.php?topic=64133.msg834841#msg834841

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
discordian666
Jr. Member
*
Offline Offline

Activity: 48


View Profile
April 10, 2012, 02:44:05 PM
 #313

I have much respect for the OP and this project, when he gets this fully operational and stable I'd love to do the same thing at my place Smiley

Clearly one of my more favourite threads on this forum

Bought from

MrBashFo (d3 gold)
Inaba (BTC)
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 10, 2012, 02:47:11 PM
 #314

If there is a way to use virtualization but still access the GPU hardware, that could allow for some really interesting ways of doing things.
There is, and a lot of commercial virtualization software offers it. It's usually called "GPU pass-through", or something along those lines.
Yes, but I have yet to hear from anyone that has tested it much. Luke-jr is the only one that I know of that has actually mined with a video card in a virtualized OS, using KVM passthough virtualization. But that was only one card, and the system was somewhat unstable. Others have mentioned that since the drivers run in usermode with X, that I might be able to run multiple X instances. But I don't really know enough about how that works to know how to set it up, or even whether it would work at all.

I'm fairly swamped at the moment, but if I can find some time I'll give it a try and see how it works, then report my results.
Did you get a chance to try this? I really would like to know before dropping another grand on this box.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 11, 2012, 05:06:08 PM
 #315

I just got the custom frame from Spotswood, and it is solid. It was flat packed, and I will have to wait until later this evening after work to put it together and take pics. But +100 for Spotswood for an awesome custom-built open air frame.

Also got fan grilles and screws, and have shipped off a couple fans to Garr255 to develop a custom PWM controller for them. Still wondering whether I should get a VT-d capable host board, especially considering that this rig could be somewhat obsolete soon.  Cry Unless Vladimir develops a PCIe based ASIC card that I can shove in. Grin

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
Sherkel
aka Tombstoner
Full Member
***
Offline Offline

Activity: 131


View Profile
April 11, 2012, 05:11:47 PM
 #316

Wow. I just don't know what to say. Cheesy For 18 GPU's, it would probably be a better deal in the end if you have a good PSU, right?

What do you get when you cross dominoes and The Matrix?
<A dominatrix!>
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 11, 2012, 06:14:03 PM
 #317

Wow. I just don't know what to say. Cheesy For 18 GPU's, it would probably be a better deal in the end if you have a good PSU, right?
Done and done. But if I want more than 8 GPUs, I need VT-d, unless anyone has been able to test and confirm otherwise.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
April 12, 2012, 03:35:06 AM
 #318

OK I got the custom frame in today, and have partially assembled the system in it. Here are some pics, and I'm going to upload a short video soon to demonstrate how loud the fans are. Grin









Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
DiabloD3
Legendary
*
Offline Offline

Activity: 1162


DiabloMiner author


View Profile WWW
April 12, 2012, 03:59:39 AM
 #319

Huh, now that I see that coming together thats almost exactly like the rig I always wanted to build but never could afford.

Spotswood
Sr. Member
****
Offline Offline

Activity: 362



View Profile WWW
April 12, 2012, 04:08:52 AM
 #320

To properly mount those fans, you could remove one of the "beams" in the top, placing it in the front in between the posts.

Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 [16] 17 18 19 20 21 22 23 24 25 26 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!