Bitcoin Forum
December 11, 2016, 04:24:36 AM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 [24] 25 26 »
  Print  
Author Topic: Mining rig extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS]  (Read 155839 times)
Garr255
Legendary
*
Offline Offline

Activity: 952


What's a GPU?


View Profile
May 19, 2012, 09:36:54 PM
 #461

I prefer printers as peripherals Wink

“First they ignore you, then they laugh at you, then they fight you, then you win.”  -- Mahatma Gandhi

Average time between signing on to bitcointalk: Two weeks. Please don't expect responses any faster than that!
1481430276
Hero Member
*
Offline Offline

Posts: 1481430276

View Profile Personal Message (Offline)

Ignore
1481430276
Reply with quote  #2

1481430276
Report to moderator
1481430276
Hero Member
*
Offline Offline

Posts: 1481430276

View Profile Personal Message (Offline)

Ignore
1481430276
Reply with quote  #2

1481430276
Report to moderator
1481430276
Hero Member
*
Offline Offline

Posts: 1481430276

View Profile Personal Message (Offline)

Ignore
1481430276
Reply with quote  #2

1481430276
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1481430276
Hero Member
*
Offline Offline

Posts: 1481430276

View Profile Personal Message (Offline)

Ignore
1481430276
Reply with quote  #2

1481430276
Report to moderator
bulanula
Hero Member
*****
Offline Offline

Activity: 518



View Profile
May 29, 2012, 10:47:08 PM
 #462

Any updates ?

I see the nice setup in the magazine thread Wink
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
May 29, 2012, 10:55:34 PM
 #463

Well I was trying to get a new post written up for another thread, but it is a lot harder than I thought. The main problem I have now is that with 12 cards installed, only 11 are shown in lspci Sad

Anyways, I finally took a deep breath and dove into the wiring of the PSU, and I can say I am pretty proud of the result:








Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
Garr255
Legendary
*
Offline Offline

Activity: 952


What's a GPU?


View Profile
May 29, 2012, 11:08:00 PM
 #464

Looking good!

“First they ignore you, then they laugh at you, then they fight you, then you win.”  -- Mahatma Gandhi

Average time between signing on to bitcointalk: Two weeks. Please don't expect responses any faster than that!
PolymorphicAssasin
Jr. Member
*
Offline Offline

Activity: 47



View Profile
May 29, 2012, 11:38:17 PM
 #465

I hope that window doesn't leak!!   Cry

My forum name comes from ye old BBS days when 'handles' were all the rage.  And yes, Assasin is spelled incorrectly on purpose. Teenage boys do that stuff.
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
May 30, 2012, 12:15:49 AM
 #466

Am I mistaken or are you chaining PCI-e extenders ? I was wondering if I could do that...

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
May 30, 2012, 12:17:29 AM
 #467

Am I mistaken or are you chaining PCI-e extenders ? I was wondering if I could do that...
Yep. For mining with its minimal bandwidth, it should be fine. Has worked in my other rigs as well, you can chain 1x as well as 16x or combine them however you like.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
May 30, 2012, 12:44:34 AM
 #468

Yep. For mining with its minimal bandwidth, it should be fine. Has worked in my other rigs as well, you can chain 1x as well as 16x or combine them however you like.
Sweet... Thanks for the information, one problem less to think about for my growing rig.

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
bulanula
Hero Member
*****
Offline Offline

Activity: 518



View Profile
June 11, 2012, 03:55:25 AM
 #469

This die for some reason ?

BFL ASIC convinced you to sell off Huh
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
June 11, 2012, 04:00:19 AM
 #470

Been shelved for a bit. Current hurdles are:

Set up a bus - currently have 2x 2360 watt PSUs waiting to juice everything up, but no way to connect them properly.
Figure out how to load a lot of cards - currently with 12 5870s plugged in, only 11 are detected.
Figure out how to properly implement virtualization. As a Linux noob, it's really difficult and time consuming.

I am in the process of consolidating lots of the info from this thread into one big new mega post, but that is also time consuming and difficult.


Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
EnergyVampire
Full Member
***
Offline Offline

Activity: 210



View Profile
June 18, 2012, 05:40:33 PM
 #471

Hello rjk,

Your rig is looking really nice!

Quick question on your setup. Which driver(s) are you using? Is the driver causing the 11 GPU limitation? I believe I read somewhere that the AMD drivers could only handle 8 GPUs but your rig has proven otherwise, kudos!

rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
June 18, 2012, 05:43:12 PM
 #472

Hello rjk,

Your rig is looking really nice!

Quick question on your setup. Which driver(s) are you using? Is the driver causing the 11 GPU limitation? I believe I read somewhere that the AMD drivers could only handle 8 GPUs but your rig has proven otherwise, kudos!
I don't think it's a driver limit because I don't have any drivers loaded. I am just listing the PCI devices, which as far as I know does not require a driver. That's why I'm pretty sure it's a BIOS limit. There will of course be a driver limit, likely still of 8 devices, which is why I was planning on using VT-d and PCIe passthough with some virtual machines, but I didn't get very far on that.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
imsaguy
General failure and former
VIP
Hero Member
*
Offline Offline

Activity: 574

Don't send me a pm unless you gpg encrypt it.


View Profile WWW
June 18, 2012, 05:45:39 PM
 #473

Try adding more RAM.  The 12th might not be detected because of being out of memory.

Coming Soon!™ © imsaguy 2011-2013, All rights reserved.

EIEIO:
https://bitcointalk.org/index.php?topic=60117.0

Shades Minoco Collection Thread: https://bitcointalk.org/index.php?topic=65989
Payment Address: http://btc.to/5r6
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
June 18, 2012, 05:46:10 PM
 #474

Try adding more RAM.  The 12th might not be detected because of being out of memory.
I've got 8GB and the board doesn't support any more. Sad

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
June 18, 2012, 06:26:17 PM
 #475

@rjk : I tried chaining pci-extenders and surprisingly it worked, but with a reduced hashrate
I lost ~6% on the card I connected in a 1x -> 1x -> 16x configuration with cablesaurus' extenders.

I checked several times that I didn't make a mistake (only inserting or removing the 1x -> 1x cable). Did you see anything like it (it was with a Saphire 5850 extreme) ?

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
rjk
Sr. Member
****
Offline Offline

Activity: 420


1ngldh


View Profile
June 18, 2012, 06:47:36 PM
 #476

@rjk : I tried chaining pci-extenders and surprisingly it worked, but with a reduced hashrate
I lost ~6% on the card I connected in a 1x -> 1x -> 16x configuration with cablesaurus' extenders.

I checked several times that I didn't make a mistake (only inserting or removing the 1x -> 1x cable). Did you see anything like it (it was with a Saphire 5850 extreme) ?
I don't recall any issues like that, but that was a while ago. Have you tried other cards and other boards? Wonder if it is related to a PCIe timing issue.

Mining Rig Extraordinaire - the Trenton BPX6806 18-slot PCIe backplane [PICS] Dead project is dead, all hail the coming of the mighty ASIC!
DiabloD3
Legendary
*
Offline Offline

Activity: 1162


DiabloMiner author


View Profile WWW
June 18, 2012, 08:01:17 PM
 #477

@rjk : I tried chaining pci-extenders and surprisingly it worked, but with a reduced hashrate
I lost ~6% on the card I connected in a 1x -> 1x -> 16x configuration with cablesaurus' extenders.

I checked several times that I didn't make a mistake (only inserting or removing the 1x -> 1x cable). Did you see anything like it (it was with a Saphire 5850 extreme) ?

6% is very high. It sounds like your -f/-I is too high/low.

gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
June 18, 2012, 09:02:23 PM
 #478

@rjk : I tried chaining pci-extenders and surprisingly it worked, but with a reduced hashrate
I lost ~6% on the card I connected in a 1x -> 1x -> 16x configuration with cablesaurus' extenders.

I checked several times that I didn't make a mistake (only inserting or removing the 1x -> 1x cable). Did you see anything like it (it was with a Saphire 5850 extreme) ?

6% is very high. It sounds like your -f/-I is too high/low.
I don't think so I use cgminer with "-I d -g 1 --gpu-dyninterval 250", on my least powerful cards, intensity is then set to 10.

I'm planning to test this on another system with several reference 5870s next time I'll have to stop it for maintenance, I'll report then.

I've compared outputs of lspci -vvv for the two Sapphire 5850 (only one of which was on a double extender), there were some rare differences but not meaningful to me. If you want me to collect some data, I'd be happy to do so on my next maintenance work.

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
crosby
Sr. Member
****
Offline Offline

Activity: 366


#RIP freemoney


View Profile WWW
July 04, 2012, 11:23:58 AM
 #479

So, you are selling the video cards ?  Sad, I was really hoping to see this completed one day. Backplane up for grabs ??

Get your BTC and LTC at www.betcoinpartners.com/c/2/374 with FREEROLLS + Daily & Weekly Bonuses + Satellites + ON DEMAND tournaments + Instant Deposit + Instant Withdrawals + RING games + GTD Tournament + On Demand Satellite, + LIVE DEALER CASINO + SPORTSBOOK + 100% WELCOME BONUS www.betcoinpartners.com/c/2/374  150 btc ($100,000) gtd monthly, 75 btc ($50,000) gtd weekly and 10 BIG daily gtd ranging 0.5 btc to up to 20 btc
Cablez
Legendary
*
Offline Offline

Activity: 1400


I owe my soul to the Bitcoin code...


View Profile
July 04, 2012, 12:54:54 PM
 #480

So so sad....would have been epic. Sad

Tired of substandard power distribution in your ASIC setup???   Chris' Custom Cablez will get you sorted out right!  No job too hard so PM me for a quote
Check my products or ask a question here: https://bitcointalk.org/index.php?topic=74397.0
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 [24] 25 26 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!