|
Title: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 22, 2018, 07:43:22 PM Hello everyone :)
I`m wondering if I have connected everything correctly. I have twelve 1080ti cards. 3 x 1200w server psu with breakout boards PICO psu to power mobo/ssd. PSU No.1. will power cards +their risers PSU No.1 will power cards +their risers PSU No.3 will power cards +their risers +PICO. My most worrying part is No.3. This is how I intend to connect everything. Is this correct? How do I get all 3 server psu`s to start at the same time? Or if I can`t, in what sequences I should start them? My motherboard is BIOSTAR TB250-BTC PRO http://www.biostar.com.tw/app/en/mb/introduction.php?S_ID=884 (http://www.biostar.com.tw/app/en/mb/introduction.php?S_ID=884) My breakout board: https://i.imgur.com/hRjLkfi.jpg https://i.imgur.com/hRjLkfi.jpg (https://i.imgur.com/hRjLkfi.jpg) Setup: https://i.imgur.com/RPRnsPk.jpg https://i.imgur.com/RPRnsPk.jpg (https://i.imgur.com/RPRnsPk.jpg) https://i.imgur.com/1Usw4Bx.jpg https://i.imgur.com/1Usw4Bx.jpg (https://i.imgur.com/1Usw4Bx.jpg) https://i.imgur.com/IwfAmlp.jpg https://i.imgur.com/IwfAmlp.jpg (https://i.imgur.com/IwfAmlp.jpg) https://i.imgur.com/qrdhDDM.jpg https://i.imgur.com/qrdhDDM.jpg (https://i.imgur.com/qrdhDDM.jpg) https://i.imgur.com/nv3NOtq.jpg https://i.imgur.com/nv3NOtq.jpg (https://i.imgur.com/nv3NOtq.jpg) https://i.imgur.com/BG2aivr.jpg https://i.imgur.com/BG2aivr.jpg (https://i.imgur.com/BG2aivr.jpg) Thank you Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 09:22:32 AM Anybody ???
Title: Re: 12 card rig, 3 server psu +PICO Post by: shimpa on January 23, 2018, 09:35:24 AM I run a very similar setup.
Depending on the algo and the card optimization (OC/DC) it should run that no problem. On 220V that PSU runs 3x1080Ti + mainboard no issue. Don't know if you have 220V but I think it's 900W max on 110V which should be enough in theory if you optimize your cards. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 09:39:02 AM I`m in Europe, 220v.
I`m just wondering - my BB has 6 pins, but PICO input connector 4 pins - is that ok? My mobo has 8 pin power connector, but PICO 4 pin. Do you have same and it works? In what sequence you turn your psu`s on ? Title: Re: 12 card rig, 3 server psu +PICO Post by: spinx on January 23, 2018, 09:55:06 AM Hi,
Depending on what kind of pci-e risers you got, you might need 5V from the server psu. I had old risers (006C?) that only had a molex connector, this is because gpu's need 5V for start signal as i understood. The better model of pci-risers has this 12V -> 5V voltage transformation built in, and therefore only requires 12V on a 6pin pci-e connector. This is how i solved getting 5V from the 12V server psu's https://bitcointalk.org/index.php?topic=1955358.msg28576837#msg28576837 This could also be a idea to feed the motherboard molex from the server psu instead of the pico-psu. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 09:56:29 AM My riser:
009s https://www.amazon.co.uk/gp/product/B077K28B6Y/ref=oh_aui_detailpage_o02_s00?ie=UTF8&psc=1 I don`t have 6 pin female to molex cable for that. Title: Re: 12 card rig, 3 server psu +PICO Post by: shimpa on January 23, 2018, 09:59:59 AM I`m just wondering - my BB has 6 pins, but PICO input connector 4 pins - is that ok? My mobo has 8 pin power connector, but PICO 4 pin. Do you have same and it works? My PICOs don't have an input connector like that, I have to modify them to work with a 6-pin PCIe connector. It's okay as long as it's a 12V input PICO and you don't swap the polarity. Make sure you don't just look at the wire colors but actually check polarity with a multimeter because I actually got a number of PCIe power cables that have their wires swapped. Quote In what sequence you turn your psu`s on ? I turn them on at the same time. I actually have this all on a switched PDU. Depending on how long your mainboard POSTs you should be good even if you don't power them on at the same time. It's safe to turn the card-only PSUs first as well. Title: Re: 12 card rig, 3 server psu +PICO Post by: spinx on January 23, 2018, 10:12:27 AM My riser: 009s https://www.amazon.co.uk/gp/product/B077K28B6Y/ref=oh_aui_detailpage_o02_s00?ie=UTF8&psc=1 I don`t have 6 pin female to molex cable for that. You only need 12V 6-pin male connectors from the psu then. Title: Re: 12 card rig, 3 server psu +PICO Post by: Michael20 on January 23, 2018, 10:41:27 AM You could use the 4pin mobo from the Pico for your Mainboard. http://i57.tinypic.com/20horih.png
8pin is need, if maximal oc, and you plug gpu's direct on Board. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 10:59:31 AM Thank you all for your help, fingers crossed it all works today and I see no sparks when I power it on :D
Title: Re: 12 card rig, 3 server psu +PICO Post by: bartjeyayo on January 23, 2018, 11:55:49 AM OP. I have 20 rigs connected with server PSU and PICO's and never ran into problems.
Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 11:56:26 AM In a exact same setup like mine?
Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 12:48:36 PM I powered up server psu and sparks went on PICO :( :( :(
https://i.imgur.com/SxPhMTR.jpg https://i.imgur.com/SxPhMTR.jpg (https://i.imgur.com/SxPhMTR.jpg) Title: Re: 12 card rig, 3 server psu +PICO Post by: bartjeyayo on January 23, 2018, 12:52:50 PM Did you mess up connecting the power? :-X
Seems like you put minus on plus and plus on minus. How did you managed to do this? ::) https://imgur.com/IwfAmlp When i take a look at my power supplies. At the lip side i got minus and the outside got plus. Just opposite around as you. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 12:54:45 PM Which one?
Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 01:23:33 PM Response from PICO distributor:
Oh dear. I can immediately see what is wrong here. In image 2 the *output* of the picoPSU is connected to the motherboard AUXPWR1 – which is also an output! According to the manual for your TB250-BTC this is an auxiliary power connection (to give additional power to) graphics cards. i.e. power goes into motherboard through the ATX connector, and comes out here. Hopefully this hasn’t damaged the motherboard. It has obviously damaged the picoPSU. FWIW the output you connected is to power a hard drive or similar device. Title: Re: 12 card rig, 3 server psu +PICO Post by: P00P135 on January 23, 2018, 02:11:54 PM Response from PICO distributor: Oh dear. I can immediately see what is wrong here. In image 2 the *output* of the picoPSU is connected to the motherboard AUXPWR1 – which is also an output! According to the manual for your TB250-BTC this is an auxiliary power connection (to give additional power to) graphics cards. i.e. power goes into motherboard through the ATX connector, and comes out here. Hopefully this hasn’t damaged the motherboard. It has obviously damaged the picoPSU. FWIW the output you connected is to power a hard drive or similar device. Was that just an old 160w pico? Think you need one of the newer 200-250w pico's to be able to power anything more than a hard drive and normal motherboard. I think that molex connection sucked too much juice and just smoked the low watt pico. Title: Re: 12 card rig, 3 server psu +PICO Post by: spinx on January 23, 2018, 02:30:51 PM Response from PICO distributor: Oh dear. I can immediately see what is wrong here. In image 2 the *output* of the picoPSU is connected to the motherboard AUXPWR1 – which is also an output! According to the manual for your TB250-BTC this is an auxiliary power connection (to give additional power to) graphics cards. i.e. power goes into motherboard through the ATX connector, and comes out here. Hopefully this hasn’t damaged the motherboard. It has obviously damaged the picoPSU. FWIW the output you connected is to power a hard drive or similar device. Was that just an old 160w pico? Think you need one of the newer 200-250w pico's to be able to power anything more than a hard drive and normal motherboard. I think that molex connection sucked too much juice and just smoked the low watt pico. I also smoked a 160w pico when i used the single molex to power a usb pci-e riser (rx560 with no 6pin). Fingers crossed that mobo survived! Title: Re: 12 card rig, 3 server psu +PICO Post by: john1010 on January 23, 2018, 02:32:00 PM Mine is asrock pro btc+ is it okay to not powerup the number 2 molex in the motehrboard? or is it advisable to powerup both?
Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 02:33:14 PM Quote Was that just an old 160w pico? Think you need one of the newer 200-250w pico's to be able to power anything more than a hard drive and normal motherboard. I think that molex connection sucked too much juice and just smoked the low watt pico. Not old, brand new. 160w is more than enough. My cpu is only 54w and ssd 2w. Mobo takes 10-30w only. If you read PICO distributors response, it says I plugged molex in wrong place. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 02:35:57 PM Mine is asrock pro btc+ is it okay to not powerup the number 2 molex in the motehrboard? or is it advisable to powerup both? Read few posts above. Yeah, go ahead and plug in both molex cables :D :D :D :D :D Title: Re: 12 card rig, 3 server psu +PICO Post by: P00P135 on January 23, 2018, 05:26:41 PM Quote Was that just an old 160w pico? Think you need one of the newer 200-250w pico's to be able to power anything more than a hard drive and normal motherboard. I think that molex connection sucked too much juice and just smoked the low watt pico. Not old, brand new. 160w is more than enough. My cpu is only 54w and ssd 2w. Mobo takes 10-30w only. If you read PICO distributors response, it says I plugged molex in wrong place. No those molex are not power outputs, they are extra power inputs to power the pcie x1 if you don't use powered risers. You don't need to even connect them if you are using power risers, but some people claim the mobo doesnt boot unless there is a power connected to these molex connectors. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 05:35:35 PM Title: Re: 12 card rig, 3 server psu +PICO Post by: P00P135 on January 23, 2018, 06:05:42 PM Yeah dood! enhance the power of your graphics with these two molex, they plug right into your gpu's for extra power when you need it the most! ???
Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 06:07:43 PM ;D ;D ;D
That`s what BIOSTAR manual says, not me :P But its 101% output, because fire and smoke started and PICO burned within 0.5 sec after I plugged it in. Title: Re: 12 card rig, 3 server psu +PICO Post by: P00P135 on January 23, 2018, 06:17:35 PM ;D ;D ;D That`s what BIOSTAR manual says, not me :P But its 101% output, because fire and smoke started and PICO burned within 0.5 sec after I plugged it in. No where does it say "output", this is just your interpretation which is 101% wrong. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 23, 2018, 06:19:40 PM Title: Re: 12 card rig, 3 server psu +PICO Post by: Corsa1r on January 23, 2018, 06:33:42 PM No, plugging in extra molex from psu actually helps motherboard give auxiliary power to graphics cards, because it can't supply everything itself.
Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 24, 2018, 07:15:15 PM Got another brand new PICO delivered today, did not plug in Molex into mobo, but result is same - burned again! Sparks, smoke and smell.
What on earth is going on?! Where is a problem???? Title: Re: 12 card rig, 3 server psu +PICO Post by: Prelude on January 24, 2018, 07:50:07 PM Response from PICO distributor: Oh dear. I can immediately see what is wrong here. In image 2 the *output* of the picoPSU is connected to the motherboard AUXPWR1 – which is also an output! According to the manual for your TB250-BTC this is an auxiliary power connection (to give additional power to) graphics cards. i.e. power goes into motherboard through the ATX connector, and comes out here. Hopefully this hasn’t damaged the motherboard. It has obviously damaged the picoPSU. FWIW the output you connected is to power a hard drive or similar device. That is NOT the issue at all. As soon as I saw your pics I thought "fuck, hope he hasn't powered that on yet.." and then scrolled through and saw you scrapped 2 PICOs. You're feeding the pico power from a PCI-e 6 pin connector on the breakout board. The pico's input connector is NOT a PCI-e connector, it's a CPU connector. You managed to make it fit in there, but it's polarity is reversed. Compare it to your actual PCI-e connectors, you'll see that the yellow cables are on the bottom, and black is on top. You've just sent 12V to ground, and ground to 12V to your poor picos. If you can cram the next pico's 4 pin connector upside down into a 6 pin, you'll be fine. Title: Re: 12 card rig, 3 server psu +PICO Post by: fanatic26 on January 24, 2018, 07:52:22 PM Depending on what kind of pci-e risers you got, you might need 5V from the server psu. I had old risers (006C?) that only had a molex connector, this is because gpu's need 5V for start signal as i understood. The better model of pci-risers has this 12V -> 5V voltage transformation built in, and therefore only requires 12V on a 6pin pci-e connector. Risers do not need 5v. I run a PICO setup and I also have PCIE to 3 molex adapters to power the cards. Everything is powered by 12v only. Title: Re: 12 card rig, 3 server psu +PICO Post by: fanatic26 on January 24, 2018, 07:55:01 PM Quote No those molex are not power outputs No, they are outputs. You are reading it wrong. They are not power outputs, they help supplement power to the PCIE ports on the board. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 24, 2018, 07:56:23 PM Quote That is NOT the issue at all. As soon as I saw your pics I thought "fuck, hope he hasn't powered that on yet.." and then scrolled through and saw you scrapped 2 PICOs. You're feeding the pico power from a PCI-e 6 pin connector on the breakout board. The pico's input connector is NOT a PCI-e connector, it's a CPU connector. You managed to make it fit in there, but it's polarity is reversed. Compare it to your actual PCI-e connectors, you'll see that the yellow cables are on the bottom, and black is on top. You've just sent 12V to ground, and ground to 12V to your poor picos. If you can cram the next pico's 4 pin connector upside down into a 6 pin, you'll be fine. I have checked with multi meter, +12v comes out from breakout board where black & yellow cables are connected from PICO. PICO`s 4 pin connector fits perfectly into 6 pin breakout board connector, did not have to force it, but it only fits in on one side due to shape of connector. I tried following - just PICO on its own, not plugged into mobo, powered on HP psu - no sparks, no smoke, no smell, runs like a dream! If you plug it into mobo and plug 4 pin into mobo, bang, fire! To me, it indicates BB is giving correct + & - to power PICO. I also checked with multi meter what comes out from PICO 4 pin which I plug into mobo, its +12v. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 24, 2018, 08:12:33 PM https://i.imgur.com/UgZtDMC.jpg
https://i.imgur.com/UgZtDMC.jpg (https://i.imgur.com/UgZtDMC.jpg) https://i.imgur.com/45vnoJX.jpg https://i.imgur.com/45vnoJX.jpg (https://i.imgur.com/45vnoJX.jpg) https://i.imgur.com/3BoiVbB.jpg https://i.imgur.com/3BoiVbB.jpg (https://i.imgur.com/3BoiVbB.jpg) https://i.imgur.com/PZwTGlv.jpg https://i.imgur.com/PZwTGlv.jpg (https://i.imgur.com/PZwTGlv.jpg) https://i.imgur.com/Yv00OAb.jpg https://i.imgur.com/Yv00OAb.jpg (https://i.imgur.com/Yv00OAb.jpg) Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 24, 2018, 08:23:54 PM Prelude, I think you were right....!!! I forced 4 pin into BB 6 pin other way around, plugged 4 pin from PICO into mobo power and powered up, it works, cpu fan spins, no fire, no smoke, no smell....!!!
Title: Re: 12 card rig, 3 server psu +PICO Post by: Prelude on January 25, 2018, 12:47:34 AM Prelude, I think you were right....!!! I forced 4 pin into BB 6 pin other way around, plugged 4 pin from PICO into mobo power and powered up, it works, cpu fan spins, no fire, no smoke, no smell....!!! I'm definitely right. ;) Your multi-meter picture shows you are reading the voltage improperly. You have your red probe on the black wire, and black probe on the yellow wire. If you'd have put red on yellow and black on black, you'd have seen -12V. Thankfully you didn't fry the motherboard etc! Title: Re: 12 card rig, 3 server psu +PICO Post by: bigjee on January 25, 2018, 02:12:08 AM So if i have this right a lot of the pain in this thread couldve been avoided by using a different bb?
such as the one below: https://www.ebay.ca/itm/DPS-1200FB-QB-6-Pin-A-Power-Supply-Breakout-Board-Adapter-For-Ethereum-Mining/362215797541?hash=item5455be7325:g:JTgAAOSw4HNaXu0v Or am i missing anything. Sure i only have 10 pcie cables vs 12 but maybe i wouldnt use a pico then since can get an extra 2 pcie with atx Title: Re: 12 card rig, 3 server psu +PICO Post by: P00P135 on January 25, 2018, 02:42:49 AM So if i have this right a lot of the pain in this thread couldve been avoided by using a different bb? such as the one below: https://www.ebay.ca/itm/DPS-1200FB-QB-6-Pin-A-Power-Supply-Breakout-Board-Adapter-For-Ethereum-Mining/362215797541?hash=item5455be7325:g:JTgAAOSw4HNaXu0v Or am i missing anything. Sure i only have 10 pcie cables vs 12 but maybe i wouldnt use a pico then since can get an extra 2 pcie with atx or a properly wired 6pin to CPU 8pin to plug directly into the motherboard and avoid the pico 4pin plug altogether. Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 25, 2018, 07:42:41 AM Quote I'm definitely right. ;) 101% :) Quote Your multi-meter picture shows you are reading the voltage improperly. You have your red probe on the black wire, and black probe on the yellow wire. If you'd have put red on yellow and black on black, you'd have seen -12V. Yes, you are correct, it shows -12v :) Quote Thankfully you didn't fry the motherboard etc! I might have :( I get nothing on the monitor, it says no signal for 3 seconds, then monitor light just flashes and black screen :( Or it could be PICO. I`m getting ATX psu from local shop today to try. Title: Re: 12 card rig, 3 server psu +PICO Post by: bigjee on January 26, 2018, 05:57:26 PM So if i have this right a lot of the pain in this thread couldve been avoided by using a different bb? such as the one below: https://www.ebay.ca/itm/DPS-1200FB-QB-6-Pin-A-Power-Supply-Breakout-Board-Adapter-For-Ethereum-Mining/362215797541?hash=item5455be7325:g:JTgAAOSw4HNaXu0v Or am i missing anything. Sure i only have 10 pcie cables vs 12 but maybe i wouldnt use a pico then since can get an extra 2 pcie with atx or a properly wired 6pin to CPU 8pin to plug directly into the motherboard and avoid the pico 4pin plug altogether. Ah okay. thanks. I was thinking something like this would work too? https://www.ebay.ca/itm/5x-ATX-4-Pin-Male-to-8-Pin-Female-EPS-Power-Cable-Cord-Adapter-CPU-Power-Supply/281297434879?hash=item417ea238ff:g:G5YAAOSwiDFYMvY0 (https://www.ebay.ca/itm/5x-ATX-4-Pin-Male-to-8-Pin-Female-EPS-Power-Cable-Cord-Adapter-CPU-Power-Supply/281297434879?hash=item417ea238ff:g:G5YAAOSwiDFYMvY0) combined with https://www.ebay.ca/itm/With-6Pin-Input-12V-DC-PC-ATX-Power-Supply-unit-For-mini-ITX-Pico-PSU-Out-180W/263070008251?hash=item3d4031c3bb:g:HKIAAOSwq~tZWo5r (https://www.ebay.ca/itm/With-6Pin-Input-12V-DC-PC-ATX-Power-Supply-unit-For-mini-ITX-Pico-PSU-Out-180W/263070008251?hash=item3d4031c3bb:g:HKIAAOSwq~tZWo5r) Title: Re: 12 card rig, 3 server psu +PICO Post by: Bimmber on January 27, 2018, 10:16:31 AM My mobo won`t even POST.
Somebody pass me the shotgun please!!! CPU fan spins for about 12 seconds, then stops for few, starts spinning again. It indicates its an electrical problem. What I tried - swapping power supplies, another brand new motherboard, removing one RAM stick. Tried inserting video card into PCIs slot and connecting monitor to it. Monitor says NO SIGNAL. Any ideas?! https://i.imgur.com/uZ9VLOS.jpg Title: Re: 12 card rig, 3 server psu +PICO Post by: bartjeyayo on January 27, 2018, 01:31:25 PM So if i have this right a lot of the pain in this thread couldve been avoided by using a different bb? such as the one below: https://www.ebay.ca/itm/DPS-1200FB-QB-6-Pin-A-Power-Supply-Breakout-Board-Adapter-For-Ethereum-Mining/362215797541?hash=item5455be7325:g:JTgAAOSw4HNaXu0v Or am i missing anything. Sure i only have 10 pcie cables vs 12 but maybe i wouldnt use a pico then since can get an extra 2 pcie with atx or a properly wired 6pin to CPU 8pin to plug directly into the motherboard and avoid the pico 4pin plug altogether. Ah okay. thanks. I was thinking something like this would work too? https://www.ebay.ca/itm/5x-ATX-4-Pin-Male-to-8-Pin-Female-EPS-Power-Cable-Cord-Adapter-CPU-Power-Supply/281297434879?hash=item417ea238ff:g:G5YAAOSwiDFYMvY0 (https://www.ebay.ca/itm/5x-ATX-4-Pin-Male-to-8-Pin-Female-EPS-Power-Cable-Cord-Adapter-CPU-Power-Supply/281297434879?hash=item417ea238ff:g:G5YAAOSwiDFYMvY0) combined with https://www.ebay.ca/itm/With-6Pin-Input-12V-DC-PC-ATX-Power-Supply-unit-For-mini-ITX-Pico-PSU-Out-180W/263070008251?hash=item3d4031c3bb:g:HKIAAOSwq~tZWo5r (https://www.ebay.ca/itm/With-6Pin-Input-12V-DC-PC-ATX-Power-Supply-unit-For-mini-ITX-Pico-PSU-Out-180W/263070008251?hash=item3d4031c3bb:g:HKIAAOSwq~tZWo5r) I'm running 15 rigs with these PicoPSU's: https://www.aliexpress.com/item/TOP-SELL-DC-12V-160W-24PIN-Pico-ATX-Switch-PSU-Car-Auto-Mini-ITX-DC-TO/32832761007.html |
