flminer
|
|
June 07, 2017, 02:13:48 AM |
|
So today i got some good info toward the use of the PCIe 1 to 3 hubs available online...
So over in the miner rig porn pages, there is a fellow who builds a lot of 1 mobo to 8-12 GPU rigs and i just didnt understand how he was managing all of this so i messaged him and this is what he mentioned to me..
It really all comes down to the CPUs that you are using.... for example the Intel's LGA-1156, LGA-1155, and LGA-1150 sockets have a single 16x PCIe port on the CPU. This port can be broken into three subports in the following configurations: 16/0/0, 8/8/0, 8/4/4. Each subport can be down negotiated independently, so it's possible to use configurations such as 4/4/4, 4/1/4, and 8/0/1. It is not however possible to connect more than three PCIe devices to this port without using an external switching chip.
Intel's Platform controller hub has an additional 8x PCIe 2.0 port which can be broken down into 8 individual 1x ports which enables the use of numerous low-bandwidth peripherals and add-in chips. Most motherboards contain a 4x port and up to three 1x ports. These ports often share bandwidth (on motherboards that contain an M.2 connector, this shares bandwidth as well) which means that the 4x port can operate in either 4x mode or 1x mode. If none of the 1x ports are populated, it will operate in 4x mode, if any of the 1x ports are populated it will operate in 1x mode for a total of four 1x connections to the PCH.
So to run 8 GPU's you have to purchase a CPU that supports atleast 8 independent ports, not all CPU's that state having 16 PCIe channels work well with multiple independent configuration, mainly server and more expensive CPU's are the ones that are coded to properly work well with 8 independent channels communicating at one time..
So example... Intel i3 6100, its rated at 16 PCIe channels MAX, 1x16, 2x8, 1x8+2x4 So in theory the x16 slot can be broken into 3 independent channels, then all other ports used in 1x, but many motherboards share the bandwidth between the x8 slot and the x16 slot to save money, so you have to figure out what configuration the motherboard is wired firstly to correctly adjust the settings in the bios for it to run. The motherboards that dont share bandwidth allow you to run 3 x GPU's off the x16 slot in (4/4/4), then 2 additional off the x8 slot in (1/1), then utilize the rest x1 slots as singles.
Most fail to use them correctly, because they try to use CPU's with basic PCH control, which doesnt support anything more than 1 independent channel per port to communicate.
The other reason they fail to use them is the fact they have to view the video on the computer to see what they are doing, so they hook a monitor up to the computer, which depending on your GPU auto changes the port priority. Most AMD cards require minimal x4 to work correctly, while most modern Nvidia cards require x8 to work correctly. So they hook 8 GPU's to the computer, go to boot it up and the PCH auto mandates lets say x8 to the viewing GPU on bootup, what this does on the main x16 slot is forces it into (8/0/1) mode, so the video will show up but not all GPU's will show up on the system or the mobo will fail to boot because your demanding to many channels on a mode that has a null (0) channel. you have to setup the bios from remote access to properly setup 8+ GPU's on modern mobo's
this sounds very likely to be true. Might get a coouple of those to play with and give it a shot.
|
|
|
|
flminer
|
|
June 07, 2017, 02:15:56 AM |
|
fyi zpool has been holding steady reported hashrate for about 4 hours now
|
|
|
|
Storx
|
|
June 07, 2017, 02:54:03 AM |
|
So today i got some good info toward the use of the PCIe 1 to 3 hubs available online...
So over in the miner rig porn pages, there is a fellow who builds a lot of 1 mobo to 8-12 GPU rigs and i just didnt understand how he was managing all of this so i messaged him and this is what he mentioned to me..
It really all comes down to the CPUs that you are using.... for example the Intel's LGA-1156, LGA-1155, and LGA-1150 sockets have a single 16x PCIe port on the CPU. This port can be broken into three subports in the following configurations: 16/0/0, 8/8/0, 8/4/4. Each subport can be down negotiated independently, so it's possible to use configurations such as 4/4/4, 4/1/4, and 8/0/1. It is not however possible to connect more than three PCIe devices to this port without using an external switching chip.
Intel's Platform controller hub has an additional 8x PCIe 2.0 port which can be broken down into 8 individual 1x ports which enables the use of numerous low-bandwidth peripherals and add-in chips. Most motherboards contain a 4x port and up to three 1x ports. These ports often share bandwidth (on motherboards that contain an M.2 connector, this shares bandwidth as well) which means that the 4x port can operate in either 4x mode or 1x mode. If none of the 1x ports are populated, it will operate in 4x mode, if any of the 1x ports are populated it will operate in 1x mode for a total of four 1x connections to the PCH.
So to run 8 GPU's you have to purchase a CPU that supports atleast 8 independent ports, not all CPU's that state having 16 PCIe channels work well with multiple independent configuration, mainly server and more expensive CPU's are the ones that are coded to properly work well with 8 independent channels communicating at one time..
So example... Intel i3 6100, its rated at 16 PCIe channels MAX, 1x16, 2x8, 1x8+2x4 So in theory the x16 slot can be broken into 3 independent channels, then all other ports used in 1x, but many motherboards share the bandwidth between the x8 slot and the x16 slot to save money, so you have to figure out what configuration the motherboard is wired firstly to correctly adjust the settings in the bios for it to run. The motherboards that dont share bandwidth allow you to run 3 x GPU's off the x16 slot in (4/4/4), then 2 additional off the x8 slot in (1/1), then utilize the rest x1 slots as singles.
Most fail to use them correctly, because they try to use CPU's with basic PCH control, which doesnt support anything more than 1 independent channel per port to communicate.
The other reason they fail to use them is the fact they have to view the video on the computer to see what they are doing, so they hook a monitor up to the computer, which depending on your GPU auto changes the port priority. Most AMD cards require minimal x4 to work correctly, while most modern Nvidia cards require x8 to work correctly. So they hook 8 GPU's to the computer, go to boot it up and the PCH auto mandates lets say x8 to the viewing GPU on bootup, what this does on the main x16 slot is forces it into (8/0/1) mode, so the video will show up but not all GPU's will show up on the system or the mobo will fail to boot because your demanding to many channels on a mode that has a null (0) channel. you have to setup the bios from remote access to properly setup 8+ GPU's on modern mobo's
this sounds very likely to be true. Might get a coouple of those to play with and give it a shot. Ya i have one on the way, because if i can get 8+ gpu's to run off 1 single mobo... that would cut my cost a lot.. i have ryzen in my main pc, which apparently skimped on pcie lanes.. so it seems none of the configurations would allow more than 6 on them, but some of the i5/i7 chips seem to have the ability of running 8+ if im understand what he is telling me correctly....
|
- GPUs Mining : 128 (Updated 3/7/18) // CPUs Mining : 19 (Updated 2/23/18)
|
|
|
QuintLeo
Legendary
Offline
Activity: 1498
Merit: 1030
|
|
June 07, 2017, 05:59:06 AM |
|
Quick question guys
Is it okay to mix up cards from different companies in one rig? got access to several 570 580s from local stores. ranging from XFX, saphire, gigabyte.. Wouldnt I encounter driver issue if I put all of them in one rig?
If they all factory clock the same, should be zero issue. If the factory clocks or "stock" TDP differ, they'll still work but you have to be extra careful to adjust them seperately to get optimal results. Stability should be the same as non-mixed if you run them at stock clocks or close.
|
I'm no longer legendary just in my own mind! Like something I said? Donations gratefully accepted. LYLnTKvLefz9izJFUvEGQEZzSkz34b3N6U (Litecoin) 1GYbjMTPdCuV7dci3iCUiaRrcNuaiQrVYY (Bitcoin)
|
|
|
kopija
|
|
June 07, 2017, 06:19:22 AM |
|
I have found
70% tdp +200 core -200 memory 75% fan
is good but not every cards likes the +200 core I have also found intensity of 24 in bat file is more stable
How does that 70% TDP translate to actual Watts? Please consult nvidia-smi or Nvidia Inspector. I am also interested in optimizing ccminer suite for best Sol/W. Thanks. Answer pretty please.
|
we are nothing but a smart contracts on a cosmic blockchain
|
|
|
Storx
|
|
June 07, 2017, 07:41:24 AM |
|
I have found
70% tdp +200 core -200 memory 75% fan
is good but not every cards likes the +200 core I have also found intensity of 24 in bat file is more stable
How does that 70% TDP translate to actual Watts? Please consult nvidia-smi or Nvidia Inspector. I am also interested in optimizing ccminer suite for best Sol/W. Thanks. Answer pretty please. so it all depends on which card you have, each GPU has a different watt value for TDP, so my MSI cards are 285watts rated for tdp, but my latest gigabyte cards are rated 255watts tdp... so look up the specs on your card.. so if your tdp is lets say 250 watts, then you take 250x0.70= actual wattage that it should be running at..
|
- GPUs Mining : 128 (Updated 3/7/18) // CPUs Mining : 19 (Updated 2/23/18)
|
|
|
flminer
|
|
June 07, 2017, 11:44:36 AM |
|
Phil, Which of these cards is the better in your opinion? ASUS ROG GeForce GTX 1080 Ti STRIX
MSI NVidia GeForce GTX 1080 Ti Gaming
|
|
|
|
NOLA
Newbie
Offline
Activity: 27
Merit: 0
|
|
June 07, 2017, 12:29:33 PM |
|
FedEX is out for delivery---wooohoooo.....looking forward to posting results this evening.
|
|
|
|
flminer
|
|
June 07, 2017, 12:33:33 PM |
|
FedEX is out for delivery---wooohoooo.....looking forward to posting results this evening.
Is always Christmas when deliveries on the way
|
|
|
|
KaydenC
|
|
June 07, 2017, 12:52:43 PM |
|
I pointed my 1080ti rigs to miningpoolhub. No auto switching just skein. My zpool stats got weird yesterday, showing only 1.3gh while it should be 5, hence the change.
Now runnng 5x 1080ti per rig, on a 1200W Evga P2 psu. 90% TDP, + 250 core, no change in mem, 950mhs on Skein per gpu.
|
|
|
|
Storx
|
|
June 07, 2017, 03:20:56 PM |
|
I pointed my 1080ti rigs to miningpoolhub. No auto switching just skein. My zpool stats got weird yesterday, showing only 1.3gh while it should be 5, hence the change.
Now runnng 5x 1080ti per rig, on a 1200W Evga P2 psu. 90% TDP, + 250 core, no change in mem, 950mhs on Skein per gpu.
kayden are you running all of this off a single power circuit? i tried to run a 2nd pc with 2 more 1080tis in my office (2nd bedroom) bringing me up to 4 total and it booted fine,,but as soon as the miner started the circuit breaker tripped for that circuit in my condo... so im thinking i need to run 3 card setups maybe also what wallet are you using with dgb coin payout at miningpoolhub since they dont autoconvert to btc, im still learning and want to possibly move if i can gain back the 20% earnings difference i see when calculating mining skein at the hashrate my cards perform at.....i currently use jaxx wallet and it doesnt support dgb coin wallets
|
- GPUs Mining : 128 (Updated 3/7/18) // CPUs Mining : 19 (Updated 2/23/18)
|
|
|
KaydenC
|
|
June 07, 2017, 03:28:44 PM |
|
I pointed my 1080ti rigs to miningpoolhub. No auto switching just skein. My zpool stats got weird yesterday, showing only 1.3gh while it should be 5, hence the change.
Now runnng 5x 1080ti per rig, on a 1200W Evga P2 psu. 90% TDP, + 250 core, no change in mem, 950mhs on Skein per gpu.
kayden are you running all of this off a single power circuit? i tried to run a 2nd pc with 2 more 1080tis in my office (2nd bedroom) bringing me up to 4 total and it booted fine,,but as soon as the miner started the circuit breaker tripped for that circuit in my condo... so im thinking i need to run 3 card setups maybe also what wallet are you using with dgb coin payout at miningpoolhub since they dont autoconvert to btc, im still learning and want to possibly move if i can gain back the 20% earnings difference i see when calculating mining skein at the hashrate my cards perform at.....i currently use jaxx wallet and it doesnt support dgb coin wallets My facility has 415v 40A 3 phrase, split to 3x single phrase circuits. Sufficient for 16000W. Im using btc autoconvert at miningpoolhub, it works for me. Not sure if there's any difference as I have not tested it.
|
|
|
|
zer0k
|
|
June 07, 2017, 03:56:21 PM |
|
I pointed my 1080ti rigs to miningpoolhub. No auto switching just skein. My zpool stats got weird yesterday, showing only 1.3gh while it should be 5, hence the change.
Now runnng 5x 1080ti per rig, on a 1200W Evga P2 psu. 90% TDP, + 250 core, no change in mem, 950mhs on Skein per gpu.
You are really pushing that PSU...have you measured it at the wall with a Kill-A-Watt? 5 x 1080ti @90% is going to be at least ~225W per card for a total of 1125W for just the cards alone Any feedback on MPH vs Zpool results?
|
|
|
|
philipma1957 (OP)
Legendary
Offline
Activity: 4158
Merit: 8042
'The right to privacy matters'
|
|
June 07, 2017, 03:57:31 PM |
|
I pointed my 1080ti rigs to miningpoolhub. No auto switching just skein. My zpool stats got weird yesterday, showing only 1.3gh while it should be 5, hence the change.
Now runnng 5x 1080ti per rig, on a 1200W Evga P2 psu. 90% TDP, + 250 core, no change in mem, 950mhs on Skein per gpu.
those settings should be tweaked 90% tdp = waste of money +250 core = good if nothing crashes 0 mem is okay but -100 to -500 save power with no effect on hash 900 to 1000 = pretty much what you can get. I would do 75% tdp +230 +240 + 250 core just to see what happens if you have 255tdp gpus your power supply is 5 x 255 x .9 = 1147 plus the mobo cpu etc
|
|
|
|
VyprBTC
|
|
June 07, 2017, 05:36:17 PM |
|
I pointed my 1080ti rigs to miningpoolhub. No auto switching just skein. My zpool stats got weird yesterday, showing only 1.3gh while it should be 5, hence the change.
Now runnng 5x 1080ti per rig, on a 1200W Evga P2 psu. 90% TDP, + 250 core, no change in mem, 950mhs on Skein per gpu.
those settings should be tweaked 90% tdp = waste of money +250 core = good if nothing crashes 0 mem is okay but -100 to -500 save power with no effect on hash 900 to 1000 = pretty much what you can get. I would do 75% tdp +230 +240 + 250 core just to see what happens if you have 255tdp gpus your power supply is 5 x 255 x .9 = 1147 plus the mobo cpu etc I definitely agree with Phil here - Also Phil - the 3 full length cards are not running that hot at all - I lowered TDP to 65% still getting 850 MH/s per card - temps a respectable 61°/64°/60°c and drawing 160-163w per card 5.4 MH/w
|
|
|
|
VoskCoin
|
|
June 07, 2017, 05:53:06 PM |
|
Going to get cracking on this 1080 TI build tomorrow !
|
|
|
|
VyprBTC
|
|
June 07, 2017, 05:56:39 PM |
|
Going to get cracking on this 1080 TI build tomorrow !
You just going to set the mobo on the birch? I was having issues with the 1080's being so heavy, they would lean to the side then the mobo would lose the connection with the GPU, had to secure the GPU so it wouldn't move or wiggle. That's the ONLY reason I'm in cases right now till I build a stabilizer bar for the GPUs
|
|
|
|
vg54dett
|
|
June 07, 2017, 06:50:45 PM |
|
@Phil
I'm about to receive my first Nvidia cards.
They are 4x Gigabyte GTX 1060 Windforce OC 3G
I don't remember, did you use them Phil ? (before you go for 1070/1080) Any suggest for settings? I would like to use a 750w PSU, and the mobo will be the asus z170 you sold me, with or without risers
|
|
|
|
flminer
|
|
June 07, 2017, 07:49:12 PM |
|
Going to switch to SSD. Any suggestions on which ones to use and the connectors for them?
|
|
|
|
DebitMe
Legendary
Offline
Activity: 2786
Merit: 1011
Get Paid Crypto To Walk or Drive
|
|
June 07, 2017, 09:10:46 PM |
|
Going to switch to SSD. Any suggestions on which ones to use and the connectors for them?
I have had a few different ones, they all seem about equal more or less. Kingston is always a good bet, but a little more expensive normally. I would just go for value over brand.
|
|
|
|
|