Data Center Mining Garage and Man Mining Cave ( PART 2 !!!!!!!!)

[Marvell1]

whats hawkfishes website and does he have pictures

[hawkfish007]

whats hawkfishes website and does he have pictures

I don't have a website, but my risers are on sale both on Amazon and eBay. I sell direct here too, payment through PayPal or btc, zec or eth. My fans are not on eBay yet, they are similar in specifications of scythe fans but built with double ball bearings for durability. Fans are $9.50 each plus shipping.  I will post picture of the small PCI-E piece later tonight. They are $1.50 each and can potentially save risers from being thrown away. Link to my Amazon listings is in my signature below. 6-pin risers will be available in a few days on Amazon but I have more in stock at home for immediate shipping.

Edit: pic of small PCI-E piece in stock.

[yun9999]

Biostar became available on NewEgg so I quickly grab 10.  =)








Also looking at plan B, so I ordered a few Gigabyte MB.  These support 6 GPUs no issues but they are a pain in the butt at time with the multiple flashing of ON/OFF, when there's any changes.








ROM Station with Pico and HP PSU.








One of the Viewer recommended this ThermalTake case so I ordered to play with it.  It's may for Micro ATX not ATX motherboard that we use so it won't fit like you expected.  Since I hate doing return, I just have to do some creative changes and use it sideways vs front to back like it's intended to be used.   Unfortunately the max you can probably fit in here is 5 GPU.  This is a very small case.

[deadsix]

Biostar became available on NewEgg so I quickly grab 10.  =)

So YOU are the reason Newegg put a limit of 1 per customer on this board

Also looking at plan B, so I ordered a few Gigabyte MB.  These support 6 GPUs no issues but they are a pain in the butt at time with the multiple flashing of ON/OFF, when there's any changes.

Why Gigabyte? Isnt the MSI Gaming 5 a much better board?

[CryptoWatcher420]

Biostar became available on NewEgg so I quickly grab 10.  =)

So YOU are the reason Newegg put a limit of 1 per customer on this board

Also looking at plan B, so I ordered a few Gigabyte MB.  These support 6 GPUs no issues but they are a pain in the butt at time with the multiple flashing of ON/OFF, when there's any changes.

Why Gigabyte? Isnt the MSI Gaming 5 a much better board?

Ha no wonder why there always out of motherboards lol

[yun9999]

I only bought 10.  Yslyung emptied the Global supply of TB85.  =)  Regarding why Gigabyte over Gaming 5?  Desparation.  They were on sale for $89.99 refurb, they are not a good replacement as they only have 6 PCIE, the 7th slot is PCI.  It's a problematic board buying refurb.  I only have 3 out of 6 working well but even those can be flashing on and off when you make any changes to PCIE connections.  Very annoying.

[construktor]

@ecohash @Marvell1 @yslyung

Regarding Gigabyte 470 4GB G1's just wanted to share some info on my experience - I had a similar issue with heat rising around 75-80c. After testing a few different settings and setups, I realized the issue in my case stemmed from having the cards in a case.

If the card was blowing up hot air against a card just under it, it would cause the top card to get hot, while the bottom card kept normal temps. Open air solved the heat issue and they run at around 62c now,

[stoon]

@yun9999 or anyone else with the Sapphire Fury cards.

I have 15 of them with all the same settings (-96mv) 900/400 15.12 driver and the last one I bought won't under-volt in Windows 10. Has anyone else ever experienced this before?
This is what I have tried;
moved it to a different rig with 5 other Fury's and it will run Optiminer but Claymore will return a error saying the GPU returned incorrect data.
moved it back to the new rig with 3 other Furys and it will crash the driver in about 30 seconds of mining with Optiminer
   reinstalled windows and new drivers - same
   installed 16.3.2 drivers - same
   UEFI Bios and standard - same
moved it to a independent computer, ran graphic benchmarks on default settings and no errors - but when I under-volt it, crashes the computer.

Every setup has more than enough power overhead, running TB 85 or H81 boards - except the independent PC (supermicro server)

I purchased it at Newegg but to send it back, I believe they would test it and it would pass there tests because how many gamers really under-volt that much.

Any suggestions

[jstefanop]

@ jstefanop - I believe the setup is using server CPU and other things that may make the setup a bit pricey?  I was excited about the config but the lack of info is making me lose interest, time to keep building rigs the normal way and MAKE SOME Money.................   I'm never a fan of constant teasers, I prefer the FULL SHOW.  =)

Nope...skylake/kabylake pentium or i3 work just fine (my dev setup uses an i3 since double the threads is worth it when driving 16 GPUs....but I realized that CPU utilization even for 16 GPUs is so low that a pentium will probably work just fine as well. I will test this week). The motherboard IS a server based board with 1151 socket, but since I will buy these in bulk for this project it will cost less than a typical 6-7 GPU board you guys are using.

Sorry for the lack of info but I deliver what I promise (guys that bought my scrypt USB ASIC miner can vouch on that), so I don't like announcing things early since I'm still in the middle of vetting out the hardware.

What I can promise right now is that this solution will definitely be cheaper in total supporting component costs per GPU with the typical 6-7 GPU setup right now.

[CryptoWatcher420]

@ jstefanop - I believe the setup is using server CPU and other things that may make the setup a bit pricey?  I was excited about the config but the lack of info is making me lose interest, time to keep building rigs the normal way and MAKE SOME Money.................   I'm never a fan of constant teasers, I prefer the FULL SHOW.  =)

Nope...skylake/kabylake pentium or i3 work just fine (my dev setup uses an i3 since double the threads is worth it when driving 16 GPUs....but I realized that CPU utilization even for 16 GPUs is so low that a pentium will probably work just fine as well. I will test this week). The motherboard IS a server based board with 1151 socket, but since I will buy these in bulk for this project it will cost less than a typical 6-7 GPU board you guys are using.

Sorry for the lack of info but I deliver what I promise (guys that bought my scrypt USB ASIC miner can vouch on that), so I don't like announcing things early since I'm still in the middle of vetting out the hardware.

What I can promise right now is that this solution will definitely be cheaper in total supporting component costs per GPU with the typical 6-7 GPU setup right now.

so what your saying your going to be offering the motherboard for around 70 to 80 dollars? if not its hardly worth it. your still vetting out hardware so to say it will be cheaper in total supporting component costs per gpu is a bit premature. tbh I doubt this setup will be cheaper than compared to a typical 6 to 7 gpu setup not to mention your playin to a niche market and not everyone in that market will see that as viable, I see more points of failure being added etc, thats what I look at. but all in all I guess we all will find out

my question is what happens when you cant deliver on this promise your making that it will be cheaper and it turns out its not, you going to take a hit? doubt it lolz

[kilo17]

Here is some info on doing multi GPU (8+) setups.  It has some great insight into what all is needed.  gstoner on the link is a Senior Director at AMD and is full of knowledge about this type of set up.

https://community.amd.com/thread/197524

this thread was started by jstefanop himself

[deadsix]

What I can promise right now is that this solution will definitely be cheaper in total supporting component costs per GPU with the typical 6-7 GPU setup right now.

Cant wait man, may the hash-force guide you.

What I can promise right now is that this solution will definitely be cheaper in total supporting component costs per GPU with the typical 6-7 GPU setup right now.

so what your saying your going to be offering the motherboard for around 70 to 80 dollars? if not its hardly worth it. your still vetting out hardware so to say it will be cheaper in total supporting component costs per gpu is a bit premature. tbh I doubt this setup will be cheaper than compared to a typical 6 to 7 gpu setup not to mention your playin to a niche market and not everyone in that market will see that as viable, I see more points of failure being added etc, thats what I look at. but all in all I guess we all will find out

my question is what happens when you cant deliver on this promise your making that it will be cheaper and it turns out its not, you going to take a hit? doubt it lolz

Why are you so negative man? Did jstenfanop take money from you for doing this project? Did anyone ask him to develop such a solution? He is doing this out of his own free will and he has invested a significant amount of time and effort into it, if you can not appreciate it at-least don't take a piss on someone else just for the heck of it. And what do you mean "What if you cant deliver" he doesn't owe you jack shit, so stop feeling so entitled.
Let him complete what he is working on and deliver, and if people see value in it, which im sure they would unless they are blind, they would buy it. You on the other hand can completely avoid it and trust me no one would hold it against you. But don't be such a killjoy.

Here is some info on doing multi GPU (8+) setups.  It has some great insight into what all is needed.  gstoner on the link is a Senior Director at AMD and is full of knowledge about this type of set up.
https://community.amd.com/thread/197524
this thread was started by jstefanop himself

Ooo so here we see the genesis of the very idea. Thank you for sharing this kilo, now lets hope it becomes a reality.

[mcturkey]

so what your saying your going to be offering the motherboard for around 70 to 80 dollars? if not its hardly worth it. your still vetting out hardware so to say it will be cheaper in total supporting component costs per gpu is a bit premature. tbh I doubt this setup will be cheaper than compared to a typical 6 to 7 gpu setup not to mention your playin to a niche market and not everyone in that market will see that as viable, I see more points of failure being added etc, thats what I look at. but all in all I guess we all will find out

my question is what happens when you cant deliver on this promise your making that it will be cheaper and it turns out its not, you going to take a hit? doubt it lolz

That's not what he was saying, though...

Using the typical 6-GPU setup, the motherboard ($80), CPU ($40), RAM ($30), OS drive ($20), and risers ($50) add up to $220 (may be more or less depending on sales and availability, but this is about as low as you're going to go most of the time while using a free OS).  Divide that by 6, and you have a per-GPU cost of $36.67.  I'm not considering power supplies, because you'll need almost the same amount of power for either of these options, though needing only one ATX connection would further reduce costs.  I'm also not considering the labor cost of setting up 3 systems with risers vs 1 system without risers.

For the 16-GPU board to be viable, the cost of the board, CPU, RAM, and OS drive combined must be less per GPU than $36.67.  That means about $586, minus CPU, RAM, and OS drive (let's say ~$90 for those items).  At around $500, this board would be comparable if you're using 3 consumer PSUs.  If you're using one of the 4K + PICO PSU configurations, the board is comparable at $550-$600.  If you are using a paid OS, you're saving 2x the cost of that, as well, so potentially $700-$800.  Personally, I think the time and troubleshooting savings of not dealing with risers, and their myriad potential points of failure, is probably worth another $200 itself for bigger farmers.

I would be shocked to see a custom 16-GPU solution like this at $500, but even double that would probably have a good market among folks like OP.

[CryptoWatcher420]

so what your saying your going to be offering the motherboard for around 70 to 80 dollars? if not its hardly worth it. your still vetting out hardware so to say it will be cheaper in total supporting component costs per gpu is a bit premature. tbh I doubt this setup will be cheaper than compared to a typical 6 to 7 gpu setup not to mention your playin to a niche market and not everyone in that market will see that as viable, I see more points of failure being added etc, thats what I look at. but all in all I guess we all will find out

my question is what happens when you cant deliver on this promise your making that it will be cheaper and it turns out its not, you going to take a hit? doubt it lolz

That's not what he was saying, though...

Using the typical 6-GPU setup, the motherboard ($80), CPU ($40), RAM ($30), OS drive ($20), and risers ($50) add up to $220 (may be more or less depending on sales and availability, but this is about as low as you're going to go most of the time while using a free OS).  Divide that by 6, and you have a per-GPU cost of $36.67.  I'm not considering power supplies, because you'll need almost the same amount of power for either of these options, though needing only one ATX connection would further reduce costs.  I'm also not considering the labor cost of setting up 3 systems with risers vs 1 system without risers.

For the 16-GPU board to be viable, the cost of the board, CPU, RAM, and OS drive combined must be less per GPU than $36.67.  That means about $586, minus CPU, RAM, and OS drive (let's say ~$90 for those items).  At around $500, this board would be comparable if you're using 3 consumer PSUs.  If you're using one of the 4K + PICO PSU configurations, the board is comparable at $550-$600.  If you are using a paid OS, you're saving 2x the cost of that, as well, so potentially $700-$800.  Personally, I think the time and troubleshooting savings of not dealing with risers, and their myriad potential points of failure, is probably worth another $200 itself for bigger farmers.

I would be shocked to see a custom 16-GPU solution like this at $500, but even double that would probably have a good market among folks like OP.

I don't see OP even touching that, doubt you would see it for $500 and honestly with the setup having so many gpu's it just brings up a whole different set of failure points, as some have mentioned before. what if one gpu fails it could affect the whole rig and that could end up being costly, gpu's down is money lost. what about trouble shooting to figure out which one has failed, that wont be an easy task.

[jstefanop]

so what your saying your going to be offering the motherboard for around 70 to 80 dollars? if not its hardly worth it. your still vetting out hardware so to say it will be cheaper in total supporting component costs per gpu is a bit premature. tbh I doubt this setup will be cheaper than compared to a typical 6 to 7 gpu setup not to mention your playin to a niche market and not everyone in that market will see that as viable, I see more points of failure being added etc, thats what I look at. but all in all I guess we all will find out

my question is what happens when you cant deliver on this promise your making that it will be cheaper and it turns out its not, you going to take a hit? doubt it lolz

That's not what he was saying, though...

Using the typical 6-GPU setup, the motherboard ($80), CPU ($40), RAM ($30), OS drive ($20), and risers ($50) add up to $220 (may be more or less depending on sales and availability, but this is about as low as you're going to go most of the time while using a free OS).  Divide that by 6, and you have a per-GPU cost of $36.67.  I'm not considering power supplies, because you'll need almost the same amount of power for either of these options, though needing only one ATX connection would further reduce costs.  I'm also not considering the labor cost of setting up 3 systems with risers vs 1 system without risers.

For the 16-GPU board to be viable, the cost of the board, CPU, RAM, and OS drive combined must be less per GPU than $36.67.  That means about $586, minus CPU, RAM, and OS drive (let's say ~$90 for those items).  At around $500, this board would be comparable if you're using 3 consumer PSUs.  If you're using one of the 4K + PICO PSU configurations, the board is comparable at $550-$600.  If you are using a paid OS, you're saving 2x the cost of that, as well, so potentially $700-$800.  Personally, I think the time and troubleshooting savings of not dealing with risers, and their myriad potential points of failure, is probably worth another $200 itself for bigger farmers.

I would be shocked to see a custom 16-GPU solution like this at $500, but even double that would probably have a good market among folks like OP.

I don't see OP even touching that, doubt you would see it for $500 and honestly with the setup having so many gpu's it just brings up a whole different set of failure points, as some have mentioned before. what if one gpu fails it could affect the whole rig and that could end up being costly, gpu's down is money lost. what about trouble shooting to figure out which one has failed, that wont be an easy task.

Setup is built around a 8 GPUs per daughterboard(the actual board I'm building). Two of my boards are connected to the mainboard (~$150). My current estimates are around 150 per board..so 300+100 = $450...I guess my estimate price is a bit too low for you then  huh The current board I'm testing can physically connect a total of 18 GPUs since it has two extra PCIE slots...youll will just need risers for that last two (there is a possibility a future BIOS update I could make it to post with 3 or even 4 of my boards for a total of 32 GPUs, but I'm just working on 16 for now...plus I would need to work closely with miner devs for anything more than 16...I have slowly hinted them improvements which they have already implemented for multi GPU setups in the past year).

Also the board has status LEDs per GPU lane...if a GPU goes down you'll know right away which one it is, and yes if one GPU crashes the board will still work. This is no different than any other mutigpu setup, other than it having just more GPU lanes. Your doing something wrong if one GPU crash brings down your whole system.

Keep in mind that this price is mostly dependent on the quantities I can order for parts on the first batch. Obviously more boards = less price per board. I am also pretty much charging the cost of components + a small profit margin for me. The design + dev + testing + prototyping etc is all done by me so thats why I can price it so low.

[MikeBuzz]

so what your saying your going to be offering the motherboard for around 70 to 80 dollars? if not its hardly worth it. your still vetting out hardware so to say it will be cheaper in total supporting component costs per gpu is a bit premature. tbh I doubt this setup will be cheaper than compared to a typical 6 to 7 gpu setup not to mention your playin to a niche market and not everyone in that market will see that as viable, I see more points of failure being added etc, thats what I look at. but all in all I guess we all will find out

my question is what happens when you cant deliver on this promise your making that it will be cheaper and it turns out its not, you going to take a hit? doubt it lolz

That's not what he was saying, though...

Using the typical 6-GPU setup, the motherboard ($80), CPU ($40), RAM ($30), OS drive ($20), and risers ($50) add up to $220 (may be more or less depending on sales and availability, but this is about as low as you're going to go most of the time while using a free OS).  Divide that by 6, and you have a per-GPU cost of $36.67.  I'm not considering power supplies, because you'll need almost the same amount of power for either of these options, though needing only one ATX connection would further reduce costs.  I'm also not considering the labor cost of setting up 3 systems with risers vs 1 system without risers.

For the 16-GPU board to be viable, the cost of the board, CPU, RAM, and OS drive combined must be less per GPU than $36.67.  That means about $586, minus CPU, RAM, and OS drive (let's say ~$90 for those items).  At around $500, this board would be comparable if you're using 3 consumer PSUs.  If you're using one of the 4K + PICO PSU configurations, the board is comparable at $550-$600.  If you are using a paid OS, you're saving 2x the cost of that, as well, so potentially $700-$800.  Personally, I think the time and troubleshooting savings of not dealing with risers, and their myriad potential points of failure, is probably worth another $200 itself for bigger farmers.

I would be shocked to see a custom 16-GPU solution like this at $500, but even double that would probably have a good market among folks like OP.

I don't see OP even touching that, doubt you would see it for $500 and honestly with the setup having so many gpu's it just brings up a whole different set of failure points, as some have mentioned before. what if one gpu fails it could affect the whole rig and that could end up being costly, gpu's down is money lost. what about trouble shooting to figure out which one has failed, that wont be an easy task.

Setup is built around a 8 GPUs per daughterboard(the actual board I'm building). Two of my boards are connected to the mainboard (~$150). My current estimates are around 150 per board..so 300+100 = $450...I guess my estimate price is a bit too low for you then  huh The current board I'm testing can physically connect a total of 18 GPUs since it has two extra PCIE slots...youll will just need risers for that last two (there is a possibility a future BIOS update I could make it to post with 3 or even 4 of my boards for a total of 32 GPUs, but I'm just working on 16 for now...plus I would need to work closely with miner devs for anything more than 16...I have slowly hinted them improvements which they have already implemented for multi GPU setups in the past year).

Also the board has status LEDs per GPU lane...if a GPU goes down you'll know right away which one it is, and yes if one GPU crashes the board will still work. This is no different than any other mutigpu setup, other than it having just more GPU lanes. Your doing something wrong if one GPU crash brings down your whole system.

Keep in mind that this price is mostly dependent on the quantities I can order for parts on the first batch. Obviously more boards = less price per board. I am also pretty much charging the cost of components + a small profit margin for me. The design + dev + testing + prototyping etc is all done by me so thats why I can price it so low.

Take my money now!

Any idea when you will be ready for pre orders?

[acostaja]

[...]

Setup is built around a 8 GPUs per daughterboard(the actual board I'm building). Two of my boards are connected to the mainboard (~$150). My current estimates are around 150 per board..so 300+100 = $450...I guess my estimate price is a bit too low for you then  huh The current board I'm testing can physically connect a total of 18 GPUs since it has two extra PCIE slots...youll will just need risers for that last two (there is a possibility a future BIOS update I could make it to post with 3 or even 4 of my boards for a total of 32 GPUs, but I'm just working on 16 for now...plus I would need to work closely with miner devs for anything more than 16...I have slowly hinted them improvements which they have already implemented for multi GPU setups in the past year).

Also the board has status LEDs per GPU lane...if a GPU goes down you'll know right away which one it is, and yes if one GPU crashes the board will still work. This is no different than any other mutigpu setup, other than it having just more GPU lanes. Your doing something wrong if one GPU crash brings down your whole system.

Keep in mind that this price is mostly dependent on the quantities I can order for parts on the first batch. Obviously more boards = less price per board. I am also pretty much charging the cost of components + a small profit margin for me. The design + dev + testing + prototyping etc is all done by me so thats why I can price it so low.

I could find someone interested on 300 of these switches, or maybe a revision since we are on the same R&D line we have some ideas about the switch-gpu link (the cable) our biggest issue to date, but we are faraway from have it ready. now working on other support H/W as Rig Resseter (with ESP8266/Relay modules) and our custom PSU breakout since none in the market satisfy us, even today we considered to integrate the ESP8266 with the PSU breakout thus having an integral Rig Manager, this is not rocket-science compared with the Switches.

[yun9999]

A motherboard config that is riser free and have a GPU Fault LED / sensor?  Plus it's competitively priced against normal config?  Hmm, now I'm interested again.  Haaha

[hawkfish007]

Here is some info on doing multi GPU (8+) setups.  It has some great insight into what all is needed.  gstoner on the link is a Senior Director at AMD and is full of knowledge about this type of set up.

https://community.amd.com/thread/197524

this thread was started by jstefanop himself

Nice link Keith, looks like AMD has a working MB with 16 S9150 made by Cirascale. But damn, those GPUs seem too close.

[deadsix]

Setup is built around a 8 GPUs per daughterboard(the actual board I'm building). Two of my boards are connected to the mainboard (~$150). My current estimates are around 150 per board..so 300+100 = $450...I guess my estimate price is a bit too low for you then  huh The current board I'm testing can physically connect a total of 18 GPUs since it has two extra PCIE slots...youll will just need risers for that last two (there is a possibility a future BIOS update I could make it to post with 3 or even 4 of my boards for a total of 32 GPUs, but I'm just working on 16 for now...plus I would need to work closely with miner devs for anything more than 16...I have slowly hinted them improvements which they have already implemented for multi GPU setups in the past year).
Also the board has status LEDs per GPU lane...if a GPU goes down you'll know right away which one it is, and yes if one GPU crashes the board will still work. This is no different than any other mutigpu setup, other than it having just more GPU lanes. Your doing something wrong if one GPU crash brings down your whole system.
Keep in mind that this price is mostly dependent on the quantities I can order for parts on the first batch. Obviously more boards = less price per board. I am also pretty much charging the cost of components + a small profit margin for me. The design + dev + testing + prototyping etc is all done by me so thats why I can price it so low.

Hey Man, could you share some pics, even a sketchup that would tell us about the size/layout of the daughter boards and the motherboards? I'm asking because it would give us a head start on building cases/frames for these boards.