Juggar
Member
Offline
Activity: 242
Merit: 11
|
|
February 07, 2018, 11:29:34 PM |
|
I went and found the $230 one on my own with only the TDP information you provided. God damn lol that googlefu. Its a blade so it cant run standalone.... youd have to buy an enclosure as well, so thats going to put a LOT of people off.
|
|
|
|
senseless
|
|
February 07, 2018, 11:32:58 PM |
|
I went and found the $230 one on my own with only the TDP information you provided. God damn lol that googlefu.
Ya, i was tossed on it because it's a blade as well. But, at that price... I'm more in need of systems with PCIE 3.0 slots. But, if I had 5MW of power I didn't know what to do with...
|
|
|
|
jakkwb
Newbie
Offline
Activity: 29
Merit: 1
|
|
February 08, 2018, 08:47:43 PM |
|
I got my $150 server up to 660hr, but at 300w....gonna see if I can fit a GPU in it.
|
|
|
|
jakkwb
Newbie
Offline
Activity: 29
Merit: 1
|
|
February 09, 2018, 10:56:11 PM |
|
Not very efficient. Oh well, it was a fun experiment.
|
|
|
|
tadeus1
Member
Offline
Activity: 140
Merit: 11
|
|
February 10, 2018, 12:09:12 AM |
|
Its probably worth it only if you have PCIE slots and put few GPUS in parallel in the same machine. As a supplemental mining
|
|
|
|
sundownz (OP)
|
|
February 10, 2018, 08:46:43 PM |
|
MY LATEST UPDATE: Got my new electrical panel all installed -- the electricians did an awesome job on it. So far I have 12 of the Dell R815 servers running... 24 more of those to go & alot of cable organization on the back side (haha). Then I will be putting together as many additional HP Z400s as I have GPUs for right now... B&H cancelled almost my entire back-order of 1080Tis from December when the cards finally came into stock last week so that has left me a bit shy on cards that I planned for (they delivered 2 out of 18 pcs... after 5 weeks of waiting). I should be able to get another ~18 systems online, though, with the cards I stocked up on in November / December.
|
|
|
|
PharmEcis
Jr. Member
Offline
Activity: 176
Merit: 1
|
|
February 11, 2018, 10:15:59 PM |
|
3 phase power?
Were you able to pickup that pallet of z400s?
|
|
|
|
ZenMonke
Newbie
Offline
Activity: 21
Merit: 0
|
|
February 11, 2018, 10:24:25 PM |
|
Then I will be putting together as many additional HP Z400s as I have GPUs for right now... B&H cancelled almost my entire back-order of 1080Tis from December when the cards finally came into stock last week so that has left me a bit shy on cards that I planned for (they delivered 2 out of 18 pcs... after 5 weeks of waiting). I should be able to get another ~18 systems online, though, with the cards I stocked up on in November / December.
Any idea why B&H cancelled your back order?
|
|
|
|
PharmEcis
Jr. Member
Offline
Activity: 176
Merit: 1
|
|
February 11, 2018, 10:26:43 PM |
|
Any idea why B&H cancelled your back order?
The inability to stomach a loss, aka greed.
|
|
|
|
sundownz (OP)
|
|
February 12, 2018, 01:21:14 AM |
|
Then I will be putting together as many additional HP Z400s as I have GPUs for right now... B&H cancelled almost my entire back-order of 1080Tis from December when the cards finally came into stock last week so that has left me a bit shy on cards that I planned for (they delivered 2 out of 18 pcs... after 5 weeks of waiting). I should be able to get another ~18 systems online, though, with the cards I stocked up on in November / December.
Any idea why B&H cancelled your back order? They made a lot of claims... such as MSI cancelling part of their order, MSI making the limits, etc, etc. IMHO it's all BS... and they didn't want to give me the price.
|
|
|
|
sundownz (OP)
|
|
February 12, 2018, 01:21:59 AM |
|
3 phase power?
Were you able to pickup that pallet of z400s?
I didn't end up going after it as I can't get enough GPUs to justify it. Just been snapping up the cheapest Z400s on e-bay. But yes it is 3-phase 240v coming in broken out to 120v circuits.
|
|
|
|
nsummy
|
|
February 12, 2018, 02:24:49 AM |
|
MY LATEST UPDATE: Got my new electrical panel all installed -- the electricians did an awesome job on it. So far I have 12 of the Dell R815 servers running... 24 more of those to go & alot of cable organization on the back side (haha). Then I will be putting together as many additional HP Z400s as I have GPUs for right now... B&H cancelled almost my entire back-order of 1080Tis from December when the cards finally came into stock last week so that has left me a bit shy on cards that I planned for (they delivered 2 out of 18 pcs... after 5 weeks of waiting). I should be able to get another ~18 systems online, though, with the cards I stocked up on in November / December. I'm installing a main lug in my basement to bring in 240v for my antminer a3. I just popped open my main breaker for the first time and I can say without a doubt I wish the electrician who did the initial wiring would have made it as organized as yours did hahaha. Also, why are you using shelving instead of racks? Seems like some racks and pdus would take up much less room.
|
|
|
|
PharmEcis
Jr. Member
Offline
Activity: 176
Merit: 1
|
|
February 12, 2018, 02:39:21 AM |
|
I didn't end up going after it as I can't get enough GPUs to justify it. Just been snapping up the cheapest Z400s on e-bay.
But yes it is 3-phase 240v coming in broken out to 120v circuits.
I think the entire pallet went for like $4,300 or so which is like $123 per unit and you don't know condition so probably not worth it anyways. May I ask why only 120v circuits? If you are deploying new, why didn't you run 240v circuits to the machines for higher density with lower amp draw? From what I can see, it looks like you had them add a 200a panel but then put in like 30 20a circuits with six of them being tandem (cheater) breakers. That's a total possible draw of 720a breaker wise but only in a 200a panel? I've been deploying 20a 240v circuits and I terminate them with 2 15a 120v (each outlet getting a separate hot from the 240v circuit) and one L6-20R 20a 240v receptacles. I then plug in a 16a 240v PDU that then powers all the big iron at 240v and allows me to have misc 120v items powered through the same circuit but through the 120v receptacles. If you are pulling 800w on the servers in yescrypt, at 120v that's getting close to 7a. Technically that means 2 servers per breaker if you want to stay around 80% of line limit as 3 servers at full tilt should technically just about trip the breaker. If it was 240, you could technically be powering 5 servers per breaker and be just over 80% load on the 20a circuit. I'm sure you know all this, just curious as to the rationale behind the decision. If you ever get a chance to respond to my PM, it would be appreciated! Obviously you've been busy!
|
|
|
|
PharmEcis
Jr. Member
Offline
Activity: 176
Merit: 1
|
|
February 12, 2018, 02:41:06 AM |
|
I'm installing a main lug in my basement to bring in 240v for my antminer a3. I just popped open my main breaker for the first time and I can say without a doubt I wish the electrician who did the initial wiring would have made it as organized as yours did hahaha.
Also, why are you using shelving instead of racks? Seems like some racks and pdus would take up much less room.
Probably cost. From the looks of the pictures, he has lots and lots of empty space in his warehouse. Those shelving units are probably around $100 a piece or so. Way cheaper than even used racks. I'm using similar racks because I had a ton of them from my prior business.
|
|
|
|
senseless
|
|
February 12, 2018, 03:44:52 AM |
|
I'm installing a main lug in my basement to bring in 240v for my antminer a3. I just popped open my main breaker for the first time and I can say without a doubt I wish the electrician who did the initial wiring would have made it as organized as yours did hahaha.
Also, why are you using shelving instead of racks? Seems like some racks and pdus would take up much less room.
Probably cost. From the looks of the pictures, he has lots and lots of empty space in his warehouse. Those shelving units are probably around $100 a piece or so. Way cheaper than even used racks. I'm using similar racks because I had a ton of them from my prior business. You can get 42U frames on ebay for $100. I'm going that route.
|
|
|
|
FallNAngel
Newbie
Offline
Activity: 7
Merit: 0
|
|
February 13, 2018, 10:59:34 PM |
|
I'm installing a main lug in my basement to bring in 240v for my antminer a3. I just popped open my main breaker for the first time and I can say without a doubt I wish the electrician who did the initial wiring would have made it as organized as yours did hahaha.
Also, why are you using shelving instead of racks? Seems like some racks and pdus would take up much less room.
Probably cost. From the looks of the pictures, he has lots and lots of empty space in his warehouse. Those shelving units are probably around $100 a piece or so. Way cheaper than even used racks. I'm using similar racks because I had a ton of them from my prior business. You can get 42U frames on ebay for $100. I'm going that route. Keep in mind though, you'll need rack mount kits for those servers. If the servers don't come with them, you won't be able to drop the servers into the rack.
|
|
|
|
Firefox Italy
Jr. Member
Offline
Activity: 198
Merit: 1
|
|
February 13, 2018, 11:46:26 PM |
|
Awesome job... Just one question.. Do you have air conditioning in this place? I think I will be necessary. The wood panels do not help..
|
|
|
|
zabidin2
Newbie
Offline
Activity: 20
Merit: 0
|
|
February 14, 2018, 12:08:15 AM |
|
Putting server in rack will safe space. So you can adding more server. Is it loud if you running cpuminer software with full load (mean use all threads available)? I'm trying cpu miner on supermicro. Lucky they have setting low speed fan so i can use all threads on each core in server. Right now test with 2 x Xeon E5-2683 v4.
|
|
|
|
PharmEcis
Jr. Member
Offline
Activity: 176
Merit: 1
|
|
February 18, 2018, 08:26:20 PM |
|
Have 2 HP Proliant DL385 G7's everything is working perfect except I cannot for the life of my figure out have to get them to connect to the network. Lan or Wan just trying to run an OS from a thumbdrive to mine with the CPU's no luck with anything Ubuntu or any of the standard ones. Been through every bios setting, anyone have any idea why I can not get this thing on the network, I am sure it is something simple and stupid, have years of experience with computer, linux and trouble shooting but right now I am out of ideas. Any help is appreciated.
Are you plugged into the iLo port or an actual network port? If you noticed there are FIVE Ethernet jacks on the back of the server. iLo port is also Ethernet but it will not get you on the network. It is access to the subsystem that runs before the server actually boots an OS which gives you full control for monitoring, remote deployment etc. Looking from the back, you should be plugged into the furthest network jack to the right, labeled #1. Also, that box is going to pull more wattage than produce hash. Only 61xx series Opterons with no AES in that box.
|
|
|
|
PharmEcis
Jr. Member
Offline
Activity: 176
Merit: 1
|
|
February 18, 2018, 11:23:06 PM |
|
After killing myself for the last 24 hours troubleshooting 2 r815's I picked up, I have learned a thing or two. If the cover is not on the box, it will not produce full power. Board will limit CPU power evident by power drawn at plug and performance in hash. I chased my tail for quite a bit yesterday and today until I figured it out. I got the servers Friday and only had enough memory on hand to get 2 cpu's running in one box. I saw appropriate hash numbers on it. Since I got 2 different speed CPUs for testings on the boxes, I tried the other set in dual mode and also saw the appropriate numbers. I then noticed the 50 memory sticks I ordered had arrived yesterday afternoon and rushed to get the boxes fully up and running. Since I had so many issues with memory population with the 1GB UDIMMS and even various 2GB RDIMMS I have, I had left the covers off and then could not figure out WhyTF in 4 cpu configs, I was down on power by 500H/s. They are also very picky about the memory that goes in them. Memory that works fine on other boxes comes up as failures on the r815s. You must populate 16 DIMM slots. If they aren't all the same size, you will have an annoying F1 key to push everything the box boots, I have not found a way around that yet. The box will boot with 8 sticks but multiple threads will not have hwloc bind memory so performance will be garbage. You will also get a slightly higher hash rate (100H/s or so) by disabling the gui and running from CLI only. These things run great off 16GB usb flash drives. le sigh...
|
|
|
|
|