AMD Opteron 6378 4x, total 64 cores hash?

[pulec777]

Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

[1715183722]

1715183722

[1715183722]

1715183722

[1715183722]

1715183722

[1715183722]

1715183722

[1715183722]

1715183722

[BartoszN1990]

good question .. the pend with mobo u use etc . did this is worth ? build for monero

[pulec777]

good question .. the pend with mobo u use etc . did this is worth ? build for monero

Yes exactly what I thought the price is quite reasonable and the 64 cores is not a few, and these versions of Opteron are pretty good.

[sirslayer]

2x 6174 opterton does 260hs @ 24 cores.  i was curious if i upgrade to 6276 x2=32 cores  would be better??

[Termie]

260h per core or overall?

[sirslayer]

260hs using all 24 cores

[Xeon_Xeon]

The opteron 6276's are expensive.

[sirslayer]

$29 usd is expensive??  well its used!!

http://www.ebay.com/itm/AMD-Opteron-6276-2-3GHz-Sixteen-Core-OS6276WKTGGGUWOF-Processor-/282333934278?_trksid=p2385738.m2548.l4275

[kolap]

Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

It's not worth it, I have a ton of 2x16core opteron which is 32 core or 32 threads hashing zcash at 15h/s compare to a rx480 at 290h/s. Monero is not much different.

[Xeon_Xeon]

$29 usd is expensive??  well its used!!

http://www.ebay.com/itm/AMD-Opteron-6276-2-3GHz-Sixteen-Core-OS6276WKTGGGUWOF-Processor-/282333934278?_trksid=p2385738.m2548.l4275

I did not see that one, I did a quick search on ebay and the first few that popped up were way more than that.

And there are a few cheap 4 cpu mobo's on ebay, tho all with non pc power connections.

[evultrole]

I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

I didn't bother with any tweaks (other than huge pages and ulimit increase), I just run xmr-stak-cpu with config as full power on every odd core, then a low power thread on the 2nd, 10th, 18th, etc.

The 6100 line lacks hardware AES, which is why you got such garbage rates (that and 24 threads would have choked the CPU cache, those CPUs probably cap out at 5 threads each and drop after that). Four of the cheap 6276 from ebay would probably get around 1500 H/s in any recent linux or 1250 H/s in Windows server 2016.

[sirslayer]

i did a 32 core xeon cpu and 4 nvidia tesla 100v rentals @ AWS last night.   this is their newest and best instances and i was only getting just over 500/600 hs on the 32 cores using cryptonight algo.  its either an bad emulation of the 32 cores and or the 4 tesla 100v is causing high cpu usage??  

[ronnylov]

I have 4x Opteron 6276. The best hashrate I got was 2030 H/s using xmrig with 56 threads and set affinity to 0xFEFEFEFEFEFEFEFE.
But my server overheats after a while with that setting so I had to change to 32 threads and affinity 0x5555555555555555.
Then I got a stable hashrate of 1700 H/s. That is the best long term stable hashrate I have got.

You can check http://monerobenchmarks.info/
4X AMD OPTERON 6282 SE 1801 H/s -a crytonight -t 64

I actually got higer hashrate running 56 threads than with 64.
But my Power consumption is around 600W so I guess it is better using AMD Vega GPU which can give same hashrate but at much lower power.
Opteron 6300 series should use a Little bit lower Power but the performance should be similar as 6200 series.

[0xcosmos]

Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

here from linus video?
:p

[sundownz]

I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

That is pretty awesome... I am looking through e-bay to see if I can dig some of these Opteron 6300 computers up =)

[sundownz]

Okay yah I'm in... Ordered 9x systems with 4x Opteron 6380s per system.

Suggestions on the best / easiest way to install Linux on these ?

[ronnylov]

Okay yah I'm in... Ordered 9x systems with 4x Opteron 6380s per system.

Suggestions on the best / easiest way to install Linux on these ?

You install Linux just as on any other other computer, no difference.
I have a 4x Opteron 6276 server and had some trouble getting it stable because of heat.
Had to replace heat sinks and underclock a bit to make it run stable.

Keep in mind they are power hungry. 600 W per system is my guess.
Also very high sound level because of the cooling needed.
Still it is a good CPU miner for CPU-friendly algos.

Edit: And as I said above the Opteron 6200 series is almost as good as 6300 series opteron.
The 6300 series was much more expensive when I bought mine.

[Branko]

Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

Between 2000 and 2500

[0xcosmos]

anyone having a list of parts for this build
4x opteron 6378?

[cafemotocb]

I have 4x Opteron 6276. The best hashrate I got was 2030 H/s using xmrig with 56 threads and set affinity to 0xFEFEFEFEFEFEFEFE.
But my server overheats after a while with that setting so I had to change to 32 threads and affinity 0x5555555555555555.
Then I got a stable hashrate of 1700 H/s. That is the best long term stable hashrate I have got.

You can check http://monerobenchmarks.info/
4X AMD OPTERON 6282 SE 1801 H/s -a crytonight -t 64

I actually got higer hashrate running 56 threads than with 64.
But my Power consumption is around 600W so I guess it is better using AMD Vega GPU which can give same hashrate but at much lower power.
Opteron 6300 series should use a Little bit lower Power but the performance should be similar as 6200 series.

I just completed a server rig build with two motherboards. One with 4x 6276 and the other 4x 6376. I was hoping you might be able to answer a few questions.

1) Are you running Linux or Windows Server?

2) I tried the affinity settings you used for xmrig but only manage 140h/s. Do you mind sharing your full config file with me?

Any pointers or thoughts on your own troubleshooting to get the fastest hashrate is greatly appreciated.

Cheers! 

[steve666]

Hi, what do you think about mixing 2x G34 processor with some GPU's in one server mboard ex. ASUS KGPE-D16?
Regards

[ronnylov]

I have 4x Opteron 6276. The best hashrate I got was 2030 H/s using xmrig with 56 threads and set affinity to 0xFEFEFEFEFEFEFEFE.
But my server overheats after a while with that setting so I had to change to 32 threads and affinity 0x5555555555555555.
Then I got a stable hashrate of 1700 H/s. That is the best long term stable hashrate I have got.

You can check http://monerobenchmarks.info/
4X AMD OPTERON 6282 SE 1801 H/s -a crytonight -t 64

I actually got higer hashrate running 56 threads than with 64.
But my Power consumption is around 600W so I guess it is better using AMD Vega GPU which can give same hashrate but at much lower power.
Opteron 6300 series should use a Little bit lower Power but the performance should be similar as 6200 series.

I just completed a server rig build with two motherboards. One with 4x 6276 and the other 4x 6376. I was hoping you might be able to answer a few questions.

1) Are you running Linux or Windows Server?

2) I tried the affinity settings you used for xmrig but only manage 140h/s. Do you mind sharing your full config file with me?

Any pointers or thoughts on your own troubleshooting to get the fastest hashrate is greatly appreciated.

Cheers!  

Hi!

1) I am using Arch Linux because that is my favourite OS. Have not tried Windows but there might be an issue with maximum number of CPU sockets allowed by license. Linux does not have that kind of limitations.

2) I also have filled 16 memory slots to give each CPU node dual channel memory (each CPU consist of two 8 core CPU nodes with two connected memory channels). Could it be an issue with memory speed? It was a while I mined cryptonight but I can check if I have the config on disk when I am back at home. The affinity setting is to lock the threads to specific CPU cores. I did initial testing on my 8 core AMD FX-8350 in Another computer which is similar to one of the CPU nodes of the server. Just scale up the settings to all CPU nodes on the server. Not sure if I used "low Power mode" when running at 32 threads though. As I said, I'll check my config.

I also have compiled xmrig myself in order to get all CPU optimizations that might be needed on my system. Don't Think it matters much but if for instance AVX is not used it would affect the results.

But I had big issues with server restarting when overheating something. It was not an easy build, lot of tweaking needed both hardware and software to get it run stable. If doing it again I would probably go for a dual socket version and maybe getting two servers instead of one. Also check Intel Xeon servers.

It is a great machine to use when you find some "CPU only" coins. Initially I was going to use it for Verium mining (should be one of the fastest builds for that) but have not yet tried Verium mining. Have been mining Intense Coin and Credits but now difficulty is too high. I am trying Yenten but does not seem very profitable. Not sure what to use it for right now. But it has already paid for itself so I just use it for fun now. Maybe will try Verium. Forgot that it was the intended purpose :-)

Edit:
./xmrig -a cryptonight -t 32 --cpu-affinity 0x5555555555555555 --av=1 -o itns.intensepool.net:5555 -u ADDRESS.30000 -p x

or

./xmrig -a cryptonight -t 56 --cpu-affinity 0xFEFEFEFEFEFEFEFE --av=1 -o itns.intensepool.net:5555 -u ADDRESS.30000 -p x

Note: This was made using an earlier version of xmrig intended for CPU mining only. I beleive later versions integrated GPU mining also. The pool I used does not exist anymore so don't try mining there.

[ronnylov]

Hi, what do you think about mixing 2x G34 processor with some GPU's in one server mboard ex. ASUS KGPE-D16?
Regards

Should work but I have not tried myself.

[sirslayer]

this is a good deal for a used hp server !!! just upgrade the cpus to opteron 6380 and add the extra pcie slots and it comes with 4 x 1200 watts = 4800 watts total .... its on ebay...  

this is to add 5 extra pcie for a total of 10 pcie !!!!
https://www.ebay.com/itm/604046-001-HP-PROLIANT-DL585-G7-SYSTEM-EPANSION-BOARD-MOTHERBOARD-5xPCIe-Tested/132036792845?epid=2254508612&hash=item1ebe01920d:g:zIUAAOSw2xRYVH1U

this is the server it self
https://www.ebay.com/itm/HP-Proliant-DL585-G7-Server-2x-AMD-12-Core-2-3GHz-64GB-8x-146GB-P410i-iLo3/401400673132?_trkparms=aid%3D555018%26algo%3DPL.SIM%26ao%3D1%26asc%3D47300%26meid%3D5df2981b35044acd886af0be44273eda%26pid%3D100010%26rk%3D1%26rkt%3D6%26sd%3D171743726458%26itm%3D401400673132&_trksid=p2047675.c100010.m2109

[PharmEcis]

this is a good deal for a used hp server !!! just upgrade the cpus to opteron 6380 and add the extra pcie slots and it comes with 4 x 1200 watts = 4800 watts total .... its on ebay...  

this is to add 5 extra pcie for a total of 10 pcie !!!!
https://www.ebay.com/itm/604046-001-HP-PROLIANT-DL585-G7-SYSTEM-EPANSION-BOARD-MOTHERBOARD-5xPCIe-Tested/132036792845?epid=2254508612&hash=item1ebe01920d:g:zIUAAOSw2xRYVH1U

this is the server it self
https://www.ebay.com/itm/HP-Proliant-DL585-G7-Server-2x-AMD-12-Core-2-3GHz-64GB-8x-146GB-P410i-iLo3/401400673132?_trkparms=aid%3D555018%26algo%3DPL.SIM%26ao%3D1%26asc%3D47300%26meid%3D5df2981b35044acd886af0be44273eda%26pid%3D100010%26rk%3D1%26rkt%3D6%26sd%3D171743726458%26itm%3D401400673132&_trksid=p2047675.c100010.m2109

Actually, it's not.  The CPU has no AES...

[ronnylov]

this is a good deal for a used hp server !!! just upgrade the cpus to opteron 6380 and add the extra pcie slots and it comes with 4 x 1200 watts = 4800 watts total .... its on ebay...  

this is to add 5 extra pcie for a total of 10 pcie !!!!
https://www.ebay.com/itm/604046-001-HP-PROLIANT-DL585-G7-SYSTEM-EPANSION-BOARD-MOTHERBOARD-5xPCIe-Tested/132036792845?epid=2254508612&hash=item1ebe01920d:g:zIUAAOSw2xRYVH1U

this is the server it self
https://www.ebay.com/itm/HP-Proliant-DL585-G7-Server-2x-AMD-12-Core-2-3GHz-64GB-8x-146GB-P410i-iLo3/401400673132?_trkparms=aid%3D555018%26algo%3DPL.SIM%26ao%3D1%26asc%3D47300%26meid%3D5df2981b35044acd886af0be44273eda%26pid%3D100010%26rk%3D1%26rkt%3D6%26sd%3D171743726458%26itm%3D401400673132&_trksid=p2047675.c100010.m2109

Actually, it's not.  The CPU has no AES...

Opteron 6380 has AES so I guess that is why he recommend CPU upgrade?
I think you are right about the included Opteron 6176.
Opteron 6100 does not have AES but 6200 and 6300 series do.

Actually I think Opteron 6272 is a better upgrade. Much cheaper than Opteron 6380 on ebay and also less power consumption so less cooling problems. Still 16 cores. I bought the Opteron 6276 but I had to limit CPU frequency in bios to about same as Opteron 6272 to avoid overheating. For mining less power consumption might be a better choise anyway.

[sundownz]

I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

I didn't bother with any tweaks (other than huge pages and ulimit increase), I just run xmr-stak-cpu with config as full power on every odd core, then a low power thread on the 2nd, 10th, 18th, etc.

Do you think you could share your full config file ?

[Edgetheguy]

Hello friends!

Don't use XMR-stak-cpu use the new combined xmr stak cpu/gpu it gains about 10-20% with light tweaks. First time you run it, it will ask you basic questions like monero or aeon, pool, wallet etc. You can either copy and paste into the command window or just use phrases to change later like "changemetopool" "changemetowallet"

After it runs, close it. You will have a cpu.txt and a config.txt

The CPU file is the recommendations from XMR stak, I did not have to tweak mine for 2x 6274 opteron CPUs. I wsa getting aroun 1100 stable xmr and 2700 aeon with this

I did go into config and force the mode into AES true and did the gpedit for the large memory pool. I was toying with selling the system cuz it's kind of loud but I moved it to a better spot and it's heating a my cats room now so I think I'll keep, here's the old listing a made for it though. I'm actually happy enough with the hash that I'll try and grab another dual or quad cpu system for another 32/64 threads. The 62xx series seem to be sweet spot for value so far and bonus if you can run a GPU with the mobo.

https://www.ebay.com/itm/202213268056?ul_noapp=true

[evultrole]

I know this is a pretty old thread, but it comes up in several related google searches so I figure it needs an answer. My server with 4x6378 running 40 threads for Monero mining does 2199.6 H/s average when idle (running Ubuntu 16.04, only does about 1800 H/s in Windows Server 2016 with same config file)

I didn't bother with any tweaks (other than huge pages and ulimit increase), I just run xmr-stak-cpu with config as full power on every odd core, then a low power thread on the 2nd, 10th, 18th, etc.

Do you think you could share your full config file ?

Sorry, I don't actually use this forum and didn't see this

Literally the only thing I had done was the CPU setup

Code:

{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 1 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 2 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 3 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 5 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 7 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 9 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 10 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 11 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 13 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 15 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 17 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 18 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 19 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 21 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 23 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 25 },
{ "low_power_mode" : true, "no_prefetch" : true, "affine_to_cpu" : 26 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 27 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 29 },
{ "low_power_mode" : false, "no_prefetch" : true, "affine_to_cpu" : 31 },

Just continued that pattern through all cores, every other core but added one low power thread at third and eleventh core on each CPU. That assignment was done because of the way the chips themselves are built. I don't remember exactly what the reason was, only that it resulted in lower heat.

I couldn't use XMRig even though it was quite a bit faster in single threads because it refused to assign that way, and did "whatever it felt like" no matter what assignment rules I fed it, resulting in a much slower overall rate (assignment seemed to be broken on more than 16 threads, not sure if they fixed it yet).

Running more than 40 threads was slower or the same speed, due to the shared resources in the CPU design (2 cores share some things, AES seems to be one of those shared functions), so this was the best hashrate I saw while still leaving the server perfectly usable for basically everything else. I can't really offer anything other than that, though, because I only ran it for a couple days as part of testing the server before putting it to work someplace else.

on linux compiling xmr-stak with -march=native added a couple hundred H/s, and -funroll-loops added about 100 H/s if you care enough to figure out where to manually assign that stuff. [insert funroll-all-loops gentoo joke here]. Playing with compile flags I think I capped out about 2650 H/s on the system, which is slower than it should have been so I think the dell board was limiting somehow (geekbench results were slightly lower than expected too). HP systems will probably do better.

[mohammadadam]

Hey, 4x Opteron 6378 64cores 2,3GHz. Does anyone have experience how powerful these processors on mining? For example Monero?

Posible hash rate?

 HI CAN YOU KINDLY CONFIRM IF YOUR OS SHOWS L3 CACHE AS 12 MB INSTEAD OF 16 MB PER PROCESSOR.

[savvadesogle]

Hi, what do you think about mixing 2x G34 processor with some GPU's in one server mboard ex. ASUS KGPE-D16?
Regards

900-1000 h/s Monero/Bytecoin on ASUS KGPE-D16 and 6380x2 like there https://translate.google.com/translate?hl=ru&sl=ru&tl=en&u=https%3A%2F%2Fwww.avito.ru%2Fmoskva%2Ftovary_dlya_kompyutera%2F16-yadernyy_protsessor_amd_opteron_6380_1107827504
Windows 10x64.

[aiij]

HI CAN YOU KINDLY CONFIRM IF YOUR OS SHOWS L3 CACHE AS 12 MB INSTEAD OF 16 MB PER PROCESSOR.

I'm seeing 16 MB L2 and 12 MB L3 in the BIOS setup too. `lscpu` shows it as 2MB and 6MB, probably because that is what an individual core will see.

Code:

On-line CPU(s) list: 0-15
Thread(s) per core:  2
Core(s) per socket:  8
Socket(s):           1
NUMA node(s):        2
Vendor ID:           AuthenticAMD
CPU family:          21
Model:               2
Model name:          AMD Opteron(tm) Processor 6378
Stepping:            0
CPU MHz:             2400.070
L1d cache:           16K
L1i cache:           64K
L2 cache:            2048K
L3 cache:            6144K