[LOCKED] cpuminer-opt v3.12.3, open source optimized multi-algo CPU miner

[joblo]

Another note to Ryzen users with Linux. I found a note that Linux kernel 4.10 added Ryzen support.
I don't know precisely what that means but if performance isn't what you expected check the kernel
version. Linux 4.10 was included in Ubuntu 17.04 and Fedora 26.

[1714024671]

1714024671

[1714024671]

1714024671

[1714024671]

1714024671

[1714024671]

1714024671

[Prospector37]

Hey guys, first time trying CPU mining with my 3570k and i have weird problems. I downloaded CPU miner 3.7.7 and I followed these instructions

Make a shortcut or .bat file and use this command line, replace the [] with your own values :

[PATH_TO_CPU_MINER]\cpuminer-aes-avx2.exe -a lyra2z -o stratum+tcp://europe.lyra2z-hub.miningpoolhub.com:17025 -u [MPH_USERNAME].[WORKER] -p [PASSWORD]

The thing is i cant even manage to open the window,even when i try to open avx2.exe nothing happens. Do i miss something? I tried to create a bat file inside this folder too,made the path and all the adresses and still i cant make this work at all. Any suggestions?

[malthrax]

Hey guys, first time trying CPU mining with my 3570k and i have weird problems. I downloaded CPU miner 3.7.7 and I followed these instructions

Make a shortcut or .bat file and use this command line, replace the [] with your own values :

[PATH_TO_CPU_MINER]\cpuminer-aes-avx2.exe -a lyra2z -o stratum+tcp://europe.lyra2z-hub.miningpoolhub.com:17025 -u [MPH_USERNAME].[WORKER] -p [PASSWORD]

The thing is i cant even manage to open the window,even when i try to open avx2.exe nothing happens. Do i miss something? I tried to create a bat file inside this folder too,made the path and all the adresses and still i cant make this work at all. Any suggestions?

open a command prompt and type it by hand.  if there's an error, you'll see it.

[joblo]

Hey guys, first time trying CPU mining with my 3570k and i have weird problems. I downloaded CPU miner 3.7.7 and I followed these instructions

Make a shortcut or .bat file and use this command line, replace the [] with your own values :

[PATH_TO_CPU_MINER]\cpuminer-aes-avx2.exe -a lyra2z -o stratum+tcp://europe.lyra2z-hub.miningpoolhub.com:17025 -u [MPH_USERNAME].[WORKER] -p [PASSWORD]

The thing is i cant even manage to open the window,even when i try to open avx2.exe nothing happens. Do i miss something? I tried to create a bat file inside this folder too,made the path and all the adresses and still i cant make this work at all. Any suggestions?

Use avx not avx2 for your Ivybridge CPU. As previously mentioned you can always see the error by bypassing
the bat file and typing the command at a comand prompt.

[nizzuu]

I would like to drop the sse42 (Nehalem) build. Nehalem users would be forced to use the sse2 build.
There is no sse42 targetted code in any algos that I'm aware of so  there should be no difference in
performance. Please report if you have data that shows otherwise.

Some results for: Pentium G4600 @ stock, DDR4-2400@ dual channel, Win 10, stock 3.7.7 binaries from github. This CPU is not old, but lacks AVX/AVX2. System was clean and idle.

I've used benchmark option: cpuminer-* -a * -t 4 --cpu-affinity 15 --benchmark for all algos. So, the ones where the difference is:

yescryptr16 - ~498.5 H/s SSE2, ~512 H/s SSE42
skunk - ~285 kH/s SSE2, ~295 kH/s SSE42
nist5 - ~450 kH/s SSE42, ~460 kH/s SSE2 (ooops)

No tests for hodl - miner exits w/o AES, expected by miner.

I've retested these suspicious results 5 times each, but it seems to be not a mistake. Btw, the difference is less than minor. Maybe OS uses some of these (sse2/sse42) in the background, so this gives minor speed changes. I don't know. Disassembly may help to see if there are actual changes in binaries for these algos, or not.

[joblo]

I would like to drop the sse42 (Nehalem) build. Nehalem users would be forced to use the sse2 build.
There is no sse42 targetted code in any algos that I'm aware of so  there should be no difference in
performance. Please report if you have data that shows otherwise.

Some results for: Pentium G4600 @ stock, DDR4-2400@ dual channel, Win 10, stock 3.7.7 binaries from github. This CPU is not old, but lacks AVX/AVX2. System was clean and idle.

I've used benchmark option: cpuminer-* -a * -t 4 --cpu-affinity 15 --benchmark for all algos. So, the ones where the difference is:

yescryptr16 - ~498.5 H/s SSE2, ~512 H/s SSE42
skunk - ~285 kH/s SSE2, ~295 kH/s SSE42
nist5 - ~450 kH/s SSE42, ~460 kH/s SSE2 (ooops)

I've retested these suspicious results 5 times each, but it seems to be not a mistake. Btw, the difference is less than minor. Maybe OS uses some of these (sse2/sse42) in the background, so this gives minor speed changes. I don't know. Disassembly may help to see if there are actual changes in binaries for these algos, or not.

Your CPU has AES so you should use the aes-sse42 build. The issue really only applies to Nehalem and any possibly similar
AMD architecture.

I found a small difference in the yescrypt code but your results differ less than skunk which has identical code.

[Elder III]

This is a reminder to Windows binaries users. I intend to make some changes in the next release
to reduce the number of binaries I have to build each release.

I would like to drop the sse42 (Nehalem) build. Nehalem users would be forced to use the sse2 build.
There is no sse42 targetted code in any algos that I'm aware of so  there should be no difference in
performance. Please report if you have data that shows otherwise.

AVX2 performance on Ryzen is still questionable. It was suggested I provide a avx-sha build. I will provide
either a avx-sha or avx2-sha build. This will not apply to 4way as it requires AVX2. Ryzen users please
test avx vs avx2 (not 4way) to determine which gets the best performance. The best algo to test AVX2
is lyra2rev2 as it has the most AVX2 code.

Ryzen 1700X @ 3.8 using 8 threads mining Vertcoin.

AVX = ~139 Kh/s per thread

AVX2 = ~137 Kh/s per thread

I was doing a fair bit of multi-tasking when running the tests for about 5 minutes each, but the overall CPU load should have been the same for both tests. I can try testing on my other PC at 4.0 ghz but I expect the differences will be the same % wise.

[nizzuu]

Btw, I've found an issue while testing...

i3-7350k @ 4.2 GHz, HT on, 8Gb RAM @ DDR4-2400 dual channels, WIN 10

The test below produces no output!

cpuminer-aes-avx -a lyra2z330 -t 4 --cpu-affinity 15

I got 100% load for all of 4 logical cpus, then it drops to 0% after 2 minutes, and stays there. Miner does not log any hashrate, and dooes not crash either. It reproduces stable - 10 out of 10 tests.

AVX2 build works okay with same settings.

[joblo]

Btw, I've found an issue while testing...

i3-7350k @ 4.2 GHz, HT on, 8Gb RAM @ DDR4-2400 dual channels, WIN 10

The test below produces no output!

cpuminer-aes-avx -a lyra2z330 -t 4 --cpu-affinity 15

I got 100% load for all of 4 logical cpus, then it drops to 0% after 2 minutes, and stays there. Miner does not log any hashrate, and dooes not crash either. It reproduces stable - 10 out of 10 tests.

AVX2 build works okay with same settings.

Benchmark or pool?

[nizzuu]

Btw, I've found an issue while testing...

i3-7350k @ 4.2 GHz, HT on, 8Gb RAM @ DDR4-2400 dual channels, WIN 10

The test below produces no output!

cpuminer-aes-avx -a lyra2z330 -t 4 --cpu-affinity 15

I got 100% load for all of 4 logical cpus, then it drops to 0% after 2 minutes, and stays there. Miner does not log any hashrate, and dooes not crash either. It reproduces stable - 10 out of 10 tests.

AVX2 build works okay with same settings.

Benchmark or pool?

Benchmark and getwork.

So I tested cryptonight with the latest 3.7.7 on my Ryzen 1800X and the speed is about 60 Kh/s per thread, this is with Hyper-threading disabled and using 7 threads (7 cores).
This was with cpuminer-aes-avx (so AES and AVX). Quite a bit lower than the 80-81 Kh/s per thread I get with xmr-stak. Is this normal speed these days or should I be getting higher with cpuminer?

Well, this speed is the same speed you get with stack or xmrig if you disable huge pages support for them (while getting higher hashrate if you do not). As cpminer-opt has a lack of huge pages support, that's what you get. So it's normal.

Another thing that could help cpuminer-opt is compiling NOT with gcc. Xmrig and stack both work faster when they are compiled with Intel compiler or MSVC (up to 5-10% faster depending on CPU and mem). Cpuminer-opt may benefit more, as it has multiple algos which are bound of different things (not only L3 cache).

I personally use xmrig compiled with trial Intel compiler from Parallel Studio XE 2018. It has Linux version as well, and as I personally gave up trying to compile cpuminer-opt as MSVC solution (using msvc 2017 compiler), somebody may give a try using Intel compiler under linux. So to compile same way as joblo does, but using Intel compiler. Of course I cannot make someone to do it, but I'm noob in linux building. But I'll try on these holidays

[seb5049]

Can someone ELI5 me on how to set up multi-algo switch mining with MiningPoolHub? I can't figure it out for the life of me what to put in the bat file (or what exe to use). I'm using a Ryzen 5 1500X.

[joblo]

Benchmark and getwork.

Both are provided as is. Getwork seems to work with most algos but is not guaranteed. I don't even know
if the coin supports it. If you can find a miner that works I'll look into fixing it in cpuminer-opt.

[joblo]

It's my turm to ask fr help. I'm fine tuning the new Windows crposs compile environment
and I'd like to remove one ugly workaround, editting configure.ac.

This code should properly link pthreadGC2 when cross compiling:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthread",[])
fi

but the procedure requires the following edit:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
fi

suggesting the logic isn't working.

Any suggestions to make the logic work?

[4ward]

It's my turm to ask fr help. I'm fine tuning the new Windows crposs compile environment
and I'd like to remove one ugly workaround, editting configure.ac.

This code should properly link pthreadGC2 when cross compiling:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthread",[])
fi

but the procedure requires the following edit:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
fi

suggesting the logic isn't working.

Any suggestions to make the logic work?

perhaps moving it to the case clause starting on line 45?

[joblo]

It's my turm to ask fr help. I'm fine tuning the new Windows crposs compile environment
and I'd like to remove one ugly workaround, editting configure.ac.

This code should properly link pthreadGC2 when cross compiling:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthread",[])
fi

but the procedure requires the following edit:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
fi

suggesting the logic isn't working.

Any suggestions to make the logic work?

perhaps moving it to the case clause starting on line 45?

That's kinda what I'm looking for but that tests $MINGW_TARGET and it returns Linux.
What I really want to test is the host as specified by "--host=x86_64-w64-mingw32"
but I can't figure out how.

[joblo]

cpuminer-opt-3.7.8 add partial 4way optimizations to most X algos including c11, x11gost,
xevan, phi1612, hsr.

https://github.com/JayDDee/cpuminer-opt/releases/tag/v3.7.8

[guytechie]

cpuminer-opt-3.7.8 add partial 4way optimizations to most X algos including c11, x11gost,
xevan, phi1612, hsr.

https://github.com/JayDDee/cpuminer-opt/releases/tag/v3.7.8

Awesome!  And I see official SHA support!  Should also add that to the "what's new".

I'm going to test avx-sha vs 4-way-sha on my Ryzen to see which is more quicker.  And just for kicks, will compare to just straight avx.

Thanks, and hope you have a happy new year!

Update:
Either it's reporting incorrectly, or there's other optimizations going on.

Mining yescrypt:

Code:

         **********  cpuminer-opt 3.7.8  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX2 and SHA extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT

CPU: AMD Ryzen Threadripper 1950X 16-Core Processor .
SW built on Dec 30 2017 with GCC 5.3.1.
CPU features: SSE2 AES AVX AVX2 SHA.
SW features: SSE2 AES AVX AVX2 4WAY.
Algo features: SSE2 SHA.
Start mining with SSE2.

This is using avx-sha.exe - it doesn't list SHA in SW features.  However, there is definitely an improvement in performance, though not really with yescrypt.  Went from the previous avx-only EXE of 15.22 kH/s to now 15.32 kH/s, but within margin of error.

However, xevan went from a 409.3 kH/s to 453.6 kK/s!!!

What's interesting is that it lists 4WAY as a feature, which I thought wasn't a part of the avx-sha.exe build.

Just to see if the avx-sha.exe build was any different than just avx only, I tried the closes avx-only build. With aes-avx.exe, I get about 14.9 kH/s for yescrypt and 413.8 kH/s for xevan.

So definitely an improvement, but not on the algo I expected.

Update 2:
Also noticed some mismatched builds from Readme.txt.

Actual builds:

Code:

cpuminer-4way-sha.exe
cpuminer-4way.exe
cpuminer-aes-avx.exe
cpuminer-aes-avx2.exe
cpuminer-aes-sse42.exe
cpuminer-avx-sha.exe
cpuminer-sse2.exe
cpuminer-sse42.exe

From readme.txt"

Code:

Exe name                Compile flags              Arch name

cpuminer-sse2.exe      "-march=core2"              Core2   
cpuminer-sse42.exe     "-march=corei7"             Nehalem
cpuminer-aes-sse42.exe "-maes -msse4.2"            Westmere
cpuminer-avx.exe       "-march=corei7-avx"         Sandybridge, Ivybridge
cpuminer-avx2.exe      "-march=core-avx2"          Haswell...
cpuminer-avx-sha       "-march=corei7-avx -msha"   Ryzen...
cpuminer-4way.exe      "-march=core-avx2 -DFOUR_WAY"       same as avx2
cpuminer-4way-sha.exe  "-march=core-avx2 -msha -DFOUR_WAY" same as avx2-sha

Perhaps the names just needs to be matched up.

[joblo]

cpuminer-opt-3.7.8 add partial 4way optimizations to most X algos including c11, x11gost,
xevan, phi1612, hsr.

https://github.com/JayDDee/cpuminer-opt/releases/tag/v3.7.8

Awesome!  And I see official SHA support!  Should also add that to the "what's new".

I'm going to test avx-sha vs 4-way-sha on my Ryzen to see which is more quicker.  And just for kicks, will compare to just straight avx.

Thanks, and hope you have a happy new year!

Update:
Either it's reporting incorrectly, or there's other optimizations going on.

Mining yescrypt:

Code:

         **********  cpuminer-opt 3.7.8  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX2 and SHA extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT

CPU: AMD Ryzen Threadripper 1950X 16-Core Processor .
SW built on Dec 30 2017 with GCC 5.3.1.
CPU features: SSE2 AES AVX AVX2 SHA.
SW features: SSE2 AES AVX AVX2 4WAY.
Algo features: SSE2 SHA.
Start mining with SSE2.

This is using avx-sha.exe - it doesn't list SHA in SW features.  However, there is definitely an improvement in performance, though not really with yescrypt.  Went from the previous avx-only EXE of 15.22 kH/s to now 15.32 kH/s, but within margin of error.

However, xevan went from a 409.3 kH/s to 453.6 kK/s!!!

What's interesting is that it lists 4WAY as a feature, which I thought wasn't a part of the avx-sha.exe build.

Just to see if the avx-sha.exe build was any different than just avx only, I tried the closes avx-only build. With aes-avx.exe, I get about 14.9 kH/s for yescrypt and 413.8 kH/s for xevan.

So definitely an improvement, but not on the algo I expected.

Update 2:
Also noticed some mismatched builds from Readme.txt.

Actual builds:

Code:

cpuminer-4way-sha.exe
cpuminer-4way.exe
cpuminer-aes-avx.exe
cpuminer-aes-avx2.exe
cpuminer-aes-sse42.exe
cpuminer-avx-sha.exe
cpuminer-sse2.exe
cpuminer-sse42.exe

From readme.txt"

Code:

Exe name                Compile flags              Arch name

cpuminer-sse2.exe      "-march=core2"              Core2   
cpuminer-sse42.exe     "-march=corei7"             Nehalem
cpuminer-aes-sse42.exe "-maes -msse4.2"            Westmere
cpuminer-avx.exe       "-march=corei7-avx"         Sandybridge, Ivybridge
cpuminer-avx2.exe      "-march=core-avx2"          Haswell...
cpuminer-avx-sha       "-march=corei7-avx -msha"   Ryzen...
cpuminer-4way.exe      "-march=core-avx2 -DFOUR_WAY"       same as avx2
cpuminer-4way-sha.exe  "-march=core-avx2 -msha -DFOUR_WAY" same as avx2-sha

Perhaps the names just needs to be matched up.

That's very confusing. The output you posted for yescrypt is from the 4way build (avx2 but no sha). There is no
4way in the avx-sha build. I double checked the names just to make sure. They don't match those in README.txt
but that's only the the inclusion of aes in the name. The important features are correct.

[guytechie]

That's very confusing. The output you posted for yescrypt is from the 4way build (avx2 but no sha). There is no
4way in the avx-sha build. I double checked the names just to make sure. They don't match those in README.txt
but that's only the the inclusion of aes in the name. The important features are correct.

The output I posted for yescrypt is from the avx-sha executable, not the avx2 executable.  That's why I'm confused as well.

[joblo]

That's very confusing. The output you posted for yescrypt is from the 4way build (avx2 but no sha). There is no
4way in the avx-sha build. I double checked the names just to make sure. They don't match those in README.txt
but that's only the the inclusion of aes in the name. The important features are correct.

The output I posted for yescrypt is from the avx-sha executable, not the avx2 executable.  That's why I'm confused as well.

That's really weird, I'm getting the same thing. I also getting lower hashrate with the 4way build. They were all built using
the winbuild-cross.sh script that clearly shows the compile options and asociated file names.

It looks like trial and error until I sort this out.