[LOCKED] cpuminer-opt v3.12.3, open source optimized multi-algo CPU miner

[joblo]

Yes I use yescryptr16 and it's solo mining.

The only way I succeeded was but connecting a vpn... weird...

So now I can mine using the built-in miner or using minerd, I'm getting around 1100h/s but wanted to see the difference with yours as I always get better results with it!

Please post the info I requested. You shouldn't get stratum errors solo mining.

[4ward]

funny thing... after cross compiling sha version, it actually gives me about +10% on m7m with a skylake cpu...

[FlowLive]

Yes I use yescryptr16 and it's solo mining.

The only way I succeeded was but connecting a vpn... weird...

So now I can mine using the built-in miner or using minerd, I'm getting around 1100h/s but wanted to see the difference with yours as I always get better results with it!

Please post the info I requested. You shouldn't get stratum errors solo mining.

Sure here it is:

Code:

D:\cpuminer-opt-3.7.1-windows>cpuminer-aes-avx2.exe -a yescryptr16 -o localhost:rpcport -u user -p pass -t 16

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1700 Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Oct 31 2017 with GCC 4.8.3
SW features: SSE2 AES AVX AVX2
Algo features: SSE2 SHA
Start mining with SSE2

[2017-10-31 13:41:53] Starting Stratum on stratum+tcp://localhost:port
[2017-10-31 13:41:53] 16 miner threads started, using 'yescryptr16' algorithm.
[2017-10-31 13:41:53] stratum_recv_line failed
[2017-10-31 13:41:53] ...retry after 10 seconds

Of course the port is forwarded and the username/password set according to my yenten.conf file.

Since this coin is supposed to support SHA, I'd like to try and compile again, last time a couple of months ago you said that it had not really been don yet... is this still the case?

[joblo]

Code:

D:\cpuminer-opt-3.7.1-windows>cpuminer-aes-avx2.exe -a yescryptr16 -o localhost:rpcport -u user -p pass -t 16

Like I said you must specify http:// when solo mining.

Compiling SHA for Windows is still a problem. It's possible to compile with msys2 but you have to know what you're
doing. Still there are problems with the build, it crashes everytime there's a stratum error.

[joblo]

funny thing... after cross compiling sha version, it actually gives me about +10% on m7m with a skylake cpu...

Please clarify. Windows? What did you compare with, precompiled binaries?

[4ward]

funny thing... after cross compiling sha version, it actually gives me about +10% on m7m with a skylake cpu...

Please clarify. Windows? What did you compare with, precompiled binaries?

yes, on windows.

cross-compile with avx2 or skylake show roughly the same speed as your avx2 version, but with znver1, gives me a boost on some algos.
im still benchmarking them all so see the difference, but m7m gave me ~10% boost

and im running on a skylake core i5 7600k

[joblo]

funny thing... after cross compiling sha version, it actually gives me about +10% on m7m with a skylake cpu...

Please clarify. Windows? What did you compare with, precompiled binaries?

yes, on windows.

cross-compile with avx2 or skylake show roughly the same speed as your avx2 version, but with znver1, gives me a boost on some algos.
im still benchmarking them all so see the difference, but m7m gave me ~10% boost

and im running on a skylake core i5 7600k

If you're using a SHA build on a Skylake it will use the openssl implementation of sha256 but not the HW acceleration.
With a normal compile it will use the included SPH implementation of sha256. My previous testing showed the SPH version
to be faster that the SW openssl version. Perhaps newer versions of openssl have improved the SW implementation.
IIRC you're using openssl 1.1.

If you see differences in algos that don't use sha256 (SHA not listed in algo features) then there's something else happening.

Edit: I did a test and can confirm about 10% improvement in m7m when compiled for SHA (openssl 1.0.2) and run on a Haswell.  
I need to do more testing.

Edit2: slower with openssl 1.0.1, looks like openssl improved in 1.0.2, good catch.

[joblo]

Yescryptr16 seems to be producing rejects. Since the pool is finding blocks I assume the
problem is in the miners. I will need to investigate.

cpuminer-opt-3.7.1 is released.

Added yescryptr16 algo for Yenten coin
Added SHA support to yescrypt and yescryptr16

These features have not been tested and have a higher risk of problems. Please report any problems
in this thread.

It would also be appreciated if a Ryzen user could report the performance difference with SHA enabled.
SHA support requires compiling from source on a recent Linux distribution, see RELEASE_NOTES
for details. The Windows binaries do not include SHA support.

git: https://github.com/JayDDee/cpuminer-opt

tarball: https://drive.google.com/file/d/0B0lVSGQYLJIZZXoyZkRNLUc2cE0/view?usp=sharing

windows binaries: https://drive.google.com/file/d/0B0lVSGQYLJIZTTV6YnhnV3F0eWc/view?usp=sharing

[slovakia]

joblo can you explain compile from linux?how is setup? im ryzen,but when this steps wont be exists all will be dead
im trying to run your miner for yenten
thanks

wallet mining is easy setup,but with your miner not

btw question .. where is  cpuminer-core-avx2??? missing in main folder

[4ward]

funny thing... after cross compiling sha version, it actually gives me about +10% on m7m with a skylake cpu...

Please clarify. Windows? What did you compare with, precompiled binaries?

yes, on windows.

cross-compile with avx2 or skylake show roughly the same speed as your avx2 version, but with znver1, gives me a boost on some algos.
im still benchmarking them all so see the difference, but m7m gave me ~10% boost

and im running on a skylake core i5 7600k

If you're using a SHA build on a Skylake it will use the openssl implementation of sha256 but not the HW acceleration.
With a normal compile it will use the included SPH implementation of sha256. My previous testing showed the SPH version
to be faster that the SW openssl version. Perhaps newer versions of openssl have improved the SW implementation.
IIRC you're using openssl 1.1.

If you see differences in algos that don't use sha256 (SHA not listed in algo features) then there's something else happening.

Edit: I did a test and can confirm about 10% improvement in m7m when compiled for SHA (openssl 1.0.2) and run on a Haswell.  
I need to do more testing.

Edit2: slower with openssl 1.0.1, looks like openssl improved in 1.0.2, good catch.

I am using openssl 1.1, so this brings the sha algos speed up, but after running benchmarks comparing your avx2 to my sha version, I also see some speedups on other algos.
I will run a benchmark with my avx2 to see how that one compares and put all data in a table

One thing I have found is that neoscrypt fails to initialize in the version i have compiled (both avx2 and sha)

[My9bot]

Code:

Win 10 Pro 64 bit
OpenSSL 1.1.0f  25 May 2017


cpuminer-opt-3.7.1-myNativ --algo=m7m  --benchmark -q

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1800X Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Nov  1 2017 with GCC 6.3.0
SW features: SSE2 AES AVX AVX2 SHA
Algo features: SSE2 AES AVX SHA
Start mining with SSE2 AES AVX SHA

[2017-11-01 12:22:52] 16 miner threads started, using 'm7m' algorithm.
[2017-11-01 12:22:59] Total: 262.14 kH, 38.54 kH/s
[2017-11-01 12:23:04] Total: 1840.97 kH, 293.92 kH/s
[2017-11-01 12:23:09] Total: 1469.23 kH, 291.32 kH/s
[2017-11-01 12:23:14] Total: 1454.33 kH, 289.60 kH/s
[2017-11-01 12:23:19] Total: 1423.37 kH, 289.73 kH/s
[2017-11-01 12:23:24] Total: 1421.89 kH, 287.81 kH/s
[2017-11-01 12:23:29] Total: 1365.32 kH, 287.75 kH/s
[2017-11-01 12:23:34] Total: 1366.31 kH, 289.06 kH/s
[2017-11-01 12:23:39] Total: 1440.71 kH, 287.66 kH/s



Win 10 Pro 64 bit
OpenSSL 1.0.2k

cpuminer-opt-3.7.1-myNativ --algo=m7m  --benchmark -q

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1800X Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Nov  1 2017 with GCC 6.3.0
SW features: SSE2 AES AVX AVX2 SHA
Algo features: SSE2 AES AVX SHA
Start mining with SSE2 AES AVX SHA

[2017-11-01 12:21:35] 16 miner threads started, using 'm7m' algorithm.
[2017-11-01 12:21:44] Total: 655.36 kH, 71.29 kH/s
[2017-11-01 12:21:49] Total: 1096.32 kH, 205.92 kH/s
[2017-11-01 12:21:54] Total: 874.22 kH, 210.36 kH/s
[2017-11-01 12:21:59] Total: 769.22 kH, 211.97 kH/s
[2017-11-01 12:22:04] Total: 967.19 kH, 221.77 kH/s
[2017-11-01 12:22:09] Total: 1051.55 kH, 224.90 kH/s
[2017-11-01 12:22:14] Total: 1124.52 kH, 225.51 kH/s
[2017-11-01 12:22:19] Total: 1013.80 kH, 225.62 kH/s
[2017-11-01 12:22:24] Total: 1128.10 kH, 225.34 kH/s
[2017-11-01 12:22:29] Total: 1111.20 kH, 224.71 kH/s

[My9bot]

Code:

Win 10 Pro 64 bit
OpenSSL 1.1.0f  25 May 2017

cpuminer-opt-3.7.1-myAVX2 --algo=m7m  --benchmark -q

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1800X Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Nov  1 2017 with GCC 6.3.0
SW features: SSE2 AES AVX AVX2
Algo features: SSE2 AES AVX SHA
Start mining with SSE2 AES AVX

[2017-11-01 12:32:18] 16 miner threads started, using 'm7m' algorithm.
[2017-11-01 12:32:28] Total: 524.29 kH, 49.57 kH/s
[2017-11-01 12:32:34] Total: 806.62 kH, 190.18 kH/s
[2017-11-01 12:32:38] Total: 778.38 kH, 190.70 kH/s
[2017-11-01 12:32:43] Total: 939.93 kH, 189.19 kH/s
[2017-11-01 12:32:48] Total: 944.10 kH, 189.71 kH/s
[2017-11-01 12:32:53] Total: 908.01 kH, 188.15 kH/s
[2017-11-01 12:32:58] Total: 939.32 kH, 189.81 kH/s
[2017-11-01 12:33:03] Total: 949.84 kH, 188.49 kH/s
[2017-11-01 12:33:08] Total: 845.20 kH, 187.82 kH/s
[2017-11-01 12:33:13] Total: 867.64 kH, 186.68 kH/s




Win 10 Pro 64 bit
OpenSSL 1.0.2k

cpuminer-opt-3.7.1-myAVX2 --algo=m7m  --benchmark -q

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1800X Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Nov  1 2017 with GCC 6.3.0
SW features: SSE2 AES AVX AVX2
Algo features: SSE2 AES AVX SHA
Start mining with SSE2 AES AVX

[2017-11-01 12:31:07] 16 miner threads started, using 'm7m' algorithm.
[2017-11-01 12:31:19] Total: 1572.86 kH, 143.93 kH/s
[2017-11-01 12:31:23] Total: 2012.75 kH, 190.25 kH/s
[2017-11-01 12:31:28] Total: 849.28 kH, 185.68 kH/s
[2017-11-01 12:31:32] Total: 882.26 kH, 184.45 kH/s
[2017-11-01 12:31:33] Total: 768.64 kH, 184.79 kH/s
[2017-11-01 12:31:38] Total: 757.57 kH, 180.84 kH/s
[2017-11-01 12:31:44] Total: 844.34 kH, 176.64 kH/s
[2017-11-01 12:31:48] Total: 842.79 kH, 182.73 kH/s

[4ward]

some results from benchmarking:
some algos that show big improvement with openssl 1.1 sha compared to original avx2 build:
lbry (19%)
m7m (13%)
myr-gr (20%)
skein (15%)

some algos cross-compiled with avx2 with newer openssl/gcc on ubuntu 17.04
groestl (13%)
hodl (18%)
whirlpoolx (18%)

many others show 5+% improvement

table with all algos i have benchmarked available here (benched on Core i5 7600k@4500 with -t 2 to prevent other processes interfering):
https://docs.google.com/spreadsheets/d/19vC17i1QZCvxlWbmxQIP4VF9FSzPuwOYtk5jJSrH48I/edit?usp=sharing

[joblo]

some results from benchmarking:
some algos that show big improvement with openssl 1.1 sha compared to original avx2 build:
lbry (19%)
m7m (13%)
myr-gr (20%)
skein (15%)

some algos cross-compiled with avx2 with newer openssl/gcc on ubuntu 17.04
groestl (13%)
hodl (18%)
whirlpoolx (18%)

many others show 5+% improvement

table with all algos i have benchmarked available here (benched on Core i5 7600k@4500 with -t 2 to prevent other processes interfering):
https://docs.google.com/spreadsheets/d/19vC17i1QZCvxlWbmxQIP4VF9FSzPuwOYtk5jJSrH48I/edit?usp=sharing

Thanks for the testing. I was able to confirm that openssl 1.0.2 adds AVX and AVX2 to sha256 & sha512. This explains the
improvement on Intel CPUs. Openssl 1.1 adds SHA support to sha256 further improving Ryzen performance. I can't confirm
that SHA is available in any 1.0.2 releases of openssl. The previously reported Ryzen improvements on Ubuntu 16.04 were
likely due to the AVX and AVX2 optimizations in openssl 1.0.2.

The next release of cpuminer-opt will use openssl by default (not just for SHA). I will add a workaround for users with
openssl 1.0.1 to use sph_sha256 and sph_sha512 which performs a little better than openssl 1.0.1. More details will be
in the release announcement.

In other news I have a fix for yescryptr16, new release should be available in a few hours.

[joblo]

Code:

Win 10 Pro 64 bit
OpenSSL 1.1.0f  25 May 2017


cpuminer-opt-3.7.1-myNativ --algo=m7m  --benchmark -q

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1800X Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Nov  1 2017 with GCC 6.3.0
SW features: SSE2 AES AVX AVX2 SHA
Algo features: SSE2 AES AVX SHA
Start mining with SSE2 AES AVX SHA

[2017-11-01 12:22:52] 16 miner threads started, using 'm7m' algorithm.
[2017-11-01 12:22:59] Total: 262.14 kH, 38.54 kH/s
[2017-11-01 12:23:04] Total: 1840.97 kH, 293.92 kH/s
[2017-11-01 12:23:09] Total: 1469.23 kH, 291.32 kH/s
[2017-11-01 12:23:14] Total: 1454.33 kH, 289.60 kH/s
[2017-11-01 12:23:19] Total: 1423.37 kH, 289.73 kH/s
[2017-11-01 12:23:24] Total: 1421.89 kH, 287.81 kH/s
[2017-11-01 12:23:29] Total: 1365.32 kH, 287.75 kH/s
[2017-11-01 12:23:34] Total: 1366.31 kH, 289.06 kH/s
[2017-11-01 12:23:39] Total: 1440.71 kH, 287.66 kH/s



Win 10 Pro 64 bit
OpenSSL 1.0.2k

cpuminer-opt-3.7.1-myNativ --algo=m7m  --benchmark -q

         **********  cpuminer-opt 3.7.1  ***********
     A CPU miner with multi algo support and optimized for CPUs
     with AES_NI and AVX extensions.
     BTC donation address: 12tdvfF7KmAsihBXQXynT6E6th2c2pByTT
     Forked from TPruvot's cpuminer-multi with credits
     to Lucas Jones, elmad, palmd, djm34, pooler, ig0tik3d,
     Wolf0, Jeff Garzik and Optiminer.

CPU: AMD Ryzen 7 1800X Eight-Core Processor
CPU features: SSE2 AES AVX AVX2 SHA
SW built on Nov  1 2017 with GCC 6.3.0
SW features: SSE2 AES AVX AVX2 SHA
Algo features: SSE2 AES AVX SHA
Start mining with SSE2 AES AVX SHA

[2017-11-01 12:21:35] 16 miner threads started, using 'm7m' algorithm.
[2017-11-01 12:21:44] Total: 655.36 kH, 71.29 kH/s
[2017-11-01 12:21:49] Total: 1096.32 kH, 205.92 kH/s
[2017-11-01 12:21:54] Total: 874.22 kH, 210.36 kH/s
[2017-11-01 12:21:59] Total: 769.22 kH, 211.97 kH/s
[2017-11-01 12:22:04] Total: 967.19 kH, 221.77 kH/s
[2017-11-01 12:22:09] Total: 1051.55 kH, 224.90 kH/s
[2017-11-01 12:22:14] Total: 1124.52 kH, 225.51 kH/s
[2017-11-01 12:22:19] Total: 1013.80 kH, 225.62 kH/s
[2017-11-01 12:22:24] Total: 1128.10 kH, 225.34 kH/s
[2017-11-01 12:22:29] Total: 1111.20 kH, 224.71 kH/s

Excellent. This shows the improvement due to SHA only and confirms that SHA is not available in openssl 1.0.2k.

[StelioKontos]

Will lyra2z330 gain benefit from thoese ssl/sha optimizations, too?

Another update, sorry for the spam.

Managed to install devtoolset-6 (GCC 6.3.1), it was quite straightforward:

... cut ...

You're trying to compile for a CPU archietcture simulated by Virtualbox. Even if the compile was successful it wouldn't work properly
on real hardware. I do not support attempts to cross compile on Linux. You're on your own.

FYI, with the help of a sysadmin, I got it to work (well, he did, most of it, and I ignore the details), so this miner is now running on Centos 6.9 and real hardware.

[joblo]

cpuminer-opt-3.7.2 is released.

Fixed yescryptr16.

Changed default sha256 and sha512 to openssl. This should be used when compiling with openssl 1.0.2
or higher (Ubuntu 16.04). This should increase the hashrate for m7m, xevan, skein, myr-gr & others
when openssl 1.0.2 is installed. This is due to AVX and AVX2 optimizations added to openssl 1.0.2.

Users with openssl 1.0.1 (Ubuntu 14.04) may get better performance by adding "-DUSE_SPH_SHA" to CFLAGS.
When using sph_sha or openssl-1.0.1 the miner will still display AVX and AVX2 mining even though neither
sph_sha nor openssl-1.0.1 have those optimizations.

Windows binaries are compiled with -DUSE_SPH_SHA and won't get the speedup.

git: https://github.com/JayDDee/cpuminer-opt

tarball: https://drive.google.com/file/d/0B0lVSGQYLJIZamNFVnZGT1FFT1k/view?usp=sharing

Windows binaries: https://drive.google.com/file/d/0B0lVSGQYLJIZMXl6SWtmUE4yTm8/view?usp=sharing

Thanks to all who helped testing SHA, particularly 4ward who discovered performance on Intel CPUs
had improved in openssl 1.0.2.

Edit: Links updated for 3.7.2

[joblo]

Will lyra2z330 gain benefit from thoese ssl/sha optimizations, too?

Another update, sorry for the spam.

Managed to install devtoolset-6 (GCC 6.3.1), it was quite straightforward:

... cut ...

You're trying to compile for a CPU archietcture simulated by Virtualbox. Even if the compile was successful it wouldn't work properly
on real hardware. I do not support attempts to cross compile on Linux. You're on your own.

FYI, with the help of a sysadmin, I got it to work (well, he did, most of it, and I ignore the details), so this miner is now running on Centos 6.9 and real hardware.

Good to read you got it working. You should check that the compiled SW features match your CPU architecture for best
performance.

[ljglug]

yescryptR16 algorithm support is not perfect
There will be an error

[2017-11-01 23:32:09] CPU #7: 448 H, 39.64 H/s
[2017-11-01 23:32:09] CPU #19: 430 H, 38.08 H/s
[2017-11-01 23:32:09] CPU #16: 491 H, 43.42 H/s
[2017-11-01 23:32:09] CPU #0: 490 H, 43.32 H/s
[2017-11-01 23:32:10] Stratum connection failed: Failed to connect to pool.bilbotel.fr port 6234: Connection refused
[2017-11-01 23:32:10] ...retry after 10 seconds
[2017-11-01 23:32:21] Stratum difficulty set to 1

[butmuncher]

cpuminer-opt-3.7.2 is released.

Fixed yescryptr16.

Changed default sha256 and sha512 to openssl. This should be used when compiling with openssl 1.0.2
or higher (Ubuntu 16.04). This should increase the hashrate for m7m, xevan, skein, myr-gr & others
when openssl 1.0.2 is installed. This is due to AVX and AVX2 optimizations added to openssl 1.0.2.

Users with openssl 1.0.1 (Ubuntu 14.04) may get better performance by adding "-DUSE_SPH_SHA" to CLAGS.
When using sph_sha or openssl-1.0.1 the miner will still display AVX and AVX2 mining even though neither
sph_sha nor openssl-1.0.1 have those optimizations.

Windows binaries are compiled with -DUSE_SPH_SHA and won't get the speedup.

git: https://github.com/JayDDee/cpuminer-opt

tarball: https://drive.google.com/file/d/0B0lVSGQYLJIZZXoyZkRNLUc2cE0/view?usp=sharing

Windows binaries: https://drive.google.com/file/d/0B0lVSGQYLJIZTTV6YnhnV3F0eWc/view?usp=sharing

Thanks to all who helped testing SHA, particularly 4ward who discovered performance on Intel CPUs
had improved in openssl 1.0.2.

Thanks for fix, you still have old link though so we cant actually download this fixed miner