[LOCKED] cpuminer-opt v3.12.3, open source optimized multi-algo CPU miner

[StelioKontos]

I'm trying to compile the 3.7.0 on a Centos 6.9 vm on virtualbox to later copy it ont a real machine server running the same Centos 6.9, I don't even know if it makes sense, but I'm doing it to not install extra packages in the real server.

After managing to bypass several errors and difficulties such as the #pragma error of gcc 4.4.7 by upgrading gcc (not so obvious), now I'm stuck with these:



Does a fix exist for the errors above or alternatively does a precompiled version exist of cpuminer-opt-3.7.0 to run in a Centos 6.9 system with this processor: https://ark.intel.com/it/products/88173/Intel-Xeon-Processor-E3-1245-v5-8M-Cache-3_50-GHz ( SSE4.1/4.2, AVX2 )?

Thank you in advance.

[joblo]

I'm trying to compile the 3.7.0 on a Centos 6.9 vm on virtualbox to later copy it ont a real machine server running the same Centos 6.9, I don't even know if it makes sense, but I'm doing it to not install extra packages in the real server.

After managing to bypass several errors and difficulties such as the #pragma error of gcc 4.4.7 by upgrading gcc (not so obvious), now I'm stuck with these:


Does a fix exist for the errors above or alternatively does a precompiled version exist of cpuminer-opt-3.7.0 to run in a Centos 6.9 system with this processor: https://ark.intel.com/it/products/88173/Intel-Xeon-Processor-E3-1245-v5-8M-Cache-3_50-GHz ( SSE4.1/4.2, AVX2 )?

Thank you in advance.

Those real servers would need most of the same packages, it's probably not worth it.

As for your compile error the first error is always the most important. From what you posted it looks like the Intel intrinsics aren't insrtalled.
You may find earlier errors for missing immintrin.h or files with similar names. I don't know if they exist for Centos 6, it's very old, or what
the package might be called.

[StelioKontos]

Those real servers would need most of the same packages, it's probably not worth it.

As for your compile error the first error is always the most important. From what you posted it looks like the Intel intrinsics aren't insrtalled.
You may find earlier errors for missing immintrin.h or files with similar names. I don't know if they exist for Centos 6, it's very old, or what
the package might be called.

Thanks for reply. Since I've root access on those dedicated machines I could install the packages but I preferrerd not, let's see. Too bad Centos was installed instead of Ubuntu.

[felixbrucker]

Those real servers would need most of the same packages, it's probably not worth it.

As for your compile error the first error is always the most important. From what you posted it looks like the Intel intrinsics aren't insrtalled.
You may find earlier errors for missing immintrin.h or files with similar names. I don't know if they exist for Centos 6, it's very old, or what
the package might be called.

Thanks for reply. Since I've root access on those dedicated machines I could install the packages but I preferrerd not, let's see. Too bad Centos was installed instead of Ubuntu.

You could run everything inside docker, if you are comfortable with that

[4ward]

It's controlled by configure.ac at line 111:

Code:

# GC2 for GNU static
if test "x$OS" = "xWindows_NT" ; then
   # MinGW
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthreadGC2",[])
else
   AC_CHECK_LIB([pthread], [pthread_create], PTHREAD_LIBS="-lpthread",[])
fi

It works as intended in the old MSYS environment but on cygwin linking fails because it can't find pthreadGC2.
I can't get cygwin to use the mingw toolchain which includes pthreadGC2. I've tried using --host and --build with
no luck.

yup, after linking with pthreadGC2 it works fine.
and it looks like it brings a very slight improve in performance (about 1% or so in a few algos that i benchmarked)
compiling sha version also works, too bad i don't have hardware to test it

[StelioKontos]

You could run everything inside docker, if you are comfortable with that

First time I heard of it, this could give an hint on how comfy I'm with it

Is is a vm manager like virtualbox or some kinda vps? Fact is I'm already paying - well, my boss is - for some dedicated servers with much power not to use and I'd loved to use them before going to spend other money around.

(sorry to the op because of this offtopic)

[joblo]

yup, after linking with pthreadGC2 it works fine.
and it looks like it brings a very slight improve in performance (about 1% or so in a few algos that i benchmarked)
compiling sha version also works, too bad i don't have hardware to test it

Good to read you got it working but too bad no significant improvement.

At my end I got it working using http://www.msys2.org/ but again no significant performance difference.

Msys2 is pretty clumsy to setup, nice installer but it only installs a minimal base system. Then you use a clumsy
package manager to install everything else.

gcc 6.3 7.2 and openssl 1.0.2l are available. Compiling with SHA works but I couldn't verify due to lack of SHA CPU.
It works fine from within Msys2 shell, getting it to work from a DOS shell required copying all the DLLs included in Mingw,
over 40 of them.

I don't like bundling DLLs, just delivering a Windows binary is scary enough. I was hoping there was a way to download
just the DLLs from Msys2 but they are all hidden in individual package files. It seems the only way to get them is to install
Msys2 and all the packages that provide the DLLs.

[felixbrucker]

You could run everything inside docker, if you are comfortable with that

First time I heard of it, this could give an hint on how comfy I'm with it

Is is a vm manager like virtualbox or some kinda vps? Fact is I'm already paying - well, my boss is - for some dedicated servers with much power not to use and I'd loved to use them before going to spend other money around.

(sorry to the op because of this offtopic)

here is a good starting point on what docker is: https://opensource.com/resources/what-docker

[dunedainbob]

Is this "yescryptR16" actually a new algorithm, or is it just yescrypt?   https://bitcointalk.org/index.php?topic=2329470.0

If new, any plans to support?  

Thanks!

Edit: source is at https://github.com/conan-equal-newone/yenten

[joblo]

Is this "yescryptR16" actually a new algorithm, or is it just yescrypt?   https://bitcointalk.org/index.php?topic=2329470.0

If new, any plans to support?  

Thanks!

Edit: source is at https://github.com/conan-equal-newone/yenten

Not until there's a stratum pool where I can test. It looks like the same hash function with different parameters.

[dunedainbob]

Is this "yescryptR16" actually a new algorithm, or is it just yescrypt?   https://bitcointalk.org/index.php?topic=2329470.0

If new, any plans to support?  

Thanks!

Edit: source is at https://github.com/conan-equal-newone/yenten

Not until there's a stratum pool where I can test. It looks like the same hash function with different parameters.

Is http://www.ypool.co a stratum pool?  Could you use that?  The pool operator apparently thought it was regular yescrypt so he set it up that way, but he's obviously not finding any blocks because no one is actually sending him yescryptR16 solutions.  Can you use his mistake to test, or does it not work that way?

BTW I don't mean to be pushy, if you can't be bothered (edit: or if it won't work) it's fine, I just thought I'd let you know in case you wanted to.

[StelioKontos]

I'm trying to compile the 3.7.0 on a Centos 6.9 vm on virtualbox to later copy it ont a real machine server running the same Centos 6.9, I don't even know if it makes sense, but I'm doing it to not install extra packages in the real server.

After managing to bypass several errors and difficulties such as the #pragma error of gcc 4.4.7 by upgrading gcc (not so obvious), now I'm stuck with these:


Does a fix exist for the errors above or alternatively does a precompiled version exist of cpuminer-opt-3.7.0 to run in a Centos 6.9 system with this processor: https://ark.intel.com/it/products/88173/Intel-Xeon-Processor-E3-1245-v5-8M-Cache-3_50-GHz ( SSE4.1/4.2, AVX2 )?

Thank you in advance.

Those real servers would need most of the same packages, it's probably not worth it.

As for your compile error the first error is always the most important. From what you posted it looks like the Intel intrinsics aren't insrtalled.
You may find earlier errors for missing immintrin.h or files with similar names. I don't know if they exist for Centos 6, it's very old, or what
the package might be called.

I'm slowly trying to come to an end at this

Followed your advice, did a make -B > makelog.txt.

First lines to popup on screen (they weren't redirected to makelog.txt, strange), were about 10 of this:

configure: WARNING: The assembler does not support the AVX2 instruction set.

It seems for that I need gcc 4.7 at least, I'm running gcc 4.4.7, I'll try to update this as first thing.

[StelioKontos]

You could run everything inside docker, if you are comfortable with that

First time I heard of it, this could give an hint on how comfy I'm with it

Is is a vm manager like virtualbox or some kinda vps? Fact is I'm already paying - well, my boss is - for some dedicated servers with much power not to use and I'd loved to use them before going to spend other money around.

(sorry to the op because of this offtopic)

here is a good starting point on what docker is: https://opensource.com/resources/what-docker

Thank you, I'll surely need that once I manage to compile the miner.

[StelioKontos]

configure: WARNING: The assembler does not support the AVX2 instruction set.

It seems for that I need gcc 4.7 at least, I'm running gcc 4.4.7, I'll try to update this as first thing.

Sorry if I flood the thread, but it may be useful information to others, too.

Managed to update to gcc 4.9 (thanks to this guy's comment), with:

(reminder: I'm on Centos6.9)

sudo yum install centos-release-scl
sudo yum install devtoolset-3-toolchain
scl enable devtoolset-3 bash

Relaunched make, got these lines on screen (still out of redirected txt, duh):



warning: implicit declaration of function ‘syslog’ [-Wimplicit-function-declaration]

Then many other lines started to popout, ending with these, that may be related to Intel intrinsics already mentioned before:



Now I try to fix all these, if you have any clues to spare, thank you in advance.

Found this for _mm_shuffle_epi8 of the last screenshot : https://msdn.microsoft.com/en-us/library/bb531427(v=vs.120).aspx

The full makelog2.txt: https://pastebin.com/yr6dexwL

---

after digging here and there, it looks like a matter of upgrading GCC to the greater version available, from my current 4.9 to 6.x or 7.x even.

[StelioKontos]

Another update, sorry for the spam.

Managed to install devtoolset-6 (GCC 6.3.1), it was quite straightforward:

Code:

sudo yum install centos-release-scl
sudo yum install devtoolset-6
scl enable devtoolset-6 bash

The errors are always there, but at least they more detailed. They are all very similar, I'll paste just one:

Code:

In file included from algo/echo/aes_ni/vperm.h:20:0,
    from algo/echo/aes_ni/hash:21:
/opt/rh/devtoolset-6/root/usr/lib/gcc/x86_64-redhat-linux/6.3.1/include/tmmintrin.h:136:1: error: inlining failed in call to always_inline '_mm_shuffle_epi8' : target specific option mismatch
 _mm_shuffle_epi8 (__m128i __X, __m128i __Y)
 ^~~~~~~~~~~~~~~~

Searching in and here found just this similar question: https://stackoverflow.com/questions/43128698/inlining-failed-in-call-to-always-inline-mm-mullo-epi32-target-specific-opti but not much idea how to proceed.

[joblo]

Another update, sorry for the spam.

Managed to install devtoolset-6 (GCC 6.3.1), it was quite straightforward:

Code:

sudo yum install centos-release-scl
sudo yum install devtoolset-6
scl enable devtoolset-6 bash

The errors are always there, but at least they more detailed. They are all very similar, I'll paste just one:

Code:

In file included from algo/echo/aes_ni/vperm.h:20:0,
    from algo/echo/aes_ni/hash:21:
/opt/rh/devtoolset-6/root/usr/lib/gcc/x86_64-redhat-linux/6.3.1/include/tmmintrin.h:136:1: error: inlining failed in call to always_inline '_mm_shuffle_epi8' : target specific option mismatch
 _mm_shuffle_epi8 (__m128i __X, __m128i __Y)
 ^~~~~~~~~~~~~~~~

Searching in and here found just this similar question: https://stackoverflow.com/questions/43128698/inlining-failed-in-call-to-always-inline-mm-mullo-epi32-target-specific-opti but not much idea how to proceed.

You're trying to compile for a CPU archietcture simulated by Virtualbox. Even if the compile was successful it wouldn't work properly
on real hardware. I do not support attempts to cross compile on Linux. You're on your own.

[joblo]

cpuminer-opt-3.7.1 is released.

Added yescryptr16 algo for Yenten coin
Added SHA support to yescrypt and yescryptr16

These features have not been tested and have a higher risk of problems. Please report any problems
in this thread.

It would also be appreciated if a Ryzen user could report the performance difference with SHA enabled.
SHA support requires compiling from source on a recent Linux distribution, see RELEASE_NOTES
for details. The Windows binaries do not include SHA support.

git: https://github.com/JayDDee/cpuminer-opt

tarball: https://drive.google.com/file/d/0B0lVSGQYLJIZZXoyZkRNLUc2cE0/view?usp=sharing

windows binaries: https://drive.google.com/file/d/0B0lVSGQYLJIZTTV6YnhnV3F0eWc/view?usp=sharing

[FlowLive]

cpuminer-opt-3.7.1 is released.

Added yescryptr16 algo for Yenten coin
Added SHA support to yescrypt and yescryptr16

These features have not been tested and have a higher risk of problems. Please report any problems
in this thread.

It would also be appreciated if a Ryzen user could report the performance difference with SHA enabled.
SHA support requires compiling from source on a recent Linux distribution, see RELEASE_NOTES
for details. The Windows binaries do not include SHA support.

git: https://github.com/JayDDee/cpuminer-opt

tarball: https://drive.google.com/file/d/0B0lVSGQYLJIZZXoyZkRNLUc2cE0/view?usp=sharing

windows binaries: https://drive.google.com/file/d/0B0lVSGQYLJIZTTV6YnhnV3F0eWc/view?usp=sharing

Do you mean to say that SHA is now enabled in binaries? Or only for yescrypt and yescriptr16 or that it still needs to be compiled regardless?

Also I am trying to mine Yenten but keep getting

Code:

[2017-10-31 12:54:42] stratum_recv_line failed
[2017-10-31 12:54:42] ...retry after 10 seconds

[joblo]

Do you mean to say that SHA is now enabled in binaries? Or only for yescrypt and yescriptr16 or that it still needs to be compiled regardless?

Also I am trying to mine Yenten but keep getting

Code:

[2017-10-31 12:54:42] stratum_recv_line failed
[2017-10-31 12:54:42] ...retry after 10 seconds

There is no SHA support in any binaries for any algos. The only way to get it is to compile yourself with a supported
CPU, compiler, openssl, and algo.

I'm not aware of any working pools but the error you see suggests a connection was made and then failed.
Need more info including command line (minus sensitive data) and miner output. If there is a working pool
I can do some testing myself.

I see you also posted connection problems in the Yenten thread. That is likely the cause of your stratum errors,
assuming you are trying to connect to an external address, ie a pool.
 
Stratum is the default if you don't specify the protocol in the url. If you're mining the wallet you must specify
-o http://<ipaddr>:<port>

Also don't use -a yescrypt for yenten, that's the old yescrypt but was used as a quick and dirty hack in yenten-minerd.

[FlowLive]

Yes I use yescryptr16 and it's solo mining.

The only way I succeeded was but connecting a vpn... weird...

So now I can mine using the built-in miner or using minerd, I'm getting around 1100h/s but wanted to see the difference with yours as I always get better results with it!