Hotmetal
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 03, 2014, 12:01:05 PM |
|
Why does it automatically set thread count to ~cpu count?
Using your formula:
[2014-08-03 13:19:33] accepted: 12/12 (100.00%), 514.93 H/s at diff 444 (yay!!!) [2014-08-03 13:19:34] accepted: 13/13 (100.00%), 513.02 H/s at diff 444 (yay!!!) [2014-08-03 13:19:35] accepted: 14/14 (100.00%), 528.15 H/s at diff 444 (yay!!!) [2014-08-03 13:19:35] accepted: 15/15 (100.00%), 525.17 H/s at diff 444 (yay!!!)
Perhaps this should be added to the original post? Its a BIG improvement.
To answer my own question, it appears as though the improvement is noticed only when the server has a large number of cpus / cache etc. Older machines seem to perform better with a larger amount of threads, even when cpu count is lower. I'm breaking > 10 000 H/s without even breaking a sweat across a few machines. Thank you
|
|
|
|
|
5w00p
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 01:44:03 AM |
|
8 Core Xeon gets 370 hash/sec all day, all night with 8 threads in ubuntu 14.04 w/ hugepages=24.
|
|
|
|
5w00p
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 01:48:16 AM |
|
Why does it automatically set thread count to ~cpu count?
Using your formula:
[2014-08-03 13:19:33] accepted: 12/12 (100.00%), 514.93 H/s at diff 444 (yay!!!) [2014-08-03 13:19:34] accepted: 13/13 (100.00%), 513.02 H/s at diff 444 (yay!!!) [2014-08-03 13:19:35] accepted: 14/14 (100.00%), 528.15 H/s at diff 444 (yay!!!) [2014-08-03 13:19:35] accepted: 15/15 (100.00%), 525.17 H/s at diff 444 (yay!!!)
Perhaps this should be added to the original post? Its a BIG improvement.
To answer my own question, it appears as though the improvement is noticed only when the server has a large number of cpus / cache etc. Older machines seem to perform better with a larger amount of threads, even when cpu count is lower. I'm breaking > 10 000 H/s without even breaking a sweat across a few machines. Thank you really, because 10,000/528 = ~19. 19 is a "few machines?" edit: and that diff is pathetically low. 444 is for a pentium 2 or someshit.
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 10:42:03 AM |
|
Looking for instructions on how to enable MADV_HUGEPAGE on Centos 6.5 , anyone ??
|
|
|
|
Hotmetal
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 11:41:33 AM |
|
really, because 10,000/528 = ~19. 19 is a "few machines?"
edit: and that diff is pathetically low. 444 is for a pentium 2 or someshit.
Yes, 19 is a "few machines". There are plenty more to use across different pools / coins. Difficulty is assigned by the network and will scale up and down. 444 is the starting difficulty for that pool and its gotten considerably higher now. Lighten up, you sound like you're having a bad day ![Wink](https://bitcointalk.org/Smileys/default/wink.gif)
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 01:54:34 PM |
|
Looking for instructions on how to enable MADV_HUGEPAGE on Centos 6.5 , anyone ??
You can't, because CentOS is garbage. I had to add in a flag to disable some optimizations for that shit OS. I know it is, is there any other way to get it to run on centos ? If i compile on ubuntu and run on centos it complains about glibc version (2.14 required, centos runs 2.12). Any other way ? Is it possible to include glibc in the static binary ? EDIT : Removing MADV_HUGEPAGE from cpu-miner.c fixes the problem but with a significant loss in speed. I need the extra speed!!
|
|
|
|
pallas
Legendary
Offline
Activity: 2716
Merit: 1094
Black Belt Developer
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 01:57:25 PM |
|
Looking for instructions on how to enable MADV_HUGEPAGE on Centos 6.5 , anyone ??
You can't, because CentOS is garbage. I had to add in a flag to disable some optimizations for that shit OS. I know it is, is there any other way to get it to run on centos ? If i compile on ubuntu and run on centos it complains about glibc version (2.14 required, centos runs 2.12). Any other way ? Is it possible to include glibc in the static binary ? EDIT : Removing MADV_HUGEPAGE from cpu-miner.c fixes the problem but with a significant loss in speed. I need the extra speed!! the static binary can include everything. did you try: ./configure --enable-static or CFLAGS='-static' ?
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 01:59:39 PM |
|
Looking for instructions on how to enable MADV_HUGEPAGE on Centos 6.5 , anyone ??
You can't, because CentOS is garbage. I had to add in a flag to disable some optimizations for that shit OS. I know it is, is there any other way to get it to run on centos ? If i compile on ubuntu and run on centos it complains about glibc version (2.14 required, centos runs 2.12). Any other way ? Is it possible to include glibc in the static binary ? EDIT : Removing MADV_HUGEPAGE from cpu-miner.c fixes the problem but with a significant loss in speed. I need the extra speed!! the static binary can include everything. did you try: ./configure --enable-static or CFLAGS='-static' ? Yes i have, i can't get past curl requirements even though i compiled curl from source with static flags.. I am not sure glibc is included in the static bin, can anyone confirm, dont want to waste time troubleshooting curl
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 02:04:02 PM |
|
Curl 7.31.1 compiled with : ./configure --disable-shared --enable-static --prefix=/usr/local --disable-ldap --disable-sspi make -j 4;make install;
miner still errors out: ./autogen.sh ./configure CFLAGS="-static' checking for the version of libcurl... 7.37.1 checking for libcurl >= version 7.15.2... yes checking whether libcurl is usable... no configure: error: Missing required libcurl >= 7.15.2
Any ideas ?
|
|
|
|
Hotmetal
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 06:24:01 PM |
|
Curl 7.31.1 compiled with : ./configure --disable-shared --enable-static --prefix=/usr/local --disable-ldap --disable-sspi make -j 4;make install;
miner still errors out: ./autogen.sh ./configure CFLAGS="-static' checking for the version of libcurl... 7.37.1 checking for libcurl >= version 7.15.2... yes checking whether libcurl is usable... no configure: error: Missing required libcurl >= 7.15.2
Any ideas ?
./configure is looking at curl prefix in /usr (depending on the distro). You might want configure curl like: ./configure --disable-shared --enable-static --prefix=/tmp/curl --disable-ldap --disable-sspi make ; make install then the miner: ./autogen.sh ./configure CFLAGS="-static' --with-libcurl=/tmp/curl make
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 06:27:02 PM |
|
Curl 7.31.1 compiled with : ./configure --disable-shared --enable-static --prefix=/usr/local --disable-ldap --disable-sspi make -j 4;make install;
miner still errors out: ./autogen.sh ./configure CFLAGS="-static' checking for the version of libcurl... 7.37.1 checking for libcurl >= version 7.15.2... yes checking whether libcurl is usable... no configure: error: Missing required libcurl >= 7.15.2
Any ideas ?
./configure is looking at curl prefix in /usr (depending on the distro). You might want configure curl like: ./configure --disable-shared --enable-static --prefix=/tmp/curl --disable-ldap --disable-sspi make ; make install then the miner: ./autogen.sh ./configure CFLAGS="-static' --with-libcurl=/tmp/curl make Tried it, no luck. Curl author should be hanged in public!!
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 07:13:55 PM |
|
Hm... try this: make distclean ./autogen.sh CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl
Same error, checking for libcurl >= version 7.15.2... yes checking whether libcurl is usable... no configure: error: Missing required libcurl >= 7.15.2 Dynamic compilation works just fine...
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 07:33:11 PM |
|
Hm... try this: make distclean ./autogen.sh CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl
Same error, checking for libcurl >= version 7.15.2... yes checking whether libcurl is usable... no configure: error: Missing required libcurl >= 7.15.2 Dynamic compilation works just fine... Pastebin config.log. http://pastebin.com/UMLA4K6B
|
|
|
|
primer-
Legendary
Offline
Activity: 1092
Merit: 1000
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 07:45:44 PM |
|
Hm... try this: make distclean ./autogen.sh CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl
Same error, checking for libcurl >= version 7.15.2... yes checking whether libcurl is usable... no configure: error: Missing required libcurl >= 7.15.2 Dynamic compilation works just fine... Pastebin config.log. http://pastebin.com/UMLA4K6BYou built libcurl with zlib, but you did not build a static copy; therefore it looks for one because you forced static compilation and cannot find it, thus the failure. PFF, stupid curl configuration scrit, version 7.37 is buggy as hell!! I got it compiled now with 7.34 : Static CURL : wget http://curl.haxx.se/download/curl-7.34.0.tar.gz ./configure --disable-shared --enable-static make -j 4;make install;
cpu miner ./autogen.sh ./configure CFLAGS="-static" make -j 4
|
|
|
|
tgt
Newbie
Offline
Activity: 19
Merit: 0
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 08:44:12 PM |
|
1600 H/s: 4x Opteron 6344 (48 physical cores @ 2.6ghz static) 64G ram (12x4GB ddr3- 14.04, built from wolf's git source inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster) sysctl -w vm.nr_hugepages=144 pool reporting > 2kh, miner at 1600-1650kh/s. https://i.imgur.com/qdQkiBi.pngCould probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.
|
|
|
|
liteon
Legendary
Offline
Activity: 1092
Merit: 1000
I'm a Firestarter!
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 09:21:02 PM |
|
1600 H/s:
4x Opteron 6344 (48 physical cores @ 2.6ghz static) 64G ram (12x4GB ddr3- 14.04, built from wolf's git source
inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster) sysctl -w vm.nr_hugepages=144
pool reporting > 2kh, miner at 1600-1650kh/s.
Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.
Reduce it to sysctl -w vm.nr_hugepages=48 Will be at least 20% more power.
|
Selling NordVPN account with premium sub - expires 2021! PM me to buy.
|
|
|
5w00p
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 10:40:47 PM |
|
really, because 10,000/528 = ~19. 19 is a "few machines?"
edit: and that diff is pathetically low. 444 is for a pentium 2 or someshit.
Yes, 19 is a "few machines". There are plenty more to use across different pools / coins. Difficulty is assigned by the network and will scale up and down. 444 is the starting difficulty for that pool and its gotten considerably higher now. Lighten up, you sound like you're having a bad day ![Wink](https://bitcointalk.org/Smileys/default/wink.gif) Ok, well I guess every day I have is a "bad day" compared to the world you live in where six figures USD worth of hardware is at your disposal and you nonchalantly work them like rented mules mining XMR like it's going out of style. Kick a brother down a Xeon server or two. will ya? ![Wink](https://bitcointalk.org/Smileys/default/wink.gif)
|
|
|
|
5w00p
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 04, 2014, 10:44:27 PM |
|
1600 H/s: 4x Opteron 6344 (48 physical cores @ 2.6ghz static) 64G ram (12x4GB ddr3- 14.04, built from wolf's git source inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster) sysctl -w vm.nr_hugepages=144 pool reporting > 2kh, miner at 1600-1650kh/s. ![](https://ip.bitcointalk.org/?u=https%3A%2F%2Fi.imgur.com%2FqdQkiBi.png&t=665&c=-XEml02SADfwvQ) Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler. I hit 1030 or so with 23 threads on AWS - you probably need to reduce your thread count. Wolf, why would he want to REDUCE his hashrate? He reports 1600 hash/sec and you report 1030. ![Huh](https://bitcointalk.org/Smileys/default/huh.gif)
|
|
|
|
Hotmetal
|
![](https://bitcointalk.org/Themes/custom1/images/post/xx.gif) |
August 05, 2014, 06:35:59 AM |
|
Ok, well I guess every day I have is a "bad day" compared to the world you live in where six figures USD worth of hardware is at your disposal and you nonchalantly work them like rented mules mining XMR like it's going out of style. Kick a brother down a Xeon server or two. will ya? ![Wink](https://bitcointalk.org/Smileys/default/wink.gif) It's more in the region of 7 figures USD worth of hardware. At the moment I'm just playing around on the portion of the development cluster. Need to make sure things are running optimally before XMR mining is moved to production. I'm responsible that way ![Tongue](https://bitcointalk.org/Smileys/default/tongue.gif)
|
|
|
|
|