Bitcoin Forum
September 23, 2017, 05:55:05 AM *
News: Latest stable version of Bitcoin Core: 0.15.0.1  [Torrent]. (New!)
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 [25] 26 27 28 29 30 31 32 33 34 35 36 »
  Print  
Author Topic: Wolf's XMR/BCN/DSH CPUMiner - 2x speed compared to LucasJones' - NEW 06/20/2014  (Read 398609 times)
primer-
Legendary
*
Offline Offline

Activity: 1022



View Profile
August 04, 2014, 06:27:02 PM
 #481

Curl 7.31.1 compiled with :
./configure --disable-shared --enable-static --prefix=/usr/local --disable-ldap --disable-sspi
make -j 4;make install;

miner still errors out:
./autogen.sh
./configure CFLAGS="-static'
checking for the version of libcurl... 7.37.1
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2

Any ideas ?

./configure is looking at curl prefix in /usr (depending on the distro). You might want configure curl like:
./configure --disable-shared --enable-static --prefix=/tmp/curl --disable-ldap --disable-sspi
make ; make install

then the miner:
./autogen.sh
./configure CFLAGS="-static' --with-libcurl=/tmp/curl
make



Tried it, no luck. Curl author should be hanged in public!!
1506146105
Hero Member
*
Offline Offline

Posts: 1506146105

View Profile Personal Message (Offline)

Ignore
1506146105
Reply with quote  #2

1506146105
Report to moderator
1506146105
Hero Member
*
Offline Offline

Posts: 1506146105

View Profile Personal Message (Offline)

Ignore
1506146105
Reply with quote  #2

1506146105
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1506146105
Hero Member
*
Offline Offline

Posts: 1506146105

View Profile Personal Message (Offline)

Ignore
1506146105
Reply with quote  #2

1506146105
Report to moderator
1506146105
Hero Member
*
Offline Offline

Posts: 1506146105

View Profile Personal Message (Offline)

Ignore
1506146105
Reply with quote  #2

1506146105
Report to moderator
1506146105
Hero Member
*
Offline Offline

Posts: 1506146105

View Profile Personal Message (Offline)

Ignore
1506146105
Reply with quote  #2

1506146105
Report to moderator
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 07:02:01 PM
 #482

Curl 7.31.1 compiled with :
./configure --disable-shared --enable-static --prefix=/usr/local --disable-ldap --disable-sspi
make -j 4;make install;

miner still errors out:
./autogen.sh
./configure CFLAGS="-static'
checking for the version of libcurl... 7.37.1
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2

Any ideas ?

./configure is looking at curl prefix in /usr (depending on the distro). You might want configure curl like:
./configure --disable-shared --enable-static --prefix=/tmp/curl --disable-ldap --disable-sspi
make ; make install

then the miner:
./autogen.sh
./configure CFLAGS="-static' --with-libcurl=/tmp/curl
make



Tried it, no luck. Curl author should be hanged in public!!

Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 07:03:48 PM
 #483

Looking for instructions on how to enable MADV_HUGEPAGE on Centos 6.5 , anyone ??

You can't, because CentOS is garbage. I had to add in a flag to disable some optimizations for that shit OS.

I know it is, is there any other way to get it to run on centos ? If i compile on ubuntu and run on centos it complains about glibc version (2.14 required, centos runs 2.12). Any other way ? Is it possible to include glibc in the static binary ?

EDIT : Removing MADV_HUGEPAGE from cpu-miner.c fixes the problem but with a significant loss in speed. I need the extra speed!!

You CAN compile the whole thing statically - but the thing is, DNS resolution will be fucked. You'll need to use your pool's IP. Also, god knows if hugepages will even work on CentOS, it may just fail to malloc().

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
primer-
Legendary
*
Offline Offline

Activity: 1022



View Profile
August 04, 2014, 07:13:55 PM
 #484


Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Same error,
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2


Dynamic compilation works just fine...
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 07:30:07 PM
 #485


Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Same error,
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2


Dynamic compilation works just fine...

Pastebin config.log.


Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
primer-
Legendary
*
Offline Offline

Activity: 1022



View Profile
August 04, 2014, 07:33:11 PM
 #486


Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Same error,
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2


Dynamic compilation works just fine...

Pastebin config.log.




http://pastebin.com/UMLA4K6B
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 07:37:06 PM
 #487


Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Same error,
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2


Dynamic compilation works just fine...

Pastebin config.log.




http://pastebin.com/UMLA4K6B
You built libcurl with zlib, but you did not build a static copy; therefore it looks for one because you forced static compilation and cannot find it, thus the failure.

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
primer-
Legendary
*
Offline Offline

Activity: 1022



View Profile
August 04, 2014, 07:45:44 PM
 #488


Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Same error,
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2


Dynamic compilation works just fine...

Pastebin config.log.




http://pastebin.com/UMLA4K6B
You built libcurl with zlib, but you did not build a static copy; therefore it looks for one because you forced static compilation and cannot find it, thus the failure.


PFF, stupid curl configuration scrit, version 7.37 is buggy as hell!!

I got it compiled now with 7.34 :

Static CURL :
Code:
wget http://curl.haxx.se/download/curl-7.34.0.tar.gz
 ./configure --disable-shared --enable-static
make -j 4;make install;

cpu miner
Code:
./autogen.sh
./configure CFLAGS="-static"
make -j 4

Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 07:58:50 PM
 #489


Hm... try this:

Code:
make distclean
./autogen.sh
CFLAGS="-I/tmp/curl/include" LDFLAGS="-static -L/tmp/curl/lib" ./configure --with-libcurl=/tmp/curl

Same error,
checking for libcurl >= version 7.15.2... yes
checking whether libcurl is usable... no
configure: error: Missing required libcurl >= 7.15.2


Dynamic compilation works just fine...

Pastebin config.log.




http://pastebin.com/UMLA4K6B
You built libcurl with zlib, but you did not build a static copy; therefore it looks for one because you forced static compilation and cannot find it, thus the failure.


PFF, stupid curl configuration scrit, version 7.37 is buggy as hell!!

I got it compiled now with 7.34 :

Static CURL :
Code:
wget http://curl.haxx.se/download/curl-7.34.0.tar.gz
 ./configure --disable-shared --enable-static
make -j 4;make install;

cpu miner
Code:
./autogen.sh
./configure CFLAGS="-static"
make -j 4


Perfect. Remember about the fucked DNS resolution.

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
tgt
Newbie
*
Offline Offline

Activity: 19


View Profile
August 04, 2014, 08:44:12 PM
 #490

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.

http://i.imgur.com/qdQkiBi.png

Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.

Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 08:47:38 PM
 #491

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.



Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.



I hit 1030 or so with 23 threads on AWS - you probably need to reduce your thread count.

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
liteon
Legendary
*
Offline Offline

Activity: 966


[ free spot ]


View Profile WWW
August 04, 2014, 09:21:02 PM
 #492

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.



Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.

Reduce it to sysctl -w vm.nr_hugepages=48
Will be at least 20% more power.

____ ____ ____ ____ ____ ____
||l |||i |||t |||e |||o |||n ||
5w00p
Hero Member
*****
Offline Offline

Activity: 630



View Profile
August 04, 2014, 10:40:47 PM
 #493


really, because 10,000/528 = ~19.  19 is a "few machines?"

edit: and that diff is pathetically low.  444 is for a pentium 2 or someshit.

Yes, 19 is a "few machines". There are plenty more to use across different pools / coins.
Difficulty is assigned by the network and will scale up and down. 444 is the starting difficulty for that pool and its gotten considerably higher now.

Lighten up, you sound like you're having a bad day Wink

Ok, well I guess every day I have is a "bad day" compared to the world you live in where six figures USD worth of hardware is at your disposal and you nonchalantly work them like rented mules mining XMR like it's going out of style.  Kick a brother down a Xeon server or two. will ya?  Wink
5w00p
Hero Member
*****
Offline Offline

Activity: 630



View Profile
August 04, 2014, 10:44:27 PM
 #494

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.



Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.



I hit 1030 or so with 23 threads on AWS - you probably need to reduce your thread count.

Wolf, why would he want to REDUCE his hashrate?

He reports 1600 hash/sec and you report 1030.  Huh
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 04, 2014, 11:19:13 PM
 #495

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.



Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.



I hit 1030 or so with 23 threads on AWS - you probably need to reduce your thread count.

Wolf, why would he want to REDUCE his hashrate?

He reports 1600 hash/sec and you report 1030.  Huh

Because he has 48 physical cores, I had 16.

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
Hotmetal
Sr. Member
****
Offline Offline

Activity: 294


View Profile
August 05, 2014, 06:35:59 AM
 #496

Ok, well I guess every day I have is a "bad day" compared to the world you live in where six figures USD worth of hardware is at your disposal and you nonchalantly work them like rented mules mining XMR like it's going out of style.  Kick a brother down a Xeon server or two. will ya?  Wink

It's more in the region of 7 figures USD worth of hardware. At the moment I'm just playing around on the portion of the development cluster.
Need to make sure things are running optimally before XMR mining is moved to production. I'm responsible that way Tongue
5w00p
Hero Member
*****
Offline Offline

Activity: 630



View Profile
August 06, 2014, 03:28:17 AM
 #497

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.



Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.



I hit 1030 or so with 23 threads on AWS - you probably need to reduce your thread count.

Wolf, why would he want to REDUCE his hashrate?

He reports 1600 hash/sec and you report 1030.  Huh

Because he has 48 physical cores, I had 16.

OK. What AWS instance type has Opterons?
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 06, 2014, 03:37:05 AM
 #498

1600 H/s:

4x Opteron 6344 (48 physical cores @ 2.6ghz static)
64G ram (12x4GB ddr3-
14.04, built from wolf's git source

inside KVM with cpu-passthrough (couldn't get it to run on 12.04 which is host's bare metal OS, could potentially be faster)
sysctl -w vm.nr_hugepages=144

pool reporting > 2kh, miner at 1600-1650kh/s.



Could probably get better performance by a) running it on baremetal, b) using numactl and a better task scheduler.



I hit 1030 or so with 23 threads on AWS - you probably need to reduce your thread count.

Wolf, why would he want to REDUCE his hashrate?

He reports 1600 hash/sec and you report 1030.  Huh

Because he has 48 physical cores, I had 16.

OK. What AWS instance type has Opterons?

None, but I doubt that 16 Intel cores would get 55% of the hash that 48 AMD cores get, assuming the Opterons are reasonably new and support AES-NI.

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
5w00p
Hero Member
*****
Offline Offline

Activity: 630



View Profile
August 06, 2014, 03:38:34 AM
 #499

OK.  What instance type did you get 1030 hash/sec on 16 cores?
Wolf0
Legendary
*
Offline Offline

Activity: 1694


Miner Developer


View Profile
August 06, 2014, 04:24:14 AM
 #500

OK.  What instance type did you get 1030 hash/sec on 16 cores?

The only instance type with 16 cores that's meant for compute. c3.8xlarge.

Code:
Donations: BTC: 1WoLFdwcfNEg64fTYsX1P25KUzzSjtEZC -- XMR: 45SLUTzk7UXYHmzJ7bFN6FPfzTusdUVAZjPRgmEDw7G3SeimWM2kCdnDQXwDBYGUWaBtZNgjYtEYA22aMQT4t8KfU3vHLHG
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 [25] 26 27 28 29 30 31 32 33 34 35 36 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!