Pooled/Remote Mining - Open Source - Updated 2010-12-24

[doublec]

puddinpop, some timestats.txt for the last few hours:

Code:

section	count	time
BitcoinMinerRemote Handling Messages	3538540	6125980632
BitcoinMinerRemoteServer::AddDistributionFromContributed	7444	12161303
BitcoinMinerRemoteServer::BlockToJson	7444	37761410
BitcoinMinerRemoteServer::DecodeBase64	1137964	7965160
BitcoinMinerRemoteServer::EncodeBase64	14888	110513
BitcoinMinerRemoteServer::GetAllClientsCalculatedKHashFromBest	990	12888072
BitcoinMinerRemoteServer::GetAllClientsCalculatedKHashFromMeta	990	5102865
BitcoinMinerRemoteServer::GetOldestNonVerifiedMetaHashClient	1684875	13319578
BitcoinMinerRemoteServer::SendWork	7444	218351595
BitcoinMinerRemoteServer::Step	3538541	1986327641
MetaHashVerifier::Start	398	112139
MetaHashVerifier::Step	78488	1280946445
RemoteClientConnection::GetCalculatedKHashRateFromBestHash	104395	12802790
RemoteClientConnection::GetCalculatedKHashRateFromMetaHash	104395	5005396
RemoteClientConnection::GetNewestSentWorkWithMetaHash	1606785	8341113
RemoteClientConnection::GetSentWorkByID	1137964	3100622
RemoteClientConnection::MessageReady	327210958	585449940
RemoteClientConnection::ProtocolError	327210958	575656559
RemoteClientConnection::ReceiveMessage	1140525	300611249
RemoteClientConnection::SendMessage	20680	17677026
RemoteClientConnection::SetWorkVerified	384	1151
RemoteClientConnection::SocketReceive	753356	11741667
RemoteClientConnection::SocketSend	19110	1143503950
VerifyBestHash	1001002	6195863

[1713862034]

1713862034

[1713862034]

1713862034

[1713862034]

1713862034

[1713862034]

1713862034

[doublec]

The server got stuck idling and producing zero hashes again. I've temporarily fallen back to the previous server, version 1.2.1, until the problem is resolved. Note that 1.2.1 is averaging about 60% the CPU usage of 1.2.2.

[kaspar]

What's the best way to finetune the opencl implementation?

If I run DiabloMiner with -w 256, I get about ~250mhash/s, which seems to be maximum, as the Catalyt Control Center displays almost 100% GPU Usage. However, if I use the OpenCL remoteminer, I peak at 100mhash/s. (-aggression 12, everything else above 12 crashes the miner)
I tried to play with the -gputhreads and -gpugrid parameters, but could not achieve any better results.

Do you have any ideas to get a similiar performance from opencl-remoteminer?

EDIT: Also the remote-opencl-client consumes a lot more cpu power (33% on 4x2.4GHz). Same is valid for the CUDA client, which runs on a different video card. Why do those versions consume such a high amount of CPU power? In contrast: DiabloMiner's CPU load is at 2%.

Current system configuration:

OS: Win 7 Pro x64
CPU: Q6600 (4x2.4GHz)
Video #1: Radeon HD 5850
Video #2: Gefore 9600 GT

[kaspar]

Some idea just came to my head:

We could write a "wrapper"-client to the pooling-server which revealsthe standard rpc-API to other clients. This would enable us to use every BC mining client out there for remote-mining. Or do I miss some obstacle here?

[puddinpop]

The server got stuck idling and producing zero hashes again. I've temporarily fallen back to the previous server, version 1.2.1, until the problem is resolved. Note that 1.2.1 is averaging about 60% the CPU usage of 1.2.2.

Where was the trouble when you attached the debugger?  I tried to duplicate this here, but I don't have enough hash rate locally to overload the server.  It sounds like a network issue to me, but it's possible it could be something else.  Are you sure you have enough upload bandwidth to the server?  Is your host throttling it?

[doublec]

Where was the trouble when you attached the debugger?  I tried to duplicate this here, but I don't have enough hash rate locally to overload the server.  It sounds like a network issue to me, but it's possible it could be something else.  Are you sure you have enough upload bandwidth to the server?  Is your host throttling it?

I saw nothing obvious in the debugger. It still seemed to be stepping through the clients ok. Is it possible for a slow or malicious client to cause the server to block or slow down?

I should have enough bandwidth. I have a similar server that serves a lot more traffic than this one running the pooled miner. That said my host has been killing the server for excessive CPU usage recently so anything is possible.

Is anyone else willing to run/take over running the pool that might have a more reliable server or connection?

[Enky1974]

I joined the remote server at 173.255.205.10 with a Nvidia 8800 GTS 512mb DDR3 (448 cores at 750mhz)
i have an average of 17400 khash/sec, not bad compared to 4400 Khash/sec of my intel Q6600 2.4ghz quadcore.

the log:
Client will start 1 miner threads
Attempting to connect to 173.255.205.10:8335
Connected to 173.255.205.10:8335
Got message 2 from server.
Server version 1.2.1
Setting CUDA device to Max GFlops device at index 0
Device info for GeForce 8800 GTS 512 :
Compute Capability : 1.1
Clock Rate (hz) : 1750000
CUDA finding best kernel configuration
Done allocating CUDA resources for (16,16)
Got message 4 from server.
Finding best configuration step end (16,16) 1609ms  prev best=9223372036854775807ms
Done allocating CUDA resources for (16,32)
Finding best configuration step end (16,32) 844ms  prev best=1609ms
Done allocating CUDA resources for (16,64)
Finding best configuration step end (16,64) 438ms  prev best=844ms
Done allocating CUDA resources for (16,128)
Finding best configuration step end (16,128) 250ms  prev best=438ms
Done allocating CUDA resources for (16,256)
Finding best configuration step end (16,256) 172ms  prev best=250ms
Done allocating CUDA resources for (32,16)
Finding best configuration step end (32,16) 844ms  prev best=172ms
Done allocating CUDA resources for (32,32)
Finding best configuration step end (32,32) 437ms  prev best=172ms
Done allocating CUDA resources for (32,64)
Finding best configuration step end (32,64) 250ms  prev best=172ms
Done allocating CUDA resources for (32,128)
Finding best configuration step end (32,128) 188ms  prev best=172ms
Done allocating CUDA resources for (32,256)
Finding best configuration step end (32,256) 172ms  prev best=172ms
Done allocating CUDA resources for (64,16)
Got message 10 from server.
Server Status : 92 clients, 186538 khash/s

[Cdecker]

I'd be willing to host one of the pool miners, but I'm a bit strapped for time in near time. Also I'm wondering what resources I need. I can create a virtual machine with quite some resources but I cannot use all of the resources. May I host it through Tor?

[sjaak]

I'd be willing to host one of the pool miners, but I'm a bit strapped for time in near time. Also I'm wondering what resources I need. I can create a virtual machine with quite some resources but I cannot use all of the resources. May I host it through Tor?

Hey,

A new server was proposed in another thread: http://bitcointalk.org/index.php?topic=2027.msg30042#msg30042

[Cdecker]

I'd be willing to host one of the pool miners, but I'm a bit strapped for time in near time. Also I'm wondering what resources I need. I can create a virtual machine with quite some resources but I cannot use all of the resources. May I host it through Tor?

Hey,

A new server was proposed in another thread: http://bitcointalk.org/index.php?topic=2027.msg30042#msg30042

That's settled then ^^
Looking forward to join the pool.

[RichardG]

Does anyone know how to obtain working stats directly from the server without having to start mining?

The code suggests so, but I don't know C[++].

[jiffy]

Hi,

is anyone of you able to build a statically linked version of the bitcoin-pool server? I found a static one of the client but not of the server. The reason is I GAVE UP! I tried compiling the sources since the last weekend without success. As soon as I solved an issue the next one was rising up.

The machine on which I like to use the server is 64 bits Ubuntu 8.04. But, just as a sidenote, I also tried to build it on Ubuntu 10.10 32 Bits which doesn't work better.


73!

[puddinpop]

The fist post has been updated with a new release.  In addition to some small code tweaks, the server now displays the bandwidth being used in the GUI, and there is a miner client using the 4way hash code.

[inertia]

Hi,

is anyone of you able to build a statically linked version of the bitcoin-pool server? I found a static one of the client but not of the server. The reason is I GAVE UP! I tried compiling the sources since the last weekend without success. As soon as I solved an issue the next one was rising up.

The machine on which I like to use the server is 64 bits Ubuntu 8.04. But, just as a sidenote, I also tried to build it on Ubuntu 10.10 32 Bits which doesn't work better.


73!

Hey, jiffy, did you install ibdb4.8++-dev before trying to compile on Ubuntu 10.10?

[jiffy]

Hi,

is anyone of you able to build a statically linked version of the bitcoin-pool server...

Hey, jiffy, did you install ibdb4.8++-dev before trying to compile on Ubuntu 10.10?

Hey, thanks for your reply.

I had 4.7 installed as it was mentioned in the build-unix.txt . I now installed 4.8 and tried again.

I now get

Code:

make
Linking CXX executable bitcoind
CMakeFiles/bitcoind.dir/__/src/db.cpp.o: In function `CDB::CDB(char const*, char const*)':
db.cpp:(.text+0x1c5): undefined reference to `DbEnv::set_lg_dir(char const*)'
db.cpp:(.text+0x1d9): undefined reference to `DbEnv::set_lg_max(unsigned int)'
db.cpp:(.text+0x1ed): undefined reference to `DbEnv::set_lk_max_locks(unsigned int)'
db.cpp:(.text+0x201): undefined reference to `DbEnv::set_lk_max_objects(unsigned int)'
db.cpp:(.text+0x22c): undefined reference to `DbEnv::set_errfile(_IO_FILE*)'
db.cpp:(.text+0x248): undefined reference to `DbEnv::set_flags(unsigned int, int)'
db.cpp:(.text+0x273): undefined reference to `DbEnv::open(char const*, unsigned int, int)'
db.cpp:(.text+0x428): undefined reference to `Db::Db(DbEnv*, unsigned int)'
CMakeFiles/bitcoind.dir/__/src/db.cpp.o: In function `CDB::CDB(char const*, char const*)':
db.cpp:(.text+0xa5d): undefined reference to `DbEnv::set_lg_dir(char const*)'
db.cpp:(.text+0xa71): undefined reference to `DbEnv::set_lg_max(unsigned int)'
db.cpp:(.text+0xa85): undefined reference to `DbEnv::set_lk_max_locks(unsigned int)'
db.cpp:(.text+0xa99): undefined reference to `DbEnv::set_lk_max_objects(unsigned int)'
db.cpp:(.text+0xac4): undefined reference to `DbEnv::set_errfile(_IO_FILE*)'
db.cpp:(.text+0xae0): undefined reference to `DbEnv::set_flags(unsigned int, int)'
db.cpp:(.text+0xb0b): undefined reference to `DbEnv::open(char const*, unsigned int, int)'
db.cpp:(.text+0xcc0): undefined reference to `Db::Db(DbEnv*, unsigned int)'
CMakeFiles/bitcoind.dir/__/src/db.cpp.o: In function `CDB::Close()':
db.cpp:(.text+0x116e): undefined reference to `DbTxn::abort()'
db.cpp:(.text+0x1237): undefined reference to `DbEnv::txn_checkpoint(unsigned int, unsigned int, unsigned int)'

[doublec]

I had 4.7 installed as it was mentioned in the build-unix.txt . I now installed 4.8 and tried again.

I now get

Edit CMakeCache.txt. Change the line that references libdb.so to libdb_cxx.so.

[slush]

You may be interested that we started another mining pool yesterday. Works with all standard CPU/GPU miners and we already found three blocks in one day. First block was already paid (it works differently than yours pool, transactions to users aren't directly inside block). http://bitcointalk.org/index.php?topic=1976.0. You are welcome!

[puddinpop]

The first post has been updated with the latest release.  The source was updated to SVN 205 and there's just some other minor code changes.  No need to update unless you really like having the latest release.

[LZ]

Will be an update here? It will be great if gethashespersec will show total hashps for all connected miners.

[doublec]

Will be an update here? It will be great if gethashespersec will show total hashps for all connected miners.

I added this to puddinpop's code in a branch of my github repository mirroring his code: https://github.com/doublec/bitcoin-pool/tree/lowcpu

With this code 'gethashespersec' will show the total server hash rate. It also adds a command line option '-distributionpercent' allowing the server operator to set the percentage of the generated coins that are available for distribution (the rest go to the server operator). It rounds the generated coin amounts to 3dp as well to help prevent dust accumulation in miners wallets. Feel free to cherry-pick the commits that interest you.