[1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool

[Schleicher]

If I start p2pool after being offline in the night this happens just about every time:

• I start bitdoind
• After bitcoind has downloaded the latest block I start p2pool
• p2pool gets stuck at

Code:

2012-01-27 17:25:42.191000 Testing bitcoind P2P connection to '127.0.0.1:8333'...

• bitcoind seems to work just fine with 80 connections or so
• I stop p2pool and bitcoind and try again

And then this happens:

Code:

2012-01-27 17:26:20.021000 Pool: 125GH/s in 18594 shares (18598/25608 verified) Recent: 0.00% >0H/s Shares: 0 (0 orphan, 0 dead) Peers: 8 (0 incoming)
2012-01-27 17:26:20.021000 Average time between blocks: 0.52 days
2012-01-27 17:26:20.021000 Pool stales: 7% Own: 50±48% Own efficiency: 54±51%
2012-01-27 17:26:21.877000 Processing 838 shares...
2012-01-27 17:27:39.275000 Requesting parent share 1dea0858 from 98.237.21.199:9333
2012-01-27 17:27:39.275000 ... done processing 838 shares. New: 838 Have: 26446/~17280
2012-01-27 17:27:39.275000 > ---> LOST CONTACT WITH BITCOIND for 60 seconds, check that it isn't frozen or dead <---
2012-01-27 17:27:39.291000 Pool: 127GH/s in 26442 shares (26446/26446 verified) Recent: 0.00% >0H/s Shares: 0 (0 orphan, 0 dead) Peers: 8 (0 incoming)
2012-01-27 17:27:39.291000 Average time between blocks: 0.51 days
2012-01-27 17:27:39.291000 Pool stales: 9% Own: 50±48% Own efficiency: 55±52%
2012-01-27 17:28:07.621000 > ---> LOST CONTACT WITH BITCOIND for 60 seconds, check that it isn't frozen or dead <---
2012-01-27 17:28:07.621000 Pool: 127GH/s in 26449 shares (26453/26453 verified) Recent: 0.00% >0H/s Shares: 0 (0 orphan, 0 dead) Peers: 8 (0 incoming)
2012-01-27 17:28:07.621000 Average time between blocks: 0.51 days
2012-01-27 17:28:07.621000 Pool stales: 9% Own: 50±48% Own efficiency: 55±52%
2012-01-27 17:28:07.636000 Lost peer 93.187.142.114:9333
2012-01-27 17:28:07.636000 Lost peer 98.237.21.199:9333
2012-01-27 17:28:07.636000 Lost peer 173.170.54.85:9333
2012-01-27 17:28:07.636000 Lost peer 74.220.242.6:9334
2012-01-27 17:28:07.636000 Lost peer 66.41.108.220:9333
2012-01-27 17:28:07.636000 Lost peer 219.84.64.174:9333
2012-01-27 17:28:07.636000 Lost peer 83.211.86.49:9333
2012-01-27 17:28:07.636000 Lost peer 109.74.195.142:9333
2012-01-27 17:28:08.104000 Outgoing connection to peer 94.23.34.145:9333 established. p2pool version: 2 '6bc7e5a'

After this hiccup everything seems to be ok.

[forrestv]

I just updated to git head to try and use the cool graphs that you added, and now p2pool does not work.

Older version of rrdtool apparently didn't have the --no-overwrite option. It wasn't necessary, so I removed it from the current git version of P2Pool... so git pull and try again?

[JWU42]

Over 48 hours -- ack!!!! 

[Red Emerald]

I just updated to git head to try and use the cool graphs that you added, and now p2pool does not work.

Older version of rrdtool apparently didn't have the --no-overwrite option. It wasn't necessary, so I removed it from the current git version of P2Pool... so git pull and try again?

3d4b58e fixed the error about rrdtool and now p2pool starts. Thanks!

I still get the depreciation warning.

Code:

$ ./run_p2pool.py
/home/user/.virtualenvs/p2pool/src/p2pool/p2pool/bitcoin/data.py:220: DeprecationWarning: object.__new__() takes no parameters
  return Type.__new__(cls, bits, endianness)
2012-01-27 10:36:23.289400 p2pool (version 3d4b58e)

EDIT: What flavor of linux do you use to develop p2pool?  I'm running p2pool in a vm so I have no problem installing something not ubuntu. Mine is only ubuntu because thats the ISO I had

[Qoheleth]

Over 48 hours -- ack!!!! 

Yeah. It's really a shame that just as p2pool is starting to get its name out there, it enters an unlucky streak like this. Hope it clears up before people give up and go back to centralized mining.

[forrestv]

Everyone needs to upgrade to either git HEAD or the py2exe snapshot in the first post, http://u.forre.st/u/rtooosfo/p2pool_win32_1685a89.zip . There has been an ongoing problem with the sharechain forking, which I believe I solved in git about a week ago. However, many miners aren't running the newer version, and it appears that they have forked off due to evidence from picchio and the sudden decrease in hashrate.

[Qoheleth]

Everyone needs to upgrade to either git HEAD or the py2exe snapshot in the first post, http://u.forre.st/u/rtooosfo/p2pool_win32_1685a89.zip . There has been an ongoing problem with the sharechain forking, which I believe I solved in git about a week ago. However, many miners aren't running the newer version, and it appears that they have forked off due to evidence from picchio and the sudden decrease in hashrate.

Done. I suspect I already had the changes - I installed from git like two days ago - but I figured it'd be good to pull anyway just in case.

Question: when I restart my p2pool instance, my sharecount resets to 0. I'm still going to get paid for my shares from previous instances when the block is found, right?

[m3ta]

Question: when I restart my p2pool instance, my sharecount resets to 0. I'm still going to get paid for my shares from previous instances when the block is found, right?

Correct.

[Qoheleth]

Also, is this anything to worry about?

Code:

2012-01-27 11:04:50.593110 ... done processing 1001 shares. New: 1001 Have: 29403/~17280

Edit: After the git pull, I'm experiencing a lot of broken connections, both between my mining software and p2pool, and between p2pool and bitcoind.

Code:

2012-01-27 11:07:34.167449 New work for worker! Difficulty: 0.999985 Share difficulty: 205.446419 Payout if block: 0.092653 BTC Total block value: 50.022500 BTC including
 7 transactions
2012-01-27 11:07:35.805210 Pool: 93891MH/s in 18389 shares (25804/34445 verified) Recent: 0.00% >0H/s Shares: 0 (0 orphan, 0 dead) Peers: 11 (0 incoming)
2012-01-27 11:07:35.806512 Average time between blocks: 0.69 days
2012-01-27 11:07:35.810322 Pool stales: 12% Own: 50?48% Own efficiency: 57?54%
2012-01-27 11:07:38.487967 Processing 1001 shares...
2012-01-27 11:08:08.510520 Requesting parent share 7c5e2a46 from 93.97.192.93:9333
2012-01-27 11:08:08.513257 ... done processing 1001 shares. New: 1001 Have: 35446/~17280
2012-01-27 11:08:08.514202 > Watchdog timer went off at:
2012-01-27 11:08:08.514789 >   File "run_p2pool.py", line 5, in <module>
2012-01-27 11:08:08.515311 >     main.run()
2012-01-27 11:08:08.515767 >   File "[redacted]/p2pool/p2pool/main.py", line 1024, in run
2012-01-27 11:08:08.516208 >     reactor.run()
2012-01-27 11:08:08.516585 >   File "/usr/lib/python2.7/site-packages/twisted/internet/base.py", line 1162, in run
2012-01-27 11:08:08.516981 >     self.mainLoop()
2012-01-27 11:08:08.517379 >   File "/usr/lib/python2.7/site-packages/twisted/internet/base.py", line 1174, in mainLoop
2012-01-27 11:08:08.517772 >     self.doIteration(t)
2012-01-27 11:08:08.518172 >   File "/usr/lib/python2.7/site-packages/twisted/internet/selectreactor.py", line 140, in doSelect
2012-01-27 11:08:08.518570 >     _logrun(selectable, _drdw, selectable, method, dict)
2012-01-27 11:08:08.518963 >   File "/usr/lib/python2.7/site-packages/twisted/python/log.py", line 84, in callWithLogger
2012-01-27 11:08:08.519384 >     return callWithContext({"system": lp}, func, *args, **kw)
2012-01-27 11:08:08.519769 >   File "/usr/lib/python2.7/site-packages/twisted/python/log.py", line 69, in callWithContext
2012-01-27 11:08:08.520187 >     return context.call({ILogContext: newCtx}, func, *args, **kw)
2012-01-27 11:08:08.520583 >   File "/usr/lib/python2.7/site-packages/twisted/python/context.py", line 118, in callWithContext
2012-01-27 11:08:08.520981 >     return self.currentContext().callWithContext(ctx, func, *args, **kw)
2012-01-27 11:08:08.521394 >   File "/usr/lib/python2.7/site-packages/twisted/python/context.py", line 81, in callWithContext
2012-01-27 11:08:08.521801 >     return func(*args,**kw)
2012-01-27 11:08:08.522184 >   File "/usr/lib/python2.7/site-packages/twisted/internet/selectreactor.py", line 146, in _doReadOrWrite
2012-01-27 11:08:08.522589 >     why = getattr(selectable, method)()
2012-01-27 11:08:08.523138 >   File "/usr/lib/python2.7/site-packages/twisted/internet/tcp.py", line 460, in doRead
2012-01-27 11:08:08.523577 >     rval = self.protocol.dataReceived(data)
2012-01-27 11:08:08.523982 >   File "[redacted]/p2pool/p2pool/util/datachunker.py", line 40, in _DataChunker
2012-01-27 11:08:08.524406 >     wants = receiver.send(buf.get(wants))
2012-01-27 11:08:08.524950 >   File "[redacted]/p2pool/p2pool/bitcoin/p2p.py", line 64, in dataReceiver
2012-01-27 11:08:08.525389 >     self.packetReceived(command, payload2)
2012-01-27 11:08:08.525793 >   File "[redacted]/p2pool/p2pool/p2p.py", line 74, in packetReceived
2012-01-27 11:08:08.526207 >     bitcoin_p2p.BaseProtocol.packetReceived(self, command, payload2)
2012-01-27 11:08:08.526615 >   File "[redacted]/p2pool/p2pool/bitcoin/p2p.py", line 74, in packetReceived
2012-01-27 11:08:08.527009 >     handler(**payload2)
2012-01-27 11:08:08.527407 >   File "[redacted]/p2pool/p2pool/p2p.py", line 206, in handle_shares
2012-01-27 11:08:08.527794 >     self.node.handle_shares(res, self)
2012-01-27 11:08:08.528186 >   File "[redacted]/p2pool/p2pool/main.py", line 241, in handle_shares
2012-01-27 11:08:08.528584 >     set_real_work2()
2012-01-27 11:08:08.528945 >   File "[redacted]/p2pool/p2pool/main.py", line 155, in set_real_work2
2012-01-27 11:08:08.529375 >     best, desired = tracker.think(ht, pre_current_work.value['previous_block'])
2012-01-27 11:08:08.529766 >   File "[redacted]/p2pool/p2pool/data.py", line 369, in think
2012-01-27 11:08:08.530174 >     if not self.attempt_verify(share):
2012-01-27 11:08:08.530549 >   File "[redacted]/p2pool/p2pool/data.py", line 324, in attempt_verify
2012-01-27 11:08:08.531006 >     share.check(self)
2012-01-27 11:08:08.531411 >   File "[redacted]/p2pool/p2pool/data.py", line 141, in check
2012-01-27 11:08:08.531795 >     share_info, gentx = generate_transaction(tracker, self.share_info['share_data'], self.header['bits'].target, self.share_info['timestamp'], self.net)
2012-01-27 11:08:08.532275 >   File "[redacted]/p2pool/p2pool/data.py", line 219, in generate_transaction
2012-01-27 11:08:08.532676 >     attempts_per_second = get_pool_attempts_per_second(tracker, previous_share_hash, net.TARGET_LOOKBEHIND)
2012-01-27 11:08:08.533101 >   File "[redacted]/p2pool/p2pool/data.py", line 177, in get_pool_attempts_per_second
2012-01-27 11:08:08.533508 >     far = tracker.shares[tracker.get_nth_parent_hash(previous_share_hash, dist - 1)]
2012-01-27 11:08:08.535436 >   File "[redacted]/p2pool/p2pool/util/skiplist.py", line 55, in __call__
2012-01-27 11:08:08.536120 >     updates[x] = updates[x][0], self.combine_deltas(updates[x][1], delta) if updates[x][1] is not None else delta
2012-01-27 11:08:08.536772 >   File "[redacted]/p2pool/p2pool/main.py", line 770, in <lambda>
2012-01-27 11:08:08.537232 >     sys.stderr.write, 'Watchdog timer went off at:\n' + ''.join(traceback.format_stack())
2012-01-27 11:08:08.558903 Pool: 93891MH/s in 18389 shares (26805/35446 verified) Recent: 0.00% >0H/s Shares: 0 (0 orphan, 0 dead) Peers: 11 (0 incoming)
2012-01-27 11:08:08.559665 Average time between blocks: 0.69 days
2012-01-27 11:08:08.560096 Pool stales: 12% Own: 50?48% Own efficiency: 57?54%
2012-01-27 11:08:08.561238 > Error in HeightTracker._think2:
2012-01-27 11:08:08.561745 > Traceback (most recent call last):
2012-01-27 11:08:08.562160 > Failure: twisted.internet.defer.TimeoutError: Getting http://127.0.0.1:8332/ took longer than 5 seconds.
2012-01-27 11:08:08.563456 > Error getting work from bitcoind:
2012-01-27 11:08:08.563960 > Traceback (most recent call last):
2012-01-27 11:08:08.564376 > Failure: twisted.internet.defer.TimeoutError: Getting http://127.0.0.1:8332/ took longer than 5 seconds.
2012-01-27 11:08:08.760915 New work for worker! Difficulty: 0.999985 Share difficulty: 205.905325 Payout if block: 0.092665 BTC Total block value: 50.022500 BTC including 7 transactions
2012-01-27 11:08:11.561114 > ---> LOST CONTACT WITH BITCOIND for 60 seconds, check that it isn't frozen or dead <---

Edit 3: After restarting everything - bitcoind, p2pool, and my miner, things seem to be working again. Definitely keeping an eye on it, though.

[m3ta]

Also, is this anything to worry about?

Code:

2012-01-27 11:04:50.593110 ... done processing 1001 shares. New: 1001 Have: 29403/~17280

Your values are close to mine, doesn't seem to be any reason to be worried about.

Code:

2012-01-27 14:05:08.343585 ... done processing 1001 shares. New: 1001 Have: 34726/~17280

[Costia]

is there a list of all the things i can see at 127.0.0.1:9332/xxxx ?

[m3ta]

is there a list of all the things i can see at 127.0.0.1:9332/xxxx ?

Check the main.py file, around line 700.

[Costia]

found only "users" "fee" and "rate"

[forrestv]

found only "users" "fee" and "rate"

Upgrade p2pool

[m3ta]

found only "users" "fee" and "rate"

Then you have a version from 2006 or so. Kidding on the 2006, but.. upgrade.

[Costia]

thats from the zip he linked on this page...
meh. maybe i got old sources

edit:
yep
was looking on old sources
i run the binary from the zip...

[forrestv]

You can get a copy of the current developer version from https://github.com/forrestv/p2pool/downloads , or you could use a git client.

EDIT: Added link to https://github.com/forrestv/p2pool/zipball/master to first post.

[JWU42]

Did a git pull just to be safe...

[1onevvolf]

Looks like the pool may be going through a two-way chain split ATM. There are twice as many shares on the network as there are verified shares.

Code:

2012-01-27 21:23:55.012000 Pool: 90535MH/s in 17326 shares (17349/34619 verified) Recent: 0.68% >612MH/s Shares: 0 (0 orphan, 0 dead) Peers: 10 (0 incoming)

I suggest that everyone upgrade their versions ASAP!

[Costia]

i am getting dead shares with the git version.
which part of the code sets the difficulty lower for debugging?