[1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool

[forrestv]

Well, I hate to do it, but I just pulled my 2GH/s from P2Pool.  Something is very seriously wrong.  I have been keeping it up to date, so don't tell me it's me version of p2pool or bitcoin, it's not.  Over the last 4 days I have watched my payout per block drop from around 0.4 to 0.15 on the last one, and p2pool.info is showing 950MH/s.  I will come back, but after what ever the hell is broken is fixed.

Were you getting more orphaned or dead shares, or was the number of shares that you got decreasing?

[1714206320]

1714206320

[1714206320]

1714206320

[1714206320]

1714206320

[TheHarbinger]

Well, I hate to do it, but I just pulled my 2GH/s from P2Pool.  Something is very seriously wrong.  I have been keeping it up to date, so don't tell me it's me version of p2pool or bitcoin, it's not.  Over the last 4 days I have watched my payout per block drop from around 0.4 to 0.15 on the last one, and p2pool.info is showing 950MH/s.  I will come back, but after what ever the hell is broken is fixed.

Were you getting more orphaned or dead shares, or was the number of shares that you got decreasing?

No, everything local stayed the same.  Orphaned/dead stayed around 5% overall, still cranking out shares about every 25 minutes, nothing here reporting errors anywhere.  Just a steady decrease in hashrate shown at p2pool.info and a steady decline in payout values.  It's like over 50% of my hashrate/shares are leaving my end, but aren't making it into the chain.

I just did a fresh install of Bitcoin 0.6.0r2 and p2pool on the server and re-downloaded the chains on both of them, going to give it until tomorrow morning to see if that fixed it, if not, i have to pull out back to a pool until the problem is located.

[DeathAndTaxes]

If your non-stale share count per hour is staying the same then it seems illogical payments would be declining.

Your payment address didn't somehow change did it?

[TheHarbinger]

If your non-stale share count per hour is staying the same then it seems illogical payments would be declining.

Your payment address didn't somehow change did it?

Nope,  been using the same .bat file to start up with the same payout address since I started on p2pool over a month ago.

[tiker]

.. and after the last restart there's no more block not found errors but a new one...

Code:

2012-03-08 21:33:41.950670 Got share hash, requesting! Hash: 297eeb74
2012-03-08 21:33:42.052282 Sending 1 shares to 67.183.247.222:54312
2012-03-08 21:33:42.157850 RECV shares 0100fd68010100000090029e66be214fee0ede0031afe5dfe84970f2cd492fd70ff705000000000000f8e2fc18b8cf2504949e0ae29ef6713b0586f5d39cf7a0f0a299c8059a948598248594f0c350b1a4fe4f1d5a0721cc412bd06081d520d9ac4c5b9...
2012-03-08 21:33:42.294022 > Error handling message: (see RECV line)
2012-03-08 21:33:42.294234 > Traceback (most recent call last):
2012-03-08 21:33:42.294404 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/selectreactor.py", line 146, in _doReadOrWrite
2012-03-08 21:33:42.294547 >     why = getattr(selectable, method)()
2012-03-08 21:33:42.294671 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/tcp.py", line 460, in doRead
2012-03-08 21:33:42.294850 >     rval = self.protocol.dataReceived(data)
2012-03-08 21:33:42.295034 >   File "/home/ed/apps/p2pool/p2pool/p2p.py", line 55, in new_dataReceived
2012-03-08 21:33:42.295178 >     old_dataReceived(data)
2012-03-08 21:33:42.295296 >   File "/home/ed/apps/p2pool/p2pool/util/datachunker.py", line 40, in _DataChunker
2012-03-08 21:33:42.295416 >     wants = receiver.send(buf.get(wants))
2012-03-08 21:33:42.295558 > --- <exception caught here> ---
2012-03-08 21:33:42.295675 >   File "/home/ed/apps/p2pool/p2pool/bitcoin/p2p.py", line 53, in dataReceiver
2012-03-08 21:33:42.295794 >     self.packetReceived(command, type_.unpack(payload))
2012-03-08 21:33:42.295967 >   File "/home/ed/apps/p2pool/p2pool/p2p.py", line 68, in packetReceived
2012-03-08 21:33:42.296109 >     bitcoin_p2p.BaseProtocol.packetReceived(self, command, payload2)
2012-03-08 21:33:42.296265 >   File "/home/ed/apps/p2pool/p2pool/bitcoin/p2p.py", line 66, in packetReceived
2012-03-08 21:33:42.296381 >     handler(**payload2)
2012-03-08 21:33:42.296502 >   File "/home/ed/apps/p2pool/p2pool/p2p.py", line 199, in handle_shares
2012-03-08 21:33:42.296621 >     self.node.handle_shares([p2pool_data.Share.from_share(share, self.node.net, self) for share in shares, self)
2012-03-08 21:33:42.296774 >   File "/home/ed/apps/p2pool/p2pool/data.py", line 187, in from_share
2012-03-08 21:33:42.296895 >     raise ValueError('unknown share type: %r' % (share['type'],))
2012-03-08 21:33:42.297047 > exceptions.ValueError: unknown share type: 0
2012-03-08 21:33:42.297854 Lost peer 67.183.247.222:54312 - Connection was closed cleanly.

[forrestv]

No, everything local stayed the same.  Orphaned/dead stayed around 5% overall, still cranking out shares about every 25 minutes, nothing here reporting errors anywhere.  Just a steady decrease in hashrate shown at p2pool.info and a steady decline in payout values.  It's like over 50% of my hashrate/shares are leaving my end, but aren't making it into the chain.

I just did a fresh install of Bitcoin 0.6.0r2 and p2pool on the server and re-downloaded the chains on both of them, going to give it until tomorrow morning to see if that fixed it, if not, i have to pull out back to a pool until the problem is located.

Can you run P2Pool in debug mode (--debug) and give me the logs in the morning? If you're already gone, the logs would be helpful even without --debug.

[forrestv]

.. and after the last restart there's no more block not found errors but a new one...

Normal, just an old peer. The next release will hide this message unless you're in debug mode..

[dub0matic]

all these problems that you are having with the RC. why dont you just use 5.2 or whatever it is. Are they really that different

[pent]

Hi. What this output means in your generated block?

http://blockexplorer.com/tx/ad2ab11753a96e2ca9e161de2766ed93ae6f1d26f819c53449e35569fe13c824#o1

OP_IFDUP OP_IF OP_2SWAP OP_VERIFY OP_2OVER OP_DEPTH

In this thread guys suggested me that someone put string "script" into CScript()

https://bitcointalk.org/index.php?topic=67158.0

This script actually spells "script"

Op Code	Decimal	Ascii Code
OP_IFDUP	115	s
OP_IF	99	c
OP_2SWAP	114	r
OP_VERIFY	105	i
OP_2OVER	112	p
OP_DEPTH	116	t

http://blockchain.info/tx/41836560e2439f440514af96ca394a38bad6f3d9d0d11dba667c886b16e504ec?show_adv=true

Also this trans has inputs < outputs! What is that?

[Diapolo]

anyone else getting tons of these.. or just me? I am on rc2, for sure. Earlier in this thread it was mentioned it is supposed to be 'ok', but still.. it isn't going away..

2012-03-08 19:22:44.788000 >     return g.throw(self.type, self.value, self.tb)
2012-03-08 19:22:44.788000 >   File "C:\data\miner2\p2pool-a15c106\p2pool\util\jsonrpc.py", line 67, in callRemote
2012-03-08 19:22:44.788000 >     raise Error(**resp['error'])
2012-03-08 19:22:44.789000 > p2pool.util.jsonrpc.Error: -5 Block not found
2012-03-08 19:22:44.790000

I had that one, too ... p2pool seems to work though.

Dia

[ThiagoCMC]

Running the latest P2Pool with Bitcoin 0.6.0 rc2 and...:

Code:

./p2pool/run_p2pool.py --version
0.9.2-24-ge7d5fbf

Code:

2012-03-09 06:48:05.670369 P2Pool: 17324 shares in chain (17328 verified/17328 total) Peers: 24 (12 incoming)
2012-03-09 06:48:05.670512  Local: 0H/s in last 0.0 seconds Local dead on arrival: ??? Expected time to share: ???
2012-03-09 06:48:05.670633  Shares: 0 (0 orphan, 0 dead) Stale rate: ??? Efficiency: ??? Current payout: 0.0000 BTC
2012-03-09 06:48:05.670749  Pool: 266GH/s Stale rate: 7.6% Expected time to block: 6.7 hours
2012-03-09 06:48:05.761092 Sending 1 shares to 67.183.247.222:64734
2012-03-09 06:48:05.966699 RECV shares 0100fd080101000000a6de4cdbe11844f81e9bba38f06a11a58d65872c71c549526b04000000000000af7acb85d67eceae9b19dd8779335b724893d49dfe4c70ef4e7e1bd80a3cdfabb8cf594f0c350b1afc0c599e8f37055648c27357b13c53ee764b35...
2012-03-09 06:48:05.967329 > Error handling message: (see RECV line)
2012-03-09 06:48:05.967448 > Traceback (most recent call last):
2012-03-09 06:48:05.967569 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/selectreactor.py", line 146, in _doReadOrWrite
2012-03-09 06:48:05.967682 >     why = getattr(selectable, method)()
2012-03-09 06:48:05.967793 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/tcp.py", line 460, in doRead
2012-03-09 06:48:05.967904 >     rval = self.protocol.dataReceived(data)
2012-03-09 06:48:05.968015 >   File "/home/administrativo/p2pool/p2pool/p2p.py", line 55, in new_dataReceived
2012-03-09 06:48:05.968127 >     old_dataReceived(data)
2012-03-09 06:48:05.968235 >   File "/home/administrativo/p2pool/p2pool/util/datachunker.py", line 40, in _DataChunker
2012-03-09 06:48:05.968347 >     wants = receiver.send(buf.get(wants))
2012-03-09 06:48:05.968455 > --- <exception caught here> ---
2012-03-09 06:48:05.968565 >   File "/home/administrativo/p2pool/p2pool/bitcoin/p2p.py", line 53, in dataReceiver
2012-03-09 06:48:05.968676 >     self.packetReceived(command, type_.unpack(payload))
2012-03-09 06:48:05.968784 >   File "/home/administrativo/p2pool/p2pool/p2p.py", line 68, in packetReceived
2012-03-09 06:48:05.968895 >     bitcoin_p2p.BaseProtocol.packetReceived(self, command, payload2)
2012-03-09 06:48:05.969006 >   File "/home/administrativo/p2pool/p2pool/bitcoin/p2p.py", line 66, in packetReceived
2012-03-09 06:48:05.969116 >     handler(**payload2)
2012-03-09 06:48:05.969225 >   File "/home/administrativo/p2pool/p2pool/p2p.py", line 199, in handle_shares
2012-03-09 06:48:05.969374 >     self.node.handle_shares([p2pool_data.Share.from_share(share, self.node.net, self) for share in shares], self)
2012-03-09 06:48:05.969490 >   File "/home/administrativo/p2pool/p2pool/data.py", line 187, in from_share
2012-03-09 06:48:05.969602 >     raise ValueError('unknown share type: %r' % (share['type'],))
2012-03-09 06:48:05.969711 > exceptions.ValueError: unknown share type: 0
2012-03-09 06:48:05.970169 Lost peer 67.183.247.222:64734 - Connection was closed cleanly.
2012-03-09 06:48:08.701801 P2Pool: 17324 shares in chain (17328 verified/17328 total) Peers: 23 (11 incoming)
2012-03-09 06:48:08.701988  Local: 0H/s in last 0.0 seconds Local dead on arrival: ??? Expected time to share: ???
2012-03-09 06:48:08.702144  Shares: 0 (0 orphan, 0 dead) Stale rate: ??? Efficiency: ??? Current payout: 0.0000 BTC
2012-03-09 06:48:08.702267  Pool: 266GH/s Stale rate: 7.6% Expected time to block: 6.7 hours

I just move to another pool temporally... Under huge debt, variance kills me... But I keep P2Pool running 24x7...

Best,
Thiago

[neptop]

It still works. This error only means that there is someone with an old client out there. Doesn't affect you other than seeing that message.

[DeathAndTaxes]

Honestly I think all that is needed is some less scary error handling.

Code:

2012-03-09 06:48:05.966699 RECV shares 0100fd080101000000a6de4cdbe11844f81e9bba38f06a11a58d65872c71c549526b04000000000000af7acb85d67eceae9b19dd8779335b724893d49dfe4c70ef4e7e1bd80a3cdfabb8cf594f0c350b1afc0c599e8f37055648c27357b13c53ee764b35...
2012-03-09 06:48:05.967329 > Error handling message: (see RECV line)
2012-03-09 06:48:05.967448 > Traceback (most recent call last):
2012-03-09 06:48:05.967569 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/selectreactor.py", line 146, in _doReadOrWrite
2012-03-09 06:48:05.967682 >     why = getattr(selectable, method)()
2012-03-09 06:48:05.967793 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/tcp.py", line 460, in doRead
2012-03-09 06:48:05.967904 >     rval = self.protocol.dataReceived(data)
2012-03-09 06:48:05.968015 >   File "/home/administrativo/p2pool/p2pool/p2p.py", line 55, in new_dataReceived
2012-03-09 06:48:05.968127 >     old_dataReceived(data)
2012-03-09 06:48:05.968235 >   File "/home/administrativo/p2pool/p2pool/util/datachunker.py", line 40, in _DataChunker
2012-03-09 06:48:05.968347 >     wants = receiver.send(buf.get(wants))
2012-03-09 06:48:05.968455 > --- <exception caught here> ---
2012-03-09 06:48:05.968565 >   File "/home/administrativo/p2pool/p2pool/bitcoin/p2p.py", line 53, in dataReceiver
2012-03-09 06:48:05.968676 >     self.packetReceived(command, type_.unpack(payload))
2012-03-09 06:48:05.968784 >   File "/home/administrativo/p2pool/p2pool/p2p.py", line 68, in packetReceived
2012-03-09 06:48:05.968895 >     bitcoin_p2p.BaseProtocol.packetReceived(self, command, payload2)
2012-03-09 06:48:05.969006 >   File "/home/administrativo/p2pool/p2pool/bitcoin/p2p.py", line 66, in packetReceived
2012-03-09 06:48:05.969116 >     handler(**payload2)
2012-03-09 06:48:05.969225 >   File "/home/administrativo/p2pool/p2pool/p2p.py", line 199, in handle_shares
2012-03-09 06:48:05.969374 >     self.node.handle_shares([p2pool_data.Share.from_share(share, self.node.net, self) for share in shares], self)
2012-03-09 06:48:05.969490 >   File "/home/administrativo/p2pool/p2pool/data.py", line 187, in from_share
2012-03-09 06:48:05.969602 >     raise ValueError('unknown share type: %r' % (share['type'],))
2012-03-09 06:48:05.969711 > exceptions.ValueError: unknown share type: 0

vs

Code:

2012-03-09 06:48:05.966699 RECV shares 0100fd080101000000a6de4cdbe11844f81e9bba38f06a11a58d65872c71c549526b04000000000000af7acb85d67eceae9b19dd8779335b724893d49dfe4c70ef4e7e1bd80a3cdfabb8cf594f0c350b1afc0c599e8f37055648c27357b13c53ee764b35...
2012-03-09 06:48:05.966699 Error parsing share.  Invalid share type. Rejecting share and notifying peer.

or

Code:

2012-03-09 06:48:05.966699 RECV shares 0100fd080101000000a6de4cdbe11844f81e9bba38f06a11a58d65872c71c549526b04000000000000af7acb85d67eceae9b19dd8779335b724893d49dfe4c70ef4e7e1bd80a3cdfabb8cf594f0c350b1afc0c599e8f37055648c27357b13c53ee764b35...
2012-03-09 06:48:05.966699 Incompatible share from obsolete version of p2pool.  Rejecting share and notifying peer

depending on the situation.

[tomtheminer]

Code:

2012-03-09 16:57:47.431000 p2pool (version 1f87c32)
2012-03-09 16:57:47.431000 
2012-03-09 16:57:47.431000 Testing bitcoind RPC connection to 'http://127.0.0.1:8332/' with username 'user'...
2012-03-09 16:57:48.460000 > Error while checking bitcoind identity:
2012-03-09 16:57:48.460000 > Traceback (most recent call last):
2012-03-09 16:57:48.460000 > Failure: twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 10061: No connection could be made because the target machine actively refused it..
2012-03-09 16:57:50.488000 > Error while checking bitcoind identity:
2012-03-09 16:57:50.488000 > Traceback (most recent call last):
2012-03-09 16:57:50.488000 > Failure: twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 10061: No connection could be made because the target machine actively refused it..
2012-03-09 16:57:52.516000 > Error while checking bitcoind identity:
2012-03-09 16:57:52.516000 > Traceback (most recent call last):
2012-03-09 16:57:52.516000 > Failure: twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 10061: No connection could be made because the target machine actively refused it..

I'm getting this error, can anyone help me?

[twmz]

Code:

2012-03-09 16:57:48.460000 > Failure: twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 10061: No connection could be made because the target machine actively refused it..

I'm getting this error, can anyone help me?

That error means that either bitcoind is not running (p2pool is looking for it on the same machine as the p2pool process) or is not configured to accept RPC requests.  

[runeks]

anyone else getting tons of these.. or just me? I am on rc2, for sure. Earlier in this thread it was mentioned it is supposed to be 'ok', but still.. it isn't going away..

2012-03-08 19:22:44.788000 >     return g.throw(self.type, self.value, self.tb)
2012-03-08 19:22:44.788000 >   File "C:\data\miner2\p2pool-a15c106\p2pool\util\jsonrpc.py", line 67, in callRemote
2012-03-08 19:22:44.788000 >     raise Error(**resp['error'])
2012-03-08 19:22:44.789000 > p2pool.util.jsonrpc.Error: -5 Block not found
2012-03-08 19:22:44.790000

I had that one, too ... p2pool seems to work though.

Dia

I experience this as well:

Code:

2012-03-09 17:35:27.652975 > Error:
2012-03-09 17:35:27.653049 > Traceback (most recent call last):
2012-03-09 17:35:27.653086 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 545, in _runCallbacks
2012-03-09 17:35:27.653122 >     current.result = callback(current.result, *args, **kw)
2012-03-09 17:35:27.653157 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1095, in gotResult
2012-03-09 17:35:27.653192 >     _inlineCallbacks(r, g, deferred)
2012-03-09 17:35:27.653226 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1037, in _inlineCallbacks
2012-03-09 17:35:27.653261 >     result = result.throwExceptionIntoGenerator(g)
2012-03-09 17:35:27.653296 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 382, in throwExceptionIntoGenerator
2012-03-09 17:35:27.653331 >     return g.throw(self.type, self.value, self.tb)
2012-03-09 17:35:27.653366 > --- <exception caught here> ---
2012-03-09 17:35:27.653400 >   File "/home/user/p2pool/p2pool/util/deferral.py", line 30, in f
2012-03-09 17:35:27.653434 >     result = yield func(*args, **kwargs)
2012-03-09 17:35:27.653468 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1037, in _inlineCallbacks
2012-03-09 17:35:27.653503 >     result = result.throwExceptionIntoGenerator(g)
2012-03-09 17:35:27.653543 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 382, in throwExceptionIntoGenerator
2012-03-09 17:35:27.653581 >     return g.throw(self.type, self.value, self.tb)
2012-03-09 17:35:27.653615 >   File "/home/user/p2pool/p2pool/util/deferral.py", line 147, in __call__
2012-03-09 17:35:27.653649 >     value = yield self.func(key)
2012-03-09 17:35:27.653683 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1037, in _inlineCallbacks
2012-03-09 17:35:27.653718 >     result = result.throwExceptionIntoGenerator(g)
2012-03-09 17:35:27.653752 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 382, in throwExceptionIntoGenerator
2012-03-09 17:35:27.653798 >     return g.throw(self.type, self.value, self.tb)
2012-03-09 17:35:27.653832 >   File "/home/user/p2pool/p2pool/main.py", line 171, in <lambda>
2012-03-09 17:35:27.653866 >     height_cacher = deferral.DeferredCacher(defer.inlineCallbacks(lambda block_hash: defer.returnValue((lambda x: x['blockcount'] if 'blockcount' in x else x['height'])((yield bitcoind.rpc_getblock('%x' % (block_hash,)))))))
2012-03-09 17:35:27.653903 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1037, in _inlineCallbacks
2012-03-09 17:35:27.653939 >     result = result.throwExceptionIntoGenerator(g)
2012-03-09 17:35:27.653973 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 382, in throwExceptionIntoGenerator
2012-03-09 17:35:27.654007 >     return g.throw(self.type, self.value, self.tb)
2012-03-09 17:35:27.654041 >   File "/home/user/p2pool/p2pool/util/jsonrpc.py", line 67, in callRemote
2012-03-09 17:35:27.654075 >     raise Error(**resp['error'])
2012-03-09 17:35:27.654109 > p2pool.util.jsonrpc.Error: -2 Safe mode: WARNING: Displayed transactions may not be correct!  You may need to upgrade, or other nodes may need to upgrade.

I just stopped p2pool, pulled the newest version from git, and started it again. So it can't be due to an outdated version.
Before stopping p2pool my "Current payout" was "0.0000 BTC", apparently due to a lot of orphaned shares recently. I will try letting it run a bit and see if this persists.

[runeks]

I restarted cgminer as well. It seems cgminer won't even connect to p2pool. cgminer is using my backup pool instead.

The p2pool log only contains these errors it seems: http://pastebin.com/uCEdHzvu

[kjj]

I restarted cgminer as well. It seems cgminer won't even connect to p2pool. cgminer is using my backup pool instead.

The p2pool log only contains these errors it seems: http://pastebin.com/uCEdHzvu

Go back a few pages.  This is a known problem with bitcoind 0.6.0rc1.  You need to either upgrade to rc2, or add a -paytoscripthashtime option to your config file or command line.

[Red Emerald]

I restarted cgminer as well. It seems cgminer won't even connect to p2pool. cgminer is using my backup pool instead.

The p2pool log only contains these errors it seems: http://pastebin.com/uCEdHzvu

Go back a few pages.  This is a known problem with bitcoind 0.6.0rc1.  You need to either upgrade to rc2, or add a -paytoscripthashtime option to your config file or command line.

"WARNING: Displayed transactions may not be correct!  You may need to upgrade, or other nodes may need to upgrade."

Do what the error says...  Upgrade.

[runeks]

Thanks guys. I hadn't considered it might be a bitcoind problem.

EDIT: I'm experiencing this as well. bitcoind is stuck at exactly block 170059. Will try re-downloading the block chain.

I think 0.6.0rc1 broke my blk0001.dat,  blkindex.dat or something else not located in .bitcoin/ (is there something else?)
When I get home I will also delete these files. (I have a 170190+ blockchain here that I will try first, before downloading the whole thing again)

I thought this too.. but mine did recover after ~5 min after installing rc2.

I gave it another hour, but it didn't recover. I copied the blockchain files from another machine and now it works.