Finding p2pool networks.py values for new altcoins

[squiggie]

I've recently tried to port p2pool to some newer alt coins and have been hitting a brick wall. I'm pretty sure this going beyond basic network.py values but I wanted to get some opinions.

I've tried setting this up for grandcoin, lottocoin, luckycoin and earthcoin. The one I'm most interested in getting to work is earthcoin, so let's take that one for example. This is the error I receive when running it.

Code:

Testing bitcoind RPC connection to 'http://127.0.0.1:5555/' with username 'user'...
2013-12-30 00:24:16.668394 > Error getting work from bitcoind:
2013-12-30 00:24:16.668474 > Traceback (most recent call last):
2013-12-30 00:24:16.668509 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 545, in _runCallbacks
2013-12-30 00:24:16.668538 >     current.result = callback(current.result, *args, **kw)
2013-12-30 00:24:16.668566 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1095, in gotResult
2013-12-30 00:24:16.668598 >     _inlineCallbacks(r, g, deferred)
2013-12-30 00:24:16.668626 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1037, in _inlineCallbacks
2013-12-30 00:24:16.668675 >     result = result.throwExceptionIntoGenerator(g)
2013-12-30 00:24:16.668704 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 382, in throwExceptionIntoGenerator
2013-12-30 00:24:16.668732 >     return g.throw(self.type, self.value, self.tb)
2013-12-30 00:24:16.668759 > --- <exception caught here> ---
2013-12-30 00:24:16.668785 >   File "/home/x/p2pool-eac/p2pool/util/deferral.py", line 41, in f
2013-12-30 00:24:16.668812 >     result = yield func(*args, **kwargs)
2013-12-30 00:24:16.668838 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1039, in _inlineCallbacks
2013-12-30 00:24:16.668866 >     result = g.send(result)
2013-12-30 00:24:16.668892 >   File "/home/x/p2pool-eac/p2pool/bitcoin/helper.py", line 49, in getwork
2013-12-30 00:24:16.668919 >     transactions=map(bitcoin_data.tx_type.unpack, packed_transactions),
2013-12-30 00:24:16.668945 >   File "/home/x/p2pool-eac/p2pool/util/pack.py", line 63, in unpack
2013-12-30 00:24:16.668972 >     obj = self._unpack(data, ignore_trailing)
2013-12-30 00:24:16.668998 >   File "/home/x/p2pool-eac/p2pool/util/pack.py", line 47, in _unpack
2013-12-30 00:24:16.669024 >     raise LateEnd()
2013-12-30 00:24:16.669050 > p2pool.util.pack.LateEnd:

Now, what I noticed is in the pack.py file, the functions

Code:

def _unpack(self, data, ignore_trailing=False):
        obj, (data2, pos) = self.read((data, 0))

        assert data2 is data

        if pos != len(data) and not ignore_trailing:
            raise LateEnd()

        return obj

 def unpack(self, data, ignore_trailing=False):
        obj = self._unpack(data, ignore_trailing)

        if p2pool.DEBUG:
            packed = self._pack(obj)
            good = data.startswith(packed) if ignore_trailing else data == packed
            if not good:
                raise AssertionError()

        return obj

is where the error is being thrown. The pos is always 1 character bigger then len(data) when the error is thrown. So setting the ignore_trailing=True eliminates the error, but when testing it against earthcoin, we hashed overnight and found a few blocks. However, none of them were actually committed to the blockchain and nothing was paid out. So I assume that is messing with the blocks submitted and they're not valid.

If you don't change that variable, the error that was mentioned is thrown for a while. Eventually it will connect to the wallet daemon, and you can actually hash in the pool, however the connection to the wallet will go unstable and the errors will start again. The connection to the wallet never really stabilizes.

Just for reference  here are my earthcoin network.py values.

Code:

earthcoin=math.Object(
        PARENT=networks.nets['earthcoin'],
        SHARE_PERIOD=10, # seconds
        CHAIN_LENGTH=3*60*60//5, # shares
        REAL_CHAIN_LENGTH=3*60*60//5, # shares
        TARGET_LOOKBEHIND=120, # shares
        SPREAD=30, # blocks
        IDENTIFIER='e137d5b8c6923410'.decode('hex'),
        PREFIX='7218c1a53ef629b0'.decode('hex'),
        P2P_PORT=9338,
        MIN_TARGET=0,
        MAX_TARGET=2**256//2**20 - 1,
        PERSIST=False,
        WORKER_PORT=19330,
        BOOTSTRAP_ADDRS=''.split(' '),
        ANNOUNCE_CHANNEL='#spool',
        VERSION_CHECK=lambda v: True,
    ),

Code:

earthcoin=math.Object(
        P2P_PREFIX='c0dbf1fd'.decode('hex'),
        P2P_PORT=15677,
        ADDRESS_VERSION=93,
        RPC_PORT=15678,
        RPC_CHECK=defer.inlineCallbacks(lambda bitcoind: defer.returnValue(
            'earthcoinaddress' in (yield bitcoind.rpc_help()) and
            not (yield bitcoind.rpc_getinfo())['testnet']
        )),
        SUBSIDY_FUNC=lambda height: 10000*100000000 >> (height + 1)//525600,
        POW_FUNC=lambda data: pack.IntType(256).unpack(__import__('ltc_scrypt').getPoWHash(data)),
        BLOCK_PERIOD=60, # s
        SYMBOL='EAC',
        CONF_FILE_FUNC=lambda: os.path.join(os.path.join(os.environ['APPDATA'], 'earthcoin') if platform.system() == 'Windows' else os.path.expanduser('~/Library/Application Support/earthcoin/') if platform.system() == 'Darwin' else os.path.expanduser('~/.earthcoin'), 'earthcoin.conf'),
        BLOCK_EXPLORER_URL_PREFIX='http://earthchain.info/block/',
        ADDRESS_EXPLORER_URL_PREFIX='http://earthchain.info/address/',
        TX_EXPLORER_URL_PREFIX='http://earthchain.info/tx/',
        SANE_TARGET_RANGE=(2**256//1000000000 - 1, 2**256//1000 - 1),
        DUMB_SCRYPT_DIFF=2**16,
        DUST_THRESHOLD=1e8,
    ),

If anyone that has better python skills than me, and a better knowledge of how p2pool works cares to help, I'd greatly appreciate it. Like I said, I don't think this is isolated to earthcoin as I've seen this behavior with several new alt coins. Also, I've posted a bug report on the official p2pool github in case anyone wants to contribute.

[1714955229]

1714955229

[1714955229]

1714955229

[1714955229]

1714955229

[seocrow]

Guys. Is anyone interested in opening a Skype Chat group to discuss P2Pool configurations.

I have setup several coins that are working perfectly now on P2Pool.

These include Dogecoin, Worldcoin, Feathercoin, Casinocoin

I have configured Grandcoin and Frankocoin but have a few issues getting these up and running. The process runs ok but all my stats are blank.

If anyone wants to trade coin settings or work on this together let me know. Lets work on expanding ALT coins available on P2Pool sites. It benefits us all.

Im also hoping to roll out Earthcoin soon.

If you want to discuss further PM me or hit me up on Skype. My Skype ID is SEOCrow

[squiggie]

Guys. Is anyone interested in opening a Skype Chat group to discuss P2Pool configurations.

I have setup several coins that are working perfectly now on P2Pool.

These include Dogecoin, Worldcoin, Feathercoin, Casinocoin

I have configured Grandcoin and Frankocoin but have a few issues getting these up and running. The process runs ok but all my stats are blank.

If anyone wants to trade coin settings or work on this together let me know. Lets work on expanding ALT coins available on P2Pool sites. It benefits us all.

Im also hoping to roll out Earthcoin soon.

If you want to discuss further PM me or hit me up on Skype. My Skype ID is SEOCrow

I certainly would be interested in doing that. Timing is key though. I too have tried to get earthcoin going but there is an issue with the p2pool code and the wallet. I've been running into sporadic disconnects. The post above me details that, but I'm sure with the right people, this can be overcome.

I'm in CST time and cane be available during the day tues and thur or perhaps on a weekend or late weeknight.

[kh4n]

Hey

Also interested in this... skype: kh4n2k8
Maybe we can get some interest / support from rav3n or cartman in maintaing a GIT for as many cryptos as we can manage.

I can help with providing stable/high-speed hosting for the nodes... as well as tinkering with the source files.

[CartmanSPC]

For those having problems I was curious as to what version of the p2pool source you were trying to use? Have seen that the latest version of p2pool (13.4) requires later versions of BTC and LTC wallets. Perhaps the ALT coin wallets you are using may not be compatible with 13.4. Try p2pool version 13.3 or earlier.

[seocrow]

Hi Cartman

Im using this version currently. Im willing to try some older versions if you think this could be why we are hitting these issues

3.3-96-g7f43101-dirty

[yahma]

rav3n git is on 13.4 and cartman-git is on 13.3

Found that syncing casino coin using (13.4) to 13.3 nodes does not work, unless you first copy the data from an existing 13.3 to 13.4 install.

@squiggie I think everyone here would be interested in syncing to common optimized configurations.  Could you please post your settings for grandcoin and other?  if you need to skype: gururise1

[CarPro]

stop guessing. what does the code say?

[squiggie]

stop guessing. what does the code say?

If you know C++ or Python perhaps you would like to help contribute? We have some skype rooms going and some other discussions. Bring your expertise if you would like to be constructive.

[squiggie]

removed

[aynstein]

Guys. Is anyone interested in opening a Skype Chat group to discuss P2Pool configurations.

I have setup several coins that are working perfectly now on P2Pool.

These include Dogecoin, Worldcoin, Feathercoin, Casinocoin

I have configured Grandcoin and Frankocoin but have a few issues getting these up and running. The process runs ok but all my stats are blank.

If anyone wants to trade coin settings or work on this together let me know. Lets work on expanding ALT coins available on P2Pool sites. It benefits us all.

Im also hoping to roll out Earthcoin soon.

If you want to discuss further PM me or hit me up on Skype. My Skype ID is SEOCrow

Did you make any progress with this? I would do a Skype conf also, but we should post the results on the forum. I read at least 3 people up for skyping...lets try and do it in the next day or so?

Skype address aynstein

[squiggie]

Guys. Is anyone interested in opening a Skype Chat group to discuss P2Pool configurations.

I have setup several coins that are working perfectly now on P2Pool.

These include Dogecoin, Worldcoin, Feathercoin, Casinocoin

I have configured Grandcoin and Frankocoin but have a few issues getting these up and running. The process runs ok but all my stats are blank.

If anyone wants to trade coin settings or work on this together let me know. Lets work on expanding ALT coins available on P2Pool sites. It benefits us all.

Im also hoping to roll out Earthcoin soon.

If you want to discuss further PM me or hit me up on Skype. My Skype ID is SEOCrow

Did you make any progress with this? I would do a Skype conf also, but we should post the results on the forum. I read at least 3 people up for skyping...lets try and do it in the next day or so?

Skype address aynstein

There are a few of us on skype and we have started a chat room. I've requested that screenname and I'll add you to the chat room.

[CartmanSPC]

Why not IRC?

[squiggie]

Why not IRC?

I don't really have a issue with communicating in both. However I do feel like the irc #p2pool and #p2pool-alt channels get a little crowded with the block announcements and make it hard to have a conversation sometimes, especially if the conversation spans for a while or if people afk for a bit and then come back into it.

[CartmanSPC]

Why not IRC?

I don't really have a issue with communicating in both. However I do feel like the irc #p2pool and #p2pool-alt channels get a little crowded with the block announcements and make it hard to have a conversation sometimes, especially if the conversation spans for a while or if people afk for a bit and then come back into it.

Ok, well my Skype name is CartmanSPC...how do I join?

[taken2]

Hey guys
I try create p2pool for VACoin but got problem with this:

2014-01-29 18:20:21.056813 p2pool (version 13.3-179-g17cf290-dirty)
2014-01-29 18:20:21.056883
2014-01-29 18:20:21.056923 Testing bitcoind RPC connection to 'http://127.0.0.1:5583/' with username 'taken'...
2014-01-29 18:20:21.063174     ...success!
2014-01-29 18:20:21.063218     Current block hash: 13856ea321024ccc6994943458797e352fdc18597cdb218fe8514a2e3
2014-01-29 18:20:21.063247     Current block height: 5497
2014-01-29 18:20:21.063268
2014-01-29 18:20:21.063294 Testing bitcoind P2P connection to '127.0.0.1:7980'...
2014-01-29 18:20:21.144818     ...success!
2014-01-29 18:20:21.144883
2014-01-29 18:20:21.144955 Determining payout address...
2014-01-29 18:20:21.145108     ...success! Payout address: VQUJa6Rsra21ScoJjNLVdtJX7pPFDWP7vh
2014-01-29 18:20:21.145146
2014-01-29 18:20:21.145166 Loading shares...
2014-01-29 18:20:21.145273     ...done loading 0 shares (0 verified)!
2014-01-29 18:20:21.145335
2014-01-29 18:20:21.145371 Initializing work...
2014-01-29 18:20:26.147994 > Error while requesting best block header:
2014-01-29 18:20:26.148044 > Traceback (most recent call last):
2014-01-29 18:20:26.148060 > Failure: twisted.internet.defer.TimeoutError: in ReplyMatcher
2014-01-29 18:20:26.148852 > Unhandled error in Deferred:
2014-01-29 18:20:26.148902 > Unhandled Error
2014-01-29 18:20:26.148923 > Traceback (most recent call last):
2014-01-29 18:20:26.148944 > Failure: twisted.internet.defer.TimeoutError: in ReplyMatcher



Anyone see that and know what is wrong?

[paniczklos]

Hi guys do have any idea what went wrong here ? ;/ I've aaded noblecoin to both networks.py files:

Code:

    noblecoin=math.Object(
        PARENT=networks.nets['noblecoin'],
        SHARE_PERIOD=8, # seconds
        CHAIN_LENGTH=6*60*60//8, # shares
        REAL_CHAIN_LENGTH=6*60*60//8, # shares
        TARGET_LOOKBEHIND=20, # shares
        SPREAD=30, # blocks
        IDENTIFIER='6e6f626c656e6f62'.decode('hex'),
        PREFIX='626e6f626c656e6f'.decode('hex'),
        P2P_PORT=8999,
        MIN_TARGET=0,
        MAX_TARGET=2**256//2**20 - 1,
        PERSIST=False,
        WORKER_PORT=8998,
        BOOTSTRAP_ADDRS='p2pool-eu.gotgeeks.com p2pool-us.gotgeeks.com rav3n.dtdns.net p2pool.gotgeeks.com p2pool.dtdns.net solidpool.org'.split(' '),
        ANNOUNCE_CHANNEL='#p2pool-alt',
        VERSION_CHECK=lambda v: True,
    ),

Code:

    noblecoin=math.Object(
        P2P_PREFIX='c0dbf1fd'.decode('hex'), 
        P2P_PORT=55884,
        ADDRESS_VERSION=21, #pubkey_address
        RPC_PORT=55883,
        RPC_CHECK=defer.inlineCallbacks(lambda bitcoind: defer.returnValue(
            'noblecoin' in (yield bitcoind.rpc_help()) and
            not (yield bitcoind.rpc_getinfo())['testnet']
        )),
        SUBSIDY_FUNC=lambda height: 5000*100000000,
        POW_FUNC=lambda data: pack.IntType(256).unpack(__import__('ltc_scrypt').getPoWHash(data)),
        BLOCK_PERIOD=60, # s
        SYMBOL='NOBL',
        CONF_FILE_FUNC=lambda: os.path.join(os.path.join(os.environ['APPDATA'], 'noblecoin') 
                if platform.system() == 'Windows' else os.path.expanduser('~/Library/Application Support/noblecoin/') 
                if platform.system() == 'Darwin' else os.path.expanduser('~/.noblecoin'), 'noblecoin.conf'),
        BLOCK_EXPLORER_URL_PREFIX='http://cryptexplorer.com/block/',
        ADDRESS_EXPLORER_URL_PREFIX='http://cryptexplorer.com/address/',
        TX_EXPLORER_URL_PREFIX='http://cryptexplorer.com/tx/',
        SANE_TARGET_RANGE=(2**256//1000000000 - 1, 2**256//1000 - 1),
        DUMB_SCRYPT_DIFF=2**16,
        DUST_THRESHOLD=0,
    ),

and that's what I get, sorry for the screenshot but I wasn't able to copy it properly;)


and also this:

Code:

2014-01-30 10:20:19.333057 >     result = result.throwExceptionIntoGenerator(g)
2014-01-30 10:20:19.333247 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2014-01-30 10:20:19.333430 >     return g.throw(self.type, self.value, self.tb)
2014-01-30 10:20:19.333618 > --- <exception caught here> ---
2014-01-30 10:20:19.333800 >   File "/root/p2pool-rav/p2pool/util/deferral.py", line 41, in f
2014-01-30 10:20:19.333978 >     result = yield func(*args, **kwargs)
2014-01-30 10:20:19.334080 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1099, in _inlineCallbacks
2014-01-30 10:20:19.334179 >     result = g.send(result)
2014-01-30 10:20:19.334279 >   File "/root/p2pool-rav/p2pool/bitcoin/helper.py", line 49, in getwork
2014-01-30 10:20:19.334377 >     transactions=map(bitcoin_data.tx_type.unpack, packed_transactions),
2014-01-30 10:20:19.334454 >   File "/root/p2pool-rav/p2pool/util/pack.py", line 63, in unpack
2014-01-30 10:20:19.334552 >     obj = self._unpack(data, ignore_trailing)
2014-01-30 10:20:19.334660 >   File "/root/p2pool-rav/p2pool/util/pack.py", line 47, in _unpack
2014-01-30 10:20:19.334757 >     raise LateEnd()
2014-01-30 10:20:19.334853 > p2pool.util.pack.LateEnd:
2014-01-30 10:20:26.735934 [b]Handshake timed out, disconnecting from 87.206.175.139:8333[/b]
2014-01-30 10:20:31.709938 P2Pool: 1 shares in chain (1 verified/1 total) Peers: 0 (0 incoming)
2014-01-30 10:20:31.710135  Local: 0H/s in last 0.0 seconds Local dead on arrival: ??? Expected time to share: ???

Where is the 8333 port coming from ? ;/

When I tried to mine :

Code:

0 11:26:46.756220 >     raise LateEnd()
2014-01-30 11:26:46.756395 > p2pool.util.pack.LateEnd:
2014-01-30 11:26:48.160877 > ########################################
2014-01-30 11:26:48.161671 > >>> Warning: LOST CONTACT WITH BITCOIND for 1.3 minutes! Check that it isn't frozen or dead!
2014-01-30 11:26:48.162145 > ########################################
2014-01-30 11:26:48.162636 P2Pool: 6 shares in chain (9 verified/9 total) Peers: 0 (0 incoming)
2014-01-30 11:26:48.163076  Local: 206kH/s in last 2.8 minutes Local dead on arrival: ~1.9% (0-4%) Expected time to share: 2.1 minutes
2014-01-30 11:26:48.163523  Shares: 8 (2 orphan, 1 dead) Stale rate: ~37.5% (13-70%) Efficiency: ~83.3% (40-116%) Current payout: 5000.0000 NOBL
2014-01-30 11:26:48.163781  Pool: 335kH/s Stale rate: 25.0% Expected time to block: 19.3 hours
2014-01-30 11:26:49.763698 > Error getting work from bitcoind:
2014-01-30 11:26:49.764641 > Traceback (most recent call last):
2014-01-30 11:26:49.765142 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
2014-01-30 11:26:49.765615 >     current.result = callback(current.result, *args, **kw)
2014-01-30 11:26:49.766081 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult
2014-01-30 11:26:49.766568 >     _inlineCallbacks(r, g, deferred)
2014-01-30 11:26:49.766818 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2014-01-30 11:26:49.767073 >     result = result.throwExceptionIntoGenerator(g)
2014-01-30 11:26:49.767315 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2014-01-30 11:26:49.767574 >     return g.throw(self.type, self.value, self.tb)
2014-01-30 11:26:49.767810 > --- <exception caught here> ---
2014-01-30 11:26:49.768042 >   File "/root/p2pool-rav/p2pool/util/deferral.py", line 41, in f
2014-01-30 11:26:49.768370 >     result = yield func(*args, **kwargs)
2014-01-30 11:26:49.768640 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1099, in _inlineCallbacks
2014-01-30 11:26:49.768895 >     result = g.send(result)
2014-01-30 11:26:49.769128 >   File "/root/p2pool-rav/p2pool/bitcoin/helper.py", line 49, in getwork
2014-01-30 11:26:49.769839 >     transactions=map(bitcoin_data.tx_type.unpack, packed_transactions),
2014-01-30 11:26:49.770090 >   File "/root/p2pool-rav/p2pool/util/pack.py", line 63, in unpack
2014-01-30 11:26:49.770442 >     obj = self._unpack(data, ignore_trailing)
2014-01-30 11:26:49.770689 >   File "/root/p2pool-rav/p2pool/util/pack.py", line 47, in _unpack
2014-01-30 11:26:49.770930 >     raise LateEnd()
2014-01-30 11:26:49.771158 > p2pool.util.pack.LateEnd:
2014-01-30 11:26:51.168902 > ########################################
2014-01-30 11:26:51.169504 > >>> Warning: LOST CONTACT WITH BITCOIND for 1.4 minutes! Check that it isn't frozen or dead!
2014-01-30 11:26:51.169964 > ########################################
2014-01-30 11:26:51.170314 P2Pool: 6 shares in chain (9 verified/9 total) Peers: 0 (0 incoming)
2014-01-30 11:26:51.170716  Local: 205kH/s in last 2.9 minutes Local dead on arrival: ~1.9% (0-4%) Expected time to share: 2.1 minutes
2014-01-30 11:26:51.171046  Shares: 8 (2 orphan, 1 dead) Stale rate: ~37.5% (13-70%) Efficiency: ~83.3% (40-116%) Current payout: 5000.0000 NOBL
2014-01-30 11:26:51.171328  Pool: 335kH/s Stale rate: 25.0% Expected time to block: 19.3 hours

[CartmanSPC]

Code:

    bitcoin=math.Object(
        PARENT=networks.nets['bitcoin'],
        SHARE_PERIOD=30, # seconds
        CHAIN_LENGTH=24*60*60//10, # shares
        REAL_CHAIN_LENGTH=24*60*60//10, # shares
        TARGET_LOOKBEHIND=200, # shares
...
    litecoin=math.Object(
        PARENT=networks.nets['litecoin'],
        SHARE_PERIOD=15, # seconds
        CHAIN_LENGTH=24*60*60//10, # shares
        REAL_CHAIN_LENGTH=24*60*60//10, # shares
        TARGET_LOOKBEHIND=200, # shares

Trying to lock down two settings for p2pool.

The first is the last number in CHAIN_LENGTH and REAL_CHAIN_LENGTH. I hear that it should equal SHARE_PERIOD but see that both Bitcoin and Litecoin have both moved away from that keeping it at 10.

Second is TARGET_LOOKBEHIND. Can anyone explain that setting? I hear that it is the number of shares back p2pool uses to adjust the share diff. and have seen some people starting to use lower values to cause the share diff to adjust faster. I am not sure if that is a good idea since 200 shares is already rather low.

[tvb]

I am going to join this topic and added cartmanspc and CryptoCrow to skype. Hope you guys will add me so I can join the discussion there as well.
It annoys me hugely that there isn't a proper post or guide which explains all the various networks.py settings in detail.

[mmininginc]

8<
It annoys me hugely that there isn't a proper post or guide which explains all the various networks.py settings in detail.

Exactly. And then everybody's wondering why p2pool isn't used more.
I've been trying to get some p2pool nodes up and running for new coins, but it's a pain...