Bitcoin Forum
March 19, 2024, 02:05:35 AM *
News: Latest Bitcoin Core release: 26.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 ... 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 [699] 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 ... 814 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2591571 times)
idonothave
Full Member
***
Offline Offline

Activity: 238
Merit: 100


View Profile
December 13, 2015, 10:14:15 AM
 #13961

case DOA

my node:
Local rate: 1.52TH/s (1.1% DOA) Expected time to share: 1.4 hours
Shares: 76 total (6 orphaned, 2 dead) Efficiency: 107.4%

de.ckpool.org node:
Local rate: 1.55TH/s (21% DOA) Expected time to share: 1.5 hours
Shares: 8 total (1 orphaned, 2 dead) Efficiency: 77.60%

there is SP20 running both

ping de.ckpool.org
PING de.ckpool.org (84.200.2.30) 56(84) bytes of data.
64 bytes from 84.200.2.30: icmp_seq=1 ttl=53 time=33.3 ms
"There should not be any signed int. If you've found a signed int somewhere, please tell me (within the next 25 years please) and I'll change it to unsigned int." -- Satoshi
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
-ck
Legendary
*
Offline Offline

Activity: 4046
Merit: 1622


Ruu \o/


View Profile WWW
December 13, 2015, 11:00:12 AM
 #13962

case DOA

my node:
Local rate: 1.52TH/s (1.1% DOA) Expected time to share: 1.4 hours
Shares: 76 total (6 orphaned, 2 dead) Efficiency: 107.4%

de.ckpool.org node:
Local rate: 1.55TH/s (21% DOA) Expected time to share: 1.5 hours
Shares: 8 total (1 orphaned, 2 dead) Efficiency: 77.60%

there is SP20 running both

ping de.ckpool.org
PING de.ckpool.org (84.200.2.30) 56(84) bytes of data.
64 bytes from 84.200.2.30: icmp_seq=1 ttl=53 time=33.3 ms

Yeah that looks pretty sad doesn't it. Not sure why it's quite so bad but anyway let's call this experiment off for the time being shall we?

Thanks very much for testing, I may come back with more later.

Developer/maintainer for cgminer, ckpool/ckproxy, and the -ck kernel
2% Fee Solo mining at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 238
Merit: 100


View Profile
December 13, 2015, 11:31:37 AM
 #13963

case DOA

my node:
Local rate: 1.52TH/s (1.1% DOA) Expected time to share: 1.4 hours
Shares: 76 total (6 orphaned, 2 dead) Efficiency: 107.4%

de.ckpool.org node:
Local rate: 1.55TH/s (21% DOA) Expected time to share: 1.5 hours
Shares: 8 total (1 orphaned, 2 dead) Efficiency: 77.60%

there is SP20 running both

ping de.ckpool.org
PING de.ckpool.org (84.200.2.30) 56(84) bytes of data.
64 bytes from 84.200.2.30: icmp_seq=1 ttl=53 time=33.3 ms

Yeah that looks pretty sad doesn't it. Not sure why it's quite so bad but anyway let's call this experiment off for the time being shall we?

Thanks very much for testing, I may come back with more later.

I do not know how much part of DOA is proxy doing but you have probably running p2pool node with python but I am with pypy. It can does something.
-ck
Legendary
*
Offline Offline

Activity: 4046
Merit: 1622


Ruu \o/


View Profile WWW
December 13, 2015, 12:36:56 PM
 #13964

I do not know how much part of DOA is proxy doing but you have probably running p2pool node with python but I am with pypy. It can does something.
I'll try changing it to pypy then. Restarting shortly.

EDIT: What package does pypy use for twisted? I get     from twisted.internet import defer, reactor, protocol, tcp ImportError: No module named twisted

Developer/maintainer for cgminer, ckpool/ckproxy, and the -ck kernel
2% Fee Solo mining at solo.ckpool.org
-ck
p3yot33at3r
Sr. Member
****
Offline Offline

Activity: 266
Merit: 250



View Profile
December 13, 2015, 12:55:04 PM
 #13965


EDIT: What package does pypy use for twisted? I get     from twisted.internet import defer, reactor, protocol, tcp ImportError: No module named twisted


Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley
-ck
Legendary
*
Offline Offline

Activity: 4046
Merit: 1622


Ruu \o/


View Profile WWW
December 13, 2015, 01:08:06 PM
 #13966

Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley

Thanks for that, firing it up now. It's an 8GB VPS.

Developer/maintainer for cgminer, ckpool/ckproxy, and the -ck kernel
2% Fee Solo mining at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 238
Merit: 100


View Profile
December 13, 2015, 02:38:03 PM
 #13967

Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley

Thanks for that, firing it up now. It's an 8GB VPS.

much better now

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
e46btc
Full Member
***
Offline Offline

Activity: 157
Merit: 103


View Profile
December 13, 2015, 04:27:39 PM
 #13968

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:



This was private node with 100% fee for testing purposes.  Lower miners qty per one node works much better also.


The same node with remote miners with good connectivity and ping below 40ms give you also quite a lot of DOA hashrate about ~10% and more DOA shares also. But I never tried p2pool w/ ckproxy.. I think this kind of design issue..

https://txid.io https://double-spending.com - Automatic BTC double-spending tool.  Legacy, Segwit and Bech32 supported.
https://dgb256.online - Digibyte mining pool , https://combine.dgb256.online - DGB mining payouts consolidation service.
https://sha256.io , https://solomining.io - DGB, BTC, BCH SOLO pools, Instant payouts, AsicBoost supported
OgNasty
Donator
Legendary
*
Offline Offline

Activity: 4676
Merit: 4153


Leading Crypto Sports Betting & Casino Platform


View Profile WWW
December 13, 2015, 05:24:45 PM
 #13969

I've been working with some experimental ckproxy code designed to consolidate multiple user logins into different upstream connections.

This makes me happy.

..Stake.com..   ▄████████████████████████████████████▄
   ██ ▄▄▄▄▄▄▄▄▄▄            ▄▄▄▄▄▄▄▄▄▄ ██  ▄████▄
   ██ ▀▀▀▀▀▀▀▀▀▀ ██████████ ▀▀▀▀▀▀▀▀▀▀ ██  ██████
   ██ ██████████ ██      ██ ██████████ ██   ▀██▀
   ██ ██      ██ ██████  ██ ██      ██ ██    ██
   ██ ██████  ██ █████  ███ ██████  ██ ████▄ ██
   ██ █████  ███ ████  ████ █████  ███ ████████
   ██ ████  ████ ██████████ ████  ████ ████▀
   ██ ██████████ ▄▄▄▄▄▄▄▄▄▄ ██████████ ██
   ██            ▀▀▀▀▀▀▀▀▀▀            ██ 
   ▀█████████▀ ▄████████████▄ ▀█████████▀
  ▄▄▄▄▄▄▄▄▄▄▄▄███  ██  ██  ███▄▄▄▄▄▄▄▄▄▄▄▄
 ██████████████████████████████████████████
▄▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄
█  ▄▀▄             █▀▀█▀▄▄
█  █▀█             █  ▐  ▐▌
█       ▄██▄       █  ▌  █
█     ▄██████▄     █  ▌ ▐▌
█    ██████████    █ ▐  █
█   ▐██████████▌   █ ▐ ▐▌
█    ▀▀██████▀▀    █ ▌ █
█     ▄▄▄██▄▄▄     █ ▌▐▌
█                  █▐ █
█                  █▐▐▌
█                  █▐█
▀▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▀█
▄▄█████████▄▄
▄██▀▀▀▀█████▀▀▀▀██▄
▄█▀       ▐█▌       ▀█▄
██         ▐█▌         ██
████▄     ▄█████▄     ▄████
████████▄███████████▄████████
███▀    █████████████    ▀███
██       ███████████       ██
▀█▄       █████████       ▄█▀
▀█▄    ▄██▀▀▀▀▀▀▀██▄  ▄▄▄█▀
▀███████         ███████▀
▀█████▄       ▄█████▀
▀▀▀███▄▄▄███▀▀▀
..PLAY NOW..
-ck
Legendary
*
Offline Offline

Activity: 4046
Merit: 1622


Ruu \o/


View Profile WWW
December 13, 2015, 09:21:23 PM
 #13970

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:
We're aware of that. This is an experiment on improving node performance for multiple miners.

Developer/maintainer for cgminer, ckpool/ckproxy, and the -ck kernel
2% Fee Solo mining at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 238
Merit: 100


View Profile
December 13, 2015, 10:05:22 PM
 #13971

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:



This was private node with 100% fee for testing purposes.  Lower miners qty per one node works much better also.


The same node with remote miners with good connectivity and ping below 40ms give you also quite a lot of DOA hashrate about ~10% and more DOA shares also. But I never tried p2pool w/ ckproxy.. I think this kind of design issue..

version 14?
e46btc
Full Member
***
Offline Offline

Activity: 157
Merit: 103


View Profile
December 14, 2015, 06:01:13 AM
 #13972


version 14?
This is not running now, just saved screenshot. 

ps: sorry for picture size, uploaded from tablet

https://txid.io https://double-spending.com - Automatic BTC double-spending tool.  Legacy, Segwit and Bech32 supported.
https://dgb256.online - Digibyte mining pool , https://combine.dgb256.online - DGB mining payouts consolidation service.
https://sha256.io , https://solomining.io - DGB, BTC, BCH SOLO pools, Instant payouts, AsicBoost supported
p3yot33at3r
Sr. Member
****
Offline Offline

Activity: 266
Merit: 250



View Profile
December 14, 2015, 09:45:04 AM
Last edit: December 14, 2015, 11:46:27 AM by p3yot33at3r
 #13973

Was this "tremor in the force" when the changeover happened?:

 

Orphan rate has been rising steadily ever since - now at 25%?

Edit: 4 of my last 5 shares are orphaned also  Sad
windpath
Legendary
*
Offline Offline

Activity: 1258
Merit: 1027


View Profile WWW
December 14, 2015, 03:57:52 PM
Last edit: December 14, 2015, 05:33:22 PM by windpath
 #13974

1 more block for BIP65 enforcement 949/950

https://chainquery.com/bitcoin-api/getblockchaininfo

Edit: and we are there:

Code:
{
"id": "bip65",
"version": 4,
"enforce": {
"status": true,
"found": 950,
"required": 750,
"window": 1000
},
"reject": {
"status": true,
"found": 950,
"required": 950,
"window": 1000
}
}
e46btc
Full Member
***
Offline Offline

Activity: 157
Merit: 103


View Profile
December 14, 2015, 06:05:40 PM
 #13975

We're aware of that. This is an experiment on improving node performance for multiple miners.
Sure I got this.
Another solution (or almost the same?) is also ckpool based, this may be not so elegant as yours but looks like it may work.

One guy asked me about how to configure ckpool in proxy mode for multiple users to deal with p2pool network.
As these users do not want to install and have Core wallet but they use online wallets which not accepts generated transactions.  So in this test enviroment ckpool works like a gateway and uses the single connection from ckproxy to p2pool network and single worker (payout address).  Is this the same what you doing?

In this case original Payout module and pplns_process() calculations of ckpool will be useless for this exact case (p2pool) and it need to be rewritten because ckpool will never know about solved p2pool Block and payouts will be never calculated based on received payout from p2pool network to specified address. But in case of single node owner with multiple miners (own devices) payout is not a problem. For different miners (persons) ckpool still can be  adopted for completely another payment module and another Block detection mechanism.  
PS: I do not ask you to do it for sure, just told it is possible if someone need this solution.

So.. This is local node w/ bitcoind, p2pool and ckpool on the same server, it is running well with no DOA shares for now and I am pretty sure only because this is LOCAL node but not remote.
I still do not have statistics for long period but for 12 hours now and just 2 workers but maybe it doesn't as soon as ckproxy running well . I have made conclusion for some time of using p2pool that it is necessary to have own local node with the shortest round trip delay, in this case DOA hashrate and DOA shares are minimal.   Another issue is GBT latency but this is not related to this particular task.






https://txid.io https://double-spending.com - Automatic BTC double-spending tool.  Legacy, Segwit and Bech32 supported.
https://dgb256.online - Digibyte mining pool , https://combine.dgb256.online - DGB mining payouts consolidation service.
https://sha256.io , https://solomining.io - DGB, BTC, BCH SOLO pools, Instant payouts, AsicBoost supported
wariner
Legendary
*
Offline Offline

Activity: 1250
Merit: 1004


pool.sexy


View Profile
December 15, 2015, 08:11:49 AM
 #13976

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?

Pool.sexy - Pool ETH-ETC-EXP-UBQ-ZEC-DBIX..and more low fee Discussion

my BTC: 1KiMpRAWscBvhRgLs8jDnqrZEKJzt3Ypfi
forrestv (OP)
Hero Member
*****
Offline Offline

Activity: 516
Merit: 643


View Profile
December 15, 2015, 09:18:49 AM
 #13977

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?


You need to be upgraded to the newest P2Pool version (v15.0, to support v4 blocks/BIP65) and then also make that change (if you want to support Bitcoin XT).

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
idonothave
Full Member
***
Offline Offline

Activity: 238
Merit: 100


View Profile
December 15, 2015, 09:34:11 AM
 #13978

We're aware of that. This is an experiment on improving node performance for multiple miners.
Sure I got this.
Another solution (or almost the same?) is also ckpool based, this may be not so elegant as yours but looks like it may work.

One guy asked me about how to configure ckpool in proxy mode for multiple users to deal with p2pool network.
As these users do not want to install and have Core wallet but they use online wallets which not accepts generated transactions.  So in this test enviroment ckpool works like a gateway and uses the single connection from ckproxy to p2pool network and single worker (payout address).  Is this the same what you doing?

In this case original Payout module and pplns_process() calculations of ckpool will be useless for this exact case (p2pool) and it need to be rewritten because ckpool will never know about solved p2pool Block and payouts will be never calculated based on received payout from p2pool network to specified address. But in case of single node owner with multiple miners (own devices) payout is not a problem. For different miners (persons) ckpool still can be  adopted for completely another payment module and another Block detection mechanism.  
PS: I do not ask you to do it for sure, just told it is possible if someone need this solution.

So.. This is local node w/ bitcoind, p2pool and ckpool on the same server, it is running well with no DOA shares for now and I am pretty sure only because this is LOCAL node but not remote.
I still do not have statistics for long period but for 12 hours now and just 2 workers but maybe it doesn't as soon as ckproxy running well . I have made conclusion for some time of using p2pool that it is necessary to have own local node with the shortest round trip delay, in this case DOA hashrate and DOA shares are minimal.   Another issue is GBT latency but this is not related to this particular task.







does it mean that the best ever would be p2pool was mining to just one address and then as coins mature it would be redistributed? is not this what nasty is doing? if there was different payout mechanism implemented in p2pool it would probably solve a lot but we will hear again that it is way to lose control. so...
wariner
Legendary
*
Offline Offline

Activity: 1250
Merit: 1004


pool.sexy


View Profile
December 15, 2015, 09:37:12 AM
 #13979

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?


You need to be upgraded to the newest P2Pool version (v15.0, to support v4 blocks/BIP65) and then also make that change (if you want to support Bitcoin XT).

yes i have p2pool v 15.0.1, but this work?:

https://github.com/p2pool/p2pool/blob/master/p2pool/work.py

 - version=min(self.current_work.value['version'], 4),
 + version=536870919,

Pool.sexy - Pool ETH-ETC-EXP-UBQ-ZEC-DBIX..and more low fee Discussion

my BTC: 1KiMpRAWscBvhRgLs8jDnqrZEKJzt3Ypfi
forrestv (OP)
Hero Member
*****
Offline Offline

Activity: 516
Merit: 643


View Profile
December 15, 2015, 09:54:29 AM
 #13980

yes i have p2pool v 15.0.1, but this work?:

https://github.com/p2pool/p2pool/blob/master/p2pool/work.py

 - version=min(self.current_work.value['version'], 4),
 + version=536870919,

Yes.

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
Pages: « 1 ... 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 [699] 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 ... 814 »
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!