Bitcoin Forum
July 28, 2017, 07:11:53 AM *
News: BIP91 seems stable: there's probably only slightly increased risk of confirmations disappearing. You should still prepare for Aug 1.
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 [700] 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 ... 781 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2366194 times)
idonothave
Full Member
***
Offline Offline

Activity: 237


View Profile
December 13, 2015, 11:31:37 AM
 #13981

case DOA

my node:
Local rate: 1.52TH/s (1.1% DOA) Expected time to share: 1.4 hours
Shares: 76 total (6 orphaned, 2 dead) Efficiency: 107.4%

de.ckpool.org node:
Local rate: 1.55TH/s (21% DOA) Expected time to share: 1.5 hours
Shares: 8 total (1 orphaned, 2 dead) Efficiency: 77.60%

there is SP20 running both

ping de.ckpool.org
PING de.ckpool.org (84.200.2.30) 56(84) bytes of data.
64 bytes from 84.200.2.30: icmp_seq=1 ttl=53 time=33.3 ms

Yeah that looks pretty sad doesn't it. Not sure why it's quite so bad but anyway let's call this experiment off for the time being shall we?

Thanks very much for testing, I may come back with more later.

I do not know how much part of DOA is proxy doing but you have probably running p2pool node with python but I am with pypy. It can does something.
1501225913
Hero Member
*
Offline Offline

Posts: 1501225913

View Profile Personal Message (Offline)

Ignore
1501225913
Reply with quote  #2

1501225913
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2226


Ruu \o/


View Profile WWW
December 13, 2015, 12:36:56 PM
 #13982

I do not know how much part of DOA is proxy doing but you have probably running p2pool node with python but I am with pypy. It can does something.
I'll try changing it to pypy then. Restarting shortly.

EDIT: What package does pypy use for twisted? I get     from twisted.internet import defer, reactor, protocol, tcp ImportError: No module named twisted

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at ckpool.org Solo mine at solo.ckpool.org
-ck
p3yot33at3r
Sr. Member
****
Offline Offline

Activity: 266



View Profile
December 13, 2015, 12:55:04 PM
 #13983


EDIT: What package does pypy use for twisted? I get     from twisted.internet import defer, reactor, protocol, tcp ImportError: No module named twisted


Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2226


Ruu \o/


View Profile WWW
December 13, 2015, 01:08:06 PM
 #13984

Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley

Thanks for that, firing it up now. It's an 8GB VPS.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at ckpool.org Solo mine at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 237


View Profile
December 13, 2015, 02:38:03 PM
 #13985

Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley

Thanks for that, firing it up now. It's an 8GB VPS.

much better now

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
e46btc
Member
**
Online Online

Activity: 117


View Profile
December 13, 2015, 04:27:39 PM
 #13986

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:



This was private node with 100% fee for testing purposes.  Lower miners qty per one node works much better also.


The same node with remote miners with good connectivity and ping below 40ms give you also quite a lot of DOA hashrate about ~10% and more DOA shares also. But I never tried p2pool w/ ckproxy.. I think this kind of design issue..
OgNasty
Donator
Legendary
*
Offline Offline

Activity: 2254


http://bit.ly/2vJEvsy


View Profile WWW
December 13, 2015, 05:24:45 PM
 #13987

I've been working with some experimental ckproxy code designed to consolidate multiple user logins into different upstream connections.

This makes me happy.

BITSLER                 ▄███
               ▄████▀
             ▄████▀
           ▄████▀  ▄██▄
         ▄████▀    ▀████▄
       ▄████▀        ▀████▄
     ▄████▀            ▀████▄
   ▄████▀                ▀████▄
 ▄████▀ ▄████▄      ▄████▄ ▀████▄
█████   ██████      ██████   █████
 ▀████▄ ▀████▀      ▀████▀ ▄████▀
   ▀████▄                ▄████▀
     ▀████▄            ▄████▀
       ▀████▄        ▄████▀
         ▀████▄    ▄████▀
           ▀████▄▄████▀
             ▀██████▀
               ▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄            
▄▄▄▄▀▀▀▀    ▄▄█▄▄ ▀▀▄         
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄      
█  ▀▄▄  ▀█▀▀ ▄      ▀████   ▀▀▄   
█ █▄  ▀▄   ▀████       ▀▀ ▄██▄ ▀▀▄
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
█  ▀▀       ▀▄▄ ▀████      ▄▄▄▀▀▀  █
█            ▄ ▀▄    ▄▄▄▀▀▀   ▄▄  █
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
█ ▄▄   ███   ▀██  █           ▀▀  █ 
█ ███  ▀██       █        ▄▄      █ 
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀  
▀▄            █        ▀▀      █  
▀▀▄   ███▄  █   ▄▄          █   
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀    
▀▀▄   █   ▀▀▄▄▄▀▀▀         
▄▄▄▄▄▄▄▄▄▄▄█▄▄▀▀▀▀              
              ▄▄▄██████▄▄▄
          ▄▄████████████████▄▄
        ▄██████▀▀▀▀▀▀▀▀▀▀██████▄
▄     ▄█████▀             ▀█████▄
██▄▄ █████▀                ▀█████
 ████████            ▄██      █████
  ████████▄         ███▀       ████▄
  █████████▀▀     ▄███▀        █████
   █▀▀▀          █████         █████
     ▄▄▄         ████          █████
   █████          ▀▀           ████▀
    █████                     █████
     █████▄                 ▄█████
      ▀█████▄             ▄█████▀
        ▀██████▄▄▄▄▄▄▄▄▄▄██████▀
          ▀▀████████████████▀▀
              ▀▀▀██████▀▀▀
            ▄▄▄███████▄▄▄
         ▄█▀▀▀ ▄▄▄▄▄▄▄ ▀▀▀█▄
       █▀▀ ▄█████████████▄ ▀▀█
     █▀▀ ███████████████████ ▀▀█
    █▀ ███████████████████████ ▀█
   █▀ ███████████████▀▀ ███████ ▀█
 ▄█▀ ██████████████▀      ▀█████ ▀█▄
███ ███████████▀▀            ▀▀██ ███
███ ███████▀▀                     ███
███ ▀▀▀▀                          ███
▀██▄                             ▄██▀
  ▀█▄                            ▀▀
    █▄       █▄▄▄▄▄▄▄▄▄█
     █▄      ▀█████████▀
      ▀█▄      ▀▀▀▀▀▀▀
        ▀▀█▄▄  ▄▄▄
            ▀▀█████
[]
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2226


Ruu \o/


View Profile WWW
December 13, 2015, 09:21:23 PM
 #13988

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:
We're aware of that. This is an experiment on improving node performance for multiple miners.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at ckpool.org Solo mine at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 237


View Profile
December 13, 2015, 10:05:22 PM
 #13989

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:



This was private node with 100% fee for testing purposes.  Lower miners qty per one node works much better also.


The same node with remote miners with good connectivity and ping below 40ms give you also quite a lot of DOA hashrate about ~10% and more DOA shares also. But I never tried p2pool w/ ckproxy.. I think this kind of design issue..

version 14?
e46btc
Member
**
Online Online

Activity: 117


View Profile
December 14, 2015, 06:01:13 AM
 #13990


version 14?
This is not running now, just saved screenshot. 

ps: sorry for picture size, uploaded from tablet
p3yot33at3r
Sr. Member
****
Offline Offline

Activity: 266



View Profile
December 14, 2015, 09:45:04 AM
 #13991

Was this "tremor in the force" when the changeover happened?:

 

Orphan rate has been rising steadily ever since - now at 25%?

Edit: 4 of my last 5 shares are orphaned also  Sad
windpath
Legendary
*
Offline Offline

Activity: 1148


View Profile WWW
December 14, 2015, 03:57:52 PM
 #13992

1 more block for BIP65 enforcement 949/950

https://chainquery.com/bitcoin-api/getblockchaininfo

Edit: and we are there:

Code:
{
"id": "bip65",
"version": 4,
"enforce": {
"status": true,
"found": 950,
"required": 750,
"window": 1000
},
"reject": {
"status": true,
"found": 950,
"required": 950,
"window": 1000
}
}

e46btc
Member
**
Online Online

Activity: 117


View Profile
December 14, 2015, 06:05:40 PM
 #13993

We're aware of that. This is an experiment on improving node performance for multiple miners.
Sure I got this.
Another solution (or almost the same?) is also ckpool based, this may be not so elegant as yours but looks like it may work.

One guy asked me about how to configure ckpool in proxy mode for multiple users to deal with p2pool network.
As these users do not want to install and have Core wallet but they use online wallets which not accepts generated transactions.  So in this test enviroment ckpool works like a gateway and uses the single connection from ckproxy to p2pool network and single worker (payout address).  Is this the same what you doing?

In this case original Payout module and pplns_process() calculations of ckpool will be useless for this exact case (p2pool) and it need to be rewritten because ckpool will never know about solved p2pool Block and payouts will be never calculated based on received payout from p2pool network to specified address. But in case of single node owner with multiple miners (own devices) payout is not a problem. For different miners (persons) ckpool still can be  adopted for completely another payment module and another Block detection mechanism.  
PS: I do not ask you to do it for sure, just told it is possible if someone need this solution.

So.. This is local node w/ bitcoind, p2pool and ckpool on the same server, it is running well with no DOA shares for now and I am pretty sure only because this is LOCAL node but not remote.
I still do not have statistics for long period but for 12 hours now and just 2 workers but maybe it doesn't as soon as ckproxy running well . I have made conclusion for some time of using p2pool that it is necessary to have own local node with the shortest round trip delay, in this case DOA hashrate and DOA shares are minimal.   Another issue is GBT latency but this is not related to this particular task.





wariner
Legendary
*
Offline Offline

Activity: 1065


pool.sexy


View Profile
December 15, 2015, 08:11:49 AM
 #13994

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?

Pool.sexy - Pool ETH-ETC-EXP-UBQ-ZEC-DBIX-DASH..and more 0.25% fee Discussion

my BTC: 1KiMpRAWscBvhRgLs8jDnqrZEKJzt3Ypfi
forrestv
Hero Member
*****
Offline Offline

Activity: 515


View Profile
December 15, 2015, 09:18:49 AM
 #13995

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?


You need to be upgraded to the newest P2Pool version (v15.0, to support v4 blocks/BIP65) and then also make that change (if you want to support Bitcoin XT).

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
idonothave
Full Member
***
Offline Offline

Activity: 237


View Profile
December 15, 2015, 09:34:11 AM
 #13996

We're aware of that. This is an experiment on improving node performance for multiple miners.
Sure I got this.
Another solution (or almost the same?) is also ckpool based, this may be not so elegant as yours but looks like it may work.

One guy asked me about how to configure ckpool in proxy mode for multiple users to deal with p2pool network.
As these users do not want to install and have Core wallet but they use online wallets which not accepts generated transactions.  So in this test enviroment ckpool works like a gateway and uses the single connection from ckproxy to p2pool network and single worker (payout address).  Is this the same what you doing?

In this case original Payout module and pplns_process() calculations of ckpool will be useless for this exact case (p2pool) and it need to be rewritten because ckpool will never know about solved p2pool Block and payouts will be never calculated based on received payout from p2pool network to specified address. But in case of single node owner with multiple miners (own devices) payout is not a problem. For different miners (persons) ckpool still can be  adopted for completely another payment module and another Block detection mechanism.  
PS: I do not ask you to do it for sure, just told it is possible if someone need this solution.

So.. This is local node w/ bitcoind, p2pool and ckpool on the same server, it is running well with no DOA shares for now and I am pretty sure only because this is LOCAL node but not remote.
I still do not have statistics for long period but for 12 hours now and just 2 workers but maybe it doesn't as soon as ckproxy running well . I have made conclusion for some time of using p2pool that it is necessary to have own local node with the shortest round trip delay, in this case DOA hashrate and DOA shares are minimal.   Another issue is GBT latency but this is not related to this particular task.







does it mean that the best ever would be p2pool was mining to just one address and then as coins mature it would be redistributed? is not this what nasty is doing? if there was different payout mechanism implemented in p2pool it would probably solve a lot but we will hear again that it is way to lose control. so...
wariner
Legendary
*
Offline Offline

Activity: 1065


pool.sexy


View Profile
December 15, 2015, 09:37:12 AM
 #13997

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?


You need to be upgraded to the newest P2Pool version (v15.0, to support v4 blocks/BIP65) and then also make that change (if you want to support Bitcoin XT).

yes i have p2pool v 15.0.1, but this work?:

https://github.com/p2pool/p2pool/blob/master/p2pool/work.py

 - version=min(self.current_work.value['version'], 4),
 + version=536870919,

Pool.sexy - Pool ETH-ETC-EXP-UBQ-ZEC-DBIX-DASH..and more 0.25% fee Discussion

my BTC: 1KiMpRAWscBvhRgLs8jDnqrZEKJzt3Ypfi
forrestv
Hero Member
*****
Offline Offline

Activity: 515


View Profile
December 15, 2015, 09:54:29 AM
 #13998

yes i have p2pool v 15.0.1, but this work?:

https://github.com/p2pool/p2pool/blob/master/p2pool/work.py

 - version=min(self.current_work.value['version'], 4),
 + version=536870919,

Yes.

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
kano
Legendary
*
Offline Offline

Activity: 2156


Linux since 1997 RedHat 4


View Profile
December 15, 2015, 10:04:13 AM
 #13999

... but we will hear again that it is way to lose control. so...
This is already common with p2pool making centralised mining nodes ...

Pool: https://kano.is Here on Bitcointalk: Forum BTC: 1KanoPb8cKYqNrswjaA8cRDk4FAS9eDMLU
FreeNode IRC: irc.freenode.net channel #kano.is Majority developer of the ckpool code
Help keep Bitcoin secure by mining on pools with full block verification on all blocks - and NO empty blocks!
idonothave
Full Member
***
Offline Offline

Activity: 237


View Profile
December 15, 2015, 11:38:17 AM
 #14000

if connections thru 9333 were compressed, would it make sharing the chain faster?
or if there was added 9334 compressed as an alternative for 9333...
Pages: « 1 ... 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 [700] 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 ... 781 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!