Bitcoin Forum
December 07, 2016, 12:39:12 PM *
News: Latest stable version of Bitcoin Core: 0.13.1  [Torrent].
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 [700] 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2032397 times)
idonothave
Full Member
***
Offline Offline

Activity: 234


View Profile
December 13, 2015, 11:31:37 AM
 #13981

case DOA

my node:
Local rate: 1.52TH/s (1.1% DOA) Expected time to share: 1.4 hours
Shares: 76 total (6 orphaned, 2 dead) Efficiency: 107.4%

de.ckpool.org node:
Local rate: 1.55TH/s (21% DOA) Expected time to share: 1.5 hours
Shares: 8 total (1 orphaned, 2 dead) Efficiency: 77.60%

there is SP20 running both

ping de.ckpool.org
PING de.ckpool.org (84.200.2.30) 56(84) bytes of data.
64 bytes from 84.200.2.30: icmp_seq=1 ttl=53 time=33.3 ms

Yeah that looks pretty sad doesn't it. Not sure why it's quite so bad but anyway let's call this experiment off for the time being shall we?

Thanks very much for testing, I may come back with more later.

I do not know how much part of DOA is proxy doing but you have probably running p2pool node with python but I am with pypy. It can does something.
1481114352
Hero Member
*
Offline Offline

Posts: 1481114352

View Profile Personal Message (Offline)

Ignore
1481114352
Reply with quote  #2

1481114352
Report to moderator
1481114352
Hero Member
*
Offline Offline

Posts: 1481114352

View Profile Personal Message (Offline)

Ignore
1481114352
Reply with quote  #2

1481114352
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1481114352
Hero Member
*
Offline Offline

Posts: 1481114352

View Profile Personal Message (Offline)

Ignore
1481114352
Reply with quote  #2

1481114352
Report to moderator
1481114352
Hero Member
*
Offline Offline

Posts: 1481114352

View Profile Personal Message (Offline)

Ignore
1481114352
Reply with quote  #2

1481114352
Report to moderator
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
December 13, 2015, 12:36:56 PM
 #13982

I do not know how much part of DOA is proxy doing but you have probably running p2pool node with python but I am with pypy. It can does something.
I'll try changing it to pypy then. Restarting shortly.

EDIT: What package does pypy use for twisted? I get     from twisted.internet import defer, reactor, protocol, tcp ImportError: No module named twisted

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
p3yot33at3r
Sr. Member
****
Offline Offline

Activity: 266



View Profile
December 13, 2015, 12:55:04 PM
 #13983


EDIT: What package does pypy use for twisted? I get     from twisted.internet import defer, reactor, protocol, tcp ImportError: No module named twisted


Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
December 13, 2015, 01:08:06 PM
 #13984

Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley

Thanks for that, firing it up now. It's an 8GB VPS.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 234


View Profile
December 13, 2015, 02:38:03 PM
 #13985

Here's what I used:

Code:
#p2pool uses twisted, and twisted uses zope.interface, and in order to install either one you need setuptools, so let's start with that:

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-18.3.2.zip

#Then zope.interface:

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

#Then Twisted:

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

Hope you got loads of RAM, cos it sucks the living daylights out of it  Smiley

Thanks for that, firing it up now. It's an 8GB VPS.

much better now

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
e46btc
Member
**
Offline Offline

Activity: 102


View Profile
December 13, 2015, 04:27:39 PM
 #13986

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:



This was private node with 100% fee for testing purposes.  Lower miners qty per one node works much better also.


The same node with remote miners with good connectivity and ping below 40ms give you also quite a lot of DOA hashrate about ~10% and more DOA shares also. But I never tried p2pool w/ ckproxy.. I think this kind of design issue..
OgNasty
Donator
Legendary
*
Offline Offline

Activity: 2030


Powered by NastyFans


View Profile WWW
December 13, 2015, 05:24:45 PM
 #13987

I've been working with some experimental ckproxy code designed to consolidate multiple user logins into different upstream connections.

This makes me happy.

BITSLER                 ▄███
               ▄████▀
             ▄████▀
           ▄████▀  ▄██▄
         ▄████▀    ▀████▄
       ▄████▀        ▀████▄
     ▄████▀            ▀████▄
   ▄████▀                ▀████▄
 ▄████▀ ▄████▄      ▄████▄ ▀████▄
█████   ██████      ██████   █████
 ▀████▄ ▀████▀      ▀████▀ ▄████▀
   ▀████▄                ▄████▀
     ▀████▄            ▄████▀
       ▀████▄        ▄████▀
         ▀████▄    ▄████▀
           ▀████▄▄████▀
             ▀██████▀
               ▀▀▀▀
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄            
▄▄▄▄▀▀▀▀    ▄▄█▄▄ ▀▀▄         
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄      
█  ▀▄▄  ▀█▀▀ ▄      ▀████   ▀▀▄   
█ █▄  ▀▄   ▀████       ▀▀ ▄██▄ ▀▀▄
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
█  ▀▀       ▀▄▄ ▀████      ▄▄▄▀▀▀  █
█            ▄ ▀▄    ▄▄▄▀▀▀   ▄▄  █
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
█ ▄▄   ███   ▀██  █           ▀▀  █ 
█ ███  ▀██       █        ▄▄      █ 
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀  
▀▄            █        ▀▀      █  
▀▀▄   ███▄  █   ▄▄          █   
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀    
▀▀▄   █   ▀▀▄▄▄▀▀▀         
▄▄▄▄▄▄▄▄▄▄▄█▄▄▀▀▀▀              
              ▄▄▄██████▄▄▄
          ▄▄████████████████▄▄
        ▄██████▀▀▀▀▀▀▀▀▀▀██████▄
▄     ▄█████▀             ▀█████▄
██▄▄ █████▀                ▀█████
 ████████            ▄██      █████
  ████████▄         ███▀       ████▄
  █████████▀▀     ▄███▀        █████
   █▀▀▀          █████         █████
     ▄▄▄         ████          █████
   █████          ▀▀           ████▀
    █████                     █████
     █████▄                 ▄█████
      ▀█████▄             ▄█████▀
        ▀██████▄▄▄▄▄▄▄▄▄▄██████▀
          ▀▀████████████████▀▀
              ▀▀▀██████▀▀▀
            ▄▄▄███████▄▄▄
         ▄█▀▀▀ ▄▄▄▄▄▄▄ ▀▀▀█▄
       █▀▀ ▄█████████████▄ ▀▀█
     █▀▀ ███████████████████ ▀▀█
    █▀ ███████████████████████ ▀█
   █▀ ███████████████▀▀ ███████ ▀█
 ▄█▀ ██████████████▀      ▀█████ ▀█▄
███ ███████████▀▀            ▀▀██ ███
███ ███████▀▀                     ███
███ ▀▀▀▀                          ███
▀██▄                             ▄██▀
  ▀█▄                            ▀▀
    █▄       █▄▄▄▄▄▄▄▄▄█
     █▄      ▀█████████▀
      ▀█▄      ▀▀▀▀▀▀▀
        ▀▀█▄▄  ▄▄▄
            ▀▀█████
[]
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2002


Ruu \o/


View Profile WWW
December 13, 2015, 09:21:23 PM
 #13988

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:
We're aware of that. This is an experiment on improving node performance for multiple miners.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
idonothave
Full Member
***
Offline Offline

Activity: 234


View Profile
December 13, 2015, 10:05:22 PM
 #13989

Local rate: 1.49TH/s (7.8% DOA) Expected time to share: 53.7 minutes
Shares: 2 total (0 orphaned, 0 dead) Efficiency: 120.0%
Actually 53 minutes and 2 'live' shares are not enough for statistics.
For the best p2pool performance it is much better to run own local node near your miners, here is example:



This was private node with 100% fee for testing purposes.  Lower miners qty per one node works much better also.


The same node with remote miners with good connectivity and ping below 40ms give you also quite a lot of DOA hashrate about ~10% and more DOA shares also. But I never tried p2pool w/ ckproxy.. I think this kind of design issue..

version 14?
e46btc
Member
**
Offline Offline

Activity: 102


View Profile
December 14, 2015, 06:01:13 AM
 #13990


version 14?
This is not running now, just saved screenshot. 

ps: sorry for picture size, uploaded from tablet
p3yot33at3r
Sr. Member
****
Offline Offline

Activity: 266



View Profile
December 14, 2015, 09:45:04 AM
 #13991

Was this "tremor in the force" when the changeover happened?:

 

Orphan rate has been rising steadily ever since - now at 25%?

Edit: 4 of my last 5 shares are orphaned also  Sad
windpath
Legendary
*
Offline Offline

Activity: 938


View Profile WWW
December 14, 2015, 03:57:52 PM
 #13992

1 more block for BIP65 enforcement 949/950

https://chainquery.com/bitcoin-api/getblockchaininfo

Edit: and we are there:

Code:
{
"id": "bip65",
"version": 4,
"enforce": {
"status": true,
"found": 950,
"required": 750,
"window": 1000
},
"reject": {
"status": true,
"found": 950,
"required": 950,
"window": 1000
}
}

e46btc
Member
**
Offline Offline

Activity: 102


View Profile
December 14, 2015, 06:05:40 PM
 #13993

We're aware of that. This is an experiment on improving node performance for multiple miners.
Sure I got this.
Another solution (or almost the same?) is also ckpool based, this may be not so elegant as yours but looks like it may work.

One guy asked me about how to configure ckpool in proxy mode for multiple users to deal with p2pool network.
As these users do not want to install and have Core wallet but they use online wallets which not accepts generated transactions.  So in this test enviroment ckpool works like a gateway and uses the single connection from ckproxy to p2pool network and single worker (payout address).  Is this the same what you doing?

In this case original Payout module and pplns_process() calculations of ckpool will be useless for this exact case (p2pool) and it need to be rewritten because ckpool will never know about solved p2pool Block and payouts will be never calculated based on received payout from p2pool network to specified address. But in case of single node owner with multiple miners (own devices) payout is not a problem. For different miners (persons) ckpool still can be  adopted for completely another payment module and another Block detection mechanism.  
PS: I do not ask you to do it for sure, just told it is possible if someone need this solution.

So.. This is local node w/ bitcoind, p2pool and ckpool on the same server, it is running well with no DOA shares for now and I am pretty sure only because this is LOCAL node but not remote.
I still do not have statistics for long period but for 12 hours now and just 2 workers but maybe it doesn't as soon as ckproxy running well . I have made conclusion for some time of using p2pool that it is necessary to have own local node with the shortest round trip delay, in this case DOA hashrate and DOA shares are minimal.   Another issue is GBT latency but this is not related to this particular task.





wariner
Legendary
*
Offline Offline

Activity: 852


P2Pool.cloud


View Profile
December 15, 2015, 08:11:49 AM
 #13994

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?

P2Pool.cloud - Public Node P2Pool EU/AMERICA Bitcoin 0% fee ITA - ENG

my BTC: 1KiMpRAWscBvhRgLs8jDnqrZEKJzt3Ypfi
forrestv
Hero Member
*****
Offline Offline

Activity: 510


View Profile
December 15, 2015, 09:18:49 AM
 #13995

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?


You need to be upgraded to the newest P2Pool version (v15.0, to support v4 blocks/BIP65) and then also make that change (if you want to support Bitcoin XT).

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
idonothave
Full Member
***
Offline Offline

Activity: 234


View Profile
December 15, 2015, 09:34:11 AM
 #13996

We're aware of that. This is an experiment on improving node performance for multiple miners.
Sure I got this.
Another solution (or almost the same?) is also ckpool based, this may be not so elegant as yours but looks like it may work.

One guy asked me about how to configure ckpool in proxy mode for multiple users to deal with p2pool network.
As these users do not want to install and have Core wallet but they use online wallets which not accepts generated transactions.  So in this test enviroment ckpool works like a gateway and uses the single connection from ckproxy to p2pool network and single worker (payout address).  Is this the same what you doing?

In this case original Payout module and pplns_process() calculations of ckpool will be useless for this exact case (p2pool) and it need to be rewritten because ckpool will never know about solved p2pool Block and payouts will be never calculated based on received payout from p2pool network to specified address. But in case of single node owner with multiple miners (own devices) payout is not a problem. For different miners (persons) ckpool still can be  adopted for completely another payment module and another Block detection mechanism.  
PS: I do not ask you to do it for sure, just told it is possible if someone need this solution.

So.. This is local node w/ bitcoind, p2pool and ckpool on the same server, it is running well with no DOA shares for now and I am pretty sure only because this is LOCAL node but not remote.
I still do not have statistics for long period but for 12 hours now and just 2 workers but maybe it doesn't as soon as ckproxy running well . I have made conclusion for some time of using p2pool that it is necessary to have own local node with the shortest round trip delay, in this case DOA hashrate and DOA shares are minimal.   Another issue is GBT latency but this is not related to this particular task.







does it mean that the best ever would be p2pool was mining to just one address and then as coins mature it would be redistributed? is not this what nasty is doing? if there was different payout mechanism implemented in p2pool it would probably solve a lot but we will hear again that it is way to lose control. so...
wariner
Legendary
*
Offline Offline

Activity: 852


P2Pool.cloud


View Profile
December 15, 2015, 09:37:12 AM
 #13997

this change http://xtnodes.com/p2pool_configuration.php

work for new v4 ? or need different configuration for xt nodes?


You need to be upgraded to the newest P2Pool version (v15.0, to support v4 blocks/BIP65) and then also make that change (if you want to support Bitcoin XT).

yes i have p2pool v 15.0.1, but this work?:

https://github.com/p2pool/p2pool/blob/master/p2pool/work.py

 - version=min(self.current_work.value['version'], 4),
 + version=536870919,

P2Pool.cloud - Public Node P2Pool EU/AMERICA Bitcoin 0% fee ITA - ENG

my BTC: 1KiMpRAWscBvhRgLs8jDnqrZEKJzt3Ypfi
forrestv
Hero Member
*****
Offline Offline

Activity: 510


View Profile
December 15, 2015, 09:54:29 AM
 #13998

yes i have p2pool v 15.0.1, but this work?:

https://github.com/p2pool/p2pool/blob/master/p2pool/work.py

 - version=min(self.current_work.value['version'], 4),
 + version=536870919,

Yes.

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
kano
Legendary
*
Offline Offline

Activity: 1932


Linux since 1997 RedHat 4


View Profile
December 15, 2015, 10:04:13 AM
 #13999

... but we will hear again that it is way to lose control. so...
This is already common with p2pool making centralised mining nodes ...

Pool: https://kano.is BTC: 1KanoiBupPiZfkwqB7rfLXAzPnoTshAVmb
CKPool and CGMiner developer, IRC FreeNode #ckpool and #cgminer kanoi
Help keep Bitcoin secure by mining on pools with Stratum, the best protocol to mine Bitcoins with ASIC hardware
idonothave
Full Member
***
Offline Offline

Activity: 234


View Profile
December 15, 2015, 11:38:17 AM
 #14000

if connections thru 9333 were compressed, would it make sharing the chain faster?
or if there was added 9334 compressed as an alternative for 9333...
Pages: « 1 ... 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 [700] 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!