[1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool

[Xantus]

oky.

so,
1st. I cloned pypy. Downloaded it, extraktet and place it on C:\pypy2-v5.8.0-win32\. Ther was nothing to install, only the pypy.exe.
2nd. I Downloaded get-pip.py and installed it using "pypy.exe get-pip.py". This automatik installation was sucessfull.
     Command "pip list" shows following installet packets now :
     

Code:

certifi (2017.7.27.1)
cffi (1.10.1)
chardet (3.0.4)
greenlet (0.4.12)
idna (2.6)
pip (9.0.1)
readline (6.2.4.1)
requests (2.18.4)
setuptools (36.2.7)
urllib3 (1.22)
wheel (0.29.0)
zope.interface (4.4.2)

3rd. i would like to install Twisted by automatic installation with pip using "pip install twisted"
   that returns :

Code:

C:\pypy2-v5.8.0-win32\bin>pip install twisted
Collecting twisted
  Using cached Twisted-17.5.0.tar.bz2
    Complete output from command python setup.py egg_info:
    no previously-included directories found matching '.travis'
    no previously-included directories found matching 'tests'
    warning: no previously-included files found matching 'examplesetup.py'
    no previously-included directories found matching 'src\exampleproj'
    no previously-included directories found matching 'src\incremental\newsfragments'

    Installed c:\users\x\appdata\local\temp\pip-build-l8fwso\twisted\.eggs\incremental-17.5.0-py2.7.egg
    Traceback (most recent call last):
      File "<module>", line 1, in <module>
      File "c:\users\x\appdata\local\temp\pip-build-l8fwso\twisted\setup.py", line 21, in <module>
        setuptools.setup(**_setup["getSetupArgs"]())
      File "c:\pypy2-v5.8.0-win32\lib-python\2.7\distutils\core.py", line 111, in setup
        _setup_distribution = dist = klass(attrs)
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\dist.py", line 325, in __init__
        self.fetch_build_eggs(attrs['setup_requires'])
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\dist.py", line 446, in fetch_build_eggs
        replace_conflicting=True,
      File "c:\pypy2-v5.8.0-win32\site-packages\pkg_resources\__init__.py", line 855, in resolve
        dist = best[req.key] = env.best_match(req, ws, installer)
      File "c:\pypy2-v5.8.0-win32\site-packages\pkg_resources\__init__.py", line 1127, in best_match
        return self.obtain(req, installer)
      File "c:\pypy2-v5.8.0-win32\site-packages\pkg_resources\__init__.py", line 1139, in obtain
        return installer(requirement)
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\dist.py", line 518, in fetch_build_egg
        return cmd.easy_install(req)
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\command\easy_install.py", line 672, in easy_install
        return self.install_item(spec, dist.location, tmpdir, deps)
      File "c:\pypy2-v5.8.0-win32\lib-python\2.7\contextlib.py", line 24, in __exit__
        self.gen.next()
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\command\easy_install.py", line 636, in _tmpdir
        os.path.exists(tmpdir) and rmtree(rmtree_safe(tmpdir))
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\command\easy_install.py", line 2241, in rmtree
        return shutil.rmtree(path, ignore_errors, onerror)
      File "c:\pypy2-v5.8.0-win32\lib-python\2.7\shutil.py", line 247, in rmtree
        rmtree(fullname, ignore_errors, onerror)
      File "c:\pypy2-v5.8.0-win32\lib-python\2.7\shutil.py", line 252, in rmtree
        onerror(os.remove, fullname, sys.exc_info())
      File "c:\pypy2-v5.8.0-win32\site-packages\setuptools\command\easy_install.py", line 1689, in auto_chmod
        return func(arg)
    WindowsError: [Error 32] Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird: c:\users\x\appdata\local\temp\easy_install-jqgatn\incremental-17.5.0\README.rst

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in c:\users\x\appdata\local\temp\pip-build-l8fwso\twisted\

i also tested to install twisted by downloading the scource, extract it into the lib directory and tried to install it with command "pypy "c:\pypy2-v5.8.0-win32\libs\twisted\setup.py install" the Error outputs was nearby the same.
does someone have an idea wath i do wrong ?

[1714204641]

1714204641

[1714204641]

1714204641

[1714204641]

1714204641

[1714204641]

1714204641

[jtoomim]

The file cannot be accessed because it is being used by another process? Maybe something is running which is using that file, or maybe it crashed uncleanly and left that file open. Try closing everything, rebooting, and trying again?

[Xantus]

The file cannot be accessed because it is being used by another process? Maybe something is running which is using that file, or maybe it crashed uncleanly and left that file open. Try closing everything, rebooting, and trying again?

Reboot done. same problem. i also retryed to install it again manualy by downloading twisterd-17.5.0.tar.bz, extracting direkt to pypy directory and running setup.
here is the output :

Code:

C:\pypy2-v5.8.0-win32>pypy C:\pypy2-v5.8.0-win32\Twisted-17.5.0\setup.py install
Traceback (most recent call last):
  File "C:\pypy2-v5.8.0-win32\Twisted-17.5.0\setup.py", line 17, in <module>
    with open('src/twisted/python/_setup.py') as f:
IOError: [Errno 2] No such file or directory: 'src/twisted/python/_setup.py'

C:\pypy2-v5.8.0-win32>pypy C:\pypy2-v5.8.0-win32\Twisted-17.5.0\setup.py
Traceback (most recent call last):
  File "C:\pypy2-v5.8.0-win32\Twisted-17.5.0\setup.py", line 17, in <module>
    with open('src/twisted/python/_setup.py') as f:
IOError: [Errno 2] No such file or directory: 'src/twisted/python/_setup.py'

interesting here ist that "src/twisted/python/_setup.py" is there ... is not missing !?
but wath du tell me these line : "with open('src/twisted/python/_setup.py') as f:"  i do have no disk drive f:

[jtoomim]

I tried installing pypy/p2pool on Windows a try myself, and while I got a bit farther than you did by installing twisted from source, I eventually ran into a roadblock because twisted requires pywin32 on Windows and pypy does not support pywin32.

However, I had better luck when I tried to run p2pool with pypy on the Windows Subsystem for Linux (Ubuntu for Windows). If you have Windows 10, I suggest you give that a try:

https://msdn.microsoft.com/en-us/commandline/wsl/install_guide

Once you have Ubuntu for Windows installed, run bash and then copy-paste these lines into your bash command line:

Code:

sudo apt-get update
sudo apt-get install pypy pypy-dev pypy-setuptools gcc build-essential git

wget https://bootstrap.pypa.io/ez_setup.py -O - | sudo pypy
sudo rm setuptools-*.zip

wget https://pypi.python.org/packages/source/z/zope.interface/zope.interface-4.1.3.tar.gz#md5=9ae3d24c0c7415deb249dd1a132f0f79
tar zxf zope.interface-4.1.3.tar.gz
cd zope.interface-4.1.3/
sudo pypy setup.py install
cd ..
sudo rm -r zope.interface-4.1.3*

wget https://pypi.python.org/packages/source/T/Twisted/Twisted-15.4.0.tar.bz2
tar jxf Twisted-15.4.0.tar.bz2
cd Twisted-15.4.0
sudo pypy setup.py install
cd ..
sudo rm -r Twisted-15.4.0*

git clone https://github.com/jtoomim/p2pool.git
cd p2pool
git checkout 1mb_segwit

Those commands should also work if you're on native Ubuntu or Debian Linux

You'll also need to install and run your bitcoind of choice (I recommend btc1, because I think segwit2x is the future of Bitcoin) and edit ~/.bitcoin/bitcoin.conf with your bitcoind's RPC username and password (or pass it to p2pool from the pypy run_p2pool.py command line), then from your p2pool directory, run

Code:

pypy run_p2pool.py

[sawa]

I recommend btc1, because I think segwit2x is the future of Bitcoin...

Is it its source code?: https://github.com/btc1/bitcoin

[frodocooper]

You'll also need to install and run your bitcoind of choice (I recommend btc1, because I think segwit2x is the future of Bitcoin) and edit ~/.bitcoin/bitcoin.conf with your bitcoind's RPC username and password (or pass it to p2pool from the pypy run_p2pool.py command line)...

In addition, I highly recommend adding the following two lines to your bitcoin.conf:

Code:

blockmaxsize=1000000
blockmaxweight=4000000

This enables your P2Pool node to mine full blocks. I'm not sure if btc1 changed its defaults, but on Bitcoin Core the default blockmaxsize and blockmaxweight values are 750 kB and 3 MB respectively, meaning that if you left your bitcoind to its defaults, your P2Pool node would be mining artificially smaller blocks.

If you decide to use the btc1 (SegWit2x) client, simply double the above values after the 2x hard fork.

Also, I highly recommend connecting your bitcoind to the public FIBRE network. This helps your bitcoind to be notified of new blocks as quickly as possible. And if your P2Pool node finds a new block, this helps propagate the newfound block to the Bitcoin network as quickly as possible, reducing the chances of that newfound block being orphaned.

Instructions for connecting your bitcoind to the public FIBRE network can be found here.

I recommend btc1, because I think segwit2x is the future of Bitcoin...

Is it its source code?: https://github.com/btc1/bitcoin

Yes.

[jtoomim]

Is it its source code?: https://github.com/btc1/bitcoin

And binary releases are here: https://github.com/btc1/bitcoin/releases

[jtoomim]

I'm working on adding fork-friendliness to p2pool now. It's a bit more complicated than I thought at first. You can't just check to see if a share's parentblock is in bitcoind's blockchain and mark the share invalid if not, because orphaned blocks are a thing. Instead, I will be trying to keep a penalty score for each share, where each share's penalty is the previous share's penalty plus 0 if the parentblock is found in the blockchain else the work done if the parentblock is not in the blockchain (i.e. orphan or invalid). P2pool will then look for the share with the greatest (work - penalty). That description is slightly oversimplified, but I hope it gets the main idea across.

[jtoomim]

I will be upgrading all of my nodes to 1mb_segwit tomorrow. I suggest that anyone mining on jtoomimnet switch to the 1mb_segwit branch ASAP.

[keke51]

Dear community! And esp MR Jtoomim!
I bet i'm not alone in willing to have a BCH (or BCC) sort of fork of P2pool. Is it real? I am not a coding person, but BCH is not far from the original BTC and maybe it is not so big work to do?

[dimkov]

Dear community! And esp MR Jtoomim!
I bet i'm not alone in willing to have a BCH (or BCC) sort of fork of P2pool. Is it real? I am not a coding person, but BCH is not far from the original BTC and maybe it is not so big work to do?

Join in the keke51. The complexity of the network BCH falls, the price increases. Ideal conditions for mining BCH. Really need P2pool BCH.

[Cryptonomist]

Go back and read here this might help. https://bitcointalk.org/index.php?topic=18313.msg19006724#msg19006724

Ok, thank you. This solved the problem.

I've got another question about p2pool. I'm fairly new to mining using p2pool, so the current situation with the different forks is a bit confusing. As I understand it from the posts on this forum and the output of jtoomim's 1mb_segwit p2pool, jtoomim's fork follows segwit2x, which will be a hardfork of the bitcoin blockchain in november. I'm in favor of segwit but not of segwit2x. So I would rather not mine on a p2pool fork that supports segwit2x. As I understand it the current version of forrestv p2pool's does not support segwit. That's the version I use currently for mining. However I see that veqtrus wrote a commit that supports segwit but not segwit2x. So my question is the folowing. Is there a plan in the foreseeable future to merge forrestv's version and veqtrus's commit, so that I just need to do a git pull to have a a p2pool version that supports segwit?  Or, is forrestv's version going to merge with jtoomim's version, so that I will be forced to chose for segwit2x anyway?

Thank you.

[jtoomim]

jtoomimnet (via the 1mb_segwit branch) follows segwit for the next two months. I am working on code that will make jtoomimnet split into a segwit chain and a segwit2x chain automatically once the fork happens. This code will also be required for supporting Bitcoin Cash, which is my immediate goal.

Supporting Bitcoin Cash is likely to require some p2pool performance improvements as well, as the current codebase struggles with 1MB blocks, much less 8MB. I hope to have Bitcoin Cash working by the end of the weekend as long as you have a high-end server. I'll try to get the needed performance improvements afterwards.

I will be forced to chose for segwit2x anyway?

It is not my goal to force anyone to do anything. As long as you are aware of the risks of mining on a minority chain, you are welcome to do so. I don't want people to mine on the minority chain due to ignorance, but as long as people know what they're doing, it's fine with me.

[Xantus]

isent it posible to compile an P2Pool exe File for windows ? 

[jtoomim]

Not with pypy. Until I get the performance good enough so that regular CPython will work for p2pool without high DOA rates on common CPUs, pypy will be necessary, and making EXEs will not be a good idea.

[jtoomim]

Sigh, more p2pool drama between me and veqtrus:

https://www.reddit.com/r/Bitcoin/comments/6uweb7/p2pool_upgrade_for_segwit_compatibility/

[jtoomim]

I goofed and set one of my nodes' bitcoinds to prune its blockchain. Apparently p2pool requires that the genesis block be unpruned, and will fail to start if pruning is enabled. Oops. ml.toom.im:9334 will be down for a couple more hours as I resync the blockchain. It's up to block 415543 so far, so it shouldn't be too much longer. If anyone was mining onto ml.toom.im:9334, sorry.

[jtoomim]

Support for v33 (Segwit) shares on jtoomimnet is at around 97% over the last few hours. Anyone still in the 3% who hasn't upgraded will be forked off very soon.

[veqtrus]

People who do not want to use jtoomimnet should use the segwit PR against the main repo as segwit will activate in less than a day.

https://github.com/veqtrus/p2pool/releases/tag/16.1-segwit

ForrestV seems to be inactive.

[Cluster2k]

Node address (Original code): http://btc.coinpool.pw:9332
Node address (Forked code): http://btc-fork.coinpool.pw:9334

To connect to me: run_p2pool.py -n btc-fork.coinpool.pw:9335
CPU: i7-3770 @ 3.40GHz
RAM: 16GB
Pipe: 1Gbit Hetzner Germany, DC#19
Using: Pypy 5.7.1 @ Ubuntu 16.04

Both nodes has integrated pull request with adaptive variable difficulty so are suitable for mining by many different ASICs at one time.

Also i've implemented scanner for public P2Pool nodes (both original and forked ones!) at https://p2pool.coinpool.pw/

I recommend using this pool, the guy is very skilled and honest.