Bitcoin Forum
December 11, 2018, 07:20:57 PM *
News: Latest Bitcoin Core release: 0.17.0 [Torrent].
 
   Home   Help Search Login Register More  
Pages: « 1 ... 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 [608] 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 ... 815 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2566825 times)
IYFTech
Hero Member
*****
Offline Offline

Activity: 686
Merit: 500


WANTED: Active dev to fix & re-write p2pool in C


View Profile
February 20, 2015, 01:51:26 PM
 #12141

Well, today is a sad day.

For the first time in over 2 years I have had to make the difficult decision of distributing my hash rate away from my p2pool node onto other centralised pools. This was not done through greed or profit hunting, but through necessity, as I have bills coming up that can't be paid unless I have some BTC coming in. I've always been happy just to break even, making a profit was just an added bonus, because more important to me was helping to promote decentralised mining & help secure the Bitcoin network, which I still believe in wholeheartedly. However, the way p2pool has performed since the last diff increase has made even this impossible & shows the desperate & well overdue need for a complete overhaul of the p2pool software.

I find it so frustrating that over the last 2+ years there has been zero attempt by the dev to address the problems that have been repeatedly pointed out by p2pool users, this was highlighted by his temper tantrum over donations before deciding to ignore any & all efforts by p2pool users to communicate with him before he abandoned this forum completely. I've lost count of how many times I & other users have said that the moment development of software stops, it is out of date & will die, and by development I mean discussing & addressing known issues & flaws & improving the user experience, not adding another shitcoin or some other useless feature that nobody will use or cares for.

We can't keep telling ourselves "don't worry, they'll come back", because eventually they won't. Not until things change, & I can't see that happening anytime soon. In the meantime, I'll be keeping my nodes up for as long as I can in the faint hope that some knight in shining armour will gallop into the github, fork it,  rewrite p2pool in C whilst simultaneously fixing all the known about issues over the last 2+ years. Wishful thinking.

Yes, today is a sad day indeed  Sad

-- Smiley  Thank you for smoking  Smiley --  If you paid VAT to dogie for items you should read this thread:  https://bitcointalk.org/index.php?topic=1018906.0
1544556057
Hero Member
*
Offline Offline

Posts: 1544556057

View Profile Personal Message (Offline)

Ignore
1544556057
Reply with quote  #2

1544556057
Report to moderator
1544556057
Hero Member
*
Offline Offline

Posts: 1544556057

View Profile Personal Message (Offline)

Ignore
1544556057
Reply with quote  #2

1544556057
Report to moderator
1544556057
Hero Member
*
Offline Offline

Posts: 1544556057

View Profile Personal Message (Offline)

Ignore
1544556057
Reply with quote  #2

1544556057
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1544556057
Hero Member
*
Offline Offline

Posts: 1544556057

View Profile Personal Message (Offline)

Ignore
1544556057
Reply with quote  #2

1544556057
Report to moderator
reallive1
Newbie
*
Offline Offline

Activity: 5
Merit: 0


View Profile
February 20, 2015, 03:58:06 PM
 #12142

Hi
Would documentation be slightly better (https://en.bitcoin.it/wiki/P2Pool_code_documentation, code documentation is one thing, project documentation is another which seems to be absent altogether), it would be easier to grant your wish.

Use of C++(mostly boost) could also be an option, but plain C could be feasible.
PatMan
Hero Member
*****
Offline Offline

Activity: 924
Merit: 1000


Watch out for the "Neg-Rep-Dogie-Police".....


View Profile WWW
February 20, 2015, 04:52:09 PM
 #12143

Hi
Would documentation be slightly better (https://en.bitcoin.it/wiki/P2Pool_code_documentation, code documentation is one thing, project documentation is another which seems to be absent altogether), it would be easier to grant your wish.

Use of C++(mostly boost) could also be an option, but plain C could be feasible.

Maybe if you contacted forrestv via github he can provide you with the info you need, no point in PM'ing him here, he hasn't even logged on for several months. Do you have an idea on how to fix the variance/scaling issue?

Yes, today is a sad day indeed  Sad

Sorry to hear that buddy, but I can't say I blame you - I'll be doing the same soon  Cry

"When one person is deluded it is called insanity - when many people are deluded it is called religion" - Robert M. Pirsig.  I don't want your coins, I want change.
Amazon UK BTC payment service - https://bitcointalk.org/index.php?topic=301229.0 - with FREE delivery!
http://www.ae911truth.org/ - http://rethink911.org/ - http://rememberbuilding7.org/
reallive1
Newbie
*
Offline Offline

Activity: 5
Merit: 0


View Profile
February 20, 2015, 05:00:26 PM
 #12144

Do you have an idea on how to fix the variance/scaling issue?

At the moment, I'm more interested in understanding how the whole shebang works, then maybe fixing the issue will be something I'll look into. I'll start by digging into the github code (I'm not too familiar with python, anyway), sending a message to the guy will surely helps.
PatMan
Hero Member
*****
Offline Offline

Activity: 924
Merit: 1000


Watch out for the "Neg-Rep-Dogie-Police".....


View Profile WWW
February 20, 2015, 05:34:20 PM
 #12145

Do you have an idea on how to fix the variance/scaling issue?

At the moment, I'm more interested in understanding how the whole shebang works, then maybe fixing the issue will be something I'll look into. I'll start by digging into the github code (I'm not too familiar with python, anyway), sending a message to the guy will surely helps.

I'm sure I speak for every p2pool user when I say "THANKS!" Any kind of input is greatly appreciated, & if you need any info, this thread is/was full of some very knowledgable p2pool users. I'm no coder/programmer, but will help in any way I can of course. If it's any help, you might try looking at this thread also:

https://bitcointalk.org/index.php?topic=213051.0

...where I first suggested an upgraded p2pool system - there are some good suggestions & info there, albeit quite old.  Wink

"When one person is deluded it is called insanity - when many people are deluded it is called religion" - Robert M. Pirsig.  I don't want your coins, I want change.
Amazon UK BTC payment service - https://bitcointalk.org/index.php?topic=301229.0 - with FREE delivery!
http://www.ae911truth.org/ - http://rethink911.org/ - http://rememberbuilding7.org/
reallive1
Newbie
*
Offline Offline

Activity: 5
Merit: 0


View Profile
February 20, 2015, 06:16:56 PM
 #12146

Well, I see that it does requires some polishing, throwing exception just because bitcoind is still downloading block...

Code:
2015-02-20 12:50:05.782411 p2pool (version 13.4-67-gbcd9a50)
2015-02-20 12:50:05.782574
2015-02-20 12:50:05.782741 Testing bitcoind RPC connection to 'http://127.0.0.1:8332/' with username 'reallive1'...
2015-02-20 12:50:06.576906 > Error getting work from bitcoind:
2015-02-20 12:50:06.577017 > Traceback (most recent call last):
2015-02-20 12:50:06.577082 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
2015-02-20 12:50:06.577147 >     current.result = callback(current.result, *args, **kw)
2015-02-20 12:50:06.577208 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult
2015-02-20 12:50:06.577267 >     _inlineCallbacks(r, g, deferred)
2015-02-20 12:50:06.577326 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2015-02-20 12:50:06.577386 >     result = result.throwExceptionIntoGenerator(g)
2015-02-20 12:50:06.577448 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2015-02-20 12:50:06.577509 >     return g.throw(self.type, self.value, self.tb)
2015-02-20 12:50:06.577569 > --- <exception caught here> ---
2015-02-20 12:50:06.577626 >   File "/home/<userreact>/src/p2pool/p2pool/util/deferral.py", line 41, in f
2015-02-20 12:50:06.577683 >     result = yield func(*args, **kwargs)
2015-02-20 12:50:06.577739 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2015-02-20 12:50:06.577797 >     result = result.throwExceptionIntoGenerator(g)
2015-02-20 12:50:06.577854 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2015-02-20 12:50:06.577912 >     return g.throw(self.type, self.value, self.tb)
2015-02-20 12:50:06.577969 >   File "/home/<userreact>/src/p2pool/p2pool/bitcoin/helper.py", line 36, in getwork
2015-02-20 12:50:06.578027 >     work = yield go()
2015-02-20 12:50:06.578082 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2015-02-20 12:50:06.578140 >     result = result.throwExceptionIntoGenerator(g)
2015-02-20 12:50:06.578195 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2015-02-20 12:50:06.578253 >     return g.throw(self.type, self.value, self.tb)
2015-02-20 12:50:06.578310 >   File "/home/<userreact>/src/p2pool/p2pool/util/jsonrpc.py", line 133, in _http_do
2015-02-20 12:50:06.578370 >     raise Error_for_code(resp['error']['code'])(resp['error']['message'], resp['error'].get('data', None))
2015-02-20 12:50:06.578430 > p2pool.util.jsonrpc.NarrowError: -10 Bitcoin is downloading blocks...
windpath
Legendary
*
Offline Offline

Activity: 1236
Merit: 1001


View Profile WWW
February 20, 2015, 06:25:40 PM
 #12147

Well, I see that it does requires some polishing, throwing exception just because bitcoind is still downloading block...

Code:
2015-02-20 12:50:05.782411 p2pool (version 13.4-67-gbcd9a50)
2015-02-20 12:50:05.782574
2015-02-20 12:50:05.782741 Testing bitcoind RPC connection to 'http://127.0.0.1:8332/' with username 'reallive1'...
2015-02-20 12:50:06.576906 > Error getting work from bitcoind:
2015-02-20 12:50:06.577017 > Traceback (most recent call last):
2015-02-20 12:50:06.577082 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 577, in _runCallbacks
2015-02-20 12:50:06.577147 >     current.result = callback(current.result, *args, **kw)
2015-02-20 12:50:06.577208 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1155, in gotResult
2015-02-20 12:50:06.577267 >     _inlineCallbacks(r, g, deferred)
2015-02-20 12:50:06.577326 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2015-02-20 12:50:06.577386 >     result = result.throwExceptionIntoGenerator(g)
2015-02-20 12:50:06.577448 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2015-02-20 12:50:06.577509 >     return g.throw(self.type, self.value, self.tb)
2015-02-20 12:50:06.577569 > --- <exception caught here> ---
2015-02-20 12:50:06.577626 >   File "/home/<userreact>/src/p2pool/p2pool/util/deferral.py", line 41, in f
2015-02-20 12:50:06.577683 >     result = yield func(*args, **kwargs)
2015-02-20 12:50:06.577739 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2015-02-20 12:50:06.577797 >     result = result.throwExceptionIntoGenerator(g)
2015-02-20 12:50:06.577854 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2015-02-20 12:50:06.577912 >     return g.throw(self.type, self.value, self.tb)
2015-02-20 12:50:06.577969 >   File "/home/<userreact>/src/p2pool/p2pool/bitcoin/helper.py", line 36, in getwork
2015-02-20 12:50:06.578027 >     work = yield go()
2015-02-20 12:50:06.578082 >   File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line 1097, in _inlineCallbacks
2015-02-20 12:50:06.578140 >     result = result.throwExceptionIntoGenerator(g)
2015-02-20 12:50:06.578195 >   File "/usr/lib/python2.7/dist-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
2015-02-20 12:50:06.578253 >     return g.throw(self.type, self.value, self.tb)
2015-02-20 12:50:06.578310 >   File "/home/<userreact>/src/p2pool/p2pool/util/jsonrpc.py", line 133, in _http_do
2015-02-20 12:50:06.578370 >     raise Error_for_code(resp['error']['code'])(resp['error']['message'], resp['error'].get('data', None))
2015-02-20 12:50:06.578430 > p2pool.util.jsonrpc.NarrowError: -10 Bitcoin is downloading blocks...

Not much to polish there other then maybe notifying the user that you can't mine without the latest block....

I admire your enthusiasm for rewriting p2pool in C, and if its bonafide would be happy to run a bounty and help raise you some cash for its completion.

Can you tell us a little about your crypto/coding background?

I've been having some shower thoughts lately about how Multisig or Smart Contracts could be used to solve the variance problem for smaller miners, by building a trustless escrow system to handle small payouts with a payment threshold...

Look forward to hearing more.
aurel57
Legendary
*
Offline Offline

Activity: 1078
Merit: 1000



View Profile
February 20, 2015, 07:22:17 PM
 #12148

Well, today is a sad day.


Yes, today is a sad day indeed  Sad

It is indeed a sad day to see someone as yourself that was so passionate about p2pool to have to move your miners. I would be very interested in which pool you have decided to mine on and your reasons why? If you don't want to post it here I understand.   
reallive1
Newbie
*
Offline Offline

Activity: 5
Merit: 0


View Profile
February 20, 2015, 07:33:30 PM
 #12149

Not much to polish there other then maybe notifying the user that you can't mine without the latest block....

I admire your enthusiasm for rewriting p2pool in C, and if its bonafide would be happy to run a bounty and help raise you some cash for its completion.

Can you tell us a little about your crypto/coding background?

I've been having some shower thoughts lately about how Multisig or Smart Contracts could be used to solve the variance problem for smaller miners, by building a trustless escrow system to handle small payouts with a payment threshold...

Look forward to hearing more.


As far as rewriting goes:
Stratum being a "human readable protocol"(json based), it's string manipulation in the end, python should be good enough.

My point in posting the exception log is this: if you manage a simple case like: "bitcoind is not ready" with exception throwing, which are at least in C++ and Java have a lot of overhead and thus performance draw back, I wonder what might be next.

As far as my background, I do embedded software development as a living, mostly C/C++.
Meuh6879
Legendary
*
Offline Offline

Activity: 1512
Merit: 1000



View Profile
February 20, 2015, 07:35:27 PM
 #12150

It is indeed a sad day to see someone as yourself that was so passionate about p2pool to have to move your miners. I would be very interested in which pool you have decided to mine on and your reasons why? If you don't want to post it here I understand.   

i think it's only the 0.10 bitcoin core installation that it reduces the mining powa on P2pool, actually ...  Wink
for me, it's 2 days without the bitcoin core -from 0.9.1 to 0.10-
IYFTech
Hero Member
*****
Offline Offline

Activity: 686
Merit: 500


WANTED: Active dev to fix & re-write p2pool in C


View Profile
February 20, 2015, 07:56:32 PM
 #12151

Well, today is a sad day.


Yes, today is a sad day indeed  Sad

It is indeed a sad day to see someone as yourself that was so passionate about p2pool to have to move your miners. I would be very interested in which pool you have decided to mine on and your reasons why? If you don't want to post it here I understand.   

I've spread it out over a few pools, as I hate centralization & hopefully it will help keep variance down. Any pool that pays on time, isn't plagued by shills & is run by a reputable & trustworthy dev is good by me.

So no, not BAN  Wink

-- Smiley  Thank you for smoking  Smiley --  If you paid VAT to dogie for items you should read this thread:  https://bitcointalk.org/index.php?topic=1018906.0
PatMan
Hero Member
*****
Offline Offline

Activity: 924
Merit: 1000


Watch out for the "Neg-Rep-Dogie-Police".....


View Profile WWW
February 20, 2015, 08:01:15 PM
 #12152


I've spread it out over a few pools, as I hate centralization & hopefully it will help keep variance down. Any pool that pays on time, isn't plagued by shills & is run by a reputable & trustworthy dev is good by me.

So no, not BAN  Wink

 Cheesy Cheesy Cheesy Cheesy

Nice one bud.

"When one person is deluded it is called insanity - when many people are deluded it is called religion" - Robert M. Pirsig.  I don't want your coins, I want change.
Amazon UK BTC payment service - https://bitcointalk.org/index.php?topic=301229.0 - with FREE delivery!
http://www.ae911truth.org/ - http://rethink911.org/ - http://rememberbuilding7.org/
aurel57
Legendary
*
Offline Offline

Activity: 1078
Merit: 1000



View Profile
February 20, 2015, 08:15:38 PM
 #12153

Well, today is a sad day.


Yes, today is a sad day indeed  Sad

It is indeed a sad day to see someone as yourself that was so passionate about p2pool to have to move your miners. I would be very interested in which pool you have decided to mine on and your reasons why? If you don't want to post it here I understand.  

I've spread it out over a few pools, as I hate centralization & hopefully it will help keep variance down. Any pool that pays on time, isn't plagued by shills & is run by a reputable & trustworthy dev is good by me.

So no, not BAN  Wink

I already knew that  Wink  but I have been spreading mine around as well.  I am on Kano's, Slush and have moved some to BAN to check on payments. I have rented miners for p2pool and will move miners from the PPS pool to p2pool as I want to keep shares.
nreal
Full Member
***
Offline Offline

Activity: 326
Merit: 100



View Profile
February 20, 2015, 08:39:04 PM
 #12154

Stratehm/stratum-proxy works just perfect on p2pool, not sure why but even one s4 hosted at umisoo works just fine without any changes to queue.
Best results ever  Grin worth to try, and it supports nicehash too so when the price is right...

https://github.com/Stratehm/stratum-proxy

✘  EXCOLONY   |▌  YOUR PLEASURE IS OUR INNOVATION
|███    White Paper   [   JOIN our ICO   ]   ANN Thread    ██|
Twitter   |   Facebook   |   Telegram   |   Medium   |   Github   |   Reddit
-ck
Moderator
Legendary
*
Offline Offline

Activity: 2730
Merit: 1148


Ruu \o/


View Profile WWW
February 20, 2015, 10:14:08 PM
 #12155

As far as rewriting goes:
Stratum being a "human readable protocol"(json based), it's string manipulation in the end, python should be good enough.
The stratum protocol bits are just string manipulation but that part alone is only one tiny component of writing pool software. It was good enough in the days when only one client was expected to connect to a p2pool instance, but if you want p2pool to be useful it needs to attract big miners to push the hashrate which means hundreds if not thousands of clients for a local p2pool instance. It does not remotely scale. There are far more fundamental problems that need addressing in the modern world of mining than the mostly cosmetic startup exception issue.

Developer/maintainer for cgminer and ckpool/ckproxy.
ZERO FEE Pooled mining at ckpool.org, 1% Fee Solo mining at solo.ckpool.org
-ck
IYFTech
Hero Member
*****
Offline Offline

Activity: 686
Merit: 500


WANTED: Active dev to fix & re-write p2pool in C


View Profile
February 20, 2015, 10:35:14 PM
 #12156

Incidentally, I too would have no problem contributing to a bounty fund for a rewrite if anyone suitable/capable can be found. I fear that if nothing is done, p2pools days are numbered.

-- Smiley  Thank you for smoking  Smiley --  If you paid VAT to dogie for items you should read this thread:  https://bitcointalk.org/index.php?topic=1018906.0
reallive1
Newbie
*
Offline Offline

Activity: 5
Merit: 0


View Profile
February 20, 2015, 10:41:41 PM
 #12157

As far as rewriting goes:
Stratum being a "human readable protocol"(json based), it's string manipulation in the end, python should be good enough.
The stratum protocol bits are just string manipulation but that part alone is only one tiny component of writing pool software. It was good enough in the days when only one client was expected to connect to a p2pool instance, but if you want p2pool to be useful it needs to attract big miners to push the hashrate which means hundreds if not thousands of clients for a local p2pool instance. It does not remotely scale. There are far more fundamental problems that need addressing in the modern world of mining than the mostly cosmetic startup exception issue.

You're right on the point where cosmetic start-up issue is not the biggest problem. Starting from there, could you list known fundamental problem?

To my knowledge, stratum don't keep its socket open(am I wrong?), thus scalability shouldn't be much of an issue here if the computer is fast enough. This could be profiled to get a better idea.
wilth1
Member
**
Offline Offline

Activity: 63
Merit: 10


View Profile
February 21, 2015, 01:03:02 AM
 #12158

Spun up a node yesterday and pointed some gear at it Shocked
Prelude
Legendary
*
Offline Offline

Activity: 1568
Merit: 1000



View Profile
February 21, 2015, 01:04:53 AM
 #12159

Count me in for a bounty. We can't just let p2pool die.
iegservers
Member
**
Offline Offline

Activity: 92
Merit: 10


View Profile
February 21, 2015, 01:07:16 AM
 #12160

Spun up a node yesterday and pointed some gear at it Shocked
Count me in for a bounty. We can't just let p2pool die.

More of this please!!!! Smiley I will throw some btc at development as well. Smiley
Pages: « 1 ... 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 [608] 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 ... 815 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!