Bitcoin Forum
December 05, 2016, 08:52:03 PM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 [400] 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 ... 744 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2030670 times)
cr1776
Legendary
*
Offline Offline

Activity: 1358


View Profile
March 13, 2014, 04:25:47 PM
 #7981

p2pool.org down for anyone else? Miners seem to roll over to back up pools. Anyone have any details on whats going on?



P2pool itself is up, you can set up other p2pool nodes as backups.  As roy7 says, for p2pool.org, you'll have to check with jude
1480971123
Hero Member
*
Offline Offline

Posts: 1480971123

View Profile Personal Message (Offline)

Ignore
1480971123
Reply with quote  #2

1480971123
Report to moderator
1480971123
Hero Member
*
Offline Offline

Posts: 1480971123

View Profile Personal Message (Offline)

Ignore
1480971123
Reply with quote  #2

1480971123
Report to moderator
1480971123
Hero Member
*
Offline Offline

Posts: 1480971123

View Profile Personal Message (Offline)

Ignore
1480971123
Reply with quote  #2

1480971123
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
smartbart24
Newbie
*
Offline Offline

Activity: 3


View Profile
March 13, 2014, 05:01:10 PM
 #7982

The P2Pool concept seems revolutionary to me so I would really like to understand it in full.

I was trying to review the source code of the P2Pool here: https://github.com/forrestv/p2pool but have slight problems "finding" into the code.
This link brought some light : https://en.bitcoin.it/wiki/P2Pool_code_documentation

Still maybe you could jump start me in two questions:
1) How does the client know which work to do (it is passed to bitcoind via get getblocktemplate right ? - but I still have to know what work has been done by the other shares before)
2) How do I append my payout adress to the script and how is ensured that script is included in the final block ?

Maybe you could hint me to some code sections ?

Thank you in advance for your help
KyrosKrane
Sr. Member
****
Offline Offline

Activity: 292


View Profile WWW
March 13, 2014, 06:39:16 PM
 #7983

p2pool.org down for anyone else? Miners seem to roll over to back up pools. Anyone have any details on whats going on?



P2pool itself is up, you can set up other p2pool nodes as backups.  As roy7 says, for p2pool.org, you'll have to check with jude
At risk of tooting my own horn, my current P2pool node (in Florida) is in my sig, and I'm bringing up another pool in Germany this weekend (I hope!). Smiley

Tips and donations: 1KyrosREGDkNLp1rMd9wfVwfkXYHTd6j5U  |  BTC P2Pool node: p2pool.kyros.info:9332
roy7
Sr. Member
****
Offline Offline

Activity: 434


View Profile
March 13, 2014, 09:19:18 PM
 #7984

Just got hit with the number of files issue myself.

Quote
2014-03-13 17:36:23.039910 > Failure: twisted.internet.error.ConnectBindError: Couldn't bind: 24: Too many open files.

I google'd how to increase the #, and checked this:

Quote
cat /proc/sys/fs/file-max
165417

But honestly that should be well more than enough? It is possible the file handles to the coin daemon aren't being closed properly? So each RPC call it slowly counts up towards the maximum?

Didn't know to try this before restarting p2pool, but

Quote
cat /proc/sys/fs/file-nr
672     0       165417

only 672 files in use after it was restarted, out of the 165K maximum.

Quote
ulimit -Hn
4096
ulimit -Sn
1024

RoyalMiningCo: Pools retired. Was fun!
roy7
Sr. Member
****
Offline Offline

Activity: 434


View Profile
March 13, 2014, 09:42:15 PM
 #7985

I use the following in my setup script for ubuntu
Code:
# Increase open file limits
sudo sh -c 'echo "* soft nofile 16384" >> /etc/security/limits.conf'
sudo sh -c 'echo "* hard nofile 65536" >> /etc/security/limits.conf'
sudo sh -c 'echo "* soft nproc 4096" >> /etc/security/limits.conf'
sudo sh -c 'echo "* hard nproc 16384" >> /etc/security/limits.conf'

for Fedora it's  /etc/security/limits.d/90-nproc.conf

Thank you for this!

RoyalMiningCo: Pools retired. Was fun!
roy7
Sr. Member
****
Offline Offline

Activity: 434


View Profile
March 13, 2014, 09:49:40 PM
 #7986

I probably ran into the soft ulimit. Looking at my other node:

Quote
$ lsof -p 9436 | wc -l
228
$ lsof -p 9436 | grep 9171 | wc -l
142

Node has 22 incoming and 10 outgoing peer connections. There are 7 active miners. However there are 142 active file descriptors on the mining port number (vertcoin is 9171).

It appears to be all of the hostnames of the miners who have ever connected to the pool since the last restart. Are those file descriptors never closed?

Looking more closely at the actual list, there are many duplicates to the same actual miners, just on a variety of ports. Such as this guy (his IP address removed):

Quote
$ lsof -p 9436 | grep 9171 | grep xxxxxxxxxxx.dynamic.upc.nl | wc -l
29

29 file handles all for one miner.

RoyalMiningCo: Pools retired. Was fun!
organofcorti
Donator
Legendary
*
Offline Offline

Activity: 1946


Poor impulse control.


View Profile WWW
March 13, 2014, 10:09:50 PM
 #7987

However variance as a fraction of expectation is much greater when hashrate is lower, which I think is what roy7 meant, and what is generally noticed by most miners.

Noticed, perhaps, if you are watching the pot boil. If you expect to make 50c/day and you make 0c/day, that looks like a big deal, but in reality your actual shortfall is still only 50c. Not going to hurt anybody.

Someone with a somewhat larger rig who expects to make $1000/day and makes $0/day (certainly possible when p2pool has 4+ day rounds), that's a $1000 shortfall, and may or may not be a big deal, depending on your financial situation.

No. It's not 'noticed because someone is looking for it' (which is what I think you meant with your analogy?). It is noticed because the 95% confidence interval for income as a fraction of expected income is much wider for lower hashrates than for higher hashrates.



Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
irrational
Jr. Member
*
Offline Offline

Activity: 56


View Profile
March 14, 2014, 12:29:28 AM
 #7988

Thinking 22+ GH/s should be sufficient for p2pool :-)

At 22 GH you will still have dry spells on p2pool. As I said, though, don't worry about it, you'll have big payoff days too. Look at it every week or two and you'll be happy with the results.
 

No worries  Smiley

From crunching the numbers, I think I'd feel ok with the variance at 22 GH/s at current pool difficulty. It's just a hobby anyway, and it'll all even out in the end.

14Cow1HA12umeV3zdZXNmrE3TsnYaaf4Q5
smooth
Legendary
*
Offline Offline

Activity: 1246



View Profile
March 14, 2014, 01:24:26 AM
 #7989

No. It's not 'noticed because someone is looking for it' (which is what I think you meant with your analogy?). It is noticed because the 95% confidence interval for income as a fraction of expected income is much wider for lower hashrates than for higher hashrates.

Yes, as a fraction of expected income but ask yourself why that even matters. If you expect to get 0.003 BTC and you get 0.002 BTC (or even in one instance 0 BTC for that matter) how is your life impacted in some major way? People can stare at numbers on a screen or lines on a chart all day long but at some point you have to relate those numbers and lines to reality, and when you do that shortfalls on hobby mining do not really matter.

roy7
Sr. Member
****
Offline Offline

Activity: 434


View Profile
March 14, 2014, 01:56:28 AM
 #7990

Yes, as a fraction of expected income but ask yourself why that even matters. If you expect to get 0.003 BTC and you get 0.002 BTC (or even in one instance 0 BTC for that matter) how is your life impacted in some major way? People can stare at numbers on a screen or lines on a chart all day long but at some point you have to relate those numbers and lines to reality, and when you do that shortfalls on hobby mining do not really matter.

You've never noticed that people using public p2pool nodes are far more likely to complain that they are getting no payouts, than that the payouts they are getting a smaller than they expected? You can argue single GPU miners shouldn't care much because their earnings are so small in absolute terms. However, they seem to care quite a bit and check their stats often. They are also very noisy when they aren't finding a share often enough to get paid on every block. Usually that degrades into saying p2pool rips off small miners since they don't understand how it'll average out long-term. Larger miners who also have variance but get paid on every block don't raise as much fuss.

RoyalMiningCo: Pools retired. Was fun!
smooth
Legendary
*
Offline Offline

Activity: 1246



View Profile
March 14, 2014, 02:00:37 AM
 #7991

You've never noticed that people using public p2pool nodes are far more likely to complain that they are getting no payouts, than that the payouts they are getting a smaller than they expected?

Yes I've noticed a lot of complaints. I'm suggesting to those people to chill out and have fun with it, not get so upset about things that don't really matter.

I also see a lot of theorizing about how "bad" the variance is for small miners from people I suspect are not even themselves small hobby miners. They are either not miners at all or are larger miners who are making unnecessary noise saying things that don't make real sense when you dig into the practical reality of it. They should just stop.

Don't get me wrong, if there were some way to flip a switch tomorrow and reduce variance for smaller miners I would suggest we do it, but there isn't. Mining is an exercise in tradeoffs. For hobby miners I suggest making tradeoffs in favor of having fun and helping the network rather than wanting to get a "steady paycheck" of a few dollars a day.

jedimstr
Hero Member
*****
Offline Offline

Activity: 784



View Profile
March 14, 2014, 02:12:12 AM
 #7992

You've never noticed that people using public p2pool nodes are far more likely to complain that they are getting no payouts, than that the payouts they are getting a smaller than they expected?

Yes I've noticed a lot of complaints. I'm suggesting to those people to chill out and have fun with it, not get so upset about things that don't really matter.

I also see a lot of theorizing about how "bad" the variance is for small miners from people I suspect are not even themselves small hobby miners. They are either not miners at all or are larger miners who are making unnecessary noise saying things that don't make real sense when you dig into the practical reality of it. They should just stop.

Don't get me wrong, if there were some way to flip a switch tomorrow and reduce variance for smaller miners I would suggest we do it, but there isn't. Mining is an exercise in tradeoffs. For hobby miners I suggest making tradeoffs in favor of having fun and helping the network rather than wanting to get a "steady paycheck" of a few dollars a day.



Oh, but you're forgetting... There is some way to flip a switch. Not quite tomorrow, but hopefully soon enough....

Anybody have any ideas how to increase the hash rate? We are sinking to a smaller and smaller percentage of the network, and round times are growing. We're having 4 day rounds now, a few more difficulty jumps and it may be weeks or longer.

Something must be done.

I'm working on a revamp of P2Pool that will give us a few key features that will help:

  • Running a "lite" P2Pool instance - one without a full Bitcoin node - will be possible without losing any of the promises P2Pool makes about its contribution to Bitcoin network health
  • P2Pool will have a non-linear sharechain so that we can have shares more often than 30 seconds, allowing small miners to use P2Pool

Both of these make P2Pool easier to use; the eventual goal is being able to run P2Pool on the same hardware miners use, such as a Raspberry Pi, though that would likely require a laborious rewrite in C++ or another compiled language.

My current progress on this: I have a piece of software talking to bitcoind and augmenting blocks with UTXO merkle branches, feeding that to another piece of lightweight software that can trustlessly verify the blockchain, while holding O(1) state. I have a good idea about how the non-linear sharechain will work, but implementing that hasn't started yet.

roy7
Sr. Member
****
Offline Offline

Activity: 434


View Profile
March 14, 2014, 02:16:50 AM
 #7993

Don't get me wrong, if there were some way to flip a switch tomorrow and reduce variance for smaller miners I would suggest we do it, but there isn't.

The only things I can think of are the patches I've already put in pull requests for, and for larger miners to take higher share diff targets so the share diff network wide would go lower. I wrote some thoughts on that a while back but got no replies. Maybe the revamp forrestv is working on will solve it.

RoyalMiningCo: Pools retired. Was fun!
roy7
Sr. Member
****
Offline Offline

Activity: 434


View Profile
March 14, 2014, 02:21:51 AM
 #7994

BTW it's kinda a bummer the max share chain is only 3 days. The SPREAD is 3 blocks worth of work, so that would normally mean any share someone finds should get one or more payouts. Is the reason we have a max share chain length at all to prevent abuse? I'd think the share chain should expand as much as needed automatically to store SPREAD worth of payouts...

RoyalMiningCo: Pools retired. Was fun!
organofcorti
Donator
Legendary
*
Offline Offline

Activity: 1946


Poor impulse control.


View Profile WWW
March 14, 2014, 02:25:36 AM
 #7995

No. It's not 'noticed because someone is looking for it' (which is what I think you meant with your analogy?). It is noticed because the 95% confidence interval for income as a fraction of expected income is much wider for lower hashrates than for higher hashrates.

Yes, as a fraction of expected income but ask yourself why that even matters. If you expect to get 0.003 BTC and you get 0.002 BTC (or even in one instance 0 BTC for that matter) how is your life impacted in some major way?

Of course it matters. It matters to people who are hobby miners who try to optimise their equipment. It's hard to optmise if you only see a share every few days.

You're also assuming everyone is a hobby miner with no concern for profit. Just because someone can only afford a low hashrate miner doesn't mean they can treat the investment as a "hobby cost". Lots of countries are poorer than the US.

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
smooth
Legendary
*
Offline Offline

Activity: 1246



View Profile
March 14, 2014, 02:34:42 AM
 #7996

No. It's not 'noticed because someone is looking for it' (which is what I think you meant with your analogy?). It is noticed because the 95% confidence interval for income as a fraction of expected income is much wider for lower hashrates than for higher hashrates.

Yes, as a fraction of expected income but ask yourself why that even matters. If you expect to get 0.003 BTC and you get 0.002 BTC (or even in one instance 0 BTC for that matter) how is your life impacted in some major way?

Of course it matters. It matters to people who are hobby miners who try to optimise their equipment. It's hard to optmise if you only see a share every few days.

You're also assuming everyone is a hobby miner with no concern for profit. Just because someone can only afford a low hashrate miner doesn't mean they can treat the investment as a "hobby cost". Lots of countries are poorer than the US.

Daily variance does not reduce your profit. People are constantly on here talking about how pools with significant fees are "better" for small miners. That is false. In fact they reduce profit.

Even in the case of looking at mining as a "paycheck" most people getting actual paychecks get paid once a week or every two weeks. Looking at your earnings every single day and expecting them to be some nice flat number every single day is stupid and counterproductive.



smooth
Legendary
*
Offline Offline

Activity: 1246



View Profile
March 14, 2014, 02:36:09 AM
 #7997

BTW it's kinda a bummer the max share chain is only 3 days. The SPREAD is 3 blocks worth of work, so that would normally mean any share someone finds should get one or more payouts. Is the reason we have a max share chain length at all to prevent abuse? I'd think the share chain should expand as much as needed automatically to store SPREAD worth of payouts...

If you pay shares on every single block you have proportional payout (subject to pool hopping abuse), not PPLNS.
smooth
Legendary
*
Offline Offline

Activity: 1246



View Profile
March 14, 2014, 02:37:46 AM
 #7998

Oh, but you're forgetting... There is some way to flip a switch. Not quite tomorrow, but hopefully soon enough....

A development project in progress is not "flipping a switch."
forrestv
Hero Member
*****
Offline Offline

Activity: 510


View Profile
March 14, 2014, 02:40:02 AM
 #7999

Oh, but you're forgetting... There is some way to flip a switch. Not quite tomorrow, but hopefully soon enough....

A development project in progress is not "flipping a switch."


Eventually, as a result of development, there will be a switch to flip.

1J1zegkNSbwX4smvTdoHSanUfwvXFeuV23
smooth
Legendary
*
Offline Offline

Activity: 1246



View Profile
March 14, 2014, 02:42:26 AM
 #8000

Oh, but you're forgetting... There is some way to flip a switch. Not quite tomorrow, but hopefully soon enough....

A development project in progress is not "flipping a switch."


Eventually, as a result of development, there will be a switch to flip.

Thank you for your efforts. One question I would ask is what work is being done to make p2pool more attractive to large miners. That is the real solution here. More blocks helps everyone.

Pages: « 1 ... 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 [400] 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 ... 744 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!