Bitcoin Forum
December 03, 2016, 12:41:52 AM *
News: Latest stable version of Bitcoin Core: 0.13.1  [Torrent].
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 [477] 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 ... 744 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2028670 times)
MineForeman.com
Legendary
*
Offline Offline

Activity: 896



View Profile WWW
July 06, 2014, 08:38:12 PM
 #9521

Yet another reason i like p2pool
I wouldn't imagine it possible to hide the fee is it?
In any case if the fee is hidden just don't use the node

Obviously you would not just hide the fee's, you would make it appear to be 0 while in reality you could set it to 1% or 5% or 100%  (the user would work it out fairly quickly if it was 100% though).

Neil

Bitcoin News http://mineforeman.com/ || MinePeon - Bitcoin mining on the Raspberry PI http://mineforeman.com/minepeon/ || MinePeon Wiki http://minepeon.com/ || MinePeon Forums http://minepeon.com/forums/
1480725712
Hero Member
*
Offline Offline

Posts: 1480725712

View Profile Personal Message (Offline)

Ignore
1480725712
Reply with quote  #2

1480725712
Report to moderator
1480725712
Hero Member
*
Offline Offline

Posts: 1480725712

View Profile Personal Message (Offline)

Ignore
1480725712
Reply with quote  #2

1480725712
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
raskul
Sr. Member
****
Offline Offline

Activity: 434



View Profile
July 06, 2014, 08:39:17 PM
 #9522

Yet another reason i like p2pool
I wouldn't imagine it possible to hide the fee is it?
In any case if the fee is hidden just don't use the node

Obviously you would not just hide the fee's, you would make it appear to be 0 while in reality you could set it to 1% or 5% or 100%  (the user would work it out fairly quickly if it was 100% though).

Neil

yeah, but ye wouldnae. really?

tips    1APp826DqjJBdsAeqpEstx6Q8hD4urac8a
-ck
Moderator
Legendary
*
Offline Offline

Activity: 1988


Ruu \o/


View Profile WWW
July 06, 2014, 08:55:30 PM
 #9523

There's a unique ID # that's passed with each message from the miner to the pool.  That number is incremented for each message.  Each share is a message.  So say the Ant sends message #122 and it's a share submission.  If p2pool rejects it, the ID it uses on the reject is its own internal counter, so it could be #155.  I'm not sure cgminer knows how to match that up.
cgminer sends a unique ID message with every share submitted It then locally adds a record of the submitted share to a database. When it gets responses from whatever the upstream server is (be it a pool or a proxy) it matches the return response based on the ID and looks it up in its database to determine what the "server" thought of its share submission. cgminer does not assume messages return synchronously and uses the ID to look up the response to its submissions. If the upstream server corrupts the share submission ID by changing its return submission ID, then that's a fault and it should not do that. As far as I'm aware, no functional pool/proxy/server changes the share submission ID to give a different ID in response.

Primary developer/maintainer for cgminer and ckpool/ckproxy.
Pooled mine at kano.is, solo mine at solo.ckpool.org
-ck
nreal
Full Member
***
Offline Offline

Activity: 182


View Profile
July 06, 2014, 08:56:18 PM
 #9524

What is the doa% with s2? on pool level its 13% now, so anything below 13 is just fine.

I believe it's much higher than that.

M

25% ?
Local dead on arrival: ~      =?


When I run it through my proxy, the Ants report in excess of 50% rejects.  I'm not sure that number is right, but I haven't double checked it to confirm.

I'm suspecting that p2pool isn't properly returning matching reject messages, so the Ants don't really know the amount of rejects.  I'm not 100% of this, as the stratum specs leave a lot to interpretation/figuring out on your own.

What I'm referring to is this.

There's a unique ID # that's passed with each message from the miner to the pool.  That number is incremented for each message.  Each share is a message.  So say the Ant sends message #122 and it's a share submission.  If p2pool rejects it, the ID it uses on the reject is its own internal counter, so it could be #155.  I'm not sure cgminer knows how to match that up.

My proxy takes care of matching those up, so the message the Ant gets back from the proxy (Relayed from the pool) is the same # of the share from the Ant, in the example above, #122.

M

With walletadress/10000000 i can expect one share that pays in 20 h - with 4 ants1 pencil modded to 150gh - anything else is just waste of space. its the only 1 share in 20 h im interested here. if i get 2 of those in a day i call it a lucky day. The pool migth just be usable for s2s with similiar settings - some days you score bigtime some not so well. I think you are using those s2 with own walletaddress for each.

This is serious mining to go after bigger fishes. Im not worried about the variation - this is more fun than chase those smaller shares..
mdude77
Legendary
*
Offline Offline

Activity: 1358


View Profile
July 06, 2014, 09:05:21 PM
 #9525

There's a unique ID # that's passed with each message from the miner to the pool.  That number is incremented for each message.  Each share is a message.  So say the Ant sends message #122 and it's a share submission.  If p2pool rejects it, the ID it uses on the reject is its own internal counter, so it could be #155.  I'm not sure cgminer knows how to match that up.
cgminer sends a unique ID message with every share submitted It then locally adds a record of the submitted share to a database. When it gets responses from whatever the upstream server is (be it a pool or a proxy) it matches the return response based on the ID and looks it up in its database to determine what the "server" thought of its share submission. cgminer does not assume messages return synchronously and uses the ID to look up the response to its submissions. If the upstream server corrupts the share submission ID by changing its return submission ID, then that's a fault and it should not do that. As far as I'm aware, no functional pool/proxy/server changes the share submission ID to give a different ID in response.

That's how I interpreted that things should be working as well.

I just double checked my code, and it appears I misspoke.  I was looking at the return message after I matched it up with the miner, so of course they would differ.

Nevermind! Smiley

M

MMinerMonitor author, monitor/auto/schedule reboots/alerts/remote/MobileMiner for Ants and Spondoolies! Latest (5.2). MPoolMonitor author, monitor stats/workers for most pools, global BTC stats (current/nxt diff/USD val/hashrate/calc)! Latest (v4.2) 
Buyer beware of Bitmain hardware and services.
ceslick
Full Member
***
Offline Offline

Activity: 161

digging in the bits... now ant powered!


View Profile WWW
July 06, 2014, 09:33:59 PM
 #9526

At the moment my conclusion is a proxy isn't going to help getting S2s working with p2pool.

I believe the problem is the constant "drop EVERYTHING you are doing and restart" messages that p2pool sends every 30 seconds.  Then it rejects all the old work coming p2pool leading to large DOA.

My recommendations for p2pool to become more S2 friendly:

1 - Sending new work every 30 seconds is fine.  It's apparently not necessary to force the miner to restart "clean jobs" = true.  It also needs to gracefully accept work from prior job IDs for a period of time like other pools do.

2 - Start at a higher pseudo difficulty than 1.

3 - Allow a higher pseudo difficulty than 1000.

4 - Send the actual errors back for rejected work, instead of just "false".

If I understood python I'd take a stab at 2 through 4.  1 might be a big deal.

Here are 2 patches for p2pool that address point 2 and 3 from your list.

First a simple patch that allow higher than 1000 pseudo-difficulty.
https://github.com/jaketri/p2pool/commit/05b630f2c8f93b78093043b28c0c543fafa0a856

And another patch that add "--min-difficulty" parameter to p2pool. For my setup I use 256 as start pseudo difficulty.

https://github.com/jaketri/p2pool/commit/5f02f893490f2b9bfa48926184c4b1329c4d1554

How do I apply those patches? GIT noob here...

http://www.integratedideas.net  - Home of Rock Solid Miners
NZ Based BTC P2Pool: http://www.integratedideas.net/p2pool-btc/  -  NZ Based DOGE P2Pool: http://www.integratedideas.net/p2pool-doge/
Cloud mining with CEX.IO: https://cex.io/r/2/ceslicknz/0/
JakeTri
Full Member
***
Offline Offline

Activity: 154


View Profile
July 06, 2014, 11:41:53 PM
 #9527

At the moment my conclusion is a proxy isn't going to help getting S2s working with p2pool.

I believe the problem is the constant "drop EVERYTHING you are doing and restart" messages that p2pool sends every 30 seconds.  Then it rejects all the old work coming p2pool leading to large DOA.

My recommendations for p2pool to become more S2 friendly:

1 - Sending new work every 30 seconds is fine.  It's apparently not necessary to force the miner to restart "clean jobs" = true.  It also needs to gracefully accept work from prior job IDs for a period of time like other pools do.

2 - Start at a higher pseudo difficulty than 1.

3 - Allow a higher pseudo difficulty than 1000.

4 - Send the actual errors back for rejected work, instead of just "false".

If I understood python I'd take a stab at 2 through 4.  1 might be a big deal.

Here are 2 patches for p2pool that address point 2 and 3 from your list.

First a simple patch that allow higher than 1000 pseudo-difficulty.
https://github.com/jaketri/p2pool/commit/05b630f2c8f93b78093043b28c0c543fafa0a856

And another patch that add "--min-difficulty" parameter to p2pool. For my setup I use 256 as start pseudo difficulty.

https://github.com/jaketri/p2pool/commit/5f02f893490f2b9bfa48926184c4b1329c4d1554

How do I apply those patches? GIT noob here...

You can cherry-pick (see "git help cherry-pick") the changes to your local git branch ...

... or you can manually apply the one line patch that allow higher than 1000 pseudo-difficulty and use "walletaddress+difficulty" as username to ask p2pool to disable dynamic pseud-difficulty and only use the requested difficulty.
For example to only receive jobs with pseudo-difficulty "2048" for your wallet-address "1Bitcoin552oR6LtAp55PMsfbEaFLjuTjg" you need to use as username "1Bitcoin552oR6LtAp55PMsfbEaFLjuTjg+2048"

You can use the stock p2pool without any patch if you need pseudo-difficulty of 1000 or less.

BTC donations always welcome: 1JakeTriwbahMYp1rSfJbTn7Afd1w62p2q
Bulk-Neteller Ltd
Member
**
Offline Offline

Activity: 67


View Profile
July 07, 2014, 08:50:19 AM
 #9528

i love the GIT nobe. wonderful posts here.
educating.
bryonp
Member
**
Offline Offline

Activity: 77


View Profile
July 07, 2014, 09:11:09 AM
 #9529

Hey All,
Can you look at these stats and tell me if I am close to the average or I am under performing??? Thanks
16 - S1's and 1 S2

Pool rate: 543TH/s (14% DOA+orphan) Share difficulty: 2060000

Node uptime: 5.5 days Peers: 6 out, 0 in

Local rate: 4.56TH/s (2.1% DOA) Expected time to share: 32.3 minutes

Shares: 254 total (37 orphaned, 8 dead) Efficiency: 95.31%

Payout if a block were found NOW: 0.19603371 BTC to XXXXXXXXXXXXXXXXXXXXXXXXX. Expected after mining for 24 hours: 0.210 BTC per block.

Current block value: 25.05644681 BTC Expected time to block: 1.5 days


(my Payout if a block were found NOW   2 days ago was hittinf .2400000000000 now it has moved down to .196   Huh??)

Thanks for any info....
windpath
Legendary
*
Offline Offline

Activity: 938


View Profile WWW
July 07, 2014, 12:08:45 PM
 #9530

Hi Bryon,

Local rate: 4.56TH/s (2.1% DOA)

16 x 200 GH/s = 3.2 TH/s expected
With the S2 = 4.2 TH/s expected

Your hashrate and DOA look great.

The difference in payout is due to the variance/luck of the number of shares you currently have in the share chain, the share chain is about 3 days long so it will take about 3 days for your payment to peak and then level out....


windpath
Legendary
*
Offline Offline

Activity: 938


View Profile WWW
July 07, 2014, 10:31:02 PM
 #9531

Mining Decentralisation: The Low Hanging Fruit

Mike Hearn posted today on the Bitcoin Foundation website about 2 methods of improving mining decentralization, p2pool was one of them...

He made 4 suggestions to improve p2pool

1. Problem: installation is too difficult
2. Problem: the p2pool website is hard to find
3. Problem: P2Pool feels clunky compared to centralised pools
4. Problem: P2Pool has an increasingly high share difficulty

Mike's problems 1-3 are relatively easy to fix, #4 is one we have all been discussing lately...

His proposed solution:

Quote
P2Pool could split itself into multiple independent p2pools, amoeba style, whenever it gets too large for small miners to benefit.

Without mass adoption of p2pool (and possibly even with it) this solution has 1 glaring flaw: Every time p2pool variance was significantly reduced by adding more miners/hashpower the "split" would increase the variance right back to high levels. Even at our current 400-500 TH/s we are still over a day to find a block.

What level of "expected time to block" would be acceptable?

Problem 4 needs a better solution. I already suggested what I thought was a decent starting point, but will take some serious work to get done.

Anyone else have any ideas on how to address high share difficulty?

Link to article:
https://bitcoinfoundation.org/2014/07/03/mining-decentralisation-the-low-hanging-fruit/

PatMan
Hero Member
*****
Offline Offline

Activity: 924


Watch out for the "Neg-Rep-Dogie-Police".....


View Profile WWW
July 08, 2014, 12:04:55 AM
 #9532

He's not exactly stated anything new, it's been like this for over a year......

"When one person is deluded it is called insanity - when many people are deluded it is called religion" - Robert M. Pirsig.  I don't want your coins, I want change.
Amazon UK BTC payment service - https://bitcointalk.org/index.php?topic=301229.0 - with FREE delivery!
http://www.ae911truth.org/ - http://rethink911.org/ - http://rememberbuilding7.org/
MineForeman.com
Legendary
*
Offline Offline

Activity: 896



View Profile WWW
July 08, 2014, 12:21:08 AM
 #9533

1. Problem: installation is too difficult

P2Pool comes complete with a partial solution for this one, you could have public servers so people don't have to go through all that it takes to setup and maintain your own.

The issue is paying for them.  I have been hashing through different ideas in my head but as of yet I have not come up with anything that floats.

Neil

Bitcoin News http://mineforeman.com/ || MinePeon - Bitcoin mining on the Raspberry PI http://mineforeman.com/minepeon/ || MinePeon Wiki http://minepeon.com/ || MinePeon Forums http://minepeon.com/forums/
norgan
Sr. Member
****
Offline Offline

Activity: 308

Decentralize your hashing - p2pool - Norgz Pool


View Profile WWW
July 08, 2014, 05:00:58 AM
 #9534

1. Problem: installation is too difficult

P2Pool comes complete with a partial solution for this one, you could have public servers so people don't have to go through all that it takes to setup and maintain your own.

The issue is paying for them.  I have been hashing through different ideas in my head but as of yet I have not come up with anything that floats.

Neil

sign up to BizSpark or dreamspark and get access to free Azure credit. enough to run a dual core 3.5gb sever for the whole moth for free.

http://www.microsoft.com/bizspark/default.aspx
https://www.dreamspark.com/

Miner, tech geek, operator of NorgzPool - Sydney Australia P2Pool Node creator of p2pool fancy front end

Tips: 1NorganBbymShTN2MMpfGzRYJF8mcPeXjv Exchange BTC locally in Australia or Donate to p2pool miners
sconklin321
Member
**
Offline Offline

Activity: 109


View Profile
July 08, 2014, 05:10:55 AM
 #9535

4. Problem: P2Pool has an increasingly high share difficulty

I had a possible solution for this, though I don't know easy it would be to implement, or if it would even be worth it.  My inspiration for this comes from the bitcoin itself.  Our sharechain is designed to work just like the bitcoin blockchain only with a shorter retarget window.  One thing the bitcoin blockchain does that the sharechain doesn't (at least to my knowledge, other than when we find blocks) is transmit the bitcoin transaction.  What if we told the nodes to treat the pseudo shares of either 10% of current difficulty, or of a fixed difficulty, like the bitcoin network does when you send bitcoins to someone else?  The node accepting the share, would broadcast the share to the network, much like the bitcoin network does when you send bitcoin.  Then when a share is found, the node that finds it, bundles the "mini-shares" just like the bitcoin network does bitcoin being transmitted.  We could even include a bonus of say 0.5% of the share value submitted with that share to the finder like transaction fees.  

So at current difficulty, the node would broadcast shares of 200k or higher to the network to be included in the next share (block).  When the share is found they are broadcast to the network and thus included in the sharechain, while maintaining a 30 second share time.  This would allow lower hashrate miners to come in and contribute to the network.
sconklin321
Member
**
Offline Offline

Activity: 109


View Profile
July 08, 2014, 05:15:52 AM
 #9536

1. Problem: installation is too difficult

P2Pool comes complete with a partial solution for this one, you could have public servers so people don't have to go through all that it takes to setup and maintain your own.

The issue is paying for them.  I have been hashing through different ideas in my head but as of yet I have not come up with anything that floats.

Neil

sign up to BizSpark or dreamspark and get access to free Azure credit. enough to run a dual core 3.5gb sever for the whole moth for free.

http://www.microsoft.com/bizspark/default.aspx
https://www.dreamspark.com/

That doesn't solve any issues, the blockchain download alone to run p2pool is greater than 3.5 gb

Edit: I'm sorry, I'm tired and didn't realize you were talking about RAM.  You could also use a service like linode.com.  $20/mth gets you 2gb or RAM and a dual core for a month, where Azure becomes $111 to $134 /mth after your free month.  You can also get 4gb of RAM and 4 cores from linode.com for $40/mth.  There is also digitalocean.com.
KyrosKrane
Sr. Member
****
Offline Offline

Activity: 292


View Profile WWW
July 08, 2014, 05:38:27 AM
 #9537

1. Problem: installation is too difficult
Murdof and I have made some tools to install p2pool more easily on Ubuntu; the thread is here:

https://bitcointalk.org/index.php?topic=651819.0

It would be trivial for someone to create a Windows installation package for p2pool; however, that would require trusting the package maker and having the user run an effectively arbitrary executable on their system.

Tips and donations: 1KyrosREGDkNLp1rMd9wfVwfkXYHTd6j5U  |  BTC P2Pool node: p2pool.kyros.info:9332
KyrosKrane
Sr. Member
****
Offline Offline

Activity: 292


View Profile WWW
July 08, 2014, 05:57:11 AM
 #9538

sign up to BizSpark or dreamspark and get access to free Azure credit. enough to run a dual core 3.5gb sever for the whole moth for free.

http://www.microsoft.com/bizspark/default.aspx
https://www.dreamspark.com/

That doesn't solve any issues, the blockchain download alone to run p2pool is greater than 3.5 gb

Edit: I'm sorry, I'm tired and didn't realize you were talking about RAM.  You could also use a service like linode.com.  $20/mth gets you 2gb or RAM and a dual core for a month, where Azure becomes $111 to $134 /mth after your free month.  You can also get 4gb of RAM and 4 cores from linode.com for $40/mth.  There is also digitalocean.com.
Another option I've mentioned before is a company called CrownCloud.net. They're a bitcoin-friendly hosting provider. They don't allow cloud mining, but they do allow you to run a bitcoin node and pool software, and they also take payment in bitcoin. Two of their packages in particular stand out. One's an OpenVPS package in Frankfurt, Germany, and the other is in their LA location. Both offer 3GB RAM, 50GB HDD, and plenty of CPU and bandwidth for $30 annually. Perfect for hosting a full bitcoin node and p2pool.  Those particular packages are frequently out of stock; I was able to nab one by following them on Twitter and waiting for them to announce more capacity.

Tips and donations: 1KyrosREGDkNLp1rMd9wfVwfkXYHTd6j5U  |  BTC P2Pool node: p2pool.kyros.info:9332
norgan
Sr. Member
****
Offline Offline

Activity: 308

Decentralize your hashing - p2pool - Norgz Pool


View Profile WWW
July 08, 2014, 06:17:56 AM
 #9539

sign up to BizSpark or dreamspark and get access to free Azure credit. enough to run a dual core 3.5gb sever for the whole moth for free.

http://www.microsoft.com/bizspark/default.aspx
https://www.dreamspark.com/

That doesn't solve any issues, the blockchain download alone to run p2pool is greater than 3.5 gb

Edit: I'm sorry, I'm tired and didn't realize you were talking about RAM.  You could also use a service like linode.com.  $20/mth gets you 2gb or RAM and a dual core for a month, where Azure becomes $111 to $134 /mth after your free month.  You can also get 4gb of RAM and 4 cores from linode.com for $40/mth.  There is also digitalocean.com.
Another option I've mentioned before is a company called CrownCloud.net. They're a bitcoin-friendly hosting provider. They don't allow cloud mining, but they do allow you to run a bitcoin node and pool software, and they also take payment in bitcoin. Two of their packages in particular stand out. One's an OpenVPS package in Frankfurt, Germany, and the other is in their LA location. Both offer 3GB RAM, 50GB HDD, and plenty of CPU and bandwidth for $30 annually. Perfect for hosting a full bitcoin node and p2pool.  Those particular packages are frequently out of stock; I was able to nab one by following them on Twitter and waiting for them to announce more capacity.

Guys, look into both of those programs. I've had $160US/month of Azure credit for 3 years now. It's not just one month free!
They have dropped the allowance now to $110us/month but still great for any student or person with registered business or tax id.
you get quite a bit of storage included in that. I a whole bunch of machines under my msdn account but I can tell you that the $110 allowance would be plenty of ram, cpu, storage and bandwidth to run a node quite happily.

Miner, tech geek, operator of NorgzPool - Sydney Australia P2Pool Node creator of p2pool fancy front end

Tips: 1NorganBbymShTN2MMpfGzRYJF8mcPeXjv Exchange BTC locally in Australia or Donate to p2pool miners
ceslick
Full Member
***
Offline Offline

Activity: 161

digging in the bits... now ant powered!


View Profile WWW
July 08, 2014, 06:30:52 AM
 #9540

I will set one up here in cloud crown and see how it goes. Would appreciate any support from miners there once complete

http://www.integratedideas.net  - Home of Rock Solid Miners
NZ Based BTC P2Pool: http://www.integratedideas.net/p2pool-btc/  -  NZ Based DOGE P2Pool: http://www.integratedideas.net/p2pool-doge/
Cloud mining with CEX.IO: https://cex.io/r/2/ceslicknz/0/
Pages: « 1 ... 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 [477] 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 ... 744 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!