Bitcoin Forum
December 06, 2016, 09:59:47 PM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 [271] 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 ... 744 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2032069 times)
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
May 18, 2013, 12:40:29 AM
 #5401

In case anyone isn't familiar with Tomato, it is a specialized Linux distribution that runs on certain hardware routers.

Other connections appear to occur with no issues (unless I goof the configuration) and if I look in the details, I can see connections between external hosts and my own on the bitcoind and p2pool ports. I can't think it would be anything about Python that would be causing the issue. Hard to see what about QOS would be an issue since it's basically just prioritizing packets. But there must be more to it.

Depends how Tomato handles QoS. You can block some traffic if you give higher priority and allow another to saturate your link. QoS isn't simple at all (you must define many compromises to make it work), if your tools make you think it is simple they probably do it wrong.

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
1481061587
Hero Member
*
Offline Offline

Posts: 1481061587

View Profile Personal Message (Offline)

Ignore
1481061587
Reply with quote  #2

1481061587
Report to moderator
1481061587
Hero Member
*
Offline Offline

Posts: 1481061587

View Profile Personal Message (Offline)

Ignore
1481061587
Reply with quote  #2

1481061587
Report to moderator
1481061587
Hero Member
*
Offline Offline

Posts: 1481061587

View Profile Personal Message (Offline)

Ignore
1481061587
Reply with quote  #2

1481061587
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
zvs
Legendary
*
Offline Offline

Activity: 1386



View Profile WWW
May 18, 2013, 05:04:59 AM
 #5402

I'm having an issue with p2pool and my router. It's not a show-stopper but I was wondering if someone might have an idea what's going on or be able to work with me to work out what is going on.

Basically, anytime I turn on QOS, I appear to stop doing any useful work. cgminer trundles along, fans spin, heat generated, Unfortunately, it appears that that's all wasted. the debug output of p2pool says that it's punishing shares for being stale. On the pools graph page, the incoming part of peers and the p2p in on traffic rate drop to zero. For whatever reason, it looks like peers are no longer supplying me with useful information (?)

I've even set things so that p2pool and bitcoind are QOSed to the highest speed category just in case they were getting squashed that way but it still gives the same result.

I can leave QOS off for now but I'd like to get this working properly. I'm using Tomato so the configuration is fairly straightforward and easy. I'll post some pictures in a little bit for illustration. I can perform packet captures and other good stuff but I'm not up on the p2pool networking.

the only thing i've ever used in windows that i've found did a proper job of managing bandwidth was netlimiter
the only thing that did almost a proper job is "format c: -y"

what, netlimiter?

why, because it installs some driver that you can disable on startup?

i don't get the big deal with it
i said on win only "format c: -y" does work almost proper Wink

oh, lots of netlimiter haters out there

but this is true

Dacentec, best deals for US dedicated servers. They regularly restock $20-$25 Opterons with 8-16GB RAM & 2x1-2TB HDD's (ofc, usually lots of other good stuff to choose from).  I did a Serverbear benchmark of one of my $20/mo Opteron (June last year), it's here.  Have had about a half dozen different servers with Dacentec, & none have failed to sustain at least 40MB/s (burst higher). My favorite is a 12-month rent-to-own ZT Systems 2XL5520 16GB 2x2TB SATA for $40/month (got lucky with the 'off-brand', haven't seen a RTO 2xL5520 for under $50/mo since -- at least for monthly contracts).  wholesaleinternet.com has some ancient 2-core intel CPUs @ $10/mo sometimes (I got an Intel Core 2 6300 @ 1.86GHz, with a 250GB HDD with 46000 hours on it, LOL. $20 @ Dacentec is much better, if you can grab one). joesdatacenter.com (same location as Wholesale Internet) also occasionally has specials (or if you don't want to wait, it has an AMD Opteron 170 @ $16/mo).
Xenotron
Jr. Member
*
Offline Offline

Activity: 31


View Profile
May 18, 2013, 07:14:08 AM
 #5403

Is there any way to avoid high CPU load by bitcoin-qt? Also latency skyrocketing to 14s...
Tried 11.4 and it seems there is a memory leak. Now started 11.2 - will see.
azw409
Member
**
Offline Offline

Activity: 74


View Profile
May 18, 2013, 08:57:28 AM
 #5404

The latency appears to be in bitcoin-qt because if I restart p2pool, the latency is still high > 10s on restart whereas if I restart both bitcoin-qt and p2pool the latency returns to around 0.5s.

So I'm not sure that using an earlier version of p2pool will have any bearing on this.

azw409
Member
**
Offline Offline

Activity: 74


View Profile
May 18, 2013, 09:02:05 AM
 #5405

Maybe the issue with latency is nothing to do with the software but extremely large blocks :-

https://bitcointalk.org/index.php?topic=207790.0

Xenotron
Jr. Member
*
Offline Offline

Activity: 31


View Profile
May 18, 2013, 09:18:30 AM
 #5406

Maybe the issue with latency is nothing to do with the software but extremely large blocks :-

https://bitcointalk.org/index.php?topic=207790.0
Nope. I have started to use blockmaxsize=5000 to see what will be changed. And so far there is no big difference.
bitcoin-qt continues to increase RAM consumption even when new block is found.
I can see on Graphs that when Bitcoin-qt releases occupied RAM then latency drops to its usual values.
Prattler
Full Member
***
Offline Offline

Activity: 192


View Profile
May 18, 2013, 09:50:09 AM
 #5407

I can confirm the high getblocktemplate latency is bitcoind related.

1. Upgrade bitcoind to the latest possible version (https://bitcointalk.org/index.php?topic=201124.0)

2. With p2pool we are real miners and make our own blocks, so edit the important settings in your bitcoin.conf!
Code:
blockmaxsize=250000 # default: 250000

blockprioritysize=27000 # default: 27000

mintxfee=0.0002 # default: 0.0001

minrelaytxfee=0.0002 # default: 0.0001
Setting mintxfee and minrelaytxfee higher than default will increase your getblocktemplate latency. It's a matter of opinion, but I think those defaults are too low for the network, so, by increasing them a bit, you are also benefiting the network. I would personally recommend setting both to 0.0005.

Edit: what happens is that lots of free and low fee transactions accumulate on the mempool, which increases getblocktemplate latency, due to an algorithmic flaw of bitcoind's getblocktemplate. It might not matter for most pools, but p2pool is more dependant on this. Setting mintxfee/minrelaytxfee above default 0.0001 reduces the accumulation of mempool garbage. Restarting bitcoind also clears the mempool and helps for a short time.
mdude77
Legendary
*
Offline Offline

Activity: 1358


View Profile
May 18, 2013, 10:13:24 AM
 #5408

I can confirm the high getblocktemplate latency is bitcoind related.

1. Upgrade bitcoind to the latest possible version (https://bitcointalk.org/index.php?topic=201124.0)

2. With p2pool we are real miners and make our own blocks, so edit the important settings in your bitcoin.conf!
Code:
blockmaxsize=250000 # default: 250000

blockprioritysize=27000 # default: 27000

mintxfee=0.0002 # default: 0.0001

minrelaytxfee=0.0002 # default: 0.0001
Setting mintxfee and minrelaytxfee higher than default will increase your getblocktemplate latency. It's a matter of opinion, but I think those defaults are too low for the network, so, by increasing them a bit, you are also benefiting the network. I would personally recommend setting both to 0.0005.

Until bitcoind gets optimized, getblocktemplate just gets too slow with the default minrelaytxfee=0.0001.

Maybe this is hardware or environment related?  I'm still using default settings and latest p2pool.  My stale rate is always 10-15% less than the pool's rate.  Yes, according to p2pool my bitcoind latency is at 10s.  So what?

M

EDIT: I restarted bitcoind, it did significantly reduce getblocktemplate latency.  Don't see a big deal here, have to restart things regularly anyhow.  Just had to restart cgminer because it went funny on me.  Presumably hit the AMD driver time limit.

MMinerMonitor author, monitor/auto/schedule reboots/alerts/remote/MobileMiner for Ants and Spondoolies! Latest (5.2). MPoolMonitor author, monitor stats/workers for most pools, global BTC stats (current/nxt diff/USD val/hashrate/calc)! Latest (v4.2) 
Buyer beware of Bitmain hardware and services.
furball
Full Member
***
Offline Offline

Activity: 172



View Profile
May 18, 2013, 11:06:48 AM
 #5409

I can confirm the high getblocktemplate latency is bitcoind related.

1. Upgrade bitcoind to the latest possible version (https://bitcointalk.org/index.php?topic=201124.0)

2. With p2pool we are real miners and make our own blocks, so edit the important settings in your bitcoin.conf!
Code:
blockmaxsize=250000 # default: 250000

blockprioritysize=27000 # default: 27000

mintxfee=0.0002 # default: 0.0001

minrelaytxfee=0.0002 # default: 0.0001
Setting mintxfee and minrelaytxfee higher than default will increase your getblocktemplate latency. It's a matter of opinion, but I think those defaults are too low for the network, so, by increasing them a bit, you are also benefiting the network. I would personally recommend setting both to 0.0005.

Until bitcoind gets optimized, getblocktemplate just gets too slow with the default minrelaytxfee=0.0001.

Maybe this is hardware or environment related?  I'm still using default settings and latest p2pool.  My stale rate is always 10-15% less than the pool's rate.  Yes, according to p2pool my bitcoind latency is at 10s.  So what?

M

EDIT: I restarted bitcoind, it did significantly reduce getblocktemplate latency.  Don't see a big deal here, have to restart things regularly anyhow.  Just had to restart cgminer because it went funny on me.  Presumably hit the AMD driver time limit.


I've been running with the blockmaxsize and mintxfee setting per above for the last 12 hours and it didn't seem to help. I just added in the blockprioritysize and minrelaytxfee settings and it looks to have made a huge difference.

Went from 5s latency to sub 1s.

Thanks so much Prattler...awesome post!
daemondazz
Sr. Member
****
Offline Offline

Activity: 280



View Profile
May 19, 2013, 12:14:48 AM
 #5410

None of the above changes have made any difference for my node - I'm currently running at 11s Get Work latency. With a 10s block time, I can't help but think I'm never going to actually solve a share.

Restarting bitcoind drops the latency back down, but it climbs back up to >10s in about half hour. I'm now restarting once per hour from cron to attempt to get some period where I might be able to get some valid work.

This is with version 0.8.1-precise2 from http://ppa.launchpad.net/bitcoin/bitcoin/ubuntu.

Any other ideas?

Computers, Amateur Radio, Electronics, Aviation - 1dazzrAbMqNu6cUwh2dtYckNygG7jKs8S
mdude77
Legendary
*
Offline Offline

Activity: 1358


View Profile
May 19, 2013, 12:18:27 AM
 #5411

None of the above changes have made any difference for my node - I'm currently running at 11s Get Work latency. With a 10s block time, I can't help but think I'm never going to actually solve a share.

Restarting bitcoind drops the latency back down, but it climbs back up to >10s in about half hour. I'm now restarting once per hour from cron to attempt to get some period where I might be able to get some valid work.

This is with version 0.8.1-precise2 from http://ppa.launchpad.net/bitcoin/bitcoin/ubuntu.

Any other ideas?

I'm at 1s latency now.  It was about 8-10 hours ago that I restarted it.  Must behave differently on linux than it does windows.  Or it's hardware related?  What horsepower do you have under the hood?  using an i7 on an SSD with 12gb of ram here.

M

MMinerMonitor author, monitor/auto/schedule reboots/alerts/remote/MobileMiner for Ants and Spondoolies! Latest (5.2). MPoolMonitor author, monitor stats/workers for most pools, global BTC stats (current/nxt diff/USD val/hashrate/calc)! Latest (v4.2) 
Buyer beware of Bitmain hardware and services.
TurdHurdur
Full Member
***
Offline Offline

Activity: 217


View Profile
May 19, 2013, 12:35:38 AM
 #5412

None of the above changes have made any difference for my node - I'm currently running at 11s Get Work latency. With a 10s block time, I can't help but think I'm never going to actually solve a share.

Restarting bitcoind drops the latency back down, but it climbs back up to >10s in about half hour. I'm now restarting once per hour from cron to attempt to get some period where I might be able to get some valid work.

This is with version 0.8.1-precise2 from http://ppa.launchpad.net/bitcoin/bitcoin/ubuntu.

Any other ideas?

Code:
mintxfee=20000

...in bitcoin.conf worked pretty good for me, still get some fee'd transactions in and latency is under .1 seconds.

Edit: it ceased being effective, unfortunate...
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
May 19, 2013, 02:39:13 AM
 #5413

Here's the settings I'm currently trying (too soon to be sure it works).
This removes any room reserved for high priority transaction (using old inputs).

Code:
blockminsize=0
blockprioritysize=0
mintxfee=0.001

mintxfee might have to be raised to avoid the current set of problematic transactions (I'm not sure how much they paid by kB).

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
zvs
Legendary
*
Offline Offline

Activity: 1386



View Profile WWW
May 19, 2013, 06:49:13 AM
 #5414

blockminsize=0
blockprioritysize=0
blockmaxsize=5000     (you could reduce this to probably 2000 or 3000 and still pick up the odd super high transaction fee transfer.  *1200 or below will always miss it, as it'll just have the 1 transaction from block)
minrelaytxfee=0.0005    (i assume that one works, i make the change in the source, which would be nMinRelayTxFee = 50000)

the post about increasing the relay fees = higher latency is wrong

ofc, if all blocks came from p2pool then we'd have issues if everyone had ^^^ those settings

i guess 'mintxfee' would be the creation tx fee, which you probably wont want to change unless you want to increase fees on your own transactions.  i assume most pools run with the default setting of 0.0001

last edit, i think;

set maxblocksize to 1000.  if you still have latency issues, then the issue lies somewhere other than with bitcoind and p2pool

Dacentec, best deals for US dedicated servers. They regularly restock $20-$25 Opterons with 8-16GB RAM & 2x1-2TB HDD's (ofc, usually lots of other good stuff to choose from).  I did a Serverbear benchmark of one of my $20/mo Opteron (June last year), it's here.  Have had about a half dozen different servers with Dacentec, & none have failed to sustain at least 40MB/s (burst higher). My favorite is a 12-month rent-to-own ZT Systems 2XL5520 16GB 2x2TB SATA for $40/month (got lucky with the 'off-brand', haven't seen a RTO 2xL5520 for under $50/mo since -- at least for monthly contracts).  wholesaleinternet.com has some ancient 2-core intel CPUs @ $10/mo sometimes (I got an Intel Core 2 6300 @ 1.86GHz, with a 250GB HDD with 46000 hours on it, LOL. $20 @ Dacentec is much better, if you can grab one). joesdatacenter.com (same location as Wholesale Internet) also occasionally has specials (or if you don't want to wait, it has an AMD Opteron 170 @ $16/mo).
daemondazz
Sr. Member
****
Offline Offline

Activity: 280



View Profile
May 19, 2013, 07:20:02 AM
 #5415

I'm at 1s latency now.  It was about 8-10 hours ago that I restarted it.  Must behave differently on linux than it does windows.  Or it's hardware related?  What horsepower do you have under the hood?  using an i7 on an SSD with 12gb of ram here.

I'm running on a HP Blade, quad core Xeon on SAS drives, so computing power shouldn't be an issue Smiley

Not sure what else to try...

Computers, Amateur Radio, Electronics, Aviation - 1dazzrAbMqNu6cUwh2dtYckNygG7jKs8S
azw409
Member
**
Offline Offline

Activity: 74


View Profile
May 19, 2013, 07:47:30 AM
 #5416

This current round is taking a long time :-(
Amph
Legendary
*
Offline Offline

Activity: 1358



View Profile
May 19, 2013, 07:58:48 AM
 #5417

yeah, two days and still no transactions, even with 4 share and efficiency of 130...
i switch to btcguild for now

KALRONG
Jr. Member
*
Offline Offline

Activity: 52



View Profile WWW
May 19, 2013, 10:30:07 AM
 #5418

yeah, two days and still no transactions, even with 4 share and efficiency of 130...
i switch to btcguild for now

remenber that the shares expire around 24h after you get them hehe

If I helped you feel free to donate any quantity, it will help me continuing to be able to test and improve things Smiley

BTC:  1HAKsmg8ZrXwydBfAh4VNTp
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
May 19, 2013, 11:13:39 AM
 #5419

i guess 'mintxfee' would be the creation tx fee, which you probably wont want to change unless you want to increase fees on your own transactions.  i assume most pools run with the default setting of 0.0001

minrelaytxfee doesn't exist in 0.8.1 (it's a constant). Looking at the source (main.cpp, CTxMemPool::accept), I added:
Code:
limitfreerelay=0
to my configuration. It may not be enough (I've not fully grasped all the conditions where this is applied).

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
daemondazz
Sr. Member
****
Offline Offline

Activity: 280



View Profile
May 19, 2013, 11:28:53 AM
 #5420

So I'm wondering whether the current long round time is related to the high latency issue. I've clicked on over a dozen of the servers in the list at http://p2pool-nodes.info/ and every single one of them has had a getwork template latency of >10 seconds.

I'm currently running a reindex on my bitcoind. It found a heap of orphan transactions and is now re-downloading the blockchain from around height 100,000...

I think I'm also going to have to temporarily switch to a different pool, until this catches up.

Computers, Amateur Radio, Electronics, Aviation - 1dazzrAbMqNu6cUwh2dtYckNygG7jKs8S
Pages: « 1 ... 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 [271] 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 ... 744 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!