Bitcoin Forum
December 09, 2016, 04:20:08 AM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 ... 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 [197] 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 ... 744 »
  Print  
Author Topic: [1500 TH] p2pool: Decentralized, DoS-resistant, Hop-Proof pool  (Read 2033065 times)
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
November 18, 2012, 10:55:57 PM
 #3921

Nice explanation from forrestv on how p2pool is counting stales on #p2pool channel:

Code:
23:05 < forrestv> gyver, assuming the share chain is operating normally (no major
                  forks), the pool hash rate estimate is unbiased except for it being
                  a little lower than true due to people leaving before telling
                  everyone they got a stale by finding another share
23:06 < forrestv> each share has a flag that says either "i don't have any uncounted
                  dead/stale shares", "i have 1 uncounted dead share", or "i have 1
                  uncounted stale share"
23:07 < forrestv> your node keeps counts of how many dead/stale shares you've mined
                  and how many times you've successfully produced a share with one of
                  those flags
23:07 < forrestv> and it keeps producing shares with one of those flags until you've
                  notified everyone of your past dead/stale shares
I can live with the lower estimation. Stales to report, according to my experience from both the network as a whole and my nodes, are mostly between 6 and 12%. So on average we lose between 6% and 12% of the hashrate of people leaving p2pool (assuming their node isn't coming back later) for the average period between their last p2pool-valid shares. The unrealistic (and provably "not happening") worst case scenario is when everybody mining on p2pool would create nodes that would only mine for a period matching their own expected interval between shares. That could explain a lower estimate of hashrate matching an artificial 110% PPS result.
Conclusion for kano, stales don't explain the current 110%, variance is probably the biggest part and p2pool has an advantage vs other pools too: it broadcasts its blocks through a much larger set of bitcoind nodes. When we had latency problems we had quite frequent orphan blocks (and probably bad luck too) and averaged ~90% PPS. Now we rarely see orphans compared to what we saw at the time.

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
1481257208
Hero Member
*
Offline Offline

Posts: 1481257208

View Profile Personal Message (Offline)

Ignore
1481257208
Reply with quote  #2

1481257208
Report to moderator
1481257208
Hero Member
*
Offline Offline

Posts: 1481257208

View Profile Personal Message (Offline)

Ignore
1481257208
Reply with quote  #2

1481257208
Report to moderator
1481257208
Hero Member
*
Offline Offline

Posts: 1481257208

View Profile Personal Message (Offline)

Ignore
1481257208
Reply with quote  #2

1481257208
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1481257208
Hero Member
*
Offline Offline

Posts: 1481257208

View Profile Personal Message (Offline)

Ignore
1481257208
Reply with quote  #2

1481257208
Report to moderator
1481257208
Hero Member
*
Offline Offline

Posts: 1481257208

View Profile Personal Message (Offline)

Ignore
1481257208
Reply with quote  #2

1481257208
Report to moderator
1481257208
Hero Member
*
Offline Offline

Posts: 1481257208

View Profile Personal Message (Offline)

Ignore
1481257208
Reply with quote  #2

1481257208
Report to moderator
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
November 18, 2012, 11:05:35 PM
 #3922

forrestv, please check my comment on last commit Smiley
https://github.com/forrestv/p2pool/commit/daa3ba3dfed955caceef49438f6d0067c7ea99a1

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
mdude77
Legendary
*
Offline Offline

Activity: 1358


View Profile
November 19, 2012, 12:24:48 AM
 #3923

Gyver, not quite. Share have a flag that indicates whether the node that generated it got a stale share in the past, and from those, nodes can compute the stale share percentage and then the total hash rate with an expression like: unstale_hash_rate / (1 - pool_stale_proportion)
Is it just a flag or a counter? We have whole network stats for DOA and Orphans too, are there 2 flags/counters?
With a counter the stale estimation should be pretty good. If it's a flag, multiple stales between shares would be miscounted as an unique stale.

What might be underestimated too is the amount of work from nodes which stop mining after stale shares.
Note that I don't think it's an actual problem. With around 9-10 GH/s, I've always seen above 100% PPS and I'm currently at around 115% PPS for the last active weeks (computed from my actual earnings vs actual hash power). It matches the :
- p2pool.info luck,
- my efficiency,
- the average tx fee percentage.
This is why I'm back mining on p2pool: hashpower promises at least 105% PPS when leasing and falls short due to high rejects, I compared my actual PPS over several weeks and stats are largely in favor of p2pool for me. I left p2pool because I had I/O issues and likes to test novelties, but now bitcoind and p2pool are both on SSDs and they are just flying (at least when I'm not rewiring the whole apartment...).

My first SSD should be arriving soon.  I'm seriously hoping it decreases my stale rate - like you, I think it's I/O related.

M

Have you got latest bitcoind from git? It's much faster than stable version, with new database. With latest bitcoind from git my GetWork Latency dropped about 5-10x times.

I managed to get ubuntu up and running a vm, and managed to get bitcoin up and running without too much of the usual linux shenanigans.  However, I see a big bold warning on the client that says this is a test build and should not be used for mining.  How are you supposed to test it if you can't use it in prod?  I'm sure not pointing GPUs to test.

M

MMinerMonitor author, monitor/auto/schedule reboots/alerts/remote/MobileMiner for Ants and Spondoolies! Latest (5.2). MPoolMonitor author, monitor stats/workers for most pools, global BTC stats (current/nxt diff/USD val/hashrate/calc)! Latest (v4.2) 
Buyer beware of Bitmain hardware and services.
cabin
Full Member
***
Offline Offline

Activity: 205


View Profile
November 19, 2012, 02:57:37 PM
 #3924

for you guys running the latest git versions of bitcoind, are you building these locally or is there someone trustworthy doing nightly builds?

1Cabinz1RSccAbFx2DikYomSKeMupy7M6V
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
November 19, 2012, 04:42:07 PM
 #3925

for you guys running the latest git versions of bitcoind, are you building these locally or is there someone trustworthy doing nightly builds?
Once you make compiling machine up and running it is not a problem to compile new git yourself even everyday Smiley
Code:
cd bitcoin
git pull
cd src
make -f makefile.unix bitcoind
strip bitcoind

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
Red Emerald
Hero Member
*****
Offline Offline

Activity: 742



View Profile WWW
November 19, 2012, 06:48:48 PM
 #3926

for you guys running the latest git versions of bitcoind, are you building these locally or is there someone trustworthy doing nightly builds?
Once you make compiling machine up and running it is not a problem to compile new git yourself even everyday Smiley
Code:
cd bitcoin
git pull
cd src
make -f makefile.unix bitcoind
strip bitcoind

I usually build with multiple cores and without UPNP support since it's easier.

Code:
make -f makefile.unix -j2 USE_UPNP= bitcoind

You will also need some dependencies.  On Ubuntu 12.04, I use:
Code:
sudo apt-get install -y git-core build-essential libssl-dev libboost-all-dev libdb5.1-dev libdb5.1++-dev libgtk2.0-dev

twmz
Hero Member
*****
Offline Offline

Activity: 737



View Profile
November 19, 2012, 07:18:35 PM
 #3927

I see a big bold warning on the client that says this is a test build and should not be used for mining. 

I am curious if others are mining with this anyway.  I, also, tried the latest and then went back to the stable version after seeing this message.  Mostly because I have used git-versions of bitcoind a lot in the past and they generally never had warnings like this.  So I took the presence of this warning to be an indication that it was especially unwise to mine with it.  But does anyone actually know if it has serious issues or if the message is mostly about prudence?

Was I helpful?  1TwmzX1wBxNF2qtAJRhdKmi2WyLZ5VHRs
WoT, GPG

Bitrated user: ewal.
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
November 19, 2012, 09:25:18 PM
 #3928

Last git is killer for litecoin pool
http://pastebin.com/EGbXXAps
Nodes are disconnected over and over.

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
ChanceCoats123
Hero Member
*****
Offline Offline

Activity: 680



View Profile
November 20, 2012, 05:37:54 AM
 #3929

Updated to v9. It seems I'm always one of the last ones to move over (because I'm not as active on these forums anymore). Could I possibly get someone to shoot me an email when a new binary is released? That way I don't get left behind, and we can move the transition to the next version along? Smiley
twmz
Hero Member
*****
Offline Offline

Activity: 737



View Profile
November 20, 2012, 05:42:30 AM
 #3930

Updated to v9. It seems I'm always one of the last ones to move over (because I'm not as active on these forums anymore). Could I possibly get someone to shoot me an email when a new binary is released? That way I don't get left behind, and we can move the transition to the next version along? Smiley

Sign up here:  http://groups.google.com/group/p2pool-notifications

forrestv uses this to send subscribers notifications anytime there is a required new version (or other urgent communications).

Was I helpful?  1TwmzX1wBxNF2qtAJRhdKmi2WyLZ5VHRs
WoT, GPG

Bitrated user: ewal.
Mobius
Hero Member
*****
Offline Offline

Activity: 957



View Profile
November 20, 2012, 07:45:19 AM
 #3931

Updated to v9. It seems I'm always one of the last ones to move over (because I'm not as active on these forums anymore). Could I possibly get someone to shoot me an email when a new binary is released? That way I don't get left behind, and we can move the transition to the next version along? Smiley

Why not add a notify on this thread, otherwise if your not willing to update yourself, then why should anyone make that effort for you. If you want to benefit, then take a proactive approach and stop waiting for someone to spoon feed you. Grow up, we are not your mom and dad.
btharper
Sr. Member
****
Offline Offline

Activity: 389



View Profile
November 20, 2012, 08:12:24 AM
 #3932

Updated to v9. It seems I'm always one of the last ones to move over (because I'm not as active on these forums anymore). Could I possibly get someone to shoot me an email when a new binary is released? That way I don't get left behind, and we can move the transition to the next version along? Smiley
Why not add a notify on this thread, otherwise if your not willing to update yourself, then why should anyone make that effort for you. If you want to benefit, then take a proactive approach and stop waiting for someone to spoon feed you. Grow up, we are not your mom and dad.
Well someone beat you to the punch with a polite, helpful answer. To add insult to injury your solution isn't really adequate; a notification on this thread would work the first time anyone else posted in this thread (nearly daily) and have relatively little correlation to the new versions coming out.

As a curiosity, does the p2pool client support forwarding a signed message similarly to how bitcoind does? Could this be added to the low-priority wishlist if not?
lenny_
Legendary
*
Offline Offline

Activity: 953



View Profile
November 20, 2012, 08:41:28 AM
 #3933

Updated to v9. It seems I'm always one of the last ones to move over (because I'm not as active on these forums anymore). Could I possibly get someone to shoot me an email when a new binary is released? That way I don't get left behind, and we can move the transition to the next version along? Smiley

New: Mailing list for urgent news (updates, bugs): http://groups.google.com/group/p2pool-notifications

Subscribe here, you will got your e-mails Smiley
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
November 20, 2012, 08:50:05 AM
 #3934

Updated to v9. It seems I'm always one of the last ones to move over (because I'm not as active on these forums anymore). Could I possibly get someone to shoot me an email when a new binary is released? That way I don't get left behind, and we can move the transition to the next version along? Smiley

Why not add a notify on this thread, otherwise if your not willing to update yourself, then why should anyone make that effort for you. If you want to benefit, then take a proactive approach and stop waiting for someone to spoon feed you. Grow up, we are not your mom and dad.
One of ways to keep node automagically updated: https://bitcointalk.org/index.php?topic=18313.msg836949#msg836949
Edit to your config, put it to cron weekly and forget.

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
gyverlb
Hero Member
*****
Offline Offline

Activity: 896



View Profile
November 20, 2012, 10:08:24 AM
 #3935

One of ways to keep node automagically updated: https://bitcointalk.org/index.php?topic=18313.msg836949#msg836949
Edit to your config, put it to cron weekly and forget.
Here's the updated version I'm currently using (launched by cron everyday and at @reboot, see your crontab manual...):

http://pastebin.com/HtD0uku4

The pool.sh script it uses launches p2pool in the background with screen. You should write it according to your needs, something like:
Code:
screen -U -S p2pool -d -m python run_p2pool.py <your_options>

Makes it easy to connect with
Code:
screen -r p2pool
if needed.

P2pool tuning guide
Trade BTC for €/$ at bitcoin.de (referral), it's cheaper and faster (acts as escrow and lets the buyers do bank transfers).
Tip: 17bdPfKXXvr7zETKRkPG14dEjfgBt5k2dd
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
November 20, 2012, 12:17:52 PM
 #3936

Update progress:
v9: 81%
v8: 12%
v5: 6%
Rest is under 1%

I`ts final git pull time! Cheesy

Latest binary 9.0-6-gf18f763 for win32 and win64 on my skydrive if any1 interested Smiley

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
organofcorti
Donator
Legendary
*
Offline Offline

Activity: 1960


Poor impulse control.


View Profile WWW
November 20, 2012, 02:31:28 PM
 #3937

I just posted a new analysis of p2Pool's statistics as per rav3n_pl's request: http://organofcorti.blogspot.com/2012/11/52-p2pool-achieving-expectations.html

I hope it dispels the "increasing the hashrate means the end of the world" myths, and I also hope one of you can answer a question I couldn't.

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
Aseras
Hero Member
*****
Offline Offline

Activity: 658


View Profile
November 20, 2012, 04:40:22 PM
 #3938

That's are my results, on Intel Atom 230 1.6GHz HT + 1 GB RAM:

It was after switching from bitcoind 0.7.1 to newest from git Smiley

2+ seconds, that sucks.

lenny_
Legendary
*
Offline Offline

Activity: 953



View Profile
November 20, 2012, 05:00:59 PM
 #3939

Look at it now! Newest p2pool, newest bitcoind compiled, same machine. It was 5s at the beginning, after customizations 2s, now it is 0.5s !
rav3n_pl
Legendary
*
Offline Offline

Activity: 1320


Don`t panic! Organize!


View Profile
November 20, 2012, 05:42:01 PM
 #3940

I just posted a new analysis of p2Pool's statistics as per rav3n_pl's request: http://organofcorti.blogspot.com/2012/11/52-p2pool-achieving-expectations.html

I hope it dispels the "increasing the hashrate means the end of the world" myths, and I also hope one of you can answer a question I couldn't.
*blushing*
(...)
*reading*
(...)
"There is no correlation between pool luck and pool hashrate, or orphaned block production and pool hashrate"
Eat this, infidels! Cheesy

In some way I see pattern in "Shares per round / D as function of p2pool hashrate" graph, it looks like this:

;]

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
My SatoshDice bot https://bitcointalk.org/index.php?topic=897685
Pages: « 1 ... 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 [197] 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 ... 744 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!