zefir
Donator
Hero Member
Offline
Activity: 919
Merit: 1000
|
|
January 28, 2015, 10:09:04 PM |
|
I need some help to correctly interpret the pool statistics. To my understanding, the round luck expresses the ratio of spent shares to solve a block. While intuitive as immediate value, it is not suitable for intuitive statistical analyses. Take e.g. the following series of luck values (real ones starting from block 338694): - 137.70%
- 3971.90%
- 18.20%
- 393.70%
Looks not so bad at first sight - makes one think the sub 20% one is well compensated by the lucky ones. But truth is, you need to average over the reciprocal values to get the combined luck of a series, formally: luck(n1..nk) = 1 / [(1/n1 + 1/n2 + ... + 1/nk) / k]For the above example we get the series luck calculated as 1 / [(0.726 + 0.025 + 5.495 + 0.254)/4] = 1 / [6.5/4] = 61.54%If my assumption is correct, then this was a quite bad luck series. Talking variance: shouldn't the average over a longer series be close to 100%? I manually typed the round lucks for the last 100 blocks into a spreadsheet for closer inspection. The averaged luck over this series (covering last ~3 weeks of mining) is 78.74% - which I found shocking low since variance should be leveled out quite well. I disbelieve this number that much that I assume my interpretation is just wrong. Anyone with better understanding willing to comment? @wizkid: are those numbers at http://eligius.st/~wizkid057/newstats/blocks.php available in CSV or JSON format? Thanks
|
|
|
|
MrTeal
Legendary
Offline
Activity: 1274
Merit: 1004
|
|
January 28, 2015, 10:23:44 PM |
|
I need some help to correctly interpret the pool statistics. To my understanding, the round luck expresses the ratio of spent shares to solve a block. While intuitive as immediate value, it is not suitable for intuitive statistical analyses. Take e.g. the following series of luck values (real ones starting from block 338694): - 137.70%
- 3971.90%
- 18.20%
- 393.70%
Looks not so bad at first sight - makes one think the sub 20% one is well compensated by the lucky ones. But truth is, you need to average over the reciprocal values to get the combined luck of a series, formally: luck(n1..nk) = 1 / [(1/n1 + 1/n2 + ... + 1/nk) / k]For the above example we get the series luck calculated as 1 / [(0.726 + 0.025 + 5.495 + 0.254)/4] = 1 / [6.5/4] = 61.54%If my assumption is correct, then this was a quite bad luck series. Talking variance: shouldn't the average over a longer series be close to 100%? I manually typed the round lucks for the last 100 blocks into a spreadsheet for closer inspection. The averaged luck over this series (covering last ~3 weeks of mining) is 78.74% - which I found shocking low since variance should be leveled out quite well. I disbelieve this number that much that I assume my interpretation is just wrong. Anyone with better understanding willing to comment? @wizkid: are those numbers at http://eligius.st/~wizkid057/newstats/blocks.php available in CSV or JSON format? Thanks That sounds about right. According to organofcorti's blog, our average time to find a block over the last 3 weeks (Jan 04-24 inclusive) is 1.2x, 1.2x and 1.42x the expected value, which is 78.5%. It's been a bad start to the year.
|
|
|
|
lanfeusst
|
|
January 29, 2015, 12:42:58 AM Last edit: January 29, 2015, 07:37:05 PM by lanfeusst |
|
I need some help to correctly interpret the pool statistics. To my understanding, the round luck expresses the ratio of spent shares to solve a block. While intuitive as immediate value, it is not suitable for intuitive statistical analyses. Take e.g. the following series of luck values (real ones starting from block 338694): - 137.70%
- 3971.90%
- 18.20%
- 393.70%
Looks not so bad at first sight - makes one think the sub 20% one is well compensated by the lucky ones. But truth is, you need to average over the reciprocal values to get the combined luck of a series, formally: luck(n1..nk) = 1 / [(1/n1 + 1/n2 + ... + 1/nk) / k]For the above example we get the series luck calculated as 1 / [(0.726 + 0.025 + 5.495 + 0.254)/4] = 1 / [6.5/4] = 61.54%If my assumption is correct, then this was a quite bad luck series. Talking variance: shouldn't the average over a longer series be close to 100%? I manually typed the round lucks for the last 100 blocks into a spreadsheet for closer inspection. The averaged luck over this series (covering last ~3 weeks of mining) is 78.74% - which I found shocking low since variance should be leveled out quite well. I disbelieve this number that much that I assume my interpretation is just wrong. Anyone with better understanding willing to comment? @wizkid: are those numbers at http://eligius.st/~wizkid057/newstats/blocks.php available in CSV or JSON format? Thanks After making the math for last 100 blocks : cat Block\ List\ -\ Eligius\ Pool\ Statistics.html |egrep % | awk '{print $8}' | cut -d % -f 1 | cut -d '>' -f 2 | tr -d , | sed 1d | head -n 100 | awk '{SUM+=1/$1} END {print NR/SUM}' 78.8334% luck For last 200 : cat Block\ List\ -\ Eligius\ Pool\ Statistics.html |egrep % | awk '{print $8}' | cut -d % -f 1 | cut -d '>' -f 2 | tr -d , | sed 1d | head -n 200 | awk '{SUM+=1/$1} END {print NR/SUM}' 82.7441% luck For last 500 : cat Block\ List\ -\ Eligius\ Pool\ Statistics.html |egrep % | awk '{print $8}' | cut -d % -f 1 | cut -d '>' -f 2 | tr -d , | sed 1d | head -n 500 | awk '{SUM+=1/$1} END {print NR/SUM}' 90.384% luck For last 1000 : cat Block\ List\ -\ Eligius\ Pool\ Statistics.html |egrep % | awk '{print $8}' | cut -d % -f 1 | cut -d '>' -f 2 | tr -d , | sed 1d | head -n 1000 | awk '{SUM+=1/$1} END {print NR/SUM}' 93.1394% luck For last 3000 : cat Block\ List\ -\ Eligius\ Pool\ Statistics.html |egrep % | awk '{print $8}' | cut -d % -f 1 | cut -d '>' -f 2 | tr -d , | sed 1d | head -n 3000 | awk '{SUM+=1/$1} END {print NR/SUM}' 94.1135% luck For everything (8870): cat Block\ List\ -\ Eligius\ Pool\ Statistics.html |egrep % | awk '{print $8}' | cut -d % -f 1 | cut -d '>' -f 2 | tr -d , | sed 1d | awk '{SUM+=1/$1} END {print NR/SUM}' 95.989% luck (The pool is then equivalent for a loyal miner to a 4% fee PPS) Orphan rate is 198/(8870+198) = 2.18% (Quite high if you ask me) The total luck rate for the pool lifetime with orphan is : 95.989*(8870+198)/8870 = 98.13 %Which leaves 1.87 % of withholding hashing power for the pool lifetime assuming it is a long enough time frame (which I think it is)
|
|
|
|
Grix
|
|
January 29, 2015, 08:37:01 AM |
|
That sounds about right. According to organofcorti's blog, our average time to find a block over the last 3 weeks (Jan 04-24 inclusive) is 1.2x, 1.2x and 1.42x the expected value, which is 78.5%. It's been a bad start to the year.
It's been about equally bad since about the start of December.
|
|
|
|
MrTeal
Legendary
Offline
Activity: 1274
Merit: 1004
|
|
January 29, 2015, 03:44:20 PM |
|
I've noticed something interesting with the stats today, and I'm not sure what to make of it. I have two Antminer S5s, one running at 387.5MHz and one at 400MHz, each with their own worker. I unplugged one (the 400MHz) about 13 hours ago, and I wanted to see what the 12 hour stats looked like. When I first checked, both workers had the same 12hr average down to the hundredth of a GH/s. I though it was a little weird but just figured there was still some of the off time in there and it was a coincidence, so I waited for the next update. The 12 hr average diverged at the next update a little, but at this most recent update they are back to displaying not only the same hashrate, but exactly the same number of accepted shares. Worker 135 12 Hours 1,301.04 Gh/s 13086208 <-The 387.5MHz one, device shows 1278GH/s Worker 136 12 Hours 1,301.04 Gh/s 13086208 <-The 400MHz one, device shows 1319GH/s
I could see them matching up once, but having the exact same number of accepted shares twice in an hour seems extremely unlikely.
|
|
|
|
Luke-Jr
Legendary
Offline
Activity: 2576
Merit: 1186
|
|
January 29, 2015, 03:51:46 PM |
|
I've noticed something interesting with the stats today, and I'm not sure what to make of it. I have two Antminer S5s, one running at 387.5MHz and one at 400MHz, each with their own worker. I unplugged one (the 400MHz) about 13 hours ago, and I wanted to see what the 12 hour stats looked like. When I first checked, both workers had the same 12hr average down to the hundredth of a GH/s. I though it was a little weird but just figured there was still some of the off time in there and it was a coincidence, so I waited for the next update. The 12 hr average diverged at the next update a little, but at this most recent update they are back to displaying not only the same hashrate, but exactly the same number of accepted shares. Worker 135 12 Hours 1,301.04 Gh/s 13086208 <-The 387.5MHz one, device shows 1278GH/s Worker 136 12 Hours 1,301.04 Gh/s 13086208 <-The 400MHz one, device shows 1319GH/s
I could see them matching up once, but having the exact same number of accepted shares twice in an hour seems extremely unlikely.
I think the S5 has a bug where it only sends up to N shares per period of time, which would explain this behaviour.
|
|
|
|
BCwinning
|
|
January 29, 2015, 05:47:06 PM |
|
I've noticed something interesting with the stats today, and I'm not sure what to make of it. I have two Antminer S5s, one running at 387.5MHz and one at 400MHz, each with their own worker. I unplugged one (the 400MHz) about 13 hours ago, and I wanted to see what the 12 hour stats looked like. When I first checked, both workers had the same 12hr average down to the hundredth of a GH/s. I though it was a little weird but just figured there was still some of the off time in there and it was a coincidence, so I waited for the next update. The 12 hr average diverged at the next update a little, but at this most recent update they are back to displaying not only the same hashrate, but exactly the same number of accepted shares. Worker 135 12 Hours 1,301.04 Gh/s 13086208 <-The 387.5MHz one, device shows 1278GH/s Worker 136 12 Hours 1,301.04 Gh/s 13086208 <-The 400MHz one, device shows 1319GH/s
I could see them matching up once, but having the exact same number of accepted shares twice in an hour seems extremely unlikely.
I think the S5 has a bug where it only sends up to N shares per period of time, which would explain this behaviour. Why do you think that? Have you brought this to bitmain's attention or?
|
The New World Order thanks you for your support of Bitcoin and encourages your continuing support so that they may track your expenditures easier.
|
|
|
Moria843
Sr. Member
Offline
Activity: 442
Merit: 250
Found Lost beach - quiet now
|
|
January 29, 2015, 05:58:29 PM |
|
Sixteen bitcoin miners and what do you get? Another day older and deeper in debt St. Peter don’t you call me cause I can’t go, I owe my soul to the electric company store
|
Hot time, summer in the city, back of my mine getting hot & gritty!!!
|
|
|
MrTeal
Legendary
Offline
Activity: 1274
Merit: 1004
|
|
January 29, 2015, 06:52:22 PM Last edit: January 29, 2015, 09:59:10 PM by MrTeal |
|
Alright, test one. I switched the 400MHz unit to a different worker (test) and let it run for 50 minutes. test 12 Hours 88.90 Gh/s 894208 3 Hours 355.61 Gh/s 894208 22.5 Minutes 710.20 Gh/s 223232 There will be a little bit of a difference in the shares since I don't have access to the box right now, so I refreshed the minerstatus tab and then restarted cgminer, but there was probably a second or so of delay there. Interestingly, (2^48/65535)*916307/(50*60) gives 1312GH/s. The actual accepted shares gives (2^48/65535)*693682/(50*60)=1279GH/s I'm rerunning the test at 412.5 to see if the difference between poolside hashrate and displayed hashrate increases. Edit: Reran the tests. test3 12 Hours 175.59 Gh/s 1766144 3 Hours 702.36 Gh/s 1766144 22.5 Minutes 487.04 Gh/s 153088 There doesn't seem to be a limit that I'm easily able to reach on the number of shares/min that I'm able to reach.
|
|
|
|
zefir
Donator
Hero Member
Offline
Activity: 919
Merit: 1000
|
|
January 29, 2015, 07:22:07 PM |
|
That sounds about right. According to organofcorti's blog, our average time to find a block over the last 3 weeks (Jan 04-24 inclusive) is 1.2x, 1.2x and 1.42x the expected value, which is 78.5%. It's been a bad start to the year.
Thank you for pointing me to that. What is interesting to note is that recently all major evaluated pools ran into bad luck. Looking back around one year, we see how bad luck and good luck pools were par - which is what one would expect. Today, all of the pools are significantly unlucky (over 1.2). How probable it can be that a set of pools worth 50PH are unlucky - individually and as a set? Variance aside, there has been a monotonic down-trend in the luck over the past year - unless I knew better I'd suspect either a systematic error in how the statistics are collected or something very fishy is going on. I'll try to get some feedback on that from organofcorti before starting conspiracy. Which leaves 1.87 % of withholding hashing power for the pool lifetime assuming it is a long enough time frame (which I think it is)
Thanks man (or should I say: bash-guru ), that was exactly what I was looking for. Kudos for instead of asking for CSV data, extract it from the website (small fix: your command for the last 3000 has a typo). Your results show exactly what I suspected my feelings are cheating me: while the all-time average seems ok, the luck is monotonically getting worse. Compare any series of the last N blocks to the previous one to see what I mean. Must be missing something...
|
|
|
|
sorry2xs
Legendary
Offline
Activity: 924
Merit: 1000
Dark Passenger Bitcoin miner 2013,Bitcoin node
|
|
January 29, 2015, 09:48:57 PM |
|
Really this started to get worse about three months ago when the FBI released a statement on the tv networks that they were washing their hands with Bitcoin, and it does smell rotten Fish!
|
Please tip the Node 1MPWKB23NsZsXHANnFwVAWT86mL24fqAjF; KO4UX THAT NO GOOD DO GOODER BAT!!!
|
|
|
Biodom
Legendary
Offline
Activity: 3892
Merit: 4341
|
|
January 29, 2015, 09:58:04 PM |
|
That sounds about right. According to organofcorti's blog, our average time to find a block over the last 3 weeks (Jan 04-24 inclusive) is 1.2x, 1.2x and 1.42x the expected value, which is 78.5%. It's been a bad start to the year.
Thank you for pointing me to that. What is interesting to note is that recently all major evaluated pools ran into bad luck. Looking back around one year, we see how bad luck and good luck pools were par - which is what one would expect. Today, all of the pools are significantly unlucky (over 1.2). How probable it can be that a set of pools worth 50PH are unlucky - individually and as a set? Variance aside, there has been a monotonic down-trend in the luck over the past year - unless I knew better I'd suspect either a systematic error in how the statistics are collected or something very fishy is going on. I'll try to get some feedback on that from organofcorti before starting conspiracy. Which leaves 1.87 % of withholding hashing power for the pool lifetime assuming it is a long enough time frame (which I think it is)
Thanks man (or should I say: bash-guru ), that was exactly what I was looking for. Kudos for instead of asking for CSV data, extract it from the website (small fix: your command for the last 3000 has a typo). Your results show exactly what I suspected my feelings are cheating me: while the all-time average seems ok, the luck is monotonically getting worse. Compare any series of the last N blocks to the previous one to see what I mean. Must be missing something... yes, nobody complained repeatedly when it was going up and down, but since december, it is going either down or stays normal (there is no UP). there are many periods of underreporting, but very few (if any) of outperforming.
|
|
|
|
kano
Legendary
Offline
Activity: 4592
Merit: 1851
Linux since 1997 RedHat 4
|
|
January 29, 2015, 10:24:59 PM |
|
That sounds about right. According to organofcorti's blog, our average time to find a block over the last 3 weeks (Jan 04-24 inclusive) is 1.2x, 1.2x and 1.42x the expected value, which is 78.5%. It's been a bad start to the year.
Thank you for pointing me to that. What is interesting to note is that recently all major evaluated pools ran into bad luck. Looking back around one year, we see how bad luck and good luck pools were par - which is what one would expect. Today, all of the pools are significantly unlucky (over 1.2). How probable it can be that a set of pools worth 50PH are unlucky - individually and as a set? Variance aside, there has been a monotonic down-trend in the luck over the past year - unless I knew better I'd suspect either a systematic error in how the statistics are collected or something very fishy is going on. I'll try to get some feedback on that from organofcorti before starting conspiracy. ... "all" pools ... no.
|
|
|
|
RealMalatesta
Legendary
Offline
Activity: 2338
Merit: 1124
|
|
January 29, 2015, 11:40:46 PM |
|
Am I the only one not seeing the last two blocks in my earnings?
|
|
|
|
fryarminer
|
|
January 30, 2015, 07:15:11 PM |
|
Sixteen bitcoin miners and what do you get? Another day older and deeper in debt St. Peter don’t you call me cause I can’t go, I owe my soul to the electric company store
LOL!!!!
|
|
|
|
wizkid057 (OP)
Legendary
Offline
Activity: 1223
Merit: 1006
|
|
January 30, 2015, 07:48:47 PM |
|
|
|
|
|
zefir
Donator
Hero Member
Offline
Activity: 919
Merit: 1000
|
|
January 30, 2015, 11:14:26 PM |
|
Thanks, worked - one just needs to RTFM . This is how the luck developed since eligius started mining, averaged over 300 and 1000 blocks: The feeling that luck got awfully bad over the past two moths is not cheating us. At the same time, it was worse 10 months ago. Let's hope we saw the bottom.
|
|
|
|
lanfeusst
|
|
January 31, 2015, 11:31:14 PM |
|
Nice chart, nothing unusual here I think but the fact that a lot of majors pools have bad luck for 1 month now is a little worrying... No reason for all the network to be unlucky for a long time. Need to wait a little more time to confirm there is a problem
|
|
|
|
sorry2xs
Legendary
Offline
Activity: 924
Merit: 1000
Dark Passenger Bitcoin miner 2013,Bitcoin node
|
|
February 04, 2015, 01:05:16 PM |
|
are the stats page down
|
Please tip the Node 1MPWKB23NsZsXHANnFwVAWT86mL24fqAjF; KO4UX THAT NO GOOD DO GOODER BAT!!!
|
|
|
kano
Legendary
Offline
Activity: 4592
Merit: 1851
Linux since 1997 RedHat 4
|
|
February 04, 2015, 01:16:16 PM |
|
Nice chart, nothing unusual here I think but the fact that a lot of majors pools have bad luck for 1 month now is a little worrying... No reason for all the network to be unlucky for a long time. Need to wait a little more time to confirm there is a problem
Got some actual stats to point out "a lot of majors pools have bad luck for 1 month now"
|
|
|
|
|