Bitcoin Forum

Bitcoin => Mining speculation => Topic started by: steamon on May 07, 2014, 07:57:42 AM



Title: 26 ph up the next 2 days someone testing?
Post by: steamon on May 07, 2014, 07:57:42 AM
https://tradeblock.com/mining/

The last 2 weeks there was no rise or going down noticeable but now suddenly in 2 days 26 ph+ is someone testing their new chips? Or a big player delivered out 1000s off miners.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: davejh on May 07, 2014, 08:21:50 AM
https://tradeblock.com/mining/

The last 2 weeks there was no rise or going down noticeable but now suddenly in 2 days 26 ph+ is someone testing their new chips? Or a big player delivered out 1000s off miners.

I've been watching the hashing rate closely for a while and there have been a few big surges over the last month where large amounts of capacity appears online and then drops off again after a few hours.

Yesterday's was a huge spike though - the hashing rate peaked at over 100 PH/s and was sustaining 90 PH/s for the about 9 hours (91 blocks solved in 9 hours) but it's largely gone now (75 blocks in the last 12 hours). Some of this may be statistical noise but it suggests that someone was running tests on a lot of new hardware. No idea who or why though.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: -ck on May 07, 2014, 12:41:56 PM
The block withholders saw that people have noticed and have moved off pools and are hashing for real.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: gallery2000 on May 09, 2014, 09:00:30 PM
The block withholders saw that people have noticed and have moved off pools and are hashing for real.

So we are screwed with the difficulty climb?


Title: Re: 26 ph up the next 2 days someone testing?
Post by: -ck on May 09, 2014, 11:01:52 PM
The block withholders saw that people have noticed and have moved off pools and are hashing for real.

So we are screwed with the difficulty climb?
Yes, get yourself more lube. It will continue for a while yet.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: deux-es on May 09, 2014, 11:17:46 PM
Asicminer taking off  :o


Title: Re: 26 ph up the next 2 days someone testing?
Post by: t3xasdolly on May 09, 2014, 11:28:43 PM
Statistical anomaly? You simply do not turn on 26 PH (about 20 MWh  :o) just for test.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: kendog77 on May 10, 2014, 12:51:42 PM
Don't forget about Bitmain and the S2s. I'm sure Bitmain sold a lot of these, and they were hashing before shipment on May 8th but are now enroute all around the world.

Most of batch 4 is offline now, but they will come back online once folks start receiving them from UPS.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: Puppet on May 11, 2014, 07:52:33 AM
Statistical anomaly?

Obviously. Although I would call it a statistical normality. You are not measuring hashrate, you are measuring the rate at which blocks are found, and we all (should) know thats inherently variable.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: tzortz on May 11, 2014, 08:29:54 PM
Could it just be....luck?


Title: Re: 26 ph up the next 2 days someone testing?
Post by: taipo on May 11, 2014, 11:21:04 PM
Quote
Estimated Next Difficulty:   8,933,507,181 (+11.66%)

Source: https://bitcoinwisdom.com/bitcoin/difficulty

in about 13.5 hours


Title: Re: 26 ph up the next 2 days someone testing?
Post by: davejh on May 13, 2014, 12:47:32 PM
Statistical anomaly?

Obviously. Although I would call it a statistical normality. You are not measuring hashrate, you are measuring the rate at which blocks are found, and we all (should) know thats inherently variable.

I did wonder about this so I've been doing a bit of research. Mining is essentially a Poisson Process so the probability distributions ought to be relatively easy to work out. I found a useful calculator: http://stattrek.com/online-calculator/poisson.aspx (a lot of the online calculators only go to 3 decimal places and so aren't so useful)

First the easy ones. How likely is it to get 10 blocks in an hour instead of 6? The answer is 0.041 so roughly once per day we should see this. In practice while the difficulty levels are increasing then we're probably seeing more like 6.6 blocks per hour and then it's 0.058 (once every 17 hours). How likely is it that we'll see zero blocks in an hour? Assuming 6.6 blocks per hour on average then that's pretty unlikely at 0.00136 (once every 735 hours, or roughly once per month).

What are the odds of 90 blocks in 9 hours, assuming 6.6 blocks per hour normally? That turns out to be 0.0000469 (once every 21.2k hours, or once every 887 days).

If someone didn't switch on a lot of additional hashing capacity then this is definitely an anomaly, not a normality  ::)

I'm thinking that I really ought to plot some graphs!


Title: Re: 26 ph up the next 2 days someone testing?
Post by: hardhouseinc on May 13, 2014, 01:03:26 PM
http://www.coindesk.com/cointerra-unveils-1-petahash-hosted-mining-contracts/

possibly these guys?

It says available for immediate deployment.....


Title: Re: 26 ph up the next 2 days someone testing?
Post by: Puppet on May 13, 2014, 08:01:29 PM
What are the odds of 90 blocks in 9 hours, assuming 6.6 blocks per hour normally? That turns out to be 0.0000469 (once every 21.2k hours, or once every 887 days).

Using your calculator, its actually 0.013% since you should be looking at the cumulative probability, ie, the chance of hitting 90 blocks or more when 59.4 is expected.
So it would happen more than once per year on average.

But Id also like to see which blocks we are talking about, not sure anyone accounted for the fact that time stamps on these blocks can be wildly off, up to two hours IIRC.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: tzortz on May 13, 2014, 09:29:02 PM
Tradeblock current hashrate shows 75phs and bitcoinwisdom says 67phs.

What do I miss here?

Sorry if is a dumb question.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: Puppet on May 13, 2014, 09:36:13 PM
Tradeblock current hashrate shows 75phs and bitcoinwisdom says 67phs.

What do I miss here?

Their estimates are averaged over a different period. The latter averages over 504 blocks, the former Im guessing over 24 hours.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: tzortz on May 13, 2014, 09:39:33 PM
So tradeblock would show more accurate data on spike cases?


Title: Re: 26 ph up the next 2 days someone testing?
Post by: davejh on May 13, 2014, 11:09:09 PM
What are the odds of 90 blocks in 9 hours, assuming 6.6 blocks per hour normally? That turns out to be 0.0000469 (once every 21.2k hours, or once every 887 days).

Using your calculator, its actually 0.013% since you should be looking at the cumulative probability, ie, the chance of hitting 90 blocks or more when 59.4 is expected.
So it would happen more than once per year on average.

But Id also like to see which blocks we are talking about, not sure anyone accounted for the fact that time stamps on these blocks can be wildly off, up to two hours IIRC.

Yes, that's definitely a better estimate for the likelihood. The number I'd quoted was for exactly 90 blocks instead of >= 90.

The blocks are numbers 299349 through 299439 - it's actually 91 blocks in the 9 hour period which I guess is really actually a cumulative probability of 0.0000532 assuming the timestamps are accurate. The timestamps seem likely to be reasonably accurate here though as there were blocks 11 minutes before and 4 minutes after. We still appear to be looking at a highly improbable event but one that should occur once every 10 to 11 months and I guess would be all too easy to miss unless you were watching the stats on a very close basis.

What I was interested to understand was the probability that in any 24 hour period the hash rate would be 10% high or 10% low. I couldn't find a good enough calculator (I need to set something up with a bignum library) but for 10% high or low in a 12 hour period things we get that the hash rate will be high 17.5% of the time and low 19.5% of the time. That (to me at least) was surprisingly often and suggests that it would be interesting to find a better way to estimate hashing rates. It's certainly more than enough to explain some of the jitter in the past difficulty increases though.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: Biontic on May 14, 2014, 03:24:25 PM
Right: I am going out on a limb here :-

Please correct me if I am mistaken. But there is no definitive hashrate - it seems that the hashrate is calculated by the speed the last x-number of blocks were solved. This can make it look like the hashrate is fluctuating wildly, when in actual fact, it is just a series of 'lucky' blocks making it 'look' like there is a spike.

can anyone confirm this or explain why I am mistaken....
TY


Title: Re: 26 ph up the next 2 days someone testing?
Post by: davejh on May 14, 2014, 04:08:16 PM
Right: I am going out on a limb here :-

Please correct me if I am mistaken. But there is no definitive hashrate - it seems that the hashrate is calculated by the speed the last x-number of blocks were solved. This can make it look like the hashrate is fluctuating wildly, when in actual fact, it is just a series of 'lucky' blocks making it 'look' like there is a spike.

can anyone confirm this or explain why I am mistaken....
TY

There is a definitive hash rate but it's not something that can be directly measured because we have no way of knowing who's hashing at any one time and how much capacity they actually have.

Until someone finds a way to break the SHA256 hashing algorithm then hashing is a Poisson Process. There's a most-likely time duration between events (blocks being found) but the block finding essentially occurs at random. That means that in theory we might not find any blocks for 24 hours or we might find 100 blocks within one second, just that both of these are astonishingly unlikely to happen.

The system is memoryless so even though we might like to believe that an improbable event gets cancelled out sometime later that can't be guaranteed either (it's just that things tend to work out that way most of the time). The spike I was looking at the other day is pretty improbable but there's no reason why another one couldn't happen later today, or indeed a much bigger one occur, it's just that both are unlikely to happen; neither is any less likely now though just because we saw one a few days ago.

Originally I assumed the spike had to be down to extra hashing capacity, and in fact if more hashing capacity had been added temporarily then the very unlikely event would become much more likely so that's certainly a possible explanation but without evidence of extra capacity then it's just a guess and it's probably safer to assume random behaviour.

The difficulty changes attempt to keep the system so that the most probable block finding time in the preceding 2016 blocks would have been 10 minutes but we could end up overestimating the difficulty because we randomly found blocks quicker or we could also underestimate it because we found blocks slower. That certainly accounts for why some difficulty changes seem a little larger or smaller than we might expect but over time the highest probability is that things will balance out.


Title: Re: 26 ph up the next 2 days someone testing?
Post by: davejh on May 22, 2014, 12:36:54 AM
What are the odds of 90 blocks in 9 hours, assuming 6.6 blocks per hour normally? That turns out to be 0.0000469 (once every 21.2k hours, or once every 887 days).

Using your calculator, its actually 0.013% since you should be looking at the cumulative probability, ie, the chance of hitting 90 blocks or more when 59.4 is expected.
So it would happen more than once per year on average.

But Id also like to see which blocks we are talking about, not sure anyone accounted for the fact that time stamps on these blocks can be wildly off, up to two hours IIRC.

Yes, that's definitely a better estimate for the likelihood. The number I'd quoted was for exactly 90 blocks instead of >= 90.

The blocks are numbers 299349 through 299439 - it's actually 91 blocks in the 9 hour period which I guess is really actually a cumulative probability of 0.0000532 assuming the timestamps are accurate. The timestamps seem likely to be reasonably accurate here though as there were blocks 11 minutes before and 4 minutes after. We still appear to be looking at a highly improbable event but one that should occur once every 10 to 11 months and I guess would be all too easy to miss unless you were watching the stats on a very close basis.

What I was interested to understand was the probability that in any 24 hour period the hash rate would be 10% high or 10% low. I couldn't find a good enough calculator (I need to set something up with a bignum library) but for 10% high or low in a 12 hour period things we get that the hash rate will be high 17.5% of the time and low 19.5% of the time. That (to me at least) was surprisingly often and suggests that it would be interesting to find a better way to estimate hashing rates. It's certainly more than enough to explain some of the jitter in the past difficulty increases though.

I finally generated and published some results. The most surprising thing to me was that it's quite likely that the difficulty level can end up significantly skewed by random events, but there's no real way to know whether this has happened or not. The full analysis is over at: http://hashingit.com/16-hash-rate-headaches