Bitcoin Forum
April 26, 2024, 07:03:58 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 [2]  All
  Print  
Author Topic: New more accurate network hashrate forecasts  (Read 5559 times)
Its About Sharing
Legendary
*
Offline Offline

Activity: 1442
Merit: 1000


Antifragile


View Profile
October 09, 2013, 03:46:57 PM
 #21

Thanks for sharing this. Quite interesting.

Are you planning on also publishing the equivalent in the Difficulty rate?
If not, would it be difficult to do that or ?

I ask because I'm looking for some new difficulty predictors. Any suggestions?

Thx,
IAS

I've already done this, just haven't gotten around to posting. Explaining what I'm doing takes way longer than actually doing it, and if I don't do a good job in the explanation then I get responses such as those at the top.

As for difficulty predictors, it depends on what you want. If you want something more than 4 retargets ahead, then you're better off checking out Death and Taxes' thread.



I'm just looking for a difficult predictor to compliment what is already out there. It seems you are taking the hashing projections quite deep and so you probably will have one of the more accurate difficulty predictors. As far as timeline, it would be nice to have a 4 week projection. But what you are already doing with the range can allow you to take it out further (but perhaps that doesn't serve a real useful purpose so far out). That range (leeway with your blue shadows looking forward) is great.

Thanks for the quick reply btw,
IAS

BTC = Black Swan.
BTC = Antifragile - "Some things benefit from shocks; they thrive and grow when exposed to volatility, randomness, disorder, and stressors and love adventure, risk, and uncertainty. Robust is not the opposite of fragile.
1714115038
Hero Member
*
Offline Offline

Posts: 1714115038

View Profile Personal Message (Offline)

Ignore
1714115038
Reply with quote  #2

1714115038
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1714115038
Hero Member
*
Offline Offline

Posts: 1714115038

View Profile Personal Message (Offline)

Ignore
1714115038
Reply with quote  #2

1714115038
Report to moderator
1714115038
Hero Member
*
Offline Offline

Posts: 1714115038

View Profile Personal Message (Offline)

Ignore
1714115038
Reply with quote  #2

1714115038
Report to moderator
Puppet
Legendary
*
Offline Offline

Activity: 980
Merit: 1040


View Profile
October 10, 2013, 09:08:52 AM
 #22

Organ, may I suggest an analysis that I personally would find more interesting?
Not sure how to put it, but giving us an idea of how accurate live updating difficulty predictions and hashrate estimates are.

For instance, right now, when I visit
http://dot-bit.org/tools/nextDifficulty.php

I see a projection of 235M, but its based on ~600 blocks. What is the spread on that ?

Or put another way, I would like to see something similar as dot bit, but guessing *current* network hashrate and next difficulty adjustment with 50 and 95% confidence intervals.

This would have to be live updating to be really interesting tough.
Dabs
Legendary
*
Offline Offline

Activity: 3416
Merit: 1912


The Concierge of Crypto


View Profile
October 11, 2013, 04:29:33 AM
 #23

ooc, can you translate your next forecast into bitcoin mining difficulty numbers? Like, 200 million, 300 million, 500 million, 1 billion, ... and when we can expect this?

Worst case scenario when all the new hardware comes online and hashing (this company said 2000 TH by January 2014, that company said 1000 TH, etc.)

organofcorti (OP)
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1007


Poor impulse control.


View Profile WWW
October 11, 2013, 06:11:44 AM
 #24

Excellent work in my opinion, I've been looking at length for such kind of research. Satoshi sent to support your site.
Would you consider performing ARIMA analysis on BTC price?


I didn't see that before and wondered who donated. Thanks for that!

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
organofcorti (OP)
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1007


Poor impulse control.


View Profile WWW
October 11, 2013, 06:29:32 AM
 #25

Thanks for all your input, Its About Sharing, Puppet and Dabs. You've all given me some idea of interesting problems to work on. Sorry it's taken so long for me to get back to you.

I'm just looking for a difficult predictor to compliment what is already out there. It seems you are taking the hashing projections quite deep and so you probably will have one of the more accurate difficulty predictors. As far as timeline, it would be nice to have a 4 week projection. But what you are already doing with the range can allow you to take it out further (but perhaps that doesn't serve a real useful purpose so far out). That range (leeway with your blue shadows looking forward) is great.

The I can forecast four retargets (~ 6 weeks at the moment) ahead with reasonable accuracy, better than the 6 week average hashrate forecast anyway. I'll post here once I get a post up. I really do want to get the forecasts up weekly but finding the time is tricky.

Puppet's comment addresses a way around the posting problem:

Organ, may I suggest an analysis that I personally would find more interesting?
Not sure how to put it, but giving us an idea of how accurate live updating difficulty predictions and hashrate estimates are.

For instance, right now, when I visit
http://dot-bit.org/tools/nextDifficulty.php

I see a projection of 235M, but its based on ~600 blocks. What is the spread on that ?

Or put another way, I would like to see something similar as dot bit, but guessing *current* network hashrate and next difficulty adjustment with 50 and 95% confidence intervals.

This would have to be live updating to be really interesting tough.

Live updating would be fantastic. I have a domain, and I could easily write something automated to regenerate charts at a two hour lag (to allow for orphaned blocks) but I have two problems:

 * I have absolutely no experience in running or coding a site or a server
 * Not many hosts are ok with their server running bitcoind - I remember one guy who was kicked off his host for exactly that (I think they thought he was mining or something)

So I could do (and already do for myself) exactly what you're suggesting but I have no idea how to do it or even how to go about learning to do it, or if I have enough time to learn to do it. I'd welcome any hints or suggestions.

ooc, can you translate your next forecast into bitcoin mining difficulty numbers? Like, 200 million, 300 million, 500 million, 1 billion, ... and when we can expect this?

Worst case scenario when all the new hardware comes online and hashing (this company said 2000 TH by January 2014, that company said 1000 TH, etc.)

I actually do a separate model for Difficulty - it's more accurate than estimating based on an estimated hashrate, and also forecasts the date of the difficulty change too.

The model can't do a worst case scenario though, and forecasting that far ahead would be too inaccurate by any measure of use. Death and Taxes' thread is what you're after. A visualisation of the data in that thread is probably a good idea and I can do that - but it won't be a modelled forecast with confidence intervals and so forth.

I promise I'll get around to posting forecasts weekly (weekly average hashrate, daily average hashrate and difficulty) but I'm really focussed on forecasting BTC prices. I didn't think it could be done with any degree of usefulness, but as I learn and experiment more I'm finding out I was wrong. It's really exciting (if you're in to that sort of thing).

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
Puppet
Legendary
*
Offline Offline

Activity: 980
Merit: 1040


View Profile
October 11, 2013, 06:47:36 AM
 #26

You dont have to run a local bitcoind, you could just use blockchain.info's api:
http://blockchain.info/api/json_rpc_api
organofcorti (OP)
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1007


Poor impulse control.


View Profile WWW
October 11, 2013, 07:02:19 AM
 #27

You dont have to run a local bitcoind, you could just use blockchain.info's api:
http://blockchain.info/api/json_rpc_api

I didn't think of getting a blockchain account and using the api - that's a great idea, and reading the api it looks like it would be pretty easy to implement. Now I just have to work on the first of the two problems Sad


Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
Puppet
Legendary
*
Offline Offline

Activity: 980
Merit: 1040


View Profile
October 11, 2013, 07:12:26 AM
 #28

Id offer my help, but my PHP skills are really not very good. Perhaps you can team up with one of the sites that currently publish similar information, like thegenesisblock, blockchain.info or even futureblock.
organofcorti (OP)
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1007


Poor impulse control.


View Profile WWW
October 11, 2013, 07:23:04 AM
 #29

Id offer my help, but my PHP skills are really not very good. Perhaps you can team up with one of the sites that currently publish similar information, like thegenesisblock, blockchain.info or even futureblock.


Again, that never occurred to me. It does sound like the best way to go about it.

Can I make a suggestion? Start a thread called "cool bitcoin shit I know" which I for one would find very helpful.

Futureblock is interesting. I think I'd use my skills for evil and bet, although the 20% house fee is a bit off-putting.


Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
Puppet
Legendary
*
Offline Offline

Activity: 980
Merit: 1040


View Profile
October 11, 2013, 07:33:17 AM
 #30

Id offer my help, but my PHP skills are really not very good. Perhaps you can team up with one of the sites that currently publish similar information, like thegenesisblock, blockchain.info or even futureblock.


Again, that never occurred to me. It does sound like the best way to go about it.

Can I make a suggestion? Start a thread called "cool bitcoin shit I know" which I for one would find very helpful.

Futureblock is interesting. I think I'd use my skills for evil and bet, although the 20% house fee is a bit off-putting.



20% fee is only if you bet at the tail end of the betting window. If you place your bet in the beginning, its 0.
I love the idea of that site, but I just wish the subject of the bet wouldnt be someone else's ambiguous estimate of network hashrate, but something unambiguous like difficulty, number of blocks found, etc.
amer
Full Member
***
Offline Offline

Activity: 168
Merit: 100


View Profile
October 12, 2013, 04:22:15 AM
 #31

organofcorti,

A thought - do you have enough information from the pools to be able to specify average GH/s per user account and get a total # of user accounts? I think if you compared that to hardware available at the time (in terms of either GH/s/$ or GH/s/W), you could perhaps determine a relationship between available GH/s/[$,W] and GH/s/user. Making the assumption that most people have a fixed amount of power/income they can provide to this effort, it might show how future changes to efficiency/pricing can impact total network hashrate. I think that would yield more accurate results than basing it on historical information.

Also, re: your other comments, I do know PHP fairly well and have a Linode that I'd be happy to host with. PM me if you're interested and we can put something together.

tips: 1amerApYUVjsKSuVUtfjxaoi7QXG7Zwao
organofcorti (OP)
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1007


Poor impulse control.


View Profile WWW
October 13, 2013, 05:03:42 AM
 #32

organofcorti,

A thought - do you have enough information from the pools to be able to specify average GH/s per user account and get a total # of user accounts? I think if you compared that to hardware available at the time (in terms of either GH/s/$ or GH/s/W), you could perhaps determine a relationship between available GH/s/[$,W] and GH/s/user. Making the assumption that most people have a fixed amount of power/income they can provide to this effort, it might show how future changes to efficiency/pricing can impact total network hashrate. I think that would yield more accurate results than basing it on historical information.

I've got the user hashrate distribution data which I update each week. However the average is not a very good indicator, and neither is the median. The hashrates per user account are generally pareto distributed, often with and undefined mean.

Secondly, I only have data for about half the network. When I had about 75% of the network I could extrapolate to the rest of the network. Now, it's just too inaccurate.

The last post I did on the subject was: http://organofcorti.blogspot.com/2013/07/network-electricity-consumption-16th.html

Also, re: your other comments, I do know PHP fairly well and have a Linode that I'd be happy to host with. PM me if you're interested and we can put something together.

Thanks for the offer - PM sent.

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
amer
Full Member
***
Offline Offline

Activity: 168
Merit: 100


View Profile
October 19, 2013, 05:40:33 AM
 #33


omg please continue to report on that information, I think that is VERY useful data.

tips: 1amerApYUVjsKSuVUtfjxaoi7QXG7Zwao
organofcorti (OP)
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1007


Poor impulse control.


View Profile WWW
October 20, 2013, 05:21:33 AM
 #34


omg please continue to report on that information, I think that is VERY useful data.

I will at some point - just need things to settle down a bit first.

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
Pages: « 1 [2]  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!