Bitcoin Forum

Other => Meta => Topic started by: totaleclipseofthebank on July 20, 2012, 04:04:44 AM



Title: Charting traffic and new thread creation by forum subcategory
Post by: totaleclipseofthebank on July 20, 2012, 04:04:44 AM
Is this possible?
It would be awesome to see the traffic vs. time on the speculation board, or the rate of new topics in the marketplace boards.


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: ChrisKoss on July 20, 2012, 08:01:16 AM
I agree.  I'd love to see a dashboard full of graphs charting activity on each forum over time.


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: gweedo on July 20, 2012, 08:51:53 AM
https://bitcointalk.org/index.php?action=stats (https://bitcointalk.org/index.php?action=stats)

this?


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: totaleclipseofthebank on July 20, 2012, 10:34:26 AM
Thanks!

Made this:
https://i.imgur.com/7jrmc.jpg


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: ChrisKoss on July 20, 2012, 05:21:38 PM
Thanks!

Made this:
https://i.imgur.com/7jrmc.jpg

Cool graph!  Looks like posts and price are pretty correlated.  Looks like the number of new posts can sometimes indicate price change, but half the time it lags behind price.


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: totaleclipseofthebank on July 20, 2012, 07:59:02 PM
Yeah, I looked and it seems that they are highly correlated, but the forum activity definitely lags the price changes. Still, it shows that the price is going to be mostly affected by hype and the number of people involved.


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: gweedo on July 20, 2012, 08:03:39 PM
Yeah, I looked and it seems that they are highly correlated, but the forum activity definitely lags the price changes. Still, it shows that the price is going to be mostly affected by hype and the number of people involved.

but is the lag cause mtgox host the forums, so when they get hit with alot of traffic the forums slow up as well it hard to tell


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: totaleclipseofthebank on July 20, 2012, 08:43:09 PM
No, the lag is on the order of a week or so. The chart above only has a 1-month resolution


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: dree12 on July 20, 2012, 09:03:07 PM
I wrote a bot to fetch the information for a thread by going through every page. One thing I learned is that spreadsheets get slow when there is too much data, but it still suffices nonetheless. In theory, the bot gathers enough data to be able to plot how many letter "e"s are posted, but I doubt this is very useful.

Here's a couple plots for this thread (https://bitcointalk.org/index.php?topic=28402):

Posts over time
https://i.imgur.com/FgJo2.png

Posts over the UTC day
https://i.imgur.com/xqRym.png

Posts over the UTC week (Mon-Sun)
https://i.imgur.com/dWYec.png

Posts by author
http://imgur.com/9Y9Vm.png

If this bot would benefit you for any topic, I can run it for any specific topic or limited sets of topics. For anything more advanced (e.g., entire boards), I would be glad to send you the source code.

Yeah, I looked and it seems that they are highly correlated, but the forum activity definitely lags the price changes. Still, it shows that the price is going to be mostly affected by hype and the number of people involved.

but is the lag cause mtgox host the forums, so when they get hit with alot of traffic the forums slow up as well it hard to tell
Mt. Gox only relatively recently begun hosting the forums, so I doubt this is the case.


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: EnergyVampire on July 20, 2012, 09:09:37 PM
Cool bot dree12,

What about "Exchange Mentioned" relative to trade volume at the exchange? just out of curiosity


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: gweedo on July 20, 2012, 09:10:33 PM
that is cool stuff and def open source the bot, put it on github


Title: Re: Charting traffic and new thread creation by forum subcategory
Post by: dree12 on July 20, 2012, 09:48:08 PM
Cool bot dree12,

What about "Exchange Mentioned" relative to trade volume at the exchange? just out of curiosity

Here's a way to do this (outside the scope of the bot I made):

Search for an phrase that describes the exchange/is the exchange's name. Record all dates. Then, plot the number of posts per long-ish period of time.