Bitcoin Forum

Other => Off-topic => Topic started by: theymos on January 24, 2013, 09:12:11 PM



Title: /r/Bitcoin stats
Post by: theymos on January 24, 2013, 09:12:11 PM
Someone requested that I post the /r/Bitcoin stats. Here they are in Reddit's JSON format so that you can create your own graphs:
http://pastebin.com/6kbMAAR3

The numbers in each array are, in order:
-Unix timestamp representing a day/hour/month
-Uniques
-Pageviews
-Subscriptions (omitted on time periods other than "day")


Title: Re: /r/Bitcoin stats
Post by: Herodes on January 26, 2013, 04:27:24 AM
Now if only some stat geek gave us a fine graph over daily visitors.


Title: Re: /r/Bitcoin stats
Post by: Phinnaeus Gage on January 26, 2013, 04:48:08 AM
Now if only some stat geek gave us a fine graph over daily visitors.

https://bitcointalk.org/index.php?action=stats

An elderberry pie chart would work for me.


Title: Re: /r/Bitcoin stats
Post by: organofcorti on January 27, 2013, 12:33:29 PM
Now if only some stat geek gave us a fine graph over daily visitors.

https://bitcointalk.org/index.php?action=stats

An elderberry pie chart would work for me.

Here is not only the requested elderberry chart, but also the R script (http://r-project.org) that generated it.

If theymos updates the data you'll be able to generate the same charts yourself (after changing the pastebin url in the script).

http://2.bp.blogspot.com/-7k6S8RNvCDE/UQUY9dZbUyI/AAAAAAAAFQc/LRJHwELeHgI/s1600/reddit2013-01-27.png (http://organofcorti.blogspot.com.au/2013/01/rbitcoin-statistics.html)

Code:

### reddit/r/Bitcoin stats
require(RJSONIO)
require(reshape)
require(ggplot2)

### change "pasteBinUrl" if theymos updates data
###
pasteBinUrl <- "http://pastebin.com/6kbMAAR3"
###



### functions
date.func <- function(x) ISOdate(1970,1,1)+ x$Unixtime

### download data
uniqueID <-  gregexpr("[1-9]", pasteBinUrl)[[1]]
reddit <- fromJSON(paste("http://pastebin.com/download.php?i=", substr(pasteBinUrl, uniqueID[1], uniqueID[2]), sep=''))

### format data sets for plotting

r.month <- data.frame(do.call(rbind, reddit$month))
r.day <- data.frame(do.call(rbind, reddit$day))
r.hour <- data.frame(do.call(rbind, reddit$hour))

colnames(r.month) <- c("Unixtime", paste(c("Uniques per", "Pageviews per"),"month"))
colnames(r.day) <- c("Unixtime", paste(c("Uniques per", "Pageviews per", "Subscriptions per"),"day"))
colnames(r.hour) <- c("Unixtime", paste(c("Uniques per", "Pageviews per"), "hour"))

#r.day$"Cumulative subscriptions" <- rev(c(cumsum(r.day$Subscriptions)))
r.day$Date <- date.func(r.day); r.month$Date <- date.func(r.month); r.hour$Date <- date.func(r.hour)

plot.df <- rbind(
melt(r.month[, 2:4], id="Date"),
melt(r.day[, 2:5], id="Date"),
melt(r.hour[, 2:4], id="Date")
)


#### the chart
reddit.plot <- ggplot(plot.df, aes(Date, value)) +
geom_line() +
facet_wrap(~variable, scales="free", ncol=1) +
ggtitle("r/Bitcoin statistics from theymos' data") + xlab("") + ylab("")
png(paste('reddit', Sys.Date(), '.png',sep=''),height=960*4,width=960*16/9*4/5,res=220)
reddit.plot
dev.off()

#### the end


Title: Re: /r/Bitcoin stats
Post by: Herodes on January 27, 2013, 12:45:39 PM
Great work man! Thanks


Title: Re: /r/Bitcoin stats
Post by: organofcorti on January 28, 2013, 04:49:18 AM
But wait, there's more:

http://3.bp.blogspot.com/-CymAN3fpp9A/UQX76SlMlMI/AAAAAAAAFWo/7ifBDxqkMPo/s1600/reddit2.lm2013-01-28.png (http://organofcorti.blogspot.com/2013/01/rbitcoin-pageviews-and-mtgox-price.html)


Title: Re: /r/Bitcoin stats
Post by: Mr. Coinman on January 28, 2013, 09:34:43 AM
There definitely seems to be some steady growth!  :D.


Title: Re: /r/Bitcoin stats
Post by: theymos on April 03, 2013, 01:01:44 AM
Current data:
http://pastebin.com/GsyXtrFf


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 03, 2013, 09:35:58 AM
Current data:
http://pastebin.com/GsyXtrFf

Updated:


http://2.bp.blogspot.com/-C6iJNYRyie0/UVvy_yoQqoI/AAAAAAAAHKo/f6Tilg4nlfY/s1600/reddit2013-04-03.png (http://organofcorti.blogspot.com/2013/04/rbitcoin-statistics-and-mtgox-price-may.html)

http://1.bp.blogspot.com/-qp9rGQB1TmQ/UVvy99YPU0I/AAAAAAAAHKg/gA0w1m06q5c/s1600/reddit2.month2013-04-03.png (http://organofcorti.blogspot.com/2013/04/rbitcoin-statistics-and-mtgox-price-may.html)

http://3.bp.blogspot.com/-JrhUky7DVf0/UVvy9kaBd_I/AAAAAAAAHKc/USgGNFxJZNc/s1600/reddit2.lm2013-04-03.png (http://organofcorti.blogspot.com/2013/04/rbitcoin-statistics-and-mtgox-price-may.html)


Title: Re: /r/Bitcoin stats
Post by: phelix on April 03, 2013, 10:22:27 PM
Any chance of getting this data / these diagrams regularly?


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 03, 2013, 10:28:18 PM
Any chance of getting this data / these diagrams regularly?

So far Theymos has provided updates every sixty eight days, like clockwork. You want the updates more often? :)

If Theymos is able to provide updates more often and I don't have time to provide chart updates more often, I'll post an updated script to generate the charts and you'll be able to do it yourself.



Title: Re: /r/Bitcoin stats
Post by: phelix on April 03, 2013, 10:32:41 PM
Any chance of getting this data / these diagrams regularly?

So far Theymos has provided updates every sixty eight days, like clockwork. You want the updates more often? :)

If Theymos is able to provide updates more often and I don't have time to provide chart updates more often, I'll post an updated script to generate the charts and you'll be able to do it yourself.


yeah, I meant on a daily basis at least. Not sure how often reddit data is updated. I think I would choose the diagram that has the best correlation / the most meaning and would put it up my website.


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 03, 2013, 10:36:43 PM
Any chance of getting this data / these diagrams regularly?

So far Theymos has provided updates every sixty eight days, like clockwork. You want the updates more often? :)

If Theymos is able to provide updates more often and I don't have time to provide chart updates more often, I'll post an updated script to generate the charts and you'll be able to do it yourself.


yeah, I meant on a daily basis at least. Not sure how often reddit data is updated. I think I would choose the diagram that has the best correlation / the most meaning and would put it up my website.

Sounds uncomfortable.

Which one has the most meaning for you?


Title: Re: /r/Bitcoin stats
Post by: phelix on April 03, 2013, 11:04:58 PM
Any chance of getting this data / these diagrams regularly?

So far Theymos has provided updates every sixty eight days, like clockwork. You want the updates more often? :)

If Theymos is able to provide updates more often and I don't have time to provide chart updates more often, I'll post an updated script to generate the charts and you'll be able to do it yourself.


yeah, I meant on a daily basis at least. Not sure how often reddit data is updated. I think I would choose the diagram that has the best correlation / the most meaning and would put it up my website.

Sounds uncomfortable.
why? of course this would have to be automatic. ;D

Quote
Which one has the most meaning for you?
the first one I guess


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 03, 2013, 11:19:38 PM
Any chance of getting this data / these diagrams regularly?

So far Theymos has provided updates every sixty eight days, like clockwork. You want the updates more often? :)

If Theymos is able to provide updates more often and I don't have time to provide chart updates more often, I'll post an updated script to generate the charts and you'll be able to do it yourself.


yeah, I meant on a daily basis at least. Not sure how often reddit data is updated. I think I would choose the diagram that has the best correlation / the most meaning and would put it up my website.

Sounds uncomfortable.
why? of course this would have to be automatic. ;D


Not sure I'd want to put anything up my um "website" automatically ;)


Which one has the most meaning for you?

the first one I guess


Looking at your website, I'd reckon you'd be able to create that chart yourself from the raw data without any problems. I'm not sure Theymos would be keen to post an update of the data every day though.


Title: Re: /r/Bitcoin stats
Post by: theymos on April 03, 2013, 11:22:50 PM
I'll do it automatically if someone writes me a PHP/Python/Perl/Bash script which logs a user onto reddit, fetches http://www.reddit.com/r/Bitcoin/about/traffic.json, and then prints it to stdout.


Title: Re: /r/Bitcoin stats
Post by: phelix on April 03, 2013, 11:25:42 PM
[...]
Looking at your website, I'd reckon you'd be able to create that chart yourself from the raw data without any problems. I'm not sure Theymos would be keen to post an update of the data every day though.
yeah I am pretty sure he has better things to do. like sitting on an island. :)

So, Theymos, should there be an easy solution for you to make this data public I would go for displaying it.


Title: Re: /r/Bitcoin stats
Post by: phelix on April 03, 2013, 11:27:34 PM
I'll do it automatically if someone writes me a PHP/Python/Perl/Bash script which logs a user onto reddit, fetches http://www.reddit.com/r/Bitcoin/about/traffic.json, and then prints it to stdout.
ok. I will hopefully find the time soon and let you know. Python would be my choice.

edit:
and I see it should even be possible to do it nicely: http://www.reddit.com/dev/api

APIs are the web 3.0


Title: Re: /r/Bitcoin stats
Post by: whiskers75 on April 07, 2013, 05:27:55 AM
I'll do it automatically if someone writes me a PHP/Python/Perl/Bash script which logs a user onto reddit, fetches http://www.reddit.com/r/Bitcoin/about/traffic.json, and then prints it to stdout.
Node.js? :P

I'll write one!


Title: Re: /r/Bitcoin stats
Post by: whiskers75 on April 07, 2013, 05:42:55 AM
On my end, it doesn't resolve properly (getaddrinfo ENOTFOUND) but maybe you'll have some luck:

Code:
// whiskers75's /r/Bitcoin Script! :)
// Coded by whiskers75 for theymos and users of the Bitcoin Forum.

var http = require('http');

var options = {
    port: 80,
    hostname: 'http://www.reddit.com',
    method: 'GET',
    path: '/r/bitcoin/about/traffic.json'
};
console.log('Requesting ' + options.hostname + options.path + ':' + options.port + ' (' + options.method + ')');
var req = http.request(options, function(res) {
    res.setEncoding('utf8');
    res.on('data', function (chunk) {
        console.log(chunk);
    });
});


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 07, 2013, 05:47:07 AM
On my end, it doesn't resolve properly (getaddrinfo ENOTFOUND) but maybe you'll have some luck:

Code:
// whiskers75's /r/Bitcoin Script! :)
// Coded by whiskers75 for theymos and users of the Bitcoin Forum.

var http = require('http');

var options = {
    port: 80,
    hostname: 'http://www.reddit.com',
    method: 'GET',
    path: '/r/bitcoin/about/traffic.json'
};
console.log('Requesting ' + options.hostname + options.path + ':' + options.port + ' (' + options.method + ')');
var req = http.request(options, function(res) {
    res.setEncoding('utf8');
    res.on('data', function (chunk) {
        console.log(chunk);
    });
});


I think you need a way to include theymos' login details as well.


Title: Re: /r/Bitcoin stats
Post by: phelix on April 07, 2013, 07:54:04 PM
I'm on it but will need more time... so busy.

if somebody else would do it I'd be happy.

current suggestion is not complete. not sure about the language.


Title: Re: /r/Bitcoin stats
Post by: phelix on April 12, 2013, 07:27:38 AM
http://blockchained.com/stuff/r_bitcoin_stats.py_


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 12, 2013, 07:42:52 AM
http://blockchained.com/stuff/r_bitcoin_stats.py_

Great, phelix! Can't wait to see what you do with it once the data is readily available. Thought about doing something similar for bitcointalk.org?


Title: Re: /r/Bitcoin stats
Post by: myrkul on April 12, 2013, 06:50:06 PM
Great stuff, Phelix.


Title: Re: /r/Bitcoin stats
Post by: theymos on April 13, 2013, 02:01:19 AM
Thanks. This will update daily:
https://bitcointalk.org/rbitcoin/


Title: Re: /r/Bitcoin stats
Post by: Zaih on April 13, 2013, 10:31:38 AM
Wow, didn't realise the subreddit was so active. Great work guys :)


Title: Re: /r/Bitcoin stats
Post by: phelix on April 14, 2013, 09:59:23 AM
 :-*

Thanks. This will update daily:
https://bitcointalk.org/rbitcoin/
Could you also write a "latest.json" file or something? It's kinda hard to properly figure out the time the date changes (especially with freaking summer/winter time).


Title: Re: /r/Bitcoin stats
Post by: phelix on April 14, 2013, 10:59:26 AM
http://blockchained.com/stuff/reddit_stats.png

ohoh this will need some more work to aggregate the data automatically...  but the weather is great outside 8)


Title: Re: /r/Bitcoin stats
Post by: organofcorti on April 14, 2013, 12:17:12 PM
[...]

ohoh this will need some more work to aggregate the data automatically...  but the weather is great outside 8)
Nice work!

I didn't think of aggregating the month/week/day data, great idea! Shame the daily data isn't available for the whole period, but if you start collecting now you'll have it from this point on. With lots more data points the correlation should be quite a bit more clear. From your chart it looks pretty clearly to be a log-log relationship.



Title: Re: /r/Bitcoin stats
Post by: phelix on April 14, 2013, 09:16:07 PM
http://www.blockchained.com/rbitcoinstats.png
somewhat messed up but should be updating...

Will integrate it into my site when I find the time. And also set up a graph of the forum stats - that might take a while, though.


Title: Re: /r/Bitcoin stats
Post by: phelix on October 27, 2013, 06:44:43 PM
Thanks. This will update daily:
https://bitcointalk.org/rbitcoin/
I guess it's disabled because of the haxoing...


Title: Re: /r/Bitcoin stats
Post by: theymos on October 27, 2013, 06:46:37 PM
Yes, but you can download stats directly from Reddit now:
http://www.reddit.com/r/Bitcoin/about/traffic.json

So I don't think that I will re-enable that script.


Title: Re: /r/Bitcoin stats
Post by: phelix on October 27, 2013, 07:35:02 PM
Yes, but you can download stats directly from Reddit now:
http://www.reddit.com/r/Bitcoin/about/traffic.json
nice

Quote
So I don't think that I will re-enable that script.
ok

Will try to find the time to adapt my script...


Title: Re: /r/Bitcoin stats
Post by: phelix on October 28, 2013, 07:48:57 AM
Here is a site that gives stats on r/bitcoin http://stattit.com/r/bitcoin/
Hmm... I can't see any interesting diagram there - am I missing something?


Title: Re: /r/Bitcoin stats
Post by: organofcorti on October 28, 2013, 09:32:01 AM
Here is a site that gives stats on r/bitcoin http://stattit.com/r/bitcoin/
Hmm... I can't see any interesting diagram there - am I missing something?

It just provides summary stats AFAICT.


Title: Re: /r/Bitcoin stats
Post by: phelix on December 19, 2013, 10:23:35 AM
With the new forum image proxy the chart above is not updating any more...

Here you can see the updated version:

http://blockchained.com/rbitcoinstats.png