Bitcoin Forum

Hi!

I am writing a master's thesis on bitcoin price formulation, and I need to obtain statistics from Bitcointalk.org from July 1, 2015, to December 31, 2018. I can only find data up until end of November 2017. Anyone know where to access the data I need?
Help is highly appreciated!

What data are you looking for? New registrations can be counted by checking profiles, and total number of posts can be counted by checking when a certain post number was made.

Specifically, I need the daily number of new posts, and daily number of new members. (If its possible to get page views as well, that would be ideal.) I have all that data from July 1, 2015 - November 31., 2017. So I need from December 1., 2017, to December 31., 2018.

You can get a pretty good estimate by finding a post around the same time each day, and subtracting post numbers. It's easiest to find them by date if you look in one of the many altcoin ANN (spam) threads. Kinda like I did here (https://bitcointalk.org/index.php?topic=5032314.0).

See Open scraped data of all the users - SQL Lite DB - 2.481.270 users (https://bitcointalk.org/index.php?topic=5066192.0)

Thank you, LoyceV!
Where do I find the # for each post?

Copy the URL, your post for example:
https://bitcointalk.org/index.php?topic=5107302.msg49692785#msg49692785
The bold part is the post number.

Ok, I must be doing something wrong:

Date           Time         Post #       # new posts
13.des   3:01 am   2561205   
14.des   3:34 am   2581018   19813
15.des   3:20 am   2588638   7620
16.des   3:27 am   2595235   6597
17.des   2:46 am   2595701   466

According to the statistics here on bitcointalk.org, there were 40668 new posts on December 13, 2017.

I can help you out quickly with the number of registered users per day: https://docs.google.com/spreadsheets/d/1tZ2a_bSEkbh0Qk-_QfX2WEhc0huRxAsg5hXfGIjI8RA/edit?usp=sharing

The period of time goes from the 17/11/2009 until the 05/12/2018.

Note that:
-   Data for the 05/12/2018 may be partial (incomplete day).

-   Data is derived from @piggy’s complete profile scrape, referenced on this thread.

-   The above referenced profile scrape is the latest I’m aware of, so there is no available external data from 05/12/2018 related to the number of accounts created per day.

-   Many accounts that are created on a daily basis are bot accounts (or just for viewing certain stuff), and actually never get any activity under their belly. See  Analysis - Bitcointalk Accounts – Date of Register vs Last Active per Rank (https://bitcointalk.org/index.php?topic=5069738.msg47925043#msg47925043) for a more comprehensive description.


Retrieving posts per day is a pain in the backside, so I can’t help you with that on a daily granular scale. You could try a per month rough vision like I’ve done in the past, checking some stats on different snapshots on archieve.is or WayBackMachine (see for example  Analysis – Merit per post per Section/Subsection (https://bitcointalk.org/index.php?topic=5083312.msg48598469#msg48598469)).

Page Views would require the same technique as above (although I’ve never been bothered with it).

DdmrDdmr, thank you! Very helpful  :) I´ll might have to stick to only new members, but anyways, thank you so much!

Monthly statistics:

Statistics of user registrations on Bitcointalk 2017-2019 (https://bitcointalk.org/index.php?topic=4685601.0)