Bitcoin Forum

Other => Meta => Topic started by: Jawhead999 on January 02, 2020, 05:17:30 AM



Title: How to search bitcointalk data
Post by: Jawhead999 on January 02, 2020, 05:17:30 AM
Hi everyone

I want to start to making a data about bitcointalk users from the beginning until now

I was see many users making data, statistics very detailed. Like count the top 10 users giving merits, counting users signing in bitcointalk etc.

But, I don't know how they can find the data? Could your help me?


Title: Re: How to search bitcointalk data
Post by: kawetsriyanto on January 02, 2020, 05:36:13 AM
Some sources data, at least:
1. https://bitcointalk.org/index.php?action=stats
2. https://bpip.org/
3. Ask LoyceV (https://bitcointalk.org/index.php?action=profile;u=459836), DdmrDdmr (https://bitcointalk.org/index.php?action=profile;u=1582324), or tranthidung (https://bitcointalk.org/index.php?action=profile;u=1292764)  ;)
You can take a look at their threads and see where they got the data.


Title: Re: How to search bitcointalk data
Post by: tranthidung on January 02, 2020, 05:47:35 AM
1. https://bitcointalk.org/index.php?action=stats
A reminder:
There are stats for some indicators of the forum were disabled around 2 years ago (since December 2017), the ones at the bottom of stats page:

And, there are data dumps from theymos, with merit and trust, ads.
  • https://bitcointalk.org/merit.txt.xz
  • https://bitcointalk.org/index.php?action=merit;stats
  • https://bitcointalk.org/adrotate.php?adstats
  • https://bitcointalk.org/trust.txt.xz

Third-party data providers:
  • Loyce.club (http://loyce.club/) (by LoyceV): For my analyses, I mostly use data from the club.
  • Merit Dashboard (https://public.tableau.com/profile/ddmrddmr#!/vizhome/BitcointalkMeritDashboard/PersonalSummary) (by DdmrDdmr): has lots of data too, but I am not familiar with that data format.
  • BPIP (https://bpip.org/) (by Vod and colleagues): has still been under-improvement process. Here are the ANN threads of BPIP (initial one (https://bitcointalk.org/index.php?topic=4746201.0); newest one (https://bitcointalk.org/index.php?topic=5213618.0)).
  • The JSON API for merit data (https://bitcointalk.org/index.php?topic=5181082.0) (by hatshepsut93).


Title: Re: How to search bitcointalk data
Post by: DdmrDdmr on January 02, 2020, 10:21:49 AM
<…>
It depends on what you want to do. If you have a clear idea of what you want to do or find out, but do not know where to derive the underlying data from, you can add those questions here and someone will likely guide you as to how to achieve it.

If, on the other hand, you are unsure at this stage, you could follow a bottom-up approach, study what's available, and see how you can use that to display something new. @tranthidung has started working on a topic to facilitate this approach:  (Un)official pages that store forum data  (https://bitcointalk.org/index.php?topic=5214233.msg53498898#msg53498898), which expands futher on what he added to this thread.


Title: Re: How to search bitcointalk data
Post by: LoyceV on January 02, 2020, 01:14:22 PM
I want to start to making a data about bitcointalk users from the beginning until now
Like LoyceV's complete List of all Bitcointalk usernames (https://bitcointalk.org/index.php?topic=5202231.0)?
What exactly are you trying to find?

Quote
But, I don't know how they can find the data? Could your help me?
All data is available right here on the forum :) Tranthidung posted some helpful links to get started.
But it really depends on what you try to find, so please share :)


Title: Re: How to search bitcointalk data
Post by: UserU on January 02, 2020, 03:46:54 PM

What exactly are you trying to find?

All data is available right here on the forum :) Tranthidung posted some helpful links to get started.
But it really depends on what you try to find, so please share :)

I reckon he's trying to follow tranthidung's steps, by using the data to generate those inference using the data analysis software.