Bitcoin Forum

Other => Meta => Topic started by: tranthidung on January 02, 2020, 07:13:30 AM



Title: (Un)official pages that store forum data
Post by: tranthidung on January 02, 2020, 07:13:30 AM
In-progress.



From this one: How to search bitcointalk data? (http://How to search bitcointalk data), I gave my answer (https://bitcointalk.org/index.php?topic=5214214.msg53498562#msg53498562) but I think in the long run, it will be good for newbies to have a specific thread for this area. They will more easily find what they need, and somewhat reduce unnecessary repeated topics on the same issue.

Let's go guys.

_____________________________________________________________________________________________________________
AuthorsLinkDescriptionsANN threadsStatus
_____________________________________________________________________________________________________________
ForumLink (https://bitcointalk.org/index.php?action=stats)Statistics centern/aPartially disabled
ForumLink (https://bitcointalk.org/index.php?action=merit;stats)Merit stats centern/aActively
ForumLink (https://bitcointalk.org/adrotate.php?adstats)Ads stats centern/aActively
ForumLink (https://bitcointalk.org/merit.txt.xz)Weekly merit data dumpn/aActively
ForumLink (https://bitcointalk.org/trust.txt.xz)Trust data dumpn/aActively
ForumLink (https://bitcointalk.org/index.php?topic=3134370.0)Addtional data dump (theymos)Link (https://bitcointalk.org/index.php?topic=3134370.0)Should observe
_____________________________________________________________________________________________________________
LoyceVLink (http://loyce.club/usernames/usernames.txt)Usernames (for all - big file)Link (https://bitcointalk.org/index.php?topic=5202231.0)Actively
LoyceVLink (http://loyce.club/bans/Autobanned.txt)Autobanned usersLink (https://bitcointalk.org/index.php?topic=5092983.0)Actively
LoyceVLink (http://loyce.club/bans/Nuked.txt)Nuked usersLink (https://bitcointalk.org/index.php?topic=5092983.0)Actively
LoyceVLink (http://loyce.club/bans/usernames.txt)Usernames of banned/nuked usersLink (https://bitcointalk.org/index.php?topic=5092983.0)Actively
LoyceVLink (http://loyce.club/bans/banned.txt)Autobanned & Nuked usersLink (https://bitcointalk.org/index.php?topic=5092983.0)Actively
LoyceVLink (http://loyce.club/active/1h.html)Active users & top posters (1 hour)Link (https://bitcointalk.org/index.php?topic=5178726.0)Actively
LoyceVLink (http://loyce.club/active)Active users & top posters (24 hour)Link (https://bitcointalk.org/index.php?topic=5178726.0)Actively
LoyceVLink (http://loyce.club/active/7d.html)Active users & top posters (7 days)Link (https://bitcointalk.org/index.php?topic=5178726.0)Actively
LoyceVLink (http://loyce.club/active/topics1h.html)Active topics (1 hour)Link (https://bitcointalk.org/index.php?topic=5178726.0)Actively
LoyceVLink (http://loyce.club/active/topics24h.html)Active topics (24 hour)Link (https://bitcointalk.org/index.php?topic=5178726.0)Actively
LoyceVLink (http://loyce.club/active/topics7d.html)Active topics (7 days)Link (https://bitcointalk.org/index.php?topic=5178726.0)Actively
LoyceVLink (http://loyce.club/trust/flags/?MD)Trust Flags ViewerLink (https://bitcointalk.org/index.php?topic=5153695.0)Actively
LoyceVLink (http://loyce.club/Merit/merit.all.txt)theymos' merit raw data (extracted by LoyceV)Link (https://bitcointalk.org/index.php?topic=3078328)Actively
LoyceVLink (http://loyce.club/Merit/merit.html)theymos' data (including usernames and post titles)Link (https://bitcointalk.org/index.php?topic=3078328)Actively
LoyceVLink (http://loyce.club/Merit/usernames.txt)earned_merits: usernameLink (https://bitcointalk.org/index.php?topic=3078328)Actively
LoyceVLink (http://loyce.club/Merit/userID_sent_received.txt)UserIDs, sent Merit and earned MeritLink (https://bitcointalk.org/index.php?topic=3078328)Actively
LoyceVLink (https://bitcointalk.org/index.php?topic=5167469.0)Unedited/deleted posts (per post/ user/ topic)Link (https://bitcointalk.org/index.php?topic=5167469.0)Actively
LoyceVLink (http://loyce.club/)For more data on loyce.clubn/aActively
LoyceVLink (https://bitcointalk.org/index.php?topic=5145594.0)LoyceV's useful data on BitcointalkLink (https://bitcointalk.org/index.php?topic=5145594.0)Actively
LoyceVLink (http://loyce.club/seclog/seclog.txt)LoyceV's sec log *Link (https://bitcointalk.org/index.php?topic=5249591.0)Updated daily
_____________________________________________________________________________________________________________
DdmrDdmrLink (https://public.tableau.com/profile/ddmrddmr#!/vizhome/BitcointalkMeritDashboard/PersonalSummary)Merit DashboardLink (https://bitcointalk.org/index.php?topic=4428616.0)Actively
Vod and BPIP teamLink (https://bpip.org/)BPIP (the first site provides forum data)initial one (https://bitcointalk.org/index.php?topic=4746201.0); current one (https://bitcointalk.org/index.php?topic=5213618.0)Upgrading
hatshepsut93Link (https://bitcointalk.org/index.php?topic=5181082.0)For merit stats tool based on the APIn/aUpgraded recently
tranthidungLink (https://bitcointalk.org/index.php?topic=5181068.0)tranthidung's statistical threads on bitcointalkLink (https://bitcointalk.org/index.php?topic=5181068.0)Actively
1miauLink (https://bitcointalk.org/index.php?topic=5120661.0)List of Bitcointalk stats *Link (https://bitcointalk.org/index.php?topic=5120661.0)Actively
tvplus006Link (https://bitcointalk.org/index.php?topic=5206041.0)No. of total / archived / inactive/ banned profiles, etc.Link (https://bitcointalk.org/index.php?topic=5206041.0)Actively
tranthidungLink (https://bitcointalk.org/index.php?topic=5168990.msg53490636#msg53490636)Assumed monthly statistics on registered accountsLink (https://bitcointalk.org/index.php?topic=5168990.msg53490636#msg53490636)Actively
ptrkLink (https://bitcointalk.org/index.php?topic=5188384)Readable merit dataset for your own evaluationsLink (https://bitcointalk.org/index.php?topic=5188384)Actively
BlackHatCoinerLink (https://btctalk.live/)Readable merit dataset for your own evaluationsLink (https://bitcointalk.org/index.php?topic=5241019)Actively
_____________________________________________________________________________________________________________

  • *: You can find lots of threads on forum stats in that list.
  • *: Newest page(s).


Title: Re: (Un)official pages that store forum data
Post by: ~KiD~ on February 24, 2020, 11:10:29 AM
Nice and useful thread, gg!
I have few questions since is the first time I see "auto-banned" so what this means since I see is the same thread as "nuked".
How can someone "auto-ban" himself and why he or she would want to do this in the first place?

What is raw data and what is used for? Do we regular user need it or can we make use of it?


Title: Re: (Un)official pages that store forum data
Post by: tranthidung on February 24, 2020, 05:32:02 PM
I have few questions since is the first time I see "auto-banned" so what this means since I see is the same thread as "nuked".
How can someone "auto-ban" himself and why he or she would want to do this in the first place?
Autoban means when one user breaks forum rule(s) and detected, he or she will be automatically banned but it will be handled and banned by forum moderator, not by bots.

Nuke is the harsh punishment and it is mostly applied to user who is considered as spam with multiaccounts.

The main difference between autoban and nuke are:
  • Autoban: posts of that user will be remained.
  • Nuke: all posts of that user will be automatically deleted / trashed immediately when a moderator clicks on his/her Nuke button.

It is my guess:
  • With autoban you will have opportunity to have a successful ban appeal and see your ban lifted after that.
  • With nuke, I have not yet seen a single user got un-nuked.

Quote
What is raw data and what is used for? Do we regular user need it or can we make use of it?
Raw data means you have to do some steps technically to get human-readable and interpretable results.


Title: Re: (Un)official pages that store forum data
Post by: TryNinja on February 24, 2020, 05:41:29 PM
Autoban means when one user breaks forum rule(s) and detected, he or she will be automatically banned but it will be handled and banned by forum moderator, not by bots.
You seem to know that already, but you said "he or she will be automatically banned but it will be handled...", which I didn't get it; There is no automatic detections or bans. All of them are done manually by the mods.


Title: Re: (Un)official pages that store forum data
Post by: Saint-loup on February 24, 2020, 05:44:59 PM
I have few questions since is the first time I see "auto-banned" so what this means since I see is the same thread as "nuked".
How can someone "auto-ban" himself and why he or she would want to do this in the first place?
Autoban means when one user breaks forum rule(s) and detected, he or she will be automatically banned but it will be handled and banned by forum moderator, not by bots.

Nuke is the harsh punishment and it is mostly applied to user who is considered as spam with multiaccounts.

The main difference between autoban and nuke are:
  • Autoban: posts of that user will be remained.
  • Nuke: all posts of that user will be automatically deleted / trashed immediately when a moderator clicks on his/her Nuke button.

It is my guess:
  • With autoban you will have opportunity to have a successful ban appeal and see your ban lifted after that.
  • With nuke, I have not yet seen a single user got un-nuked.
AFAIK nuking only applies to newbie accounts, moderators (I don't know if it's the same for GM) can only nuke users, they can't ban them.
But it's not a sanction reserved for multiaccounts. Moderators can't see if an user is using an alt account or not, so they just nuke newbie accounts if they think the account is harmful for the forum in a way or another.


Title: Re: (Un)official pages that store forum data
Post by: LoyceV on February 24, 2020, 06:21:17 PM
*: LoyceV, please confirm that list of usernames is for both Autobanned & nuked users or only for Autobanned users.
Both.

Can you add this data (https://bitcointalk.org/index.php?topic=5167469.0) to your list? When I read your title, I actually expected to find something like that in here.


Title: Re: (Un)official pages that store forum data
Post by: tranthidung on February 25, 2020, 11:57:54 AM
Autoban means when one user breaks forum rule(s) and detected, he or she will be automatically banned but it will be handled and banned by forum moderator, not by bots.
You seem to know that already, but you said "he or she will be automatically banned but it will be handled...", which I didn't get it; There is no automatic detections or bans. All of them are done manually by the mods.
Maybe my described it badly. Let's me clarify it.
I, personally, misunderstood it myself when I see "Autoban" I thought it is a sort of ban will be automatically investigated and handled by forum bots. When I posted it somewhere in the forum a while ago, one user claimed that it is handled by forum moderators, not bots.

*: LoyceV, please confirm that list of usernames is for both Autobanned & nuked users or only for Autobanned users.
Both.
Edited.
Quote
Can you add this data (https://bitcointalk.org/index.php?topic=5167469.0) to your list? When I read your title, I actually expected to find something like that in here.
Ok. It's been added.
_____________________________________________________________________________________________________________
AuthorsLinkDescriptionsANN threadsStatus
_____________________________________________________________________________________________________________
LoyceVLink (https://bitcointalk.org/index.php?topic=5167469.0)Unedited/deleted posts (per post/ user/ topic)Link (https://bitcointalk.org/index.php?topic=5167469.0)Actively
_____________________________________________________________________________________________________________


Title: Re: (Un)official pages that store forum data
Post by: BlackHatCoiner on April 17, 2020, 09:47:15 AM
Hello @tranthidung, can my unofficial live stat counter be written in the list?


Title: Re: (Un)official pages that store forum data
Post by: bitmover on April 17, 2020, 11:47:39 AM
shouldn't this be in Meta?

I think most beginners doesn't even know or care about what are those pages are talking about lol
It is like a bitcointalk social statistics


Title: Re: (Un)official pages that store forum data
Post by: tranthidung on April 17, 2020, 01:00:22 PM
shouldn't this be in Meta?
There are 3 main reasons why I decided to leave the thread in Beginners & Help board:
  • Meta is abundant with threads on data and statistics (merits, posts, trusts). I would like to keep more space in Meta for other things unrelated to statistics.
  • If one user often visits Meta, he will know those pages.
  • Beginners / Newbies sometimes need to have some motivation that can be a starting dot for them to build up career on the forum. Motivations can be thread provides forum data. Maybe one newbie has a good skill on statistics but does neither know where to get data not know there is a Meta board for forum-related discussions. My thread probably stimulates them to start doing something.

Update:

Oops. Maybe moderator moved the thread to Meta mins ago.


Title: Re: (Un)official pages that store forum data
Post by: bitmover on April 17, 2020, 01:34:44 PM
  • Meta is abundant with threads on data and statistics (merits, posts, trusts). I would like to keep more space in Meta for other things unrelated to statistics.

I think meta is the perfect place for those statistics, as those statistics are totally unrelated with bitcoin. I think this board is more like Bitcoin Beginners, not forum career beginners...

I hope beginners & help doesn't become flooded with merit,trust, posts statistics as well.
But that's ok if this board doesn't become too flooded with that kind of topic.


Title: Re: (Un)official pages that store forum data
Post by: actmyname on May 15, 2020, 09:01:18 AM
Do we have anything for the Security log (https://bitcointalk.org/seclog.php)? Looking through the post I don't see anything that archives it (or even mention of it at all). In the past I tried to archive it about once/twice a month in order to make sure that there weren't any missing points of data but if @LoyceV wants to start scraping this, it would be a great addition for checking compromised accounts and useful information regarding account security.


Title: Re: (Un)official pages that store forum data
Post by: LoyceV on May 15, 2020, 11:30:51 AM
Do we have anything for the Security log (https://bitcointalk.org/seclog.php)?
BPIP keeps track, see TeeRoll's profile (https://bpip.org/profile.aspx?p=TeeRoll) for example. I'm not sure when BPIP started this.

Quote
In the past I tried to archive it about once/twice a month
Archive.is (https://archive.is/https://bitcointalk.org/seclog.php) has many files, but there are some gaps in between.

Quote
if @LoyceV wants to start scraping this
I'll leave it to BPIP, they started earlier so there's no point in adding less complete data now.


Title: Re: (Un)official pages that store forum data
Post by: ChemicalSpillage on May 15, 2020, 11:35:41 AM
Do we have anything for the Security log (https://bitcointalk.org/seclog.php)?
BPIP keeps track, see TeeRoll's profile (https://bpip.org/profile.aspx?p=TeeRoll) for example. I'm not sure when BPIP started this.

Quote
In the past I tried to archive it about once/twice a month
Archive.is (https://archive.is/https://bitcointalk.org/seclog.php) has many files, but there are some gaps in between.

Quote
if @LoyceV wants to start scraping this
I'll leave it to BPIP, they started earlier so there's no point in adding less complete data now.
Totally forgot about BPIP! (despite using it to check for users)

It would be nice to have a list by chronological order than by user though.


Title: Re: (Un)official pages that store forum data
Post by: LoyceV on May 19, 2020, 12:05:25 PM
It would be nice to have a list by chronological order than by user though.
Here you go: LoyceV's seclog log (https://bitcointalk.org/index.php?topic=5249591.0) :)


Title: Re: (Un)official pages that store forum data
Post by: Tom Bombadil on May 22, 2020, 04:13:15 PM
Thanks for this yummy content. :)
I did the Turkish translation (https://bitcointalk.org/index.php?topic=5250316.0).


Title: Re: (Un)official pages that store forum data
Post by: tranthidung on May 23, 2020, 04:00:53 AM
Thanks for this yummy content. :)
I did the Turkish translation (https://bitcointalk.org/index.php?topic=5250316.0).
Thank you so much for your time to translate it into Turkish and help to spread it out. It means my thread is helpful for the forum community, generally. I am happy with the recognition.

Stay safe, as always, and keep up your good works.

Reminder: The OP might be updated over time so make sure that you will keep your Turkish thread will be updated too.
Example: Today, I updated OP with LoyceV's seclog.


Title: Re: (Un)official pages that store forum data
Post by: erikoy on October 16, 2020, 02:08:00 AM
Hello @tranthidung, can my unofficial live stat counter be written in the list?
Yeah I believe this will help. I had always been checking the forum activity, online and and posts recently to check.
 
I really like that live stat counter and even wishes to see it part in the forum where it will be visible on top part of the interface of the forum.

Anyway, hats off to the one who made it @BlackHatCoiner


Title: Re: (Un)official pages that store forum data
Post by: tranthidung on October 26, 2020, 04:54:47 AM
Bump !