Bitcoin Forum

Other => Meta => Topic started by: LoyceV on November 17, 2019, 04:20:09 PM



Title: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on November 17, 2019, 04:20:09 PM
Viewing all members (https://bitcointalk.org/index.php?action=mlist;sa=all) has been "temporarily disabled" for as long as I can remember, so I made a list myself.

Another reason to make this, is that I often need to find the userID that goes with a username. I can't easily get this from the forum, which is why until recently I used BPIP (https://bpip.org/) for this. Unfortunately, a small percentage of users are missing from BPIP.
So I made my own :D

There are 2 versions, each with all 2.7 million userIDs.
usernames.txt (https://loyce.club/usernames/usernames.txt) (currently 51 MB) (or usernames.lastday.txt (https://loyce.club/usernames/usernames.lastday.txt) for only the daily changes)
Sample:
Code:
459831: XiomarHeck
459832: MelvaBeave
459833: JanieCaulf
459834: VickyVPTD
459835: bensam1231
459836: LoyceV
459837: btc.jobworks
459838: LyleHlyrf
459839: NormaClowe
459840: ForestClar
459841: TyrellKCU

BBCode.txt (https://loyce.club/usernames/BBCode.txt) (currently 231 MB) (or BBCode.lastday.txt (https://loyce.club/usernames/BBCode.lastday.txt) for only the daily changes)
Sample:
Code:
459831. [url=https://bitcointalk.org/index.php?action=profile;u=459831]XiomarHeck[/url]
459832. [url=https://bitcointalk.org/index.php?action=profile;u=459832]MelvaBeave[/url]
459833. [url=https://bitcointalk.org/index.php?action=profile;u=459833]JanieCaulf[/url]
459834. [url=https://bitcointalk.org/index.php?action=profile;u=459834]VickyVPTD[/url]
459835. [url=https://bitcointalk.org/index.php?action=profile;u=459835]bensam1231[/url]
459836. [url=https://bitcointalk.org/index.php?action=profile;u=459836]LoyceV[/url]
459837. [url=https://bitcointalk.org/index.php?action=profile;u=459837]btc.jobworks[/url]
459838. [url=https://bitcointalk.org/index.php?action=profile;u=459838]LyleHlyrf[/url]
459839. [url=https://bitcointalk.org/index.php?action=profile;u=459839]NormaClowe[/url]
459840. [url=https://bitcointalk.org/index.php?action=profile;u=459840]ForestClar[/url]
459841. [url=https://bitcointalk.org/index.php?action=profile;u=459841]TyrellKCU[/url]

This list could also be useful for finding spam-accounts created on certain dates (which means they match a certain list of userIDs).

These lists are updated once a day every 2 hours.


If a user changes their name (either because they're VIP or because Admin granted a wish), please post so I can update them manually.



See [overview] LoyceV's useful data on Bitcointalk (https://bitcointalk.org/index.php?topic=5145594.0) for more of my forum-related topics


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: NavI_027 on November 17, 2019, 05:02:10 PM
I'm just curious, did you manually listed all the accounts with other info and made a .txt format of it? If your answer is yes then absolutely wow :o! Where on earth did you find the perseverance to do it?

Anyway, you're right, this could be helpful on finding spam accounts but honestly I think only few will use this because 1) there's a file need to be downloaded, members tend to not spend even a small amount of data for such thing; and 2) "Reporting Spammers, Sh*tposters, Scammers etc." type of threads are enough already. Don't get me wrong your work is amazing but those are my negative insights.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: 100bitcoin on November 17, 2019, 05:07:40 PM
I'm just curious, did you manually listed all the accounts with other info and made a .txt format of it?
Definitely Not! ::)


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: LoyceV on November 17, 2019, 05:28:46 PM
I'm just curious, did you manually listed all the accounts with other info and made a .txt format of it?
Lol no, it was just one line of code (and a very long wait).

Quote
I think only few will use this
I think so too. But it's there for whoever has a use for it.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: PrimeNumber7 on November 17, 2019, 09:49:16 PM
I was just looking for something like this.

These lists are updated once a day.
It might be a good idea to create a second file that contains only the UIDs of those you have updated in the last day.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: NavI_027 on November 18, 2019, 03:39:32 AM
I'm just curious, did you manually listed all the accounts with other info and made a .txt format of it?
Lol no, it was just one line of code (and a very long wait).
Hahaha, I see ;D. Sorry if I don't have backgrounds when it comes to IT stuff, I just took a guess.
Quote
I think only few will use this
I think so too. But it's there for whoever has a use for it.
Yeah, it's better to had the most possible options for us to get rid of those "cancer cells" a lot easier.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: BITCOIN4X on November 18, 2019, 04:14:47 AM
Sorry, maybe my question is outside the OP discussion, but I havent been able to access bpip.org for several days. I get a warning message like this when access it.
Quote
Your connection is not private Attackers might try to steal your information from bpip.org (for example, passwords, messages, or credit cards). Learn more
I want to know, am I the only one like this?


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: Upgrade00 on November 18, 2019, 06:53:51 AM
I want to know, am I the only one like this?
I was getting the exact same error some days ago, and for safety reasons I didn't bypass it and just let it be for a while assuming it was some kind of server error.
It appears to be working normally now on my browser without any action from my end. You can try again, and if need be refresh your cache.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: BITCOIN4X on November 18, 2019, 09:28:57 AM
~snip
It appears to be working normally now on my browser without any action from my end. You can try again, and if need be refresh your cache.
Right, now functioning and returning to normal. I access the bpip.org site quite often and this is the first time I have had this kind of interference.
But I try to access on android with deskop mode through a browser and it works. Both mobile and deskop are now back to normal.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: TheBeardedBaby on November 18, 2019, 09:41:04 AM
I'm so tired of repeating myself on every new thread you start but this is another great work.
What I suggest is to add a footer to every thread with a link to the list with all your other work (http://) so people no need bookmarks anymore.
It will be very helpful for me, I guess for the rest of the guys as well. You really need a table of content because you produce quite a lot of content, valuable one and it's easy to get lost (the list you have is only forum related stuff, and you have quite many other great threads.
I have my own bookmark folder called LoyceV, where I put everything with a tags for easy access, I just created it recently and it is helpful to follow your work. I can keep remembering all the stuff you created. :)


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: LoyceV on November 18, 2019, 02:34:06 PM
It might be a good idea to create a second file that contains only the UIDs of those you have updated in the last day.
That is a good idea indeed, so I added it:
http://loyce.club/usernames/usernames.lastday.txt
http://loyce.club/usernames/BBCode.lastday.txt
Note that today's "daily" versions are incomplete because I uploaded a few test versions in between. If you download the full version now, you can download daily additions starting tomorrow.

I havent been able to access bpip.org for several days. I get a warning message like this when access it.
See Re: Announcing BPIP - The Bitcointalk Public Information Project! (https://bitcointalk.org/index.php?topic=4746201.msg53089012#msg53089012).

I'm so tired of repeating myself on every new thread you start but this is another great work.
Thanks :D This was actually one of the easier things to make, but I've been postponing it for a long time because it involved scraping 2.7 million pages.

Quote
What I suggest is to add a footer to every thread with a link to the list with all your other work (http://) so people no need bookmarks anymore.
Done:
See [overview] LoyceV's useful data on Bitcointalk (https://bitcointalk.org/index.php?topic=5145594.0) for more of my forum-related topics
Note that the above topic does not show all my topics (https://bitcointalk.org/gettopics.php?user=459836), only the ones that directly concern the forum.


Title: Re: LoyceV's complete List of all Bitcointalk usernames.
Post by: xolxol on November 24, 2019, 08:46:45 AM
Thanks for the work you've done here,i commend you for being a skilled DT Member here!You are worth a thousand times than those abusive DT members whom doesnt contribute anything at all.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LTU_btc on November 28, 2019, 11:52:30 PM
Wow, great project, sir! :D. Personally, probably I won't find where to use it. But if it's beneficial for someone like you, it's good thing to have. Any plans in your minds about further projects?
Sorry, maybe my question is outside the OP discussion, but I havent been able to access bpip.org for several days. I get a warning message like this when access it.
Quote
Your connection is not private Attackers might try to steal your information from bpip.org (for example, passwords, messages, or credit cards). Learn more
I want to know, am I the only one like this?
Personally I visited BPIP in recent days and didn't got any errors. Oops, didn't noticed that's old post.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: tranthidung on November 29, 2019, 01:32:11 AM
usernames.txt (http://loyce.club/usernames/usernames.txt) (currently 51 MB)
Are there ways to load that file, LoyceV? I opened that page, and it is imcompletely loaded on my computer, so I can not copy and paste it in Notepad for later use.  :-\


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: PrimeNumber7 on November 29, 2019, 03:40:06 AM
usernames.txt (http://loyce.club/usernames/usernames.txt) (currently 51 MB)
Are there ways to load that file, LoyceV? I opened that page, and it is imcompletely loaded on my computer, so I can not copy and paste it in Notepad for later use.  :-\
You can run this python (https://www.python.org/) script on your computer if you want to save a file located on the internet onto your computer.

Code:
import os
import csv
import requests


path = 'http://loyce.club/usernames/usernames.txt'

r = requests.get(path)
with open ('usernames.txt', 'wb') as f:
    f.write(r.content)
You will need to run the script in the folder you want the file saved to. The script will save the file as "usernames.txt" however you can change this to another file name. The script will access the webpage located at the variable 'path'.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on November 29, 2019, 07:01:39 AM
usernames.txt (http://loyce.club/usernames/usernames.txt) (currently 51 MB)
Are there ways to load that file, LoyceV? I opened that page, and it is imcompletely loaded on my computer, so I can not copy and paste it in Notepad for later use.  :-\
Try this: Right click > Save Link As...

You can run this python (https://www.python.org/) script
If you really don't like right-clicking, I'd recommend wget (https://www.gnu.org/software/wget/).

Any plans in your minds about further projects?
Although off-topic: yes! I've been wanting to complete my dtview-viewer for a very long time now, but never got the time to complete it. And something else, but that's going to be a surprise.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: Flash Cunt on November 29, 2019, 04:39:07 PM
Is there a way to list the known alts, or other relationships between accounts?


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on November 29, 2019, 05:03:30 PM
Is there a way to list the known alts, or other relationships between accounts?
I'll leave that to the interested reader :D Or if there's anything I can automate, I can probably list some of them.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on December 06, 2019, 09:59:46 AM
I noticed some usernames are missing: goatpig (https://bitcointalk.org/index.php?action=profile;u=7811) for example. Many accounts have been removed in the past, so I'm now checking 16066 profiles for missing usernames.
I'll post the results when it's done.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: tranthidung on December 06, 2019, 12:46:53 PM
I noticed some usernames are missing: goatpig (https://bitcointalk.org/index.php?action=profile;u=7811) for example. Many accounts have been removed in the past, so I'm now checking 16066 profiles for missing usernames.
Removed or renamed. It is helpful if you can keep the username list to their current names rather than initial names.
Mr. Big, for example, is a current username, not initial one.
Is this (rickbig41) original name of Mr. Big?
But there is at least one problem to consider to not doing this. Sometimes, users ask admins or global moderators to change their usernames for personal issues (privacy, or security, for example). They changed usernames not because of fun. In such cases, in my opinion it is better and a kind of respect if we don't show the relation between initial and current usernames. If they already got accepted to do it (from admins/ global moderators) I think we should respect them (I could be wrong.)


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on December 07, 2019, 10:11:41 AM
It is helpful if you can keep the username list to their current names rather than initial names.
Unfortunately, there's no way to know which usernames changed without scraping all of them.

The annoying thing is: this breaks my Trust list viewer (https://bitcointalk.org/index.php?topic=5102296.0) updates. I have no way of finding a userID with a changed username. Last week, killyou72's username was changed to FFrankie (https://bitcointalk.org/index.php?action=profile;u=408367), and it wasn't in my files so I had to manually search for it. This delays my update by a few hours.

Quote
Sometimes, users ask admins or global moderators to change their usernames for personal issues (privacy, or security, for example). They changed usernames not because of fun. In such cases, in my opinion it is better and a kind of respect if we don't show the relation between initial and current usernames. If they already got accepted to do it (from admins/ global moderators) I think we should respect them (I could be wrong.)
You're wrong :P The original username can't be hidden. Try this: click MY MESSAGES > New Message > Find Members > Enter "Mr. Big" > click Search > Click "Mr. Big". It shows your PM is going to "rickbig41".

I noticed some usernames are missing: goatpig (https://bitcointalk.org/index.php?action=profile;u=7811) for example. Many accounts have been removed in the past, so I'm now checking 16066 profiles for missing usernames.
I'll post the results when it's done.
Only 33 usernames were missing, this is the full list:
5624. saltwater fishing (https://bitcointalk.org/index.php?action=profile;u=5624)
7811. goatpig (https://bitcointalk.org/index.php?action=profile;u=7811)
8701. yogeshahuja (https://bitcointalk.org/index.php?action=profile;u=8701)
9923. TurboHz (https://bitcointalk.org/index.php?action=profile;u=9923)
11907. franz583 (https://bitcointalk.org/index.php?action=profile;u=11907)
13272. 49er (https://bitcointalk.org/index.php?action=profile;u=13272)
177627. xiaohailuo (https://bitcointalk.org/index.php?action=profile;u=177627)
246300. Bitcoinsalez (https://bitcointalk.org/index.php?action=profile;u=246300)
351127. Zuzuru (https://bitcointalk.org/index.php?action=profile;u=351127)
381785. omgimpro0 (https://bitcointalk.org/index.php?action=profile;u=381785)
476360. WolfgaSNPW (https://bitcointalk.org/index.php?action=profile;u=476360)
584147. MrFudged6_6929 (https://bitcointalk.org/index.php?action=profile;u=584147)
584148. MrFudged3_7000 (https://bitcointalk.org/index.php?action=profile;u=584148)
584149. bee444 (https://bitcointalk.org/index.php?action=profile;u=584149)
827442. Kinkingsssx (https://bitcointalk.org/index.php?action=profile;u=827442)
874436. Bortnikov23 (https://bitcointalk.org/index.php?action=profile;u=874436)
1188625. Robot03 (https://bitcointalk.org/index.php?action=profile;u=1188625)
1532520. kakgiso (https://bitcointalk.org/index.php?action=profile;u=1532520)
1570390. kangtesbere (https://bitcointalk.org/index.php?action=profile;u=1570390)
1570391. AHMADYTRADE (https://bitcointalk.org/index.php?action=profile;u=1570391)
1570392. micahalcorn (https://bitcointalk.org/index.php?action=profile;u=1570392)
1992444. fcunha (https://bitcointalk.org/index.php?action=profile;u=1992444)
1992448. emc350 (https://bitcointalk.org/index.php?action=profile;u=1992448)
2015385. conluqua434 (https://bitcointalk.org/index.php?action=profile;u=2015385)
2033129. ZEN177 (https://bitcointalk.org/index.php?action=profile;u=2033129)
2115193. GINSASUKE (https://bitcointalk.org/index.php?action=profile;u=2115193)
2130219. WasiqSiddiqui3 (https://bitcointalk.org/index.php?action=profile;u=2130219)
2137755. Nhap002 (https://bitcointalk.org/index.php?action=profile;u=2137755)
2243672. tojapiotrek (https://bitcointalk.org/index.php?action=profile;u=2243672)
2252792. tiplols (https://bitcointalk.org/index.php?action=profile;u=2252792)
2486063. up53tNovelia (https://bitcointalk.org/index.php?action=profile;u=2486063)
2537255. the_maxwell (https://bitcointalk.org/index.php?action=profile;u=2537255)
2668635. Olinka (https://bitcointalk.org/index.php?action=profile;u=2668635)
They'll be added in the next update, which is currently running finished. You'll need to download the full version for this, not just the daily changes.

Trivia
There are 13937 usernames that start with "MrFudged"!


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: tranthidung on December 07, 2019, 10:47:37 AM
Unfortunately, there's no way to know which usernames changed without scraping all of them.
I don't think so, Loyce. I don't have skills to do this but I imagine that you only have to scrap username of active accounts. When one username changed, that owner most likely log in that account to send request to admin/ global moderators and if request accepted, admin/global moderator will do something that likely trigger that account from inactive to active.

I know you don't have data on active/inactive status of all users so I know this task is challenging for you.  ;D


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on December 07, 2019, 11:08:16 AM
I know you don't have data on active/inactive status of all users so I know this task is challenging for you.  ;D
I could check the usernames on all accounts that make a post, but it's still not covering all cases.

My main problem is with the Trust data dump (which shows usernames, unlike the Merit data dump which shows userIDs), and this is the main reason I can't full automate it yet. I'll just leave it as is for now, with some manual fixes once every few weeks.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: tranthidung on December 07, 2019, 11:11:48 AM
I could check the usernames on all accounts that make a post, but it's still not covering all cases.

My main problem is with the Trust data dump (which shows usernames, unlike the Merit data dump which shows userIDs), and this is the main reason I can't full automate it yet. I'll just leave it as is for now, with some manual fixes once every few weeks.
I don't say you should use last posts, instead latest log-in time (Last active on profile page) but as being said I don't think you will spend your time and somewhat potential damages on your computer to do this.

I meant you can narrow down the population of active users (with Last Active time, not with Last post) to scrap data.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on December 07, 2019, 11:39:55 AM
I don't say you should use last posts, instead latest log-in time (Last active on profile page) but as being said I don't think you will spend your time and somewhat potential damages on your computer to do this.
I still need to download the profile to see when they were last active. That's way too much scraping for maybe one name change per month.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: CucakRowo on January 30, 2020, 10:08:39 PM
Thank you for providing this tools. http://loyce.club/ (http://loyce.club/). Your tools really helped me a lots ifor doing small investigation activities.
i've searched your thread about that tools, but couldn't find it.

As i saw in your tools UI, you need a server. If there is free time, take your time to check this services. https://www.arweave.org/hosting.html (https://www.arweave.org/hosting.html)



Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on February 01, 2020, 08:09:50 AM
As i saw in your tools UI, you need a server.
Hosting is covered now, and working very well:
Quote from: http://loyce.club/
suchmoon (https://bitcointalk.org/index.php?action=profile;u=234771) donated powerful large AWS webhosting for loyce.club (end of 2019 until now)


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: Timmzzy on June 20, 2020, 12:40:09 PM
Viewing all members (https://bitcointalk.org/index.php?action=mlist;sa=all) has been "temporarily disabled" for as long as I can remember, so I made a list myself.

Another reason to make this, is that I often need to find the userID that goes with a username. I can't easily get this from the forum, which is why until recently I used BPIP (https://bpip.org/) for this. Unfortunately, a small percentage of users are missing from BPIP.
So I made my own :D

There are 2 versions, each with all 2.7 million userIDs.
usernames.txt (http://loyce.club/usernames/usernames.txt) (currently 51 MB) (or usernames.lastday.txt (http://loyce.club/usernames/usernames.lastday.txt) for only the daily changes)
Sample:
Code:
459831: XiomarHeck
459832: MelvaBeave
459833: JanieCaulf
459834: VickyVPTD
459835: bensam1231
459836: LoyceV
459837: btc.jobworks
459838: LyleHlyrf
459839: NormaClowe
459840: ForestClar
459841: TyrellKCU

BBCode.txt (http://loyce.club/usernames/BBCode.txt) (currently 231 MB) (or BBCode.lastday.txt (http://loyce.club/usernames/BBCode.lastday.txt) for only the daily changes)
Sample:
Code:
459831. [url=https://bitcointalk.org/index.php?action=profile;u=459831]XiomarHeck[/url]
459832. [url=https://bitcointalk.org/index.php?action=profile;u=459832]MelvaBeave[/url]
459833. [url=https://bitcointalk.org/index.php?action=profile;u=459833]JanieCaulf[/url]
459834. [url=https://bitcointalk.org/index.php?action=profile;u=459834]VickyVPTD[/url]
459835. [url=https://bitcointalk.org/index.php?action=profile;u=459835]bensam1231[/url]
459836. [url=https://bitcointalk.org/index.php?action=profile;u=459836]LoyceV[/url]
459837. [url=https://bitcointalk.org/index.php?action=profile;u=459837]btc.jobworks[/url]
459838. [url=https://bitcointalk.org/index.php?action=profile;u=459838]LyleHlyrf[/url]
459839. [url=https://bitcointalk.org/index.php?action=profile;u=459839]NormaClowe[/url]
459840. [url=https://bitcointalk.org/index.php?action=profile;u=459840]ForestClar[/url]
459841. [url=https://bitcointalk.org/index.php?action=profile;u=459841]TyrellKCU[/url]

This list could also be useful for finding spam-accounts created on certain dates (which means they match a certain list of userIDs).

These lists are updated once a day.


If a user changes their name (either because they're VIP or because Admin granted a wish), please post so I can update them manually.



See [overview] LoyceV's useful data on Bitcointalk (https://bitcointalk.org/index.php?topic=5145594.0) for more of my forum-related topics

I my self has been trying to figure out why it's been disabled for this long, was there a big reason for that? Because going through this post you made am literally confused on what am to do if am to download this:
Quote
usernames.txt (http://loyce.club/usernames/usernames.txt)[/b] (currently 51 MB) (or usernames.lastday.txt (http://loyce.club/usernames/usernames.lastday.txt) for only the daily changes)
or am just to click it and view up the list using my browser.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on June 20, 2020, 02:11:25 PM
@Timmzzy: please remove my big quote from your post. There's no need to quote the OP.

I my self has been trying to figure out why it's been disabled for this long, was there a big reason for that?
It's probably because of server load.

Quote
you made am literally confused on what am to do if am to download this:
Then don't download it. If you don't know what to do with it, this isn't for you.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: block_contractor on March 23, 2021, 02:08:42 PM
Is there a way to exclude the users that no longer exist? Or a way to have your script still work, even if the user no longer exists, by looking through archives/history?
Interesting little project for the history of the first and most successful crypto so far.  :D


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on March 23, 2021, 07:21:28 PM
Is there a way to exclude the users that no longer exist?
I already show them:
Code:
1: admin
2: [s]does not exist[/s]
3: satoshi
4: sirius
5: [s]does not exist[/s]
6: nandnor
7: [s]does not exist[/s]
8: [s]does not exist[/s]
9: [s]does not exist[/s]
10: Xunie
11: madhatter
12: nanaimogold
13: SmokeTooMuch
14: The Madhatter
15: [s]does not exist[/s]
16: xuO4k04c6Ng
17: The Doctor
18: [s]does not exist[/s]
19: [s]does not exist[/s]
20: [s]does not exist[/s]
21: AgoraMutual
If you want to exclude them, just do a grep (https://tldp.org/LDP/Bash-Beginners-Guide/html/sect_04_02.html) -v

Quote
Or a way to have your script still work, even if the user no longer exists, by looking through archives/history?
My guess is those users were removed a long time ago, I don't expect any archives to exist from that time.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on August 08, 2021, 12:49:58 PM
Now, as I understand it, is it possible to download either a complete list of absolutely all registrations or a list of the user for the last day?
Close: it's either a full list, or the last 2 hours. If anyone wants a compressed version of the large file, I can add it.

Quote
Loycev, is there a complete archive of users, distributed by the number of registrations for each specific day? Or at least for every month? For example, a list of all users who registered in June 2021, July 2021, August 2021, etc.?
I didn't keep track of registration dates, maybe BPIP or TryNinja or DdmrDdmr has this data. But if you only want a certain month, you can manually search the first and last user, and get them from my list.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: examplens on August 10, 2021, 09:46:56 AM
LoyceV, is it possible to single out only usernames/accounts which are only registered and never used again. No one single post, no activity after registration, just registered and abandoned?
I was searching for something and I saw that there were a lot of them, maybe they could even be deleted especially those registered a few years earlier and never used after.
I guess new users when coming here have a harder task finding the right username if they don’t want some generic "hgga654".


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on August 10, 2021, 09:57:28 AM
LoyceV, is it possible to single out only usernames/accounts which are only registered and never used again. No one single post, no activity after registration, just registered and abandoned?
Not really: I can't know if a user who registered years ago deleted his posts, or got Nuked. For new users I know if they made a post (https://loyce.club/archive/members/).

Quote
I was searching for something and I saw that there were a lot of them, maybe they could even be deleted especially those registered a few years earlier and never used after.
Many (https://bitcointalk.org/seclog.php?all) of those users wake up again after a while (and some of them start spamming).

Quote
I guess new users when coming here have a harder task finding the right username if they don’t want some generic "hgga654".
Reusing usernames is a bad idea: what if someone tries to contact an old user, and it turns out to be someone else?


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on August 10, 2021, 10:10:05 AM
I think deleting members which are proxy banned is a good idea of freeing up some old usernames.
I don't think it's going to happen.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: examplens on August 10, 2021, 10:28:28 AM
LoyceV, is it possible to single out only usernames/accounts which are only registered and never used again. No one single post, no activity after registration, just registered and abandoned?
Not really: I can't know if a user who registered years ago deleted his posts, or got Nuked. For new users I know if they made a post (https://loyce.club/archive/members/).

Quote
I was searching for something and I saw that there were a lot of them, maybe they could even be deleted especially those registered a few years earlier and never used after.
Many (https://bitcointalk.org/seclog.php?all) of those users wake up again after a while (and some of them start spamming).

Quote
I guess new users when coming here have a harder task finding the right username if they don’t want some generic "hgga654".
Reusing usernames is a bad idea: what if someone tries to contact an old user, and it turns out to be someone else?

I meant accounts like this. he was registered, stayed for one minute and never returned back, or did not return under that username.
has only a website on its profile and it is most likely an account created to make a backlink to that site. this is one case, but I've seen a lot of them even without website link in profile.

https://i.ibb.co/V201Gsc/image.png (https://imgbb.com/)


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on August 10, 2021, 10:35:54 AM
I meant accounts like this. he was registered, stayed for one minute and never returned back, or did not return under that username.
has only a website on its profile and it is most likely an account created to make a backlink to that site. this is one case, but I've seen a lot of them even without website link in profile.
At some point Bitcointalk accounts were used to spam backlinks: I've seen certain backlinks on (tens of) thousands of profiles. It would have been better to hide the Website link for users with evil fee.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: PrimeNumber7 on August 10, 2021, 04:37:43 PM
I meant accounts like this. he was registered, stayed for one minute and never returned back, or did not return under that username.
has only a website on its profile and it is most likely an account created to make a backlink to that site. this is one case, but I've seen a lot of them even without website link in profile.
At some point Bitcointalk accounts were used to spam backlinks: I've seen certain backlinks on (tens of) thousands of profiles. It would have been better to hide the Website link for users with evil fee.
I believe that accounts that are evil banned are not able to post links in their profile anymore. I am not sure what happened to the accounts that did this before this was changed. It would probably be best to have websites removed from evil banned accounts, if they haven't been already.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: gredinger on August 12, 2021, 03:30:05 AM
I often need to find the userID that goes with a username. I can't easily get this from the forum

https://bitcointalk.org/index.php?action=profile;user=LoyceV

You can use 'user=[username]' parameter for a query easily enough. Once you're to the user profile, you can pull the user ID from send a message ahref [or other parts of the profile].


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on August 12, 2021, 08:39:39 AM
https://bitcointalk.org/index.php?action=profile;user=LoyceV
Wow, after all those years, I never new this was possible :o
Thanks for this, it will come in handy, especially for data dumps (https://bitcointalk.org/trust.txt.xz) that show usernames instead of userIDs!


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: TheBeardedBaby on August 12, 2021, 01:39:48 PM
https://bitcointalk.org/index.php?action=profile;user=LoyceV
Wow, after all those years, I never new this was possible :o
Thanks for this, it will come in handy, especially for data dumps (https://bitcointalk.org/trust.txt.xz) that show usernames instead of userIDs!

Keep in mind that this one does not work with changed nicknames. You'll get error like trying to test mine:
https://bitcointalk.org/index.php?action=profile;user=TheBeardedBaby


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on August 12, 2021, 02:33:21 PM
Keep in mind that this one does not work with changed nicknames.
Well, that sucks :( Those are ones I need to search most.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: ajaxtempest on May 19, 2022, 04:54:10 PM
Just found that i am the  3,468,973 th user!

Also i could have been the 14294th user. That was the date and time i had posted in some tech forum about bitcoin.
Should have joined this forum that day :-\
may 21 2011.

btc was $5.59 on that day.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: mellon on May 20, 2022, 06:16:36 PM
Interesting. I’m about few years not be here. a lot has changed, but not LoyceV as he worked for the benefit of the community and continues this noble cause.  Glad to see you. Should be anything changed in the list after my post?


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: Welsh on May 20, 2022, 06:24:54 PM
Keep in mind that this one does not work with changed nicknames. You'll get error like trying to test mine:
https://bitcointalk.org/index.php?action=profile;user=TheBeardedBaby
It does however, link to the new username's profile if you put in their old username. I guess, if the user changed their username for privacy reasons, could potentially be an issue. Although, there's other ways to find that out, so probably not that critical.

Wow, after all those years, I never new this was possible :o
Yeah, not something I even considered trying. Good to know for the future, though.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: joker_josue on September 02, 2022, 06:54:05 AM
Is it possible to obtain a list of users, including the registration date?


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on September 02, 2022, 07:05:46 AM
Is it possible to obtain a list of users, including the registration date?
It's possible, but I don't have it. BPIP (https://bpip.org/) shows it, so maybe @suchmoon or @ibminer can give you a database dump for this?
Alternatively, you could just check one in every 1000 profiles, that should give you a pretty good estimate of the other registration dates. Scraping all profiles (3.5 million) just for this would take 6 weeks and seems like a waste of forum bandwidth.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: joker_josue on September 02, 2022, 06:57:58 PM
It's possible, but I don't have it. BPIP (https://bpip.org/) shows it, so maybe @suchmoon or @ibminer can give you a database dump for this?
Alternatively, you could just check one in every 1000 profiles, that should give you a pretty good estimate of the other registration dates. Scraping all profiles (3.5 million) just for this would take 6 weeks and seems like a waste of forum bandwidth.

I understand. Thanks for the feedback.

For the intended purpose, it would only make sense to have the dates right, at least from the oldest members.
I'll try to see with @suchmoon or @ibminer if they can help.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on February 10, 2024, 08:02:02 AM
What happened to userID 3604953 (https://bitcointalk.org/index.php?action=profile;u=3604953)? This one was skipped, which made my scraper think it's not in use so it was stuck for a week.
It's working again, but I'm curious what caused this.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: ibminer on February 16, 2024, 12:31:57 PM
What happened to userID 3604953 (https://bitcointalk.org/index.php?action=profile;u=3604953)?~

I discovered this same ID looping on BPIP's parsers around the 22nd of January, which I had to skip, to keep the parsers going. I didn't realize it was effecting others though, we saw it more as a bug on our end, which we've been monitoring.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: babo on February 16, 2024, 04:29:52 PM
What happened to userID 3604953 (https://bitcointalk.org/index.php?action=profile;u=3604953)? This one was skipped, which made my scraper think it's not in use so it was stuck for a week.
It's working again, but I'm curious what caused this.


LoyceV a question: I wanted to ask you something, is the code you are using to scrape free? I wanted to take a look maybe :)
thankz


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on February 17, 2024, 09:18:17 AM
is the code you are using to scrape free? I wanted to take a look maybe :)
I use free open source tools, but my code is not public. Basically, I download the latest user profile, and check if it exists. If it exists, I'll go to the next one. If it doesn't exist, I'll wait a few hours and try again. That's it. So if the forum somehow skips one userID, my script doesn't reach the next one until I intervene.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on June 22, 2024, 07:08:37 AM
I keep getting emails from people for a "responsible disclosure", telling me everyone can see usernames when they Google "intitle:"index of" “/usernames". Lol :D
I've now added an info.txt file pointing at this topic.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: aliveNFT on September 16, 2024, 10:08:51 AM
Hey Loyce.

Is this DB still active and updating on daily basis?
I want use it for testing some small project for bitcointalk.


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: LoyceV on September 16, 2024, 10:12:07 AM
Is this DB still active and updating on daily basis?
It's not a DB, but it's updated. See loyce.club/usernames/ (https://loyce.club/usernames/):
Code:
2024-09-16 12:09

Quote
I want use it for testing some small project for bitcointalk.
Good luck :)


Title: Re: LoyceV's complete List of all Bitcointalk usernames
Post by: aliveNFT on September 16, 2024, 10:15:16 AM
It's not a DB, but it's updated. See loyce.club/usernames/ (https://loyce.club/usernames/):
Code:
2024-09-16 12:09

Yeah, I saw it, I just wanted to make sure from you personally.
for me, this is a Database of user nicknames :D I can't put it any other way.

Thank you for quick answer.