Bitcoin Forum
May 23, 2024, 02:24:44 PM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: Any blockexplorers for searching by regex and/or partial addresses?  (Read 158 times)
Bigbootybooty (OP)
Newbie
*
Offline Offline

Activity: 4
Merit: 0


View Profile
October 05, 2021, 01:56:10 PM
 #1

Hi everyone,

Question's in the title. I started working on a project where I have only partial addresses (bitcoin, eth, ada, etc), and I want to search various blockchains to get a list of possible addresses that I can then narrow down to try to find the actual one I'm interested in. On Etherscan for example, it will autocomplete once you enter enough beginning characters, but what if I only have the last few characters or some in the middle?

I believe I can download the entire blockchain and then search that way, but I'm not actually sure if that's true and if it is I'm hoping there's a way I can do the search without needing to do so.

Thanks for the help!
NeuroticFish
Legendary
*
Offline Offline

Activity: 3682
Merit: 6406


Looking for campaign manager? Contact icopress!


View Profile
October 05, 2021, 02:04:14 PM
 #2

Hi everyone,

Question's in the title. I started working on a project where I have only partial addresses (bitcoin, eth, ada, etc), and I want to search various blockchains to get a list of possible addresses that I can then narrow down to try to find the actual one I'm interested in. On Etherscan for example, it will autocomplete once you enter enough beginning characters, but what if I only have the last few characters or some in the middle?

I believe I can download the entire blockchain and then search that way, but I'm not actually sure if that's true and if it is I'm hoping there's a way I can do the search without needing to do so.

Thanks for the help!


At least for Bitcoin it may be of help List of all Bitcoin addresses with a balance. Of course, it'll be one day old and it helps only if there are funds on the address, but it's much smaller than the blockchain and it's much easier to search into.

For the altcoins I can't help, sorry.

█████████████████████████
████▐██▄█████████████████
████▐██████▄▄▄███████████
████▐████▄█████▄▄████████
████▐█████▀▀▀▀▀███▄██████
████▐███▀████████████████
████▐█████████▄█████▌████
████▐██▌█████▀██████▌████
████▐██████████▀████▌████
█████▀███▄█████▄███▀█████
███████▀█████████▀███████
██████████▀███▀██████████
█████████████████████████
.
BC.GAME
▄▄░░░▄▀▀▄████████
▄▄▄
██████████████
█████░░▄▄▄▄████████
▄▄▄▄▄▄▄▄▄██▄██████▄▄▄▄████
▄███▄█▄▄██████████▄████▄████
███████████████████████████▀███
▀████▄██▄██▄░░░░▄████████████
▀▀▀█████▄▄▄███████████▀██
███████████████████▀██
███████████████████▄██
▄███████████████████▄██
█████████████████████▀██
██████████████████████▄
.
..CASINO....SPORTS....RACING..
█░░░░░░█░░░░░░█
▀███▀░░▀███▀░░▀███▀
▀░▀░░░░▀░▀░░░░▀░▀
░░░░░░░░░░░░
▀██████████
░░░░░███░░░░
░░█░░░███▄█░░░
░░██▌░░███░▀░░██▌
░█░██░░███░░░█░██
░█▀▀▀█▌░███░░█▀▀▀█▌
▄█▄░░░██▄███▄█▄░░▄██▄
▄███▄
░░░░▀██▄▀


▄▄████▄▄
▄███▀▀███▄
██████████
▀███▄░▄██▀
▄▄████▄▄░▀█▀▄██▀▄▄████▄▄
▄███▀▀▀████▄▄██▀▄███▀▀███▄
███████▄▄▀▀████▄▄▀▀███████
▀███▄▄███▀░░░▀▀████▄▄▄███▀
▀▀████▀▀████████▀▀████▀▀
Bigbootybooty (OP)
Newbie
*
Offline Offline

Activity: 4
Merit: 0


View Profile
October 05, 2021, 03:56:28 PM
 #3


At least for Bitcoin it may be of help List of all Bitcoin addresses with a balance. Of course, it'll be one day old and it helps only if there are funds on the address, but it's much smaller than the blockchain and it's much easier to search into.

For the altcoins I can't help, sorry.

This is very helpful, thanks!!

If anyone has ideas for altcoins, I'd super appreciate it.

LoyceV
Legendary
*
Offline Offline

Activity: 3318
Merit: 16687


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
October 05, 2021, 04:51:27 PM
 #4

I also have List of all Bitcoin addresses ever used, but I'm still looking for hosting for the 20 GB file.

If anyone has ideas for altcoins, I'd super appreciate it.
Blockchair Database Dumps also has BCH, BSV, Dash, Doge, Ethereum, Litecoin and Zcash. I could get you the data for some of the altcoins if you really want, but it's some work and downloads are limited to 100 kB/s.

Bigbootybooty (OP)
Newbie
*
Offline Offline

Activity: 4
Merit: 0


View Profile
October 05, 2021, 07:02:48 PM
 #5

I also have List of all Bitcoin addresses ever used, but I'm still looking for hosting for the 20 GB file.

If anyone has ideas for altcoins, I'd super appreciate it.
Blockchair Database Dumps also has BCH, BSV, Dash, Doge, Ethereum, Litecoin and Zcash. I could get you the data for some of the altcoins if you really want, but it's some work and downloads are limited to 100 kB/s.

That could be helpful as well. I think I remember with Mediafire you can host up to 20GB files for like $10/month, which I might be willing to pay for if that would work.

Thanks for those existing links!! I appreciate the offer on the altcoins, but it's not pressing for me at the moment, so it might not be worth the effort currently
LoyceV
Legendary
*
Offline Offline

Activity: 3318
Merit: 16687


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
October 05, 2021, 08:14:49 PM
 #6

I also have List of all Bitcoin addresses ever used, but I'm still looking for hosting for the 20 GB file.
That could be helpful as well. I think I remember with Mediafire you can host up to 20GB files for like $10/month, which I might be willing to pay for if that would work.
Mediafire wouldn't work, I need a VPS for processing the data.
NotATether has hosted a 4 months old version on files.notatether.com/public/loycev/addresses_sorted.txt.gz. If the partial addresses you have are older than that, it should be enough for your project.

LoyceV
Legendary
*
Offline Offline

Activity: 3318
Merit: 16687


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
October 06, 2021, 10:04:11 AM
 #7

By any chance, are you looking service like Google Cloud Storage FUSE (https://cloud.google.com/storage/docs/gcs-fuse)?
No. From the link:
Quote
For just the 12 charged operations, the cost of this sequence of commands is $0.000084.
They'll want my creditcard for this.

LoyceV
Legendary
*
Offline Offline

Activity: 3318
Merit: 16687


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
October 06, 2021, 11:31:30 AM
 #8

DigitalOcean
Last time I checked, they wanted my creditcard too. I have high hopes to find a good VPS deal again on Black Friday.

Bigbootybooty (OP)
Newbie
*
Offline Offline

Activity: 4
Merit: 0


View Profile
October 07, 2021, 05:48:58 PM
 #9

Last time I checked, they wanted my creditcard too. I have high hopes to find a good VPS deal again on Black Friday.

If you don't already know this, there's a bunch of virtual/temporary card services out there that might work if you can pay for multiple months up front. In the US at least, visa has a prepaid debit card that works on most sites I've tried. Maybe Revolut's virtual cards are credit instead of debit, but I haven't tried them so not sure.

I might be willing to consider paying for it myself somehow if you don't find another option, but that'd get complicated

LoyceV
Legendary
*
Offline Offline

Activity: 3318
Merit: 16687


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
October 07, 2021, 06:09:09 PM
 #10

Why don't you check https://bitcoin-vps.com/
Most are quite expensive, especially for large storage (thanks to Chia mining I guess).

Quote
recheck feature on VPS provider you currently use.
Loyce.club is hosted on AWS, sponsored by suchmoon. But AWS charges ridiculous rates for bandwidth, so it's not worth it for large files. My addresses with a balance costs about 1% of what AWS would charge for the bandwidth. But it's currently offline. AWS is never offline Smiley

If you don't already know this, there's a bunch of virtual/temporary card services out there that might work if you can pay for multiple months up front.
I prefer to get one that accepts crypto directly. I'm keeping an eye on LowEndTalk for new offers. Some are good, some just disappear after a while.

Quote
I might be willing to consider paying for it myself somehow if you don't find another option, but that'd get complicated
I have a pay-by-the-hour account at RamNode, that will work. But it's not worth keeping online all the time (and some work to setup for one-time use). I've used it a few times, performance is good.



What exactly do you need? Just a (sorted) list of all Bitcoin addresses ever used (including emptied addresses, about 20 GB compressed), updated up until yesterday? Or would you need frequent updates too?

AdolfinWolf
Legendary
*
Offline Offline

Activity: 1946
Merit: 1427


View Profile
October 08, 2021, 08:42:52 PM
Last edit: October 08, 2021, 09:04:04 PM by AdolfinWolf
 #11

I was looking for this feature a couple years ago and back then there were several blockexplorers offering this service but it seems like they're all dead now.

https://bitcointalk.org/index.php?topic=808066.0
https://www.smartbit.com.au/

Not sure how they did this. Put all used addresses in a DB and then SQL for partial matches?
Code:
SELECT address FROM addresses WHERE address LIKE '%some substring%';

We can use getblock with txindex=1 is what i'm thinking. https://bitcointalk.org/index.php?topic=959897.msg10500979#msg10500979 maybe something like this?

No idea how it would work for altcoins though. Probably easier to download the dump for a couple altcoins. https://blockchair.com/dumps is indeed really nice.

NotATether
Legendary
*
Offline Offline

Activity: 1610
Merit: 6756


bitcoincleanup.com / bitmixlist.org


View Profile WWW
October 08, 2021, 10:51:16 PM
 #12

That could be helpful as well. I think I remember with Mediafire you can host up to 20GB files for like $10/month, which I might be willing to pay for if that would work.

On 1fichier.com you get 2TB of cloud storage for just $20-something per year which is much better if you have a large dataset.

Three notes:

- the links can be shared with anyone and made public
- they allow you to pay in Bitcoin
- The download links for non-subscribers are rare-limited and throttled.

But it still does the job. I was a paying customer for it last year.

If you don't already know this, there's a bunch of virtual/temporary card services out there that might work if you can pay for multiple months up front.

Ezzocard is one, but it is redundant for 1fichier since you can just pay in bitcoin as I mentioned.

.
.BLACKJACK ♠ FUN.
█████████
██████████████
████████████
█████████████████
████████████████▄▄
░█████████████▀░▀▀
██████████████████
░██████████████
████████████████
░██████████████
████████████
███████████████░██
██████████
CRYPTO CASINO &
SPORTS BETTING
▄▄███████▄▄
▄███████████████▄
███████████████████
█████████████████████
███████████████████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████████████
█████████████████████
███████████████████
▀███████████████▀
█████████
.
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!