Bitcoin Forum
December 04, 2020, 02:50:31 AM *
News: Latest Bitcoin Core release: 0.20.1 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1] 2 »  All
  Print  
Author Topic: List of all Bitcoin addresses with a balance  (Read 1482 times)
This is a self-moderated topic. If you do not want to be moderated by the person who started this topic, create a new topic. (1 post by 1 user deleted.)
LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
June 11, 2020, 03:30:34 PM
Last edit: November 20, 2020, 05:01:08 PM by LoyceV
Merited by bitmover (5), suchmoon (4), Ratimov (3), OmegaStarScream (2), BrewMaster (2), BTCW (2), Coin-1 (1), Porfirii (1), PawGo (1), COVID-19 (1)
 #1

Background
There's another very useful data dump on Blockchair that deserves attention: blockchair_bitcoin_addresses_latest.tsv.gz!

On many occasions I found myself searching for a complete snapshot of all funded addresses, for instance to search for a balance when you only have a partial Bitcoin address. This file takes almost a day to download at 10 kB/s.

The data
See addresses.loyce.club. I keep a few snapshots of Blockchair's daily data.
Sample: blockchair_bitcoin_addresses_and_balance_DATE.tsv.gz (sorted by balance, highest first (in satoshis)):
Code:
address balance
35hK24tcLEWcgNA4JxpvbkNkoAcDGqQPsP      25550215765875
3KZ526NxCVXbKwwP66RgM3pte6zW4gY1tD      10185724750535
37XuVSEpWW4trkfmvWzegTHQt7BdktSKUs      9450577254951
.......
m-3165957a315e3d9d2de76eccb1140cb8      1
127TnYq7APW8WfKewd7EdxA8gMUXEtr623      1
1E6NkSVsBewyz8Z8wJBYVTKgWmdqcUSWkS      1
This file is in CSV (Comma-Separated Values) format (or more accurately: Tab-separated values). It's probably too large (30 million rows) to import into a spreadsheet.

I create a new file with all funded addresses, without balances.
Sample: Bitcoin_addresses_DATE.txt.gz (sorted in alphabetical order):
Code:
1111111111111111111114oLvT2
111111111111111111112BEH2ro
111111111111111111112xT3273
.......
bc1qzzzz6hthvpjgtl9pgqyepwwzfrky2ntmm5ccpc
bc1qzzzzp3khtxe32q03qfm6epm5ytyytq7lfcakpn
bc1zqyqsywvzqe
This file is in TEXT format. The first addresses are burn addresses, nobody can access those funds. The (incomplete) last address somehow really got funded.

Download speed should be around 1000 times faster than Blockchair. I don't offer uncompressed downloads.

How to use
The most likely use is to check a long list of Bitcoin addresses for a remaining balance.
On Linux, use this to find matching addresses:
Code:
comm -12 Bitcoin_addresses_June_09_2020.txt <(cat mylist.txt | sort | uniq)
  • Bitcoin_addresses_June_09_2020.txt: the extracted latest version downloaded from addresses.loyce.club.
  • mylist.txt: your own list of addresses, one address per line.
This takes only seconds to check millions of addresses. If your text file has Microsoft formatting, you may need to use this instead:
Code:
comm -12 Bitcoin_addresses_June_09_2020.txt <(cat mylist.txt | fromdos | sort | uniq)

Updates
I'll provide daily updates. I keep the 2 latest snapshots, then delete the oldest one.
I haven't fully tested this yet. I'll know in a few days if it works.

Credits
Blockchair Database Dumps has a staggering amount of data, easily accessible (at 10 kB/s) with daily updates. All data presented in this topic comes from Blockchair.

No spam please.
Self-moderated against spam. Discussion and questions are welcome.



Related topics
Bitcoin block data available in CSV format
List of all Bitcoin addresses with a balance
List of all Bitcoin addresses ever used

1607050231
Hero Member
*
Offline Offline

Posts: 1607050231

View Profile Personal Message (Offline)

Ignore
1607050231
Reply with quote  #2

1607050231
Report to moderator
1607050231
Hero Member
*
Offline Offline

Posts: 1607050231

View Profile Personal Message (Offline)

Ignore
1607050231
Reply with quote  #2

1607050231
Report to moderator
1607050231
Hero Member
*
Offline Offline

Posts: 1607050231

View Profile Personal Message (Offline)

Ignore
1607050231
Reply with quote  #2

1607050231
Report to moderator
If you want to be a moderator, report many posts with accuracy. You will be noticed.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1607050231
Hero Member
*
Offline Offline

Posts: 1607050231

View Profile Personal Message (Offline)

Ignore
1607050231
Reply with quote  #2

1607050231
Report to moderator
1607050231
Hero Member
*
Offline Offline

Posts: 1607050231

View Profile Personal Message (Offline)

Ignore
1607050231
Reply with quote  #2

1607050231
Report to moderator
BrewMaster
Legendary
*
Offline Offline

Activity: 1750
Merit: 1164


There is trouble abrewing


View Profile
June 12, 2020, 04:18:32 AM
 #2

how did you download these files? i've tried a couple of times using my cloud downloader but each time it failed near the end. i suspected the file might have been removed or changed since it took nearly a day to download.

I'm not sure what the weird "address" format at the end is.
for some reason blockchair.com assigns these weird format addresses to any outscript that they see. this includes OP_RETURN outputs too which can be found in almost all of the coinbase transactions.
the last one in your list for example is a simple P2PKH script that starts with a garbage being pushed to the stack followed by an OP_DROP which makes the pushto virtually not-exist.
https://blockchair.com/bitcoin/transaction/48e7694b3de213e2ab36cfcfaaa3013a22e1a5dc28168772cb01be99f91a12fa

LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
June 12, 2020, 09:15:33 AM
 #3

how did you download these files?
wget

Quote
i've tried a couple of times using my cloud downloader but each time it failed near the end. i suspected the file might have been removed or changed since it took nearly a day to download.
As long as your download doesn't disconnect, I assume the file you're downloading doesn't change. However, one of my downloads got corrupted, so I now test each new .gz-file before sharing it, and before deleting the oldest one.

Quote
for some reason blockchair.com assigns these weird format addresses to any outscript that they see. this includes OP_RETURN outputs too which can be found in almost all of the coinbase transactions.
the last one in your list for example is a simple P2PKH script that starts with a garbage being pushed to the stack followed by an OP_DROP which makes the pushto virtually not-exist.
https://blockchair.com/bitcoin/transaction/48e7694b3de213e2ab36cfcfaaa3013a22e1a5dc28168772cb01be99f91a12fa
I thought it must have been OP_RETURN indeed, but didn't look into it.
As an easy "solution", I'll remove the 397,175 "addresses" that contain a "-" from Bitcoin_addresses_DATE.txt.gz. I won't change existing files for this, so updates start in about 2 days.

LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
June 15, 2020, 09:25:06 AM
Last edit: July 08, 2020, 11:28:45 AM by LoyceV
Merited by bitmover (1), Ratimov (1)
 #4

In Ratimov's Russian translation, FontSeli asked how this can be useful for a normal person (thanks Google Translate). I'll answer this here.

I can think of several other uses:
  • Say you have a list of your old Bitcoin addresses and want to know if they hold any balance. But you don't want to let any block explorer or Electrum server know which address you're looking at. By downloading all addresses, you can easily do a local search without anyone else knowing which address you're looking for.
  • I've also seen cases where someone has an incomplete Bitcoin address, and wants to know if it's worth to pursue recovering the private key. Block explorers don't let you search for incomplete addresses. As a rediculous example, here are all funded addresses that contain "Loyce":
Code:
1LoyceVSbrv3CP3jT12qVYrNSbrqz4FL5q      1499000
1PKDzdoRNoP1LoyceZLT1VwNsvP2GBuxk6      100000
1F9Q7dzMyFBkrNQvdo4ECLL5DvLoycewSw      71917
17YTjpKVtRLAVP6igaztot5Loycegd5igR      70701
1MakvXVkoAGJXhbbTEAM3Loyce6LibBaEQ      31590

Captain-Cryptory
Sr. Member
****
Offline Offline

Activity: 910
Merit: 385


👿 lurks in the details.


View Profile
June 21, 2020, 10:33:49 AM
Last edit: June 21, 2020, 11:20:45 AM by Captain-Cryptory
 #5

............. But you don't want to let any block explorer or Electrum server know which address you're looking at. .............




still the choosing of any block explorer to pursue the  addresses of your interest would lead to  swifter result. All out good VPN would  help to hide from the curiosity expressed by those who are behind the  block explorer. In this old-fashioned approach I find reasonable compromise between   convenience and safety.


▄██████████      █████████▄
▄██████████████████████████▄
▄█████▀          ▀███████▀          ▀████▄
▄█████                ███████                ████▄
▄█████                █████████                ████▄
█████                █████  █████                ████
█████               █████       █████               ████
█████             █████          █████              ████
█████              ████              ████              ████
████▌            █████              █████            ▐███
████▌            ████                  ████            ▐███
█████            █████              █████            ████
█████            ██████      ██████            ████
█████████    █████████████    ████████
█████████      █████████      ████████



        ▀▀▀▀▀▀▀▀▀▀▀▀▀
         ▀▀▀▀▀▀▀▀▀▀▀
      ▀▀▀▀▀▀▀▀▀
    ▀▀▀▀▀▀▀▀▀
  ▀▀▀▀▀▀▀▀▀▀▀
 ▀▀▀▀▀▀▀▀▀▀▀▀▀
       ▀▀▀▀▀▀▀▀▀▀▀
         ▀▀▀▀▀▀
           ▀▀▀▀
             ▀▀
           ▀▀


▀▀▀▀▀▀▀▀▀▀▀▀▀
    ▀▀▀▀▀▀▀▀▀▀▀
      ▀▀▀▀▀▀▀▀▀
          ▀▀▀▀▀▀▀▀▀
        ▀▀▀▀▀▀▀▀▀▀▀
      ▀▀▀▀▀▀▀▀▀▀▀▀▀
    ▀▀▀▀▀▀▀▀▀▀▀
            ▀▀▀▀▀▀
              ▀▀▀▀
                   ▀▀
LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
June 21, 2020, 11:57:57 AM
 #6

still the choosing of any block explorer to pursue the  addresses of your interest would lead to  swifter result. All out good VPN would  help to hide from the curiosity expressed by those who are behind the  block explorer.
For many users that will be true. I just offer one more option Smiley

bitmover
Legendary
*
Offline Offline

Activity: 1050
Merit: 2077


www.Crypto.Games: Multiple coins, multiple games


View Profile WWW
June 30, 2020, 02:41:59 AM
 #7

Nice job LoyceV.

You are good with these kind of data.

I am searching for historical volume data from exchanges, BTC pairs. I tried in coinmarketcap but I couldn't find there. Do you have any idea where I can find it?

▄▄█████████▄▄
▄█████████████████▄
▄████▀▀▀▀█████▀▀▀▀████▄
████▀██████▀█▀██████▀████
██████████████████████████
▐█████▄███████████████▄█████▌
▐███████▄▄█████████▄▄███████▌
▐██████▀█████████████▀██████▌
▐███████████████████████████▌
▀██████████████████████▀
▀████▄████▄▀▀▄████▄████▀
▀███████▀███▀███████▀
▀▀█████████████▀▀
  ▀▀▀▀▀▀▀▀▀
|
★.★.★   8 GAMES   ★   WAGERING CONTEST   ★   JACKPOTS   ★   FAUCET   ★.★.★
  ▄▄▄
▄█ ▄▀█▄
██ ▄▀██
 ▀▄▄█▀
  ▄▄▄
▄█▀ ▀█▄
██   ██
 ▀█▄█▀
  ▄▄▄
▄█▀█▀█▄

 ▀███▀
  ▄▄▄
▄██▀▄█▄
██▀▄███
 ▀▄▄▄▀
  ▄▄▄
▄█ ▄▀█▄
██ █ ██
 ▀▄▄█▀
  ▄▄▄
▄▀▄▄▄▀▄
█▀▀▀▀▄█
 ▀███▀
  ▄▄▄
▄▀   ▀▄
█  █▄ █
 ▀▄██▀
  ▄▄▄
▄█▀ ▀█▄
██   ██
 ▀█▄█▀
  ▄▄▄
▀ █ ▀
▀▀▄▀▀
 ▀▄█▄
  ▄▄▄
▄█ ▄▀█▄
██ ▄▀██
 ▀▄▄█▀
|
LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
June 30, 2020, 10:05:53 AM
 #8

I am searching for historical volume data from exchanges, BTC pairs. I tried in coinmarketcap but I couldn't find there. Do you have any idea where I can find it?
I haven't seen this data yet. I've seen sites that sell historic data, but I'm not sure if they include exchange volumes.
And even if you do find it, the data must have come from the exchanges themselves, and some of them are known to provide fake data.

LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
July 08, 2020, 11:33:57 AM
Last edit: July 20, 2020, 08:36:54 AM by LoyceV
Merited by malevolent (1)
 #9

I can think of several other uses:
I thought of another use: what if you wanted to know how many addresses might be ChipMixer chips? They have specific sizes of 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096 or 8192 mBTC. A quick search (using yesterday's address list) shows:
1 mBTC: 266408 addresses
2 mBTC: 66301 addresses
4 mBTC: 30343 addresses
8 mBTC: 15695 addresses
16 mBTC: 8290 addresses
32 mBTC: 3894 addresses
64 mBTC: 1797 addresses
128 mBTC: 1167 addresses
256 mBTC: 595 addresses
512 mBTC: 259 addresses
1024 mBTC: 442 addresses
2048 mBTC: 120 addresses
4096 mBTC: 139 addresses
8192 mBTC: 59 addresses


bitwise
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
September 17, 2020, 03:45:08 PM
 #10

AFAIK you don't need to download this if you run a node
on any bitcoind node you can run dumptxoutset command and then just parse it

and when https://github.com/bitcoin/bitcoin/pull/18689/ gets merged, you won't even need to parse it
btc_enigma
Hero Member
*****
Offline Offline

Activity: 668
Merit: 508


View Profile
September 24, 2020, 09:43:56 AM
 #11

AFAIK you don't need to download this if you run a node
on any bitcoind node you can run dumptxoutset command and then just parse it

and when https://github.com/bitcoin/bitcoin/pull/18689/ gets merged, you won't even need to parse it


This feature would be really nice. Thanks for highlighting it

alevlaslo
Hero Member
*****
Offline Offline

Activity: 1722
Merit: 588


View Profile
October 19, 2020, 06:40:49 AM
 #12

Hello, please divide the addresses into three groups, we can not import different types into the Vanitysearch program at the same time

1111BiGmrM7hbhvpDPyVfXpzuQBUJEkdc
LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
October 19, 2020, 10:11:37 AM
 #13

Hello, please divide the addresses into three groups
I won't add different file formats for specific uses (because of restrictions on disk space and server load).

You're free to do that yourself though, it's quite easy:
For all Bech32 addresses:
Code:
wget http://addresses.loyce.club/blockchair_bitcoin_addresses_and_balance_October_19_2020.tsv.gz -O - | gunzip | grep "^b" > Bech32_bitcoin_addresses_and_balance_October_19_2020.tsv
Replace the "b" by "1" or "3" for other addresses, and adjust the file date for the latest version.



I'm glad to see this addresses subdomain consumes more data than the rest of loyce.club combined, that means it's being used Smiley

alevlaslo
Hero Member
*****
Offline Offline

Activity: 1722
Merit: 588


View Profile
October 19, 2020, 11:37:06 AM
 #14

thank you, but I have Windows, where do I need to set this command and what program to install?

1111BiGmrM7hbhvpDPyVfXpzuQBUJEkdc
LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
October 19, 2020, 11:54:21 AM
 #15

I have Windows, where do I need to set this command and what program to install?
I have no idea Tongue

So I got you this instead: http://alladdresses.loyce.club:20319/tmp/
It won't be updated, and it's scheduled to be deleted in 7 days.

alevlaslo
Hero Member
*****
Offline Offline

Activity: 1722
Merit: 588


View Profile
October 19, 2020, 12:13:45 PM
 #16

thank you very much!

1111BiGmrM7hbhvpDPyVfXpzuQBUJEkdc
alevlaslo
Hero Member
*****
Offline Offline

Activity: 1722
Merit: 588


View Profile
October 19, 2020, 01:03:12 PM
 #17

how do I remove extra characters? The program does not accept with them, each line only must has an address only, there should be nothing else

1111BiGmrM7hbhvpDPyVfXpzuQBUJEkdc
bitmover
Legendary
*
Offline Offline

Activity: 1050
Merit: 2077


www.Crypto.Games: Multiple coins, multiple games


View Profile WWW
October 19, 2020, 02:02:29 PM
Last edit: October 19, 2020, 02:31:08 PM by bitmover
 #18

how do I remove extra characters? The program does not accept with them, each line only must has an address only, there should be nothing else

Which program are you using?
You will struggle a lot to manipulate this kind of data in apps such as excel.

personally, I could only open that 1GB files in my python environment. All other programs just froze

Edit: I was able to open the larger file in Notepad++.

▄▄█████████▄▄
▄█████████████████▄
▄████▀▀▀▀█████▀▀▀▀████▄
████▀██████▀█▀██████▀████
██████████████████████████
▐█████▄███████████████▄█████▌
▐███████▄▄█████████▄▄███████▌
▐██████▀█████████████▀██████▌
▐███████████████████████████▌
▀██████████████████████▀
▀████▄████▄▀▀▄████▄████▀
▀███████▀███▀███████▀
▀▀█████████████▀▀
  ▀▀▀▀▀▀▀▀▀
|
★.★.★   8 GAMES   ★   WAGERING CONTEST   ★   JACKPOTS   ★   FAUCET   ★.★.★
  ▄▄▄
▄█ ▄▀█▄
██ ▄▀██
 ▀▄▄█▀
  ▄▄▄
▄█▀ ▀█▄
██   ██
 ▀█▄█▀
  ▄▄▄
▄█▀█▀█▄

 ▀███▀
  ▄▄▄
▄██▀▄█▄
██▀▄███
 ▀▄▄▄▀
  ▄▄▄
▄█ ▄▀█▄
██ █ ██
 ▀▄▄█▀
  ▄▄▄
▄▀▄▄▄▀▄
█▀▀▀▀▄█
 ▀███▀
  ▄▄▄
▄▀   ▀▄
█  █▄ █
 ▀▄██▀
  ▄▄▄
▄█▀ ▀█▄
██   ██
 ▀█▄█▀
  ▄▄▄
▀ █ ▀
▀▀▄▀▀
 ▀▄█▄
  ▄▄▄
▄█ ▄▀█▄
██ ▄▀██
 ▀▄▄█▀
|
alevlaslo
Hero Member
*****
Offline Offline

Activity: 1722
Merit: 588


View Profile
October 19, 2020, 03:37:14 PM
 #19

I have Notepad++, but I don't have enough RAM, it freezes after selecting all the text and ALT+SHIFT+>>>

1111BiGmrM7hbhvpDPyVfXpzuQBUJEkdc
LoyceV
Legendary
*
Offline Offline

Activity: 2058
Merit: 7200


Thick-Skinned Gang Leader


View Profile WWW
October 19, 2020, 04:05:01 PM
Merited by alevlaslo (1)
 #20

how do I remove extra characters?
You mean remove the balance? I just use cut. I got you 3 new files with only addresses.

Pages: [1] 2 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!