pbies (OP)
|
 |
October 12, 2022, 11:03:33 PM |
|
Is there a way (API?) to quickly check balance for thousands of public addresses? Locally (Bitcoin Core) or via any market API?
|
BTC: bc1qmrexlspd24kevspp42uvjg7sjwm8xcf9w86h5k
|
|
|
|
|
|
|
Once a transaction has 6 confirmations, it is extremely unlikely that an attacker without at least 50% of the network's computation power would be able to reverse it.
|
|
|
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
|
|
|
|
Sarah Azhari
|
 |
October 13, 2022, 02:33:09 AM |
|
That site uses a captcha, look hard when opening using TOR. I found another one that doesn't use it, besides that not only bitcoin, we can check also the balance ETH, BCH dan BTG and set a delay if check a large number of addresses www.homebitcoin.com
|
|
|
|
PawGo
Legendary
Offline
Activity: 952
Merit: 1367
|
 |
October 13, 2022, 07:18:28 AM |
|
Is there a way (API?) to quickly check balance for thousands of public addresses? Locally (Bitcoin Core) or via any market API?
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. That way you are independent of network connection, API limitations etc. In long term perspective, this is the best solution (of course you need to update your database from time to time). Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.
|
|
|
|
NeuroticFish
Legendary
Offline
Activity: 3514
Merit: 6210
Premium Bitcoin Mixer
|
 |
October 13, 2022, 07:29:36 AM |
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. That way you are independent of network connection, API limitations etc. In long term perspective, this is the best solution (of course you need to update your database from time to time). Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.This is what I'd suggest: a local block explorer that provides the API OP needs. The dumps from loyce.club are big (over 1GB zipped for the addresses with funds) and I find downloading them on a daily basis counterproductive.
|
|
|
|
NotATether
Legendary
Offline
Activity: 1442
Merit: 6023
Premium Bitcoin Mixer
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. That way you are independent of network connection, API limitations etc. In long term perspective, this is the best solution (of course you need to update your database from time to time). Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.This is what I'd suggest: a local block explorer that provides the API OP needs. The dumps from loyce.club are big (over 1GB zipped) and I find downloading them on a daily basis counterproductive. Why not just a database, if you're going to be dumping data and blocks onto the hard disk? But not SQLite or some other db-as-file.At least you will be able to make comprehensive SQL queries, make graphs (using something like PowerBI) and scale to many computers if you run out of disk space.
|
|
|
|
ETFbitcoin
Legendary
Offline
Activity: 2716
Merit: 7005
Mixero: Privacy by XMR (Monero) bridge
|
 |
October 13, 2022, 11:46:56 AM |
|
Is there a way (API?) to quickly check balance for thousands of public addresses? Locally (Bitcoin Core) or via any market API?
FYI, Bitcoin Core isn't suitable for your needs. It lacks address index, so you'll need to use scantxoutset or import the address on wallet then rescan whole blockchain which take some time. Many block explorer offer API, but i doubt the free option is generous enough to let you get details of thousand address within short time. That site uses a captcha, look hard when opening using TOR. I tried opening that website on Tor Browser and didn't face any captcha or security check Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.
Take note depending on which software you use, you only don't to run all 3. For example, Bcoin (full node with address index) or Bitcoin Core and Mempool.space.
|
|
|
|
joniboini
Legendary
Offline
Activity: 2030
Merit: 1764
Coinomize.biz
|
 |
October 13, 2022, 01:40:01 PM |
|
This website looks old and according to it, the last update was back in 2020. I'd not use it if there is a better alternative out there. That site uses a captcha, look hard when opening using TOR.
I tried opening that website on Tor Browser and didn't face any captcha or security check I think he is referring to the captcha check before you can proceed with the balance checking, not the web security check itself.
|
|
|
|
|
Sarah Azhari
|
 |
October 14, 2022, 03:15:58 AM |
|
That site uses a captcha, look hard when opening using TOR. I tried opening that website on Tor Browser and didn't face any captcha or security check I mean captcha like this,  This website looks old and according to it, the last update was back in 2020. I'd not use it if there is a better alternative out there. oh, I don't know that, I just found that link on bitmover post. I don't know exactly what you want, you ask question: how to check the balance for thousands of public addresses. the loyce link only has data address which you can't check the address that you want.
|
|
|
|
ETFbitcoin
Legendary
Offline
Activity: 2716
Merit: 7005
Mixero: Privacy by XMR (Monero) bridge
|
 |
October 14, 2022, 08:11:05 AM |
|
--snip--
I mean captcha like this,  I see, reCAPTCHA indeed is very annoying for Tor users. I don't know exactly what you want, you ask question: how to check the balance for thousands of public addresses. the loyce link only has data address which you can't check the address that you want. There are 2 different type of file on LoyceV website, which are "List of all funded Bitcoin addresses (sorted by balance (in satoshis), highest first) " (this is what @pbies use) and "List of all funded Bitcoin addresses (balance not shown, sorted in alphabetical order) ". I also tried download the former and can confirm the file contain balance in Satoshi unit. $ head -n 5 blockchair_bitcoin_addresses_and_balance_March_01_2022.tsv address balance 34xp4vRoCGJym3xR7yCVPFHoCNxv4Twseo 25259722706415 bc1qgdjqv0av3q56jvd82tkdjpy7gdp9ut8tlqmgrpmv24sq90ecnvqqjwvw97 16800998565493 1P5ZEDWTKTFGxQjZphgWPQUpe554WKDfHQ 12711157350542 3LYJfcfHPXYJreMsASk2jkn69LWEYKzexb 1166011365465
$ tail -n 5 blockchair_bitcoin_addresses_and_balance_March_01_2022.tsv 14jBn3YqcxFNtKmBXMHbC55Z5rsUDtTrrf 1 1JNuAjoN9cj8zyHfJ45nfhMMEgkoVwLvkT 1 1PiSSHEADZc72TzydsM98fXTizZ2HUdNJM 1 13xUr3oovz6rd2w9NrpHEyZfr1BfNs3pum 1 1JSU7TXuEqrEFD5aUr5BDs6yPBPW7THYkE 1
|
|
|
|
LoyceV
Legendary
Online
Activity: 3150
Merit: 15571
Thick-Skinned Gang Leader and Golden Feather 2021
|
 |
October 14, 2022, 09:42:07 AM Last edit: October 14, 2022, 10:00:33 AM by LoyceV |
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. The fastest solution is this: How to useThe most likely use is to check a long list of Bitcoin addresses for a remaining balance. On Linux, use this to find matching addresses (after extrating the compressed .gz file of course): comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | sort | uniq) - Bitcoin_addresses_LATEST.txt: the extracted latest version downloaded from addresses.loyce.club.
- mylist.txt: your own list of addresses, one address per line.
This takes only seconds to check millions of addresses. If your text file has Microsoft formatting, you may need to use this instead: comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | fromdos | sort | uniq) But, that only gets you a list of funded addresses, not their balances. I'll cook something up: grep -f mylist.txt blockchair_bitcoin_addresses_and_balance_LATEST.tsv This is a bit slower and eats RAM: 500,000 input addresses uses 1.5 GB and took 50 seconds. You could mix it with the earlier command to only search the balance for addresses that aren't empty. I don't know exactly what you want, you ask question: how to check the balance for thousands of public addresses. the loyce link only has data address which you can't check the address that you want. See the explanations on List of all Bitcoin addresses with a balance.
|
|
|
|
|
PawGo
Legendary
Offline
Activity: 952
Merit: 1367
|
 |
October 14, 2022, 05:50:28 PM |
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. The fastest solution is this: How to useThe most likely use is to check a long list of Bitcoin addresses for a remaining balance. On Linux, use this to find matching addresses (after extrating the compressed .gz file of course): comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | sort | uniq) All depends on how it is going to be used. If you want to test a bulk of addresses from time to time - then yes, maybe. If you want to test 1 address every few (mili)seconds, it will be too slow, dedicated (and properly indexed) database will be better.
|
|
|
|
NeuroticFish
Legendary
Offline
Activity: 3514
Merit: 6210
Premium Bitcoin Mixer
|
 |
October 14, 2022, 06:23:25 PM |
|
All depends on how it is going to be used. If you want to test a bulk of addresses from time to time - then yes, maybe. If you want to test 1 address every few (mili)seconds, it will be too slow, dedicated (and properly indexed) database will be better.
If OP goes on this route, he could load up the file into an optimized structure in memory (maybe b-tree?) at the start of the day and then just query his own structure every time. This should be quicker than using an actual database.
|
|
|
|
ETFbitcoin
Legendary
Offline
Activity: 2716
Merit: 7005
Mixero: Privacy by XMR (Monero) bridge
|
I noticed sentence "Powered by mempool.space and Coindesk." on your website. Have you checked whether those free API actually let user check thousand address within short time? All depends on how it is going to be used. If you want to test a bulk of addresses from time to time - then yes, maybe. If you want to test 1 address every few (mili)seconds, it will be too slow, dedicated (and properly indexed) database will be better.
If OP goes on this route, he could load up the file into an optimized structure in memory (maybe b-tree?) at the start of the day and then just query his own structure every time. This should be quicker than using an actual database. Actual database also use optimized data structure (such as btree or trie), although it comes down to whether you can utilize it properly or not.
|
|
|
|
LoyceV
Legendary
Online
Activity: 3150
Merit: 15571
Thick-Skinned Gang Leader and Golden Feather 2021
|
 |
October 15, 2022, 12:21:44 PM |
|
I tried 400 addresses, but it never loaded the results. "Powered by mempool.space and Coindesk." Would it work to replace those by your own utxo dump from Bitcoin Core? It takes more resources than using an API, but won't have any limitations on how many addresses you can check.
|
|
|
|
bitmover
Legendary
Offline
Activity: 2142
Merit: 5217
bitcoindata.science
|
 |
October 15, 2022, 12:32:03 PM |
|
I noticed sentence "Powered by mempool.space and Coindesk." on your website. Have you checked whether those free API actually let user check thousand address within short time?
No, you can't use thousands at once. It won't load. You need to make a few each time. Would it work to replace those by your own utxo dump from Bitcoin Core? It takes more resources than using an API, but won't have any limitations on how many addresses you can check.
Certainly this would be the best solution. I believe my next project will to run my own node in an online server. I don't have it now. I will take a look on the costs and what else could I do with it.
|
|
|
|
LoyceV
Legendary
Online
Activity: 3150
Merit: 15571
Thick-Skinned Gang Leader and Golden Feather 2021
|
 |
October 15, 2022, 12:33:31 PM |
|
I believe my next project will to run my own node in an online server. I don't have it now. I will take a look on the costs and what else could I do with it. I happen to have one running, it's a donated Xeon that's meant for cool projects like this. I don't mind feeding you data dumps in some format.
|
|
|
|
AnotherAlt
Sr. Member
  
Offline
Activity: 280
Merit: 259
https://bitcoincleanup.com #EndTheFUD
|
 |
October 15, 2022, 12:52:24 PM |
|
I would say bitmover's project is cool. OP can check if this meets your needs. Running a server for such a thing doesn't worth it unless you use it daily or for your work. You can also check the BitAC Android app. It's an open-source android app, and the codes can be found on Github. I haven't tried the app yet since I never had to check multiple address balances at once. You may want to try it and let us know if it works 
|
|
|
|
|