pbies (OP)
|
|
October 12, 2022, 11:03:33 PM |
|
Is there a way (API?) to quickly check balance for thousands of public addresses? Locally (Bitcoin Core) or via any market API?
|
BTC: bc1qmrexlspd24kevspp42uvjg7sjwm8xcf9w86h5k
|
|
|
|
Sarah Azhari
|
|
October 13, 2022, 02:33:09 AM |
|
That site uses a captcha, look hard when opening using TOR. I found another one that doesn't use it, besides that not only bitcoin, we can check also the balance ETH, BCH dan BTG and set a delay if check a large number of addresses www.homebitcoin.com
|
|
|
|
PawGo
Legendary
Offline
Activity: 952
Merit: 1385
|
|
October 13, 2022, 07:18:28 AM |
|
Is there a way (API?) to quickly check balance for thousands of public addresses? Locally (Bitcoin Core) or via any market API?
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. That way you are independent of network connection, API limitations etc. In long term perspective, this is the best solution (of course you need to update your database from time to time). Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.
|
|
|
|
NeuroticFish
Legendary
Offline
Activity: 3822
Merit: 6553
Looking for campaign manager? Contact icopress!
|
|
October 13, 2022, 07:29:36 AM |
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. That way you are independent of network connection, API limitations etc. In long term perspective, this is the best solution (of course you need to update your database from time to time). Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.This is what I'd suggest: a local block explorer that provides the API OP needs. The dumps from loyce.club are big (over 1GB zipped for the addresses with funds) and I find downloading them on a daily basis counterproductive.
|
|
|
|
NotATether
Legendary
Offline
Activity: 1750
Merit: 7322
In memory of o_e_l_e_o
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. That way you are independent of network connection, API limitations etc. In long term perspective, this is the best solution (of course you need to update your database from time to time). Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.This is what I'd suggest: a local block explorer that provides the API OP needs. The dumps from loyce.club are big (over 1GB zipped) and I find downloading them on a daily basis counterproductive. Why not just a database, if you're going to be dumping data and blocks onto the hard disk? But not SQLite or some other db-as-file.At least you will be able to make comprehensive SQL queries, make graphs (using something like PowerBI) and scale to many computers if you run out of disk space.
|
|
|
|
ABCbits
Legendary
Offline
Activity: 3024
Merit: 7939
Crypto Swap Exchange
|
|
October 13, 2022, 11:46:56 AM |
|
Is there a way (API?) to quickly check balance for thousands of public addresses? Locally (Bitcoin Core) or via any market API?
FYI, Bitcoin Core isn't suitable for your needs. It lacks address index, so you'll need to use scantxoutset or import the address on wallet then rescan whole blockchain which take some time. Many block explorer offer API, but i doubt the free option is generous enough to let you get details of thousand address within short time. That site uses a captcha, look hard when opening using TOR. I tried opening that website on Tor Browser and didn't face any captcha or security check Another solution would be to host everything locally - full node, spv server like electrs and then rpc explorer.
Take note depending on which software you use, you only don't to run all 3. For example, Bcoin (full node with address index) or Bitcoin Core and Mempool.space.
|
|
|
|
joniboini
Legendary
Offline
Activity: 2338
Merit: 1805
|
|
October 13, 2022, 01:40:01 PM |
|
This website looks old and according to it, the last update was back in 2020. I'd not use it if there is a better alternative out there. That site uses a captcha, look hard when opening using TOR.
I tried opening that website on Tor Browser and didn't face any captcha or security check I think he is referring to the captcha check before you can proceed with the balance checking, not the web security check itself.
|
| CHIPS.GG | | | ▄▄███████▄▄ ▄████▀▀▀▀▀▀▀████▄ ▄███▀░▄░▀▀▀▀▀░▄░▀███▄ ▄███░▄▀░░░░░░░░░▀▄░███▄ ▄███░▄░░░▄█████▄░░░▄░███▄ ███░▄▀░░░███████░░░▀▄░███ ███░█░░░▀▀▀▀▀░░░▀░░░█░███ ███░▀▄░▄▀░▄██▄▄░▀▄░▄▀░███ ▀███░▀░▀▄██▀░▀██▄▀░▀░███▀ ▀███░▀▄░░░░░░░░░▄▀░███▀ ▀███▄░▀░▄▄▄▄▄░▀░▄███▀ ▀████▄▄▄▄▄▄▄████▀ █████████████████████████ | | ▄▄███████▄▄ ▄███████████████▄ ▄█▀▀▀▄█████████▄▀▀▀█▄ ▄██████▀▄█▄▄▄█▄▀██████▄ ▄████████▄█████▄████████▄ ████████▄███████▄████████ ███████▄█████████▄███████ ███▄▄▀▀█▀▀█████▀▀█▀▀▄▄███ ▀█████████▀▀██▀█████████▀ ▀█████████████████████▀ ▀███████████████████▀ ▀████▄▄███▄▄████▀ ████████████████████████ | | 3000+ UNIQUE GAMES | | | 12+ CURRENCIES ACCEPTED | | | VIP REWARD PROGRAM | | ◥ | Play Now |
|
|
|
|
Sarah Azhari
|
|
October 14, 2022, 03:15:58 AM |
|
That site uses a captcha, look hard when opening using TOR. I tried opening that website on Tor Browser and didn't face any captcha or security check I mean captcha like this, This website looks old and according to it, the last update was back in 2020. I'd not use it if there is a better alternative out there. oh, I don't know that, I just found that link on bitmover post. I don't know exactly what you want, you ask question: how to check the balance for thousands of public addresses. the loyce link only has data address which you can't check the address that you want.
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3458
Merit: 17513
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
October 14, 2022, 09:42:07 AM Last edit: October 14, 2022, 10:00:33 AM by LoyceV |
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. The fastest solution is this: How to useThe most likely use is to check a long list of Bitcoin addresses for a remaining balance. On Linux, use this to find matching addresses (after extrating the compressed .gz file of course): comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | sort | uniq) - Bitcoin_addresses_LATEST.txt: the extracted latest version downloaded from addresses.loyce.club.
- mylist.txt: your own list of addresses, one address per line.
This takes only seconds to check millions of addresses. If your text file has Microsoft formatting, you may need to use this instead: comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | fromdos | sort | uniq) But, that only gets you a list of funded addresses, not their balances. I'll cook something up: grep -f mylist.txt blockchair_bitcoin_addresses_and_balance_LATEST.tsv This is a bit slower and eats RAM: 500,000 input addresses uses 1.5 GB and took 50 seconds. You could mix it with the earlier command to only search the balance for addresses that aren't empty. I don't know exactly what you want, you ask question: how to check the balance for thousands of public addresses. the loyce link only has data address which you can't check the address that you want. See the explanations on List of all Bitcoin addresses with a balance.
|
|
|
|
|
PawGo
Legendary
Offline
Activity: 952
Merit: 1385
|
|
October 14, 2022, 05:50:28 PM |
|
The fastest solution would be to download daily dump of founded addresses (from blockchair or http://addresses.loyce.club/ ), load into local database (for example postgresql) and then have have a program which launches queries to your database. The fastest solution is this: How to useThe most likely use is to check a long list of Bitcoin addresses for a remaining balance. On Linux, use this to find matching addresses (after extrating the compressed .gz file of course): comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | sort | uniq) All depends on how it is going to be used. If you want to test a bulk of addresses from time to time - then yes, maybe. If you want to test 1 address every few (mili)seconds, it will be too slow, dedicated (and properly indexed) database will be better.
|
|
|
|
NeuroticFish
Legendary
Offline
Activity: 3822
Merit: 6553
Looking for campaign manager? Contact icopress!
|
|
October 14, 2022, 06:23:25 PM |
|
All depends on how it is going to be used. If you want to test a bulk of addresses from time to time - then yes, maybe. If you want to test 1 address every few (mili)seconds, it will be too slow, dedicated (and properly indexed) database will be better.
If OP goes on this route, he could load up the file into an optimized structure in memory (maybe b-tree?) at the start of the day and then just query his own structure every time. This should be quicker than using an actual database.
|
|
|
|
ABCbits
Legendary
Offline
Activity: 3024
Merit: 7939
Crypto Swap Exchange
|
I noticed sentence "Powered by mempool.space and Coindesk." on your website. Have you checked whether those free API actually let user check thousand address within short time? All depends on how it is going to be used. If you want to test a bulk of addresses from time to time - then yes, maybe. If you want to test 1 address every few (mili)seconds, it will be too slow, dedicated (and properly indexed) database will be better.
If OP goes on this route, he could load up the file into an optimized structure in memory (maybe b-tree?) at the start of the day and then just query his own structure every time. This should be quicker than using an actual database. Actual database also use optimized data structure (such as btree or trie), although it comes down to whether you can utilize it properly or not.
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3458
Merit: 17513
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
October 15, 2022, 12:21:44 PM |
|
I tried 400 addresses, but it never loaded the results. "Powered by mempool.space and Coindesk." Would it work to replace those by your own utxo dump from Bitcoin Core? It takes more resources than using an API, but won't have any limitations on how many addresses you can check.
|
|
|
|
bitmover
Legendary
Offline
Activity: 2450
Merit: 6244
bitcoindata.science
|
|
October 15, 2022, 12:32:03 PM |
|
I noticed sentence "Powered by mempool.space and Coindesk." on your website. Have you checked whether those free API actually let user check thousand address within short time?
No, you can't use thousands at once. It won't load. You need to make a few each time. Would it work to replace those by your own utxo dump from Bitcoin Core? It takes more resources than using an API, but won't have any limitations on how many addresses you can check.
Certainly this would be the best solution. I believe my next project will to run my own node in an online server. I don't have it now. I will take a look on the costs and what else could I do with it.
|
|
|
|
LoyceV
Legendary
Offline
Activity: 3458
Merit: 17513
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
October 15, 2022, 12:33:31 PM |
|
I believe my next project will to run my own node in an online server. I don't have it now. I will take a look on the costs and what else could I do with it. I happen to have one running, it's a donated Xeon that's meant for cool projects like this. I don't mind feeding you data dumps in some format.
|
|
|
|
AnotherAlt
Sr. Member
Offline
Activity: 280
Merit: 259
https://bitcoincleanup.com #EndTheFUD
|
|
October 15, 2022, 12:52:24 PM |
|
I would say bitmover's project is cool. OP can check if this meets your needs. Running a server for such a thing doesn't worth it unless you use it daily or for your work. You can also check the BitAC Android app. It's an open-source android app, and the codes can be found on Github. I haven't tried the app yet since I never had to check multiple address balances at once. You may want to try it and let us know if it works
|
|
|
|
NeuroticFish
Legendary
Offline
Activity: 3822
Merit: 6553
Looking for campaign manager? Contact icopress!
|
|
October 15, 2022, 01:50:17 PM |
|
Actual database also use optimized data structure (such as btree or trie), although it comes down to whether you can utilize it properly or not.
That's correct. The indexes at least are optimized. But the access to the database itself also comes with a cost. I agree, it's after all up to dev skills and preferences.
|
|
|
|
|