Check BTC balance programmatically

[zzyyxx332211]

Hi,

I've got a list (200 million+) of bitcoin and ethereum addresses I need to check the balance for.

For ethereum, I'm running a geth + prysm node and I can simply check the balance for a specific address by calling `provider.getBalance(address)`.

For bitcoin, I initially assumed that this was possible in the same way by using bitcoin-core, so I synced the blocks but then find out this is not possible (I can use `client.importAddress(address, '', false)` but then I will have to rescan the blocks and it doesn't seem a viable solution considering the amount of addresses I have to check).

I also looked into bitcoin-abe and it seems that it will import all blocks in a database so then I may be able to query the data to check the balance (I probably will have to calculate it by summing up all unspent transaction outputs associated with each address).

I was wondering if anyone knew a better way of doing this or had any suggestion.

Thanks!

[1714480490]

1714480490

[1714480490]

1714480490

[1714480490]

1714480490

[bitmover]

Hi,

I've got a list (200 million+) of bitcoin and ethereum addresses I need to check the balance for.

wow, that is way too much

I created this tool which allows you to search up to 465 addresses at once (much more than that there is a URL characters limit to make requests).

https://bitcoindata.science/bitcoin-balance-check

I never thought someone would to search for so many addresses!

The API I use is this one. Maybe you can create a bot to search for them, and make a thousand requests. It might work.
https://www.blockchain.com/explorer/api/blockchain_api

https://blockchain.info/multiaddr?active=$address|$address
Multiple Addresses Allowed
separated by "|"

example

Code:

https://blockchain.info/balance?active=1BTcsMpUYghRt1C1jrgcZ5UUp3CZbcEYyr,1BtCdfQB8q4H8dwTECg2nwbvimUEvFFwqn,1BtCQFw9UJR6E4f18hQ2Wxy7JXw6pLoZio,1BtCpSAJ14d64ZHTqc6uqaLMVXoovTsSXr,1BtcijWNLFdTrqUHwUTmN98xgs3taWCUs2,1BtcszwKy8CAip7cKijiQap95EzpGa7jLP,1Btc52YEBewJDjSRwxX6ZQWncM2zPdAV7i,1BtcU1zFCrGMK6yp68UqiMmaqnmvzxPFmU,1BTCAmZgMYFKSwc3Dc6wPwwkKmnJaxgvkV,1BtCqXxKv5UaQkxc77s6FGwopvxeEk7XVi,1BTCyJFwTj5i318RxfRX3fHyxEMkwKuQWJ,1Btc1Mh2dhrQecznSDLA2Vx6rSWSa8VGVM,1BTC4U8TNPx8GzV83bHfU7z3WM36sx9ZS9,1BTCWw2kqU987ZMmfuwULR6gMD7saQeEb,1BtC5V6DjGKer9FQnki7zpmAUCj3mjbD5p,1BTCaNiobNSBuX2CrX8Vo61d2wJf6c4sa2,1BTC4UUWMkHScH18yk89QxtPRdoEGhDPxs,1BTCR26yWcgZYdarLrbg7Urj3uWjCVSA5N,1BTC16oW8qMHmYQpFrKezTaDBk7uBKgyJq,1BtCRDjQkRx6Xsxz52UWVLbGimXw1iuYRL,1BTCGPrd9AEr2DUKx4V4WPzj2EPsLFHHgP,1BTC1ztaMtZbzV7rx8L67gRn935BFcxfUn,1BTcRWD4dpYGHazLXAStfeb69LyZEw2UuE,1BTChFRXA9G2aYmS7siWZoo87wvugDDMUg,1BtCpsLxTS2t9BAHBhamMSAb5aWnfAxM3Y,1BTC8nzkXQa9eP8nfBzE1KqLnCS4PL744o,1BTcpLJg6JxpFTED1TESMgZTV5Kyg3GcWU,1BTC1oK146VxWHjJJY58LYGHC4BRQTqkv2,1Btc4Adapm74LBcaZ9G3HzbhNG2fbJUbxL,1BTCo2L4EeREqTtxS9uRFoEoeoypZuCzXZ,1Btc4Me3UhgWhkeCph4riB3p1uNMVBCHxS,1BtCX6FJVb3CE39BadUuH5PvkHn7GUR48t,1BtcAbMSLFQ7RFTAPp6bMTdM1NjaFa7p98,1Btc4U4r2qD16GumfCa72DsXBno9uZnc3K,1Btc4MeCQQVVFF6oaGKBcqvqUBJAeo6QkR,1BTC44CWSWqc5BcDbsobPujFWDm7hp2KDo,1BTCDoDAgEdKDxbH5aeHosvt1uPZLR898F,1BTCNQxGQ33jXJgtwQ3wJFgts2sJiLqGdH,1BTChxGs4VpyQsgcr513Bwsqxb6wJvPrkD,1BTC1uFcG1w7VgQbh8a1WMEi7vEXtb2z7P,1BTCo5onte4NYiBd9RxxjipJcYXzALivy8,1BTCNshZtuWwGJrwU1xr6amxcBPx9GpvR8,1BTCNMCF2yD42XRoRrzGTBN9hXyAhDYyKL,1BTCp4v3B2KpfxS6PqvEfmDGjZXxHFZrCp,1BTCP4qPp5rgAUwwF2jkKYkUCf7WRuZ68f,1BTCnNovagwbnbfXaoTmRZu5zKtCAfVRD2,1BTCNCgfRBQyuPbu2MC8WmGBZktCfPvkWQ,1BTCnaz6su4qcfspqpqjfAj63YfirrhYK2,1BTCSZFxcVfnTs4EEqFgUvGYrtbF6AJMm5,1BTCop1fhXKKfuAsF95wDwFCNvEKFfqw66,1BTCNJvKqTBRbkhGTbEJYSAAPLGk3drfVx,1BTCoreV2Jnfqd5TbSNmPSYYR4xeu6d4UY,1BTCoYXP7TKbZQxEeSxrR2dQGnD1QfL8Gt,1BTCGibdpgotdTtMhU71HLqFRbdAQJddnW,1BTCNM3z2V5d2MRqR6MMkAhH9MJWMMHp5a,1BTCsdC2UCdKJ2k5kRUyPobRaZRYEm4eeH,1BTCnbm4QNY2AXmSoy6fJq2MXB6tKwJjoB,1BTCnQMJUsvy9KN95XZDpLgQjEyXdsMpFn,1BTCorrotNQ12TGYW4ViHFxDDWeTjZTvYf,1BTCoSPWTy6hPCnhuj13DoiiRhdCbsjq1z,1BTCte5m8mgLcEhYup4m5SgWtqifq6sHK9,1BTCoKs74QrvFGtogbou33QJT3DQ2GL7MP,1BTCd7C2QawiQ8Dz18mxmj4kF2TnMKWWzN,1BTCoWrnVZPnAJwctEVUNhd3JRBA8FRW7F,1BTCo69sWHQ1tSGCrq9kDBPVVLxFRxweQ1,1BTCTbCuWP2jDuFMUBqKGMULxYBnGGBAgk,1BTCoCtuGTPjyaJMDqXXydroUjk8dzNQDK,1BTCNLLb1QGVE7P5QAjXMqeBqvc3YwALzG,1BTCnUeY41Yvv8odHomWWK8fsGQSdWk4U,1BTCe4rRRHyRUNuMFK4vivnPTArsiGMAmp,1BTCnpjo2Fb1UbC6jRPWJrsW3WDycPHLTa,1BTCoqdK4AB1ZePvpL1Bata39t1TrMw4vW,1BTCNWxePJPrNEJheX9GnwA7NfqVEbKYHQ,1BTCipV7m7ck9aZyhU2HgMpuJSyXgctK5X,1BTCHGyqJDydj3qG92BGxDnJFp979Nsbze,1BTCN7AX3PNsynrPSn6S5LrpeT1sFy14o8,1BTCeQng9hziWCfPkSjDDbmqmDxQoJvWi8,1BTC4ULnnakp9ps65Cd7VN15ct2fuNWjxX,1BTCnQWY3yhD8mD8sxDrfKhN4nZcqgXRNi,1BTCDtXMZWuFcpWaxME8kA3dQc8EuuFtR5,1BTCnjeVS6NSvxR9E8fL8fmFvG37w6b8m9,1BTCFh3Vh5EudnD4nXAGnJ7rUZKG797SFU,1BTCn3xp21AJCSAmNCeGWNjx1rU9Hpg3K6,1BTCffmhreyKp45nL3hLnTiPsrkguZsKoD,1BTCnx7S9Ugf5iZDwFgyMmbAqnTRAP48Hk,1BTCfYvPFzup9dVytREtRtau8iiqrYguVi,1BTCNFihALuqeZ9jPrJqawaj9ULgevFo6z,1BTCnedXAosrYg9kTLSY7QgjBna3e2x1uR,1BTCosp11EscsWogmLwBQizB9mdansqWJS,1BTC1xY3P3Wqkx2k42gcDE8mdeeUGgd9DP,1BTC8HNMH688Qbq5ttaMEH5DQ8qPvTzRjX,1BTCnuNxLkt1iKpx6fQeP7DyjuXv8ZTFRe,1BTCE7eFm2tQTpFRgp8khBaF6crNzME7q6,1BTCFf6z5mqhxvgEAFYer3zyMnq2q5Fost,1BTC4Uh8fMz29jZzT2K1ivhkg8f8vsuSt5,1BTCoFFnL8pNqyeCQtktMQR13FBFAc5XcV,1BTCnwQpELB3KTu7FptEkKswuBYxeQ53Do,1BTCnjRWZkTGmUWWsEjwoBwqQ7ZfTx6JeG,1BTCp4FkykViG2GRDG9vz1ATcqy8Zr9kwC,1BTCfLyTPdQWNSFQWQPdvsETkxo6ip5Uzo,1BTCp1tCnnKFiLRNr5gTPzy4gHFprFS2AD,1BTCFDwJMdjCKJKHD8c9kZewszocBZUPNx,1BTCp6JMgq4pFxE5BHArqppUdbVJXfoYvG,1BTCDPKxa487eSJDudkTfP5G13BMCr8YQ6,1BTCECebmLXcyyjoBmnEUJngEN3Ytw7ASH,1BTC2hMPVS7Humyr8uW7TpFArSGikEdbv,1BTCnkABoNYbo6PyeoTvoETmYQUUreo4pz,1BTCeu6iBEWCEgcsjsEYj3bji24xWVNZ8v,1BTCoSGTd88x1cynB2uMPhdTDyXoWYuH7Q,1BTCouRRYkFNYt2L6ZJD4bEmpGpvZ1o7df,1BTCNNLH7moKQs8kUMD3KL7DwF4tStssLB,1BTCP6Udmc7cjqy4VMXmMKZupkCCzwj7Wk,1BTCogsuwNTnZtoxsoZG9roWTwR7Gzk8ip,1BtCMR53qxXWC8hXortxGEewhH2yTXFwJb,1BTCp8VqfLNf7BXxsnCZa8HTzes2Usakr8,1BTCD9bQFTuS6K8geyZ1zcfYLrYtJiK2S4,1BTCnARXqkMrvuKUrjmEEdwiYZFtaPYADU,1BTCoE4g5CmyUPTRivN2QKs6w4CczLCj41,1BTCNbv455YL157hc8xxFebsm45St6ZXge,1Btc6fDtu4kVq12qUs4udWzTrXgtPJPbTN,1BTCNTMvUASA5iJFbaW2yckgZCKXq5aFT4,1BTCp6yF8524DZracKdPSFmSWkWLU54T1T,1BTCoxZeShbLsj7tgMqdUiwJKhe3HCWBiM,1BTCN1TpN3DcF7fAHHcQkkf84Q4zksHmd3,1BTCP6vyKTFGJWJnU9i6SbzmfCpYZa43Ca,1BTCNKgpqqJDLqWL8grCBEBpW7ZfF7zK5g,1BTCo86PpBTWJhzhHDrqsj6hLSxxyjd1sK,1BTCN7BM1TM7rQjpQ2CHB7wJ31Z6YsvJVi,1BTCNEAyF9R5vwYwRgcrVGXoWAdMFMqXjD,1BTCNYWfPDuiytymBgYQSz2AkFXaWyK3sQ,1BTCNoUGVN5e2hGspABoCcmw1NpBqXrWoN,1BTCNgtJVU3WYJ4XinmhZ3UBGTF4D1DGoy,1BTCFo8MVk5DJ8nuBDNEWr2Y8EE4QV2zsd,1BTCnYfTfKGSMAXcmXCXMoXWJof4vBGBUn,1BTCE7x4sdutuuYhMyBgLMJ217TrgDuJy8,1BTCntKeJZtUqbRb1C6SYgNuhFhF8oZV7U,1BTCoaagu3hu74jRyzCzAoDzmgGbTAPnhM,1BTcJxqNHGtA9ViqmAw4MhE7TxYDV1Nw5v,1BTCNWuSSQa95sQUSUmPjYBTLc533Fc3Bw,1BTCnb7Gx1343nvhoMzHBwzE7o4Ta5sbie,1BTCNnWqDS5wAYeVUGLLnAqB9Dvkgm7Fsx,1BTCnGBQ3p2h2P1ndp6m7STDTUmAV8q3jW,1BTCoWX3U73BT3k6KsMDFFRuWgg8pHxfdm,1BTCoGwE7UHBdvwBRkofjsFkpvUbjhmQ8B,1BTCCJ4R2ZgLgk4ea3nkLuP933gMybgGrn,1BTCFGPV5JVKbDZauRf5GB9zbw9gF7p4hS,1BTChQjJW9zKrZ2dPWZJFjSzu2q74eJTdD,1BTCoBj9vUVASneqdWeA4BrD4kqkDCfZkf,1BTCNRx55r1zhp6JJKE6FAfnhLZEWoMBg4,1BTCNRuT8nevUKQrhw7e6JN379ziw8fQL2,1BTCnbeQzcYzdaFVmJ1kqE1LH58oE2YgVL,1BTCN1zGB6WozUWysBz5XedBsj4GQW3d8g,1BTCN3Zy4fHVaaTVYaL5BDuYfWTiNSk4Kb,1BTCeeQ2p3MoJLiakwg9dtEujBiqxQindy,1BTCNLGfqRiMjFhpoMW81WnEjEs1uoqY6Z,1BTCHwnWjy4gndvyQvovM7VXMXvYKU79ZB,1BTCNr5R3bCDeMTER4PSEWMW6sG1JZEaui,1BTCDFLeD9zwFiTorex8iut7Yee1AmUY8n,1BTCoJu8irtc41HFJsbyrX75bWbgDWbaBB,1BTCNDoe4yXTVKKTic6RiR7JSFat3jpknb,1BTC4U42NDSnYUEKamSS9mXYkv9NzXbT2d,1BTCP72E3mvTayumM6a7p4ZPFyFAwGuqT3,1BTCnW4GbnZGL3zatagtFWTvNgq8iki3iK,1BTCoNqetkRNN55poB7bXjbnYghaxZjbvn,1BTCnq3tauip84PDoodCvPBebDzr1SnL3q,1BTCnLaW6neb4wd7D2yU3kC6fQsSfNctqX,1BTCngFvhM8VBcBMCgc9x4UHXC1QY9deyS,1BTCNCfRmejnHG7PeU9dyZKrEZ2z3yv72z,1BTCE9R4sQTbFcHcQ6tEkcFkkwaH8pNZUT,1BTCnn3qLqeD5DENyU1cTXgTNjaeS5J6g,1BTCNm45Gk7PjuffyU7LgDPVptfcknPymf,1BTCp1WeUybaC19KYY2DSQab3Lx7gygJmS,1BTCT6bG4jSyBoFG1WboYrLQ75TDBcXBBu,1BTCexFHcanGWvVDDYLJzccpLrBKqRfbkL,1BTCSXePxp8x8it5dYui8TWEnoMhj3DEkz,1BTCt9tMJjDsNMzZo9o6n2KPkAbWbJLkw4,1BTCEwA32E1B3atkTuJP37fRstbgA1JpgM,1BTCetk5DRm88L9CdSLLzEFiHqmd9p78vk,1BTCnVZdtwzYfKayAg2zhLuQoKw3RjZuLz,1BTCEwD6RiveP41hu1V6b6dD1cUm4nP76u,1BTCp3FaMG6RfkT3awzYHMyPKbTVJ35MeD,1BTCnKhVwXgkceFxTfRYZ5apCrHqqfFZ9j,1BTCo5ZiDtj3ZkbXUDZtjojjCTECYp455c,1BTCezUrVMEYuMJXLSBpdsedjAaxwhaZYh,1BTCP6uS5zh9GkxynCgRDvVH7UTLrn6rD4,1BTCooe4vdDhGRmZqVDrZtBoxbLLBMV8mZ,1BTCnJBHWc856XxGoAS8dKBbJHWnhnmDFu,1BTCs9Epq3JVaCh8rJDrraN2s71cawYzLT,1BTCTdoNtg6nZCaF2YDkZAAuatBKpvsXHx,1BTCnpeWK9qEJnYqLHA3i6CacESBuCUjwp,1BTCsFvNh6nCLLkN6JwT1XQHSZrgGpJBYB,1BTC7QF2cNwvfK1eaKttZWvR7Afi8VWyUP,1BtczrzmTEoC8wdRFUCKJAyby9HQtMzq2w,1BTCoTPsych6ZRmHjSY2DJePVXx3TdTohc,1BTC4yQy8CUHseuEDqxdXw4swonTiAF7Sf,1BtCpcNsLhj4jaT4CQvrUCSSqJHaTp7xFp,1BtCxzrRRriT9FcKwrYKC96ZDHhrnmiVb9,1BTCorgHwCg6u2YSAWKgS17qUad6kHmtQW,1BtctvrBQiedb3KF2sbzHEb4VsB9VFSKUx,1BtCthWYPedrgj8xCUVs5Kc1vQ3tjwfJiF,1BtCz5GKrNnHn6n54P7c8bwo4PTRrta8vn,1bTCDvcGrFRqhr58jJWWtkHaadA42VhZu,1BTCDhBBCDCbyBFHU5Cme5iTpu8aucnCm4,1BtCPiG2rhCbAubQF5npC65H3cmFe5rpUp,1Btc811p2xZ9d7gsbf2auC9gmRhGjPKoUS,1BtCo1gjrSFBoFGeKDUx36vko2ENE2Riv9,1BTcgcbEAycLppU9biChQ3gy1nbKxjm5Jw,1BtCz38RtEF97kGkMhweUpoEGhpYyTaJ1E,1BTCxpEozN2N9g2WgnL9628ki9k4J7tdpv,1BTCHzfWhQEQwzCnR2piZYSAguFqNJC6A,1BTCZ5VF4q8sGDuHv5u8xbCf953iF1fyvx,1BTCZTFPGfvPvRf9EM9yRvxHnj5K3qQkW1,1BTCYJCBRgFeU2azKxPb7Ka2S4f77r8k63,1BTCy3KeCBpKuu4QxDGRZzGRr95ZwvJdtH,1BTCZPjaXRLgsj91YF18fSD58DXtUPv1jh,1BTCZn7rY3zG3CBJc15RCrQySiD2Fc5d1t,1BTCZR1jGTZ4updV2Dn2JxyqUBsvLd3rnW,1BTCY85iYi1Dk4YHZPdigGLZPsS8k3b4Dt,1BTCzSAkeQS8hjrsJPrNLCCV4sVk3qVhdw,1BTCzYNzwhdGbAccz3dqw2mj5kfsrfLMdU,1BTCxmXVC9hEnkxMVdS44itSyVASYgEjZG,1BTCZE9ZauW8TGhq7iR6nXd1hwS6LqRqpV,1BTCxkRxf1DSmkgNHp5Qpb3fzs48BFwo9X,1BTCZBp99VQ8evRoqnZt6nR2XbpeyC4amt,1BTCzeMDecvEeG1BBQzL3xJtrwiiMh2JU1,1BTCfapjHSwYpR2N7DML2EWfdBrHUuQNb5,1BTCZ1y6cmaLo1caRhFGtNfUi4trQh66d9,1BTCzJxHZbQzAWWHeHYuDv4pRCDTbgq5an,1BTCbwrSnSpq2BK7iMNPhbogs2g7d3nCsr,1BTCyzDPSjjcYikuwLv9gZVVxKS5tBPXQD,1BTCBhGKRZvNDsuJE7tdUMANPFsHQv1wUh,1BTCY9HgiAN8AFzhUdTBmq6BivD3eru41i,1BTCZS5ny3HAu9XQ3cn71mk8KtxPrrsVnR,1BTCcrXXCXmeGZrq1ucriHTeSwNzpMvNsV,1BTCXWBu3nv8zxDhPMud2jRJ6RcHqXf4BZ,1BTCXuSnFZp8b2rHGNTNnTGxt98ckfGta8,1BTCztnCu6fyTRzRe4pzXM9bcoqgfshkUi,1BTCBJpBFjTRvceYF6j6pGbLTBQnwoWygg,1BTCY47Qz84bzbZdiaBBGwXmtFKuBaygbL,1BTCec1hAyPWQcUBH9aXWZ27YYPhuN8WxC,1BTCzfS9f3BmGCz4KLNXUnHPtfKn3saCKd,1BTCz2DBu4jcicmZF8g36PvwPfgT6mtjyX,1BTCDxxRGUDBS7s8vdW9XuBwP9uVzHqUcQ,1BTCyiPEeaaR1dnebpY76rECo6Cs8sib2w,1BTCbLpHVs3EsDodM8rnaZxu6LbrQ9D6M5,1BTCxRjMRVMTjExXNw73HkCPu6voJNpc5N,1BTCxtiYFpMR6j8YUoAs3Cx2f1xawwy6oD,1BTCy373NgDa1GMQbvFbHZX3w5j8qrKLY2,1BTCc6QtKNbV8eED1XsV1HXWr3m6Mvh1B9,1BTCxQPSAYQ5ATuoFPCpgEfmomqrC4sj5b,1BTCGiuTFqPx2nAGMBLpGnPW3Sdp4FbQNq,1BTCY8GqKjAKBrswd8PFHp7jHzgFkT3QKm,1BTCYXoFWdgQC5T1wu85MHYopamk1avKYh,1BTCza9NW7YN6ewxPvjGcrC3nfwXC6buUj,1BTCGZC1nvb7NkQB3yLj3dWnTajDXJWUmy,1BTCyTCaKmZdAs8QoUD5TrfDH5Ycghyj4W,1BTCYELGAvdvAthEomkpQauY8Rbr2uCeVb,1BTCAZVqBQVUPUjwp368thjANhx171MQZm,1BTCYDp1wwbceLh4kokjdy4N6h2HGmyDtA,1BTCDXZKkvYuAFth5FrSjhfzsz5bwbj26U,1BTCz7VnxYx2XfArR8q4JD4GnEGbyikp62,1BTCzbSWjeiDTEjuRsPsY11oA4Vo35KWXy,1BTCcnanFG2P4f31P5n8ofA5gEJtd8qrdu,1BTCFA2AgMYQbwwjgEuevgguK4CFN9FkiP,1BTCSjSyQDjZHckxRYeJg64KM4RcEGxgfZ,1BTCyrmeZvQdSf1vSa3pNM6HcaMYeRWJAg,1BTCgoQeS9hjskhsYN5VZ5aRpavh1aFrFd,1BTCxoXkSBZ45F175KMqkUS4VizW8DsGGN,1BTCyCE1e85wTDiAV3upqV1sBravpRmep7,1BTCYyUiARNK89csuSYXT7H6eCKJXXZLHt,1BTCxRoeTqsQph5zyQiMKNqzdNAoV4KJKW,1BTCZ2b8aUzCiDXLJoR1bBj5hehMzj1UBr,1BTCDgatwjFhhgT3KrqKWLtDPhEHkQSo9m,1BTCxYpwL5y2zcXaJbv7Za4uXxD6SNN7FV,1BTCG9aA65dxx4U2NNZLRh14Li1M14ck2a,1BTCXSo4zhYgajqttkW2QFy3qRx4Uyx4Vc,1BTChMmaaG3cHB4dVDeMgrPUwBCx9Q6wX8,1BTCzx47qwzsvNt8vUGueY4UrAAC8cY9Y6,1BTCzADKe7jCmJz2Ug9MQ9ELybgxqpsGwP,1BTCFMN8CyrFJnw61EgAhY5jpvwJwx3Dxx,1BTCFjdChwbzE3He25ECrt6L68GJRhrTBm,1BTCyKpM6XuaFk7wqQcgp9HssujZ5jbvDi,1BTCYgq2nFDmwd1AW5AWA2QWDzxoYssLFf,1BTCY1FHGanUpXsXBdSD3UmZqLqjoLXvGs,1BTCcF9UjF3aAVwtGsUTDnDMGnEC9sp51f,1BTCXNGwbgk2vJP2FvnAp2bttbfKcAdPFp,1BTCaWLcmwxNT6d5ePUd2FHbuwWRuLNnZX,1BTCdMaqY6SqJRi5w4Ets9MJa9wxVfVAd7,1BTCCJgss4gG1yBh6eR16apuirQDFRwCx3,1BTCdEEVmcr4oWS1JvDdapwCuD9nYdW2ay,1BTCadaNzTMrYQu2R9Fa3RsFsSdfHckTDa,1BTCxQj8rNuKxMdVm5iqHGCPZbPAXCvzyY,1BTCXUXkmFvHa28rNck6YmNYSRpZgnJ6oR,1BTCXs69VkAso9jgAVgBecyYdbRbd8o3Ca,1BTCfGhNg2ndz7DRejv5QW5R72s76T13s7,1BTCyafFEf3gmBtYyKsDoNnFhd8XpqMDsN,1BTCznkj65Dj7YB91TJFeGrm5irt6Knzju,1BTCykc3mktJgoqsghsXZKYXShp76QYyYs,1BTCaRbo8fuvg8yGfHEC4hoKUWmdBpFnyk,1BTCYcXSuyjiCqdQJJRuvotxd5e7izVdKN,1BTCGrGTWjjG3TzwBLaWqRKBxmn1YaxEYb,1BTCf7jU1Ds4aWBD9a1gKgnSa97LeFFcs7,1BTCyh9dsNsuez1Tg9yw4KprAoqdY62ZWz,1BTCEm8N2UuvGjeFr2sfcr75ZAsNwBdf37,1BTCfs4NTHX2HyYbzht7Ahs5FVSNzj9Qmt,1BTCB9TuCG6dc8EG1JbK39YGYkcfehfsQm,1BTCCPwxtxYo2FAJy3mD5mJLV4vZ8itaf1,1BTCxnyGTAmH5bg5Unx7bYcQrpR49Vf4Gh,1BTCY5MuiFCTwwKjP7QqPYDKsz9ZNYsJma,1BTCzxsjdhpizPUCGn4uCzqqN3apRfT2Xa,1BTCZTtR7jk7xoztyeGdnHVNV3cPDSTTso,1BTCZmtKZiiTt5frQUGjhWDo7GKPXFQg8s,1BTCXZBddeYv36psU8LfZTLoH9ZLXJJgoX,1BTCyCv6GMZVYSfeMWj8Lkpq2RnqFq2v7R,1BTCbS3omyEzW43W3MWw4WMN9LKLG1yHn6,1BTCyo5LJYiHM16bingxSavNB2BhTDfZ83,1BTCXMHxTtrcmmiWENE3jwBvHjvcLgm178,1BTCyRazBLQ3Ap7VzYW4XVNa8Nwe78RQ8T,1BTCzKayZEiyA2e8uhxsxvvFa5jtf7Eguu,1BTCT1RiaiU6SsmTPMt5y8zwmGtd43TtUT,1BTCYVnV3naf45kZex8TfVGLA2zGNDnb9r,1BTCYLi5m8oE1QQfxJvU5tGzPJ2rsDwo2u,1BTCbbd33eGFrLqYNm8Q4bLmENnEWLxrqu,1BTCDF4GU5wu78MYzPc6hL3RcoxKaavVqX,1BTCYtRGLkJPkZJ5RoumxBfWNxioYfBQvw,1BTCYN1uWv9hw6E46FzDD59K73iNBK2bh,1BTCZ3wK23PM84LNAsGxRZhTFQoeWXjhts,1BTCAsE9Kz3MBVZRemp1jc6eoxU8DYqY1R,1BTCBHtJzWznSvWJt1fzGiNo8UqV3YeVJa,1BTCyacpATkdQR4Vrj6FfNR9hkm1JFEfJW,1BTCzb3JnteRS6jUkASTH5K1PX2wQrDDaw,1BTCYZ6jPTzZF1aQLiT2EJpdNQtoCJqFWy,1BTCyx5iYN6mXKnSQatCBW6Ja73D3Xxhqr,1BTCYs74SojfjcU8CQJziUZtB4Pd2biKhB,1BTCzEE9FvSauPmX12m7grakSvz4z58VK7,1BTCCNULEdd6MCkuQVtk9ssyaN2nSkREXH,1BTCXnrXwdU4js2XsnpRx3177GPPZEHjA2,1BTCFTtNkPiRqT8MvxKA4SbBnnRa3XW5Bw,1BTCys2N8ZxtuUTt29todf23GMVtMd4otx,1BTCC8GFVCpKyNgN433t2P8FLrR794yAHa,1BTCyX1DdyqTNJfy4m62LvRE91vv8whYgE,1BTCEwGLPfGRPW4Ht7eipv4VnHEdtLUEAN,1BTCzxsHKoWvU6GR1rB6j6EgnYLpkM7msz,1BTCZSURJGEkwdovv3JmmWSZNVwpK4RvYq,1BTCY8AJpAK15fZ6Am151WoF8YJV5pYn1k,1BTCfPjgygU1vCjoFZEw6uQw4nPd5ZA4pM,1BTCDYWfEzdLKW7GnnDAHM2GBs6jiecthd,1BTCEB7uuPrR3djy7zACRWUM9Er6H5MLGi,1Btc7yBkVFkdbuTYfY6V2uhmcRgxUropQd,1BtcNfBUWdzm56quYAqLiPCPohPgjorTTW,1BtcbBwjGPTcYevb4Rhj2qD1n4EEk7jes5,1BTCoosGr6h5R1UJsTCwWeStZta21QzWuw,1BTCLxAwXSeJkkzVAxuYmytRX1L5wWhgf3,1Btc6M5579CfFcpSPCjVJLMJhN6JWMVjRN,1BtCMeEH3J3bA2mqPJfJbgENXw33P518GX,1BTCA3A5xuN6NoM6STcak3L5nPGE2noAKx,1BtcRmkRYgCQkaKFwEKMUCdPSrM7byHDmZ,1BTCxxZDkhd3RzJMeMF3goRpAU7Gkcwvtb,1BTCUSDiHhv5K6jXP5yvG7kBD1UmXrE9n3,1BtcDqdeTDBoNN15aKYLNFmjLE1i4EvjTq,1Btc4XDq24Mzn15XmNwy4YFrq9MCFQfNXk,1BtCGrfECJhaqMSwf3QEFDPGTCL3Ypavsf,1BtCArFQHHfQm2FuhtQFVVAjkri25UG1FV,1BTCJdyG1cJkpyWRgLo3cWRece9yt8RAJJ,1BTCSimyEjHmwEwKGQoS7Te9sNLJkDW9NM,1BTCa2A3ETKra3GwmdrCdFYFNZJrbJPhLp,1BTcohYjAfN8i5b4ynUywHsGCmcAh9N36U,1BTCZkNAnCCVTz17soEunsxdk9eC44gJ5u,1BTC7tp2h5MCs1aXm6DBYGFfghF6Xjupu5,1BTC98qt4fdGTbyxR8Y7yBVdUcZNN5aNtx,1BTCisEcQFpyh4gfFcDxWUC3WxF2TekP4x,1BTCfmCJvpFfYubwCs51zd5UVgQkAx72bz,1BTC7ugVgstTsnEvyVB1wHixFHheCiyzpD,1BTC1jARFVTf854zYoufbgr4dy7F2QSg9Z,1BTCiZQrqKVpURJob82YDRWtRgw9XRn2c8,1BTC7KWw5auoe9PK5c9oyK6rUEgrDXh2yV,1BTC1UxuZ28ARdwZhNpFNyhjxu8KYWTDKR,1BTC3mTE6JmLcZ7q6nysy3uPQLEneqH1H7,1BTC24nH2FpmhYBGxmB6XivBYqqEKr69gH,1BTCaJMt7S9d1uV8NHT2hKRqWzUyFEGvyX,1BTCFon7fCUwv1XFVzabLyzXxow93mHjkP,1BTCHm8bJM3JehUgGs9TcgjBv3fLULf5e5,1BTCafxFV53JVHN3wpNDqXiFsJmVTcdBC,1BTC5px1LaXZnv9Kyqq7JWvGsiXRBLGitv,1BTC8RmFKqMd4NzZKDFtV2ynybqeRRbu5H,1BTC1TSAFFHYvEHMdFY5J7YX3dS1jvkZBs,1BTCHBTQ6YGKx43RwEnQz3u2HJke9mmxNK,1BTC62yq3Q8DWEtpPeDcNq24Jj9DfkrZm2,1BTC4VAdxKcxXmMo3yd7y4CGSRMsmHkWEu,1BTC27KGjsfPhsokjhnXtMQ2r1WxD1mmez,1BTCZSJKW4X3aX2mLUVGBGkJBQ8SSgt5Ci,1BTC2ccTuGtXYYtpUFKCeULEMpuesUpB7v,1BTC9vHhvnv1ufNdvp6JZTNZRXpXwGnozv,1BTCaMGgPBd9gjfuQ9hjaPXFiVuTrBtiAo,1BTC3tuzxcRES3sukEwZ7hrdayppMh3TVb,1BTCFyyDwDZxKXTj2EkAPtA8WgDbnXyjq9,1BTC1janoNsbus9cEWC8LFyEqanyVGbUBA,1BTCH3tRNhMFNyQwJUDdq8uw7s89WDwryS,1BTC6dbsVrPmCd6E2sonisX9DwcEEDGeww,1BTCsJbxiwStk9qUoBMD8Z9GkpEZsSMq3c,1BTCERqXD9hQXyMd2n1cMtQBsfPS4jb3YL,1BTC1MDDFcL44qQTTAqp1VMYgwwVwuSXyM,1BTC35oth6cCb2XMUN8k8McPjANfzMaogW,1BTC5k69Lk5c5gZM2u45cfskCN2BMtjw8j,1BTC3tLVQka8Pwzd9GTcm9yPN6DXei7dND,1BTCHa5ZgYVZnzN1cPMUhfW7EJkGZwCh8R,1BTC9F4mFJhkgTM7cTRKbckVh5kEUCHuGh,1BTCfNT2uenV6cm5Eeh8ErRpb5nJdAjnMx,1BTCTCjgkkd9vuYM2a6y4QdSdzq5G1sBVB,1BTC4bUN7hS7vQLZu7KJZzXz6ePuicb4Jo,1BTCsc75XNEiv233AZcVMDpZaM9X4faf4p,1BTCA7dsmUknExif2NZWU9HQvUeKrd8ooe,1BTC4WKYeUNWdcxJZjANDuzGAkpez1Ncun,1BTCG3Pi9xprqwJ7sZS8oqqAhGkvbxQC9d,1BTC1pKNx1b9et2u9UHqHMSPLUBqaeoFqJ,1BTCaDN2hJvvYmGjAku4bSWuyYA2zRhEKq,1BTCDcGiMJQkbWeKvZmBMye17QkWxrHVyB,1BTCHngH7KaZ9RGCSUXzpCeyr5kWGpEVrD,1BTC55Zj4e5cDwtag6ct5CRaupNSAFXnxu,1BTC5JvYVQ44TwbD1AJgQNPQwoMqFCSTmw,1BTCaFcLm2raQC1d8yzZh2pC4ptVMnSBNa,1BTCFGxVeQAXv9fyFHHxgxiP4RdRSMHNos,1BTC7G7eqt6TGjD2UsW5tHhXqw4ebktBd8,1BTC1dZzLWrA5tsSNAnTJnvcVVbVYo3h5k,1BTC5ExVpg4WFJ72NTT2PFSVidMBqtZq2P,1BTCsGuKDRDfSAhesKjiKzULLqqPR1qUMB,1BTC8grBKgfbKKbNW9FgExG8kcvJ8R3SWq,1BTC554KWgeHMWaDkmrZ2bTCZd1EZLkyoH,1BTCFKn8YFA73fjx8cur5v4JSQyZ2LYV9H,1BTC4FZtduRJoeCzYSuQiNmbCq31M8VMZB,1BTCSqWtqYB8FF5JxVUEx64y7KzsQiFFvL,1BTC2uJyNsuTv1t8vptjSHyVRQLKDn4Yov,1BTC4Jtk68UpDoskQtNoS8BzA57EHjqiTt,1BTC1yHPhtDmunJAq1s1vsP8QpDBMtzeDC,1BTC4wVGkfs3EfusJUe25tTJeW4KESHbki,1BTC9DceEUf62x9DMorXYd2PJvPJv7PLqy,1BTC8Hncoz67qD8u2xSSQSVyvSiCAmsFv1,1BTC7rBa7vBN8BDvGStk7tffcTGsXmXDkC,1BTCt84AxRJXXYbvYNjFyRm3AYXGnPdXgj,1BTC3y7VHrTofTpo6UUGoejW1E9oTduUdF,1BTCABXki7WYJayvtYL27Kkp3gyNEdi15q,1BTC1kzdwyiFw6D2SpX9JraXDTN2baMmqg,1BTC14Fwv4LG79WzNa3zj7ZvT9MwXJb31F,1BTC54bboLy2UojeWGEHFQ3LFZ1jHpzgoA,1BTC12247roTHXCdNddpQ1hHbDKSj7hMMb,1BTC5eS1sJ9KZwJASRFjZCjckurjk8Lf1b,1BTCt1SXELwhDt6REkjBNTEGz8W4JXtjFn,1BTC3zAf66WYGVF9tFDVHhVxLPtef929TW,1BTCGmh5tM54j1W4FhzaHuiVxkKtfE7C3,1BTC9sbBWwDiAR4qAGFkMyeEvfGj5vjWPo,1BTCA8YVj8Bq1YL28mRq7iRLh393RrowwX,1BTC2QnkYwXJGe15GEcwHiVWojdY5hAoS3,1BTCDXvGNj6QJ6qV4FGZnt3DqmgGagsUxY,1BTC1FCazi3saNmLCNbaMDFJP3bN9nYBiS,1BTCC6APaUGqVeDd8SseE8QLVkGETwrvF3,1BTC2Kan19L5LTdG4wRJRTb2xyfPXFEJxB,1BTChwPbLTqM1Ey3st1j69t5kUFMyD4Wxg,1BTC472YXDehT2e9vY9jNogVksTRo23oHh,1BTCSfhMjVLBLvQcpjaEdiKSi15ctFa6sU,1BTC4CUnSrozrgxtpU6v1Twk8U4zykUfEn,1BTC1LL6Sn6smJfM9JxGdvYZb7kUbsRNU8,1BTC3goEJfLu39kUBY716ZFSNNCpXfReqv,1BTCBYNFhgxaamKqMvRoKDGXFU6azBV3Ui,1BTC392SSsS4mJgn6YqznBwYhiY1rk3bv8,1BTC7Uy72eJgVQ7L5gFM6oA3is1Zp7sTaE,1BTC5rAHZgKrCVGEHSPmqkxX6Wk7cRRUWz,1BTCSmDn3npNHnBujABTGApwjHUX4KMz5b

[pooya87]

Since it is not "normal" for people to want to check the balance of such a large number of addresses (200 million+) and there is also no logical reason to do so, there is no ready and easy to use tool you can use. You should write your own which means a full node with an indexed and optimized database for large number of lookups based on address.

Other than that, you can use available old snapshots of the blockchain such as the one that blockchair.com explorer provides (can be downloaded faster from here: https://bitcointalk.org/index.php?topic=5254914.0). Then write a script that looks up the balance of each address from that snapshot/list. I believe their snapshot updates daily, so it is not that old.
@LoyceV also has a sorted file which could be used to somewhat optimize the search (eg. using binary search).

[LoyceV]

I was wondering if anyone knew a better way of doing this

Yes
Step 1: Download the latest list of all Bitcoin addresses with a balance.
Step 2: Do this:

How to use
The most likely use is to check a long list of Bitcoin addresses for a remaining balance.
On Linux, use this to find matching addresses (after extrating the compressed .gz file of course):

Code:

comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | sort | uniq)

• Bitcoin_addresses_LATEST.txt: the extracted latest version downloaded from addresses.loyce.club.
• mylist.txt: your own list of addresses, one address per line.

This takes only seconds to check millions of addresses. If your text file has Microsoft formatting, you may need to use this instead:

Code:

comm -12 Bitcoin_addresses_LATEST.txt <(cat mylist.txt | fromdos | sort | uniq)

You can do the same for ethereum, but I only have an old list of addresses.

@LoyceV also has a sorted file which could be used to somewhat optimize the search (eg. using binary search).

"Somewhat optimize" is an understatement

[apogio]

Let me just say something. Not for OP, but for a friend  

If someone had 200+ million addresses:

1. trying to find if these addresses have a balance and spending from them is considered stealing. Of course it's impossible unless he they had 200+ million key-pairs instead of 200+ million addresses.

2. finding a match between these 200+ million addresses (if they are not known to be funded and are completely randomly generated) and the addresses from the "List of all bitcoin addresses with a balance" is not as easy as it seems. The address space is huge. The addresses are produced using RIPEMD160, so the number that is produced is 160 bits long. This gives a space of 2^160 ~= 1.46 * 10 ^ 48. Your number is 200M = 2 * 10 ^ 8. I think you get the point.

3. trying to trace these addresses is considered at least unethical.

[NotATether]

For bitcoin, I initially assumed that this was possible in the same way by using bitcoin-core, so I synced the blocks but then find out this is not possible (I can use `client.importAddress(address, '', false)` but then I will have to rescan the blocks and it doesn't seem a viable solution considering the amount of addresses I have to check).

Zpywallet is designed to crunch these kind of things but the full node connector is very slow because it scans all blocks for transactions. Currently I am trying to speed it up by not parsing every single transaction.

Blockstream.info's endpoint does not have any rate limits AFAIK but I would not advise you do this with 200m addresses as you will get ban hammered quickly.

[LoyceV]

1. trying to find if these addresses have a balance and spending from them is considered stealing.
~
3. trying to trace these addresses is considered at least unethical.

Trying to do something is not the same as actually stealing. I'm not worried about ethics when there's math to protect me. If it's unethical to check a randomly generated address for a balance, every new Electrum wallet installation is unethical too. Most people don't seem to realize it, but they're "brute-forcing" 30 addresses! And that's totally fine, they won't find a thing.

It's a different story when checking brainwallets: there's actually a chance to find funded ones. You can bet many people are trying to "hack" them.

[apogio]

Trying to do something is not the same as actually stealing. I'm not worried about
It's a different story when checking brainwallets: there's actually a chance to find funded ones. You can bet many people are trying to "hack" them.

Of course checking is not stealing. Only spending is stealing.

How do you know if these addresses are produced by a "brain" key or not?  Or a dictionary perhaps

[LoyceV]

How do you know if these addresses are produced by a "brain" key or not?

I don't know, but it doesn't matter. If someone creates his own private key instead of using a proper random generator, he should know his funds can be stolen at any time.

[apogio]

How do you know if these addresses are produced by a "brain" key or not?

I don't know, but it doesn't matter. If someone creates his own private key instead of using a proper random generator, he should know his funds can be stolen at any time.

Haha we re saying the same thing. Of course his funds can be stolen. But stealing them is not right. That's what I am saying. Anyway, I think we agree on everything.

[LoyceV]

Of course his funds can be stolen. But stealing them is not right.

There's also no point in pointing fingers at someone who may try this. For everyone who creates a topic here, there are probably hundreds of people doing the same quietly. Stealing is bad, but "be your own bank" comes with your own responsibilities.

If everyone uses properly generated random private keys, all OP does is prove to himself that Bitcoin is very secure.

[pooya87]

@LoyceV also has a sorted file which could be used to somewhat optimize the search (eg. using binary search).

"Somewhat optimize" is an understatement

Well, considering I've never tried it I can't confidently comment on the degree of optimization. I've only used the "regular" list a while back to try some stuff out with some addresses that I only had a fraction of the string. Let's just say it took more time to compile the 10 lines of code than to get the result

[LoyceV]

I can't confidently comment on the degree of optimization.

It's very difficult to beat the performance of a standard Linux CLI tools.

[JohanM]

The best way to do would be to convert the actual Bitcoin UTXO database into a SQL database so you can search it.
This database is kept on every node but it is a LevelDB database that can only be accessed sequentially.
So you need a translation software to read it.
I made one myself in Java. It takes about 1 hour to convert the full UTXO to a MYSQL database. It's about 24GB large when only a few fields are saved (addresses, balance, block height, txid). It contains 162 million records as of today.

You can then do a quick search to see if a specific address is in the database.
If found you can easily calculate the balance by doing a select count(*).
Running the queries would need a pc with a very fast random access SSD and as much ram as you can spare (think 128 or 256GB).

There's probably a few projects on GitHub that convert the UTXO.

[LoyceV]

The best way to do would be to convert the actual Bitcoin UTXO database into a SQL database so you can search it.
This database is kept on every node but it is a LevelDB database that can only be accessed sequentially.
So you need a translation software to read it.
I made one myself in Java. It takes about 1 hour to convert the full UTXO to a MYSQL database. It's about 24GB large when only a few fields are saved (addresses, balance, block height, txid). It contains 162 million records as of today.

For OP's purpose, he doesn't need all UTXOs, only the balances. There are only 51 million addresses, so you could reduce the size of your database to 8 GB.

You can then do a quick search to see if a specific address is in the database.
If found you can easily calculate the balance by doing a select count(*).
Running the queries would need a pc with a very fast random access SSD and as much ram as you can spare (think 128 or 256GB).

How fast can you check a million addresses from this database?

[mullick]

For OP's purpose the amount of time it would take to parse a fully indexed chain into an sql database is probably the same time frame to query that list for all 200m+ addresses. In the long term the database would be the way to go though imo. Plus its a great way to learn more about the protocol.

I'm guessing OP set keypool=200000000 and now wants to check for collisions 

[ABCbits]

The best way to do would be to convert the actual Bitcoin UTXO database into a SQL database so you can search it.
This database is kept on every node but it is a LevelDB database that can only be accessed sequentially.
So you need a translation software to read it.
I made one myself in Java. It takes about 1 hour to convert the full UTXO to a MYSQL database. It's about 24GB large when only a few fields are saved (addresses, balance, block height, txid). It contains 162 million records as of today.

You can then do a quick search to see if a specific address is in the database.
If found you can easily calculate the balance by doing a select count(*).
Running the queries would need a pc with a very fast random access SSD and as much ram as you can spare (think 128 or 256GB).

There's probably a few projects on GitHub that convert the UTXO.

At this stage, IMO it's better to run self-hosted block explorer or electrum server which already index for UTXO/address where you just need to either,
1. Use their API to obtain balance of address.
2. Access their SQL database directly.

[WhyFhy]

Ahh the old collision checker. (possible yes, probable no)

infinity/200,000,000 is still infinity.

You have much better chances hitting a solo mining block with a proc or playing provably fair lottery on freebitcoin

even better chances getting struck by lightning.

Do the same thing you would with a barcode scanner for dvd's.

rate limit 10-30 a second depending, if something file it. if nothing ignore it.

check it out in a few days and learn your pissing in the wind.

modify JLVS to scan realtime.

Lets say you do get a hit , what are you going to do clean them out?

even if there was an asic keysearcher chewing out quadrillions of keys a second you are wasting time.

the only way this could be feasible is knowing the keyspace. even then odds are shit. https://privatekeys.pw/puzzles/bitcoin-puzzle-tx

Personally, I wouldn't waste the resources.

https://vanitypool.appspot.com/availableWork solve these at least you have a chance.