Bitcoin Forum

Bitcoin => Development & Technical Discussion => Topic started by: 0xYasin on April 16, 2024, 04:20:36 AM



Title: Seeking Advice on Efficiently Analyzing Interactions Between 100 Crypto Wallets
Post by: 0xYasin on April 16, 2024, 04:20:36 AM
Hello everyone,

I'm working on a project where I need to analyze transactions between a list of 100 cryptocurrency wallets to determine if there are any common transactions among them. I've encountered some challenges due to API rate limits and the vast amount of data involved.

Here's what I've tried so far:

Using APIs like CovalentHQ and Transpose.io, but I hit rate limits due to the number of required API calls.

Attempting to track transactions for each wallet, but again, the rate limit becomes an issue with 100 wallets.

I'm seeking suggestions or advice on how to efficiently handle this task. Are there any APIs or tools that can handle this scale of data more effectively? Or perhaps there's a smarter approach to minimize the number of API calls? Any advice or guidance from your experience would be greatly appreciated!

Thank you in advance for your help!


Title: Re: Seeking Advice on Efficiently Analyzing Interactions Between 100 Crypto Wallets
Post by: ABCbits on April 16, 2024, 10:07:21 AM
I assume you're analyzing Bitcoin wallet. In this case, i would recommend you to run your own Bitcoin full node and Bitcoin block explorer with API feature. Bitcoin Core is probably most solid for Bitcoin full nodes, while there are so many option for block explorer. Mempool probably offer most feature[1], but other option such as Bitcoin Explorer (along with any Electrum server)[2] should be easier option. That way, the only limit is your hardware speed. Other than that, your option is using paid API with higher limit.

[1] https://github.com/mempool/mempool (https://github.com/mempool/mempool)
[2] https://github.com/janoside/btc-rpc-explorer/ (https://github.com/janoside/btc-rpc-explorer/)


Title: Re: Seeking Advice on Efficiently Analyzing Interactions Between 100 Crypto Wallets
Post by: odolvlobo on April 16, 2024, 08:28:51 PM
It's not clear to me what you mean by "wallets" and "common transactions". I assume you mean addresses and the transactions referring to them. I agree with the suggestion for running your own node if that's what you are looking for. However, if you are looking for analysis information, such as groups of addresses (aka wallets), you will probably have to pay to get around rate limits.


Title: Re: Seeking Advice on Efficiently Analyzing Interactions Between 100 Crypto Wallets
Post by: bitmover on April 18, 2024, 04:23:48 PM
Hello everyone,

I'm working on a project where I need to analyze transactions between a list of 100 cryptocurrency wallets to determine if there are any common transactions among them. I've encountered some challenges due to API rate limits and the vast amount of data involved.

Have you tried wallet explorer?
It will basically group addresses togrther when they spend utxo together. Easy and good tool

http://walletexplorer.com/

It might help you to find obvious connections between addresses.