Crypto.BI Toolbox - Explore blocks, transactions and addresses locally

[cryptobi]

Hi, I've developed a simple set of tools to explore blocks, TX's and addresses locally, without the need for an external API.

Here's a sample using test data* :



How it Works

It imports raw block files (blkXXXXX.dat) files into a local database using a C++ layer that is linked straight to Bitcoin Core.

After the data is imported you can write any sort of query you wish, build custom apps on top of it and so on.

Use Any DB

The database interface is abstracted into a DAO layer so you can easily implement a different underlying DB like Neo4J or Cassandra. Right now I've been playing with it using MySQL. The MySQL layer is functional in this initial release.

Python Scripted

A separate Python implementation is provided so you can explore the local DB using some example scripts.

Since most of these functions don't access low level Bitcoin Core functions, this part of Toolbox is independent from the C++ code.

You can roll your own Python scripts easily by simply writing code around the DAO. A base implementation of the DAO is provided. Other language interfaces can be easily implemented by using the Python layer as a prototype.

E.g. This reference implementation can be easily extended to run analysis using Spark or Hadoop, for example.

In Sync with Bitcoin Core

By linking the C++ tree straight to Bitcoin Core, the code is always up to date with the latest BIP's, new block formats, forks, etc.

Code / Docs / Meta

Github

Documentation / Toolbox Home

License : MIT

Hope you enjoy playing with it!
Regards, Jose


* Perhaps you noticed that the genesis block didn't display any transactions on the provided screenshot. That's because during my first tests the genesis block was inserted by hand and not parsed from blk files, so it was left empty on my test data (TX data not imported). Don't worry, when you import the blk files Satoshi's very first coins will be shown correctly.

[1714018361]

1714018361

[1714018361]

1714018361

[1714018361]

1714018361

[1714018361]

1714018361

[AltcoinBuilder]

nice! thanks for sharing.
is this an offline tool and we should updated dat files right?

[cryptobi]

nice! thanks for sharing.
is this an offline tool and we should updated dat files right?

Hi, thanks for your comment.

Yep, offline tool.

But Bitcoin Core, of course, must be online in order to receive newer blocks.

Toolbox itself doesn't use the Internet at all, you can run the analysis on a separate computer/cluster/etc.

[songsunling]

Great!

will this support bch or bsv in the future?

[AussieHash]

Nice work 👍

[taserz]

This might be one of the best open source projects to explore the block chain in years!

[R.I.U. iol]

This is really nice. Is there screenshots?

[Pmalek]

Is there screenshots?

Read the documentation that is posted in the OP.
From https://crypto.bi/tape/toolbox/ you can reach the getting started guide > https://crypto.bi/tape/readme/

[cryptobi]

New tool added to the Toolbox:  Encrypted Cloud Backups (ECB)

https://crypto.bi/tape/ecb/

ECB mangles filenames and uses strong encryption before sending your files to Amazon S3. Even if the repository leaked somehow or was hacked, it's impossible to know what the files are because their filenames and content look like random noise.

I used to use this to back up wallet.dat and other sensible files without using their real names.

[cryptobi]

Just pushed a commit for toolbox/db/blocks_updater

This tool should be kept running in the background while Bitcoin Core runs. It'll insert missing blocks, TX's, inputs and outputs into the local DB as they are committed to the block files.

Docs: https://crypto.bi/tape/updater/

[DougM]

Just pushed a commit for toolbox/db/blocks_updater

This tool should be kept running in the background while Bitcoin Core runs. It'll insert missing blocks, TX's, inputs and outputs into the local DB as they are committed to the block files.

Docs: https://crypto.bi/tape/updater/

Very intriguing!  Unfortunately most of the links for tape are currently broken.  Are you still working on this project?

For example these are all broken:
https://crypto.bi/tape/toolbox/
https://crypto.bi/tape/readme/
https://crypto.bi/tape/python/
https://crypto.bi/tape/python/

[unsigned_long_long]

Nice work!

I will try this out since I'm already running a node and I don't like using block explorers.

Roughly how many extra disk space does it use? I presume it needs to store an index of addresses.