.

[thallium205]

Hey all.

I developed an online tool that does the exact same kind of operations (grouping addresses together through connected components) in O(1) while giving you the ability to visualize an ownership network that is built on top of it.  For that first address you calculated, you can check out the results by going here: http://blockviewer.com/#/owns/1CjLmm25ty4aSjxzG8Er4qSiQ63bqaQGA8 and then clicking on the "owner" node (they are sort of hard to click on... I'm working on that).  That will pull up all the addresses associated with it, along with other information.

If you think this is interesting, check out my announcement post here -> https://bitcointalk.org/index.php?topic=103609.0
I don't mean to thread jack you all, but I thought you all would find this interesting.  If you would like to check more addresses, simply type it in in the search bar and select "Owner Address".  Then, as usual, click the owner node and start traversing the block chain!

Enjoy!

[1714833707]

1714833707

[1714833707]

1714833707

[Chimsley]

I installed this and started doing some of the examples in the readme file and everything is working until I ran allbalances.

I get this output.

xxxxx@xxxxxxxx:~/blockparser$ ./parser allbalances >allbalances.txt

info: Starting command "allBalances"

info: analyzing blockchain ...
info:        0 blocks,    0.000 MegaMoves ,    0.000 MegaAddrs ,  0.00%
info:   118089 blocks,    1.049 MegaMoves ,    0.381 MegaAddrs , 59.56%
info:   129462 blocks,    2.097 MegaMoves ,    0.722 MegaAddrs , 65.29%
info:   134099 blocks,    3.146 MegaMoves ,    1.060 MegaAddrs , 67.63%
info:   138049 blocks,    4.194 MegaMoves ,    1.462 MegaAddrs , 69.62%
info:   142392 blocks,    5.243 MegaMoves ,    1.844 MegaAddrs , 71.81%
info:   146931 blocks,    6.291 MegaMoves ,    2.164 MegaAddrs , 74.10%
info:   152726 blocks,    7.340 MegaMoves ,    2.481 MegaAddrs , 77.02%
info:   158931 blocks,    8.389 MegaMoves ,    2.733 MegaAddrs , 80.15%
info:   164693 blocks,    9.437 MegaMoves ,    2.953 MegaAddrs , 83.06%
info:   169636 blocks,   10.486 MegaMoves ,    3.182 MegaAddrs , 85.55%
info:   174740 blocks,   11.534 MegaMoves ,    3.410 MegaAddrs , 88.13%
info:   178761 blocks,   12.583 MegaMoves ,    3.635 MegaAddrs , 90.15%
info:   180687 blocks,   13.631 MegaMoves ,    3.811 MegaAddrs , 91.13%
info:   181868 blocks,   14.680 MegaMoves ,    3.968 MegaAddrs , 91.72%
info:   183095 blocks,   15.729 MegaMoves ,    4.125 MegaAddrs , 92.34%
info:   184314 blocks,   16.777 MegaMoves ,    4.273 MegaAddrs , 92.96%
info:   185046 blocks,   17.826 MegaMoves ,    4.407 MegaAddrs , 93.32%
info:   186241 blocks,   18.874 MegaMoves ,    4.558 MegaAddrs , 93.93%
info:   187702 blocks,   19.923 MegaMoves ,    4.754 MegaAddrs , 94.66%
info:   189164 blocks,   20.972 MegaMoves ,    4.931 MegaAddrs , 95.40%
info:   190250 blocks,   22.020 MegaMoves ,    5.094 MegaAddrs , 95.95%
info:   191531 blocks,   23.069 MegaMoves ,    5.262 MegaAddrs , 96.60%
info:   192657 blocks,   24.117 MegaMoves ,    5.449 MegaAddrs , 97.16%
info:   193834 blocks,   25.166 MegaMoves ,    5.630 MegaAddrs , 97.76%
info:   194764 blocks,   26.214 MegaMoves ,    5.815 MegaAddrs , 98.23%
info:   195960 blocks,   27.263 MegaMoves ,    6.006 MegaAddrs , 98.83%
info:   197082 blocks,   28.312 MegaMoves ,    6.172 MegaAddrs , 99.39%
fatal: o2i_ECPublicKey failed
Aborted (core dumped)

This is a fresh Ubuntu 12.04 install with 8Gb of ram. Any thoughts on why I got this message? The allbalances.txt file is created but is empty so I assume the file is not written until the command is completed.

***Disclaimer***
I am just barely above noob level on linux.

[EskimoBob]

I am having trouble compiling.
http://pastebin.com/TrfSecqA

From the README:

Code:

sudo apt-get install libssl-dev build-essential g++-4.4 libboost-all-dev libsparsehash-dev git-core perl

Did you do that ?

I am going to attempt building it in Gentoo.
(most of this stuff is probably installed)

Code:

emerge -atvu1 dev-libs/openssl dev-libs/boost dev-cpp/sparsehash dev-vcs/git dev-lang/perl

[Chimsley]

Cool thanks znort987 for the future fix. I am just tinkering but I have seen other people on the forums doing serious analysis with this tool and I applaud you for releasing this to everyone.

[JompinDox]

sorry for the newb question:

is it possible to find out how many addresses containing over 500 btc have NOT been used since January 2011, for instance?

(not used = not used for sending coins)

[flatfly]

Great, thanks!

Btw, are there any pre-built windows binaries available?

[dooglus]

Great, thanks!

Btw, are there any pre-built windows binaries available?

Nope.
And there's unlikely ever going to be any.
haven't touched windows in 10 years and don't plan to do so ever again.

+1

[organofcorti]

Great, thanks!

Btw, are there any pre-built windows binaries available?

Nope.
And there's unlikely ever going to be any.
haven't touched windows in 10 years and don't plan to do so ever again.

What, you're saying that we just have to work when we're at work? It's people like you that make it hard for me to be a slacker.

[Buffer Overflow]

haven't touched windows in 10 years and don't plan to do so ever again.

6 years for me; and counting.

[xchrix]

great work znort!
is it also possible to use this parser for a litecoin blockchain? i think so...

unfortunately i only have debian 32bit so i have to organize a 64bit server for testing this.

[xchrix]

ok i see. i am good at php coding but c++ is not my best friend i dont think that i am able to provide some patches.

[SgtSpike]

It'd be great if someone could host this on the web, maybe charging a small fee for each lookup or something.

[SgtSpike]

It'd be great if someone could host this on the web, maybe charging a small fee for each lookup or something.

Mmmh, not really : this is designed to run a full linear sweep of the entire
blockchain for every query ... that's truly heavy duty (both raw I/O and CPU).

The moment 5 users hit the web site at the same time, the server will basically die.

The way blockchain.info does it is the right approach for what you describe:
they dump the blockchain into a DB with a crapload of pre-computed indices
and update said DB incrementally to keep the queryable version up to date.

I guess I just don't like blockchain.info's way of displaying the data it finds.  Maybe I need to get used to it more.

Regardless, jobs could be queued, and the resource-intensiveness is why I suggested a small fee for each lookup.

There are those of us who do not know linux well enough to run something like what you have created here, but would still like it to be accessible. 

[dirtycat]

I installed this and started doing some of the examples in the readme file and everything is working until I ran allbalances.

I get this output.

xxxxx@xxxxxxxx:~/blockparser$ ./parser allbalances >allbalances.txt

info: Starting command "allBalances"

info: analyzing blockchain ...
info:        0 blocks,    0.000 MegaMoves ,    0.000 MegaAddrs ,  0.00%
info:   118089 blocks,    1.049 MegaMoves ,    0.381 MegaAddrs , 59.56%
info:   129462 blocks,    2.097 MegaMoves ,    0.722 MegaAddrs , 65.29%
info:   134099 blocks,    3.146 MegaMoves ,    1.060 MegaAddrs , 67.63%
info:   138049 blocks,    4.194 MegaMoves ,    1.462 MegaAddrs , 69.62%
info:   142392 blocks,    5.243 MegaMoves ,    1.844 MegaAddrs , 71.81%
info:   146931 blocks,    6.291 MegaMoves ,    2.164 MegaAddrs , 74.10%
info:   152726 blocks,    7.340 MegaMoves ,    2.481 MegaAddrs , 77.02%
info:   158931 blocks,    8.389 MegaMoves ,    2.733 MegaAddrs , 80.15%
info:   164693 blocks,    9.437 MegaMoves ,    2.953 MegaAddrs , 83.06%
info:   169636 blocks,   10.486 MegaMoves ,    3.182 MegaAddrs , 85.55%
info:   174740 blocks,   11.534 MegaMoves ,    3.410 MegaAddrs , 88.13%
info:   178761 blocks,   12.583 MegaMoves ,    3.635 MegaAddrs , 90.15%
info:   180687 blocks,   13.631 MegaMoves ,    3.811 MegaAddrs , 91.13%
info:   181868 blocks,   14.680 MegaMoves ,    3.968 MegaAddrs , 91.72%
info:   183095 blocks,   15.729 MegaMoves ,    4.125 MegaAddrs , 92.34%
info:   184314 blocks,   16.777 MegaMoves ,    4.273 MegaAddrs , 92.96%
info:   185046 blocks,   17.826 MegaMoves ,    4.407 MegaAddrs , 93.32%
info:   186241 blocks,   18.874 MegaMoves ,    4.558 MegaAddrs , 93.93%
info:   187702 blocks,   19.923 MegaMoves ,    4.754 MegaAddrs , 94.66%
info:   189164 blocks,   20.972 MegaMoves ,    4.931 MegaAddrs , 95.40%
info:   190250 blocks,   22.020 MegaMoves ,    5.094 MegaAddrs , 95.95%
info:   191531 blocks,   23.069 MegaMoves ,    5.262 MegaAddrs , 96.60%
info:   192657 blocks,   24.117 MegaMoves ,    5.449 MegaAddrs , 97.16%
info:   193834 blocks,   25.166 MegaMoves ,    5.630 MegaAddrs , 97.76%
info:   194764 blocks,   26.214 MegaMoves ,    5.815 MegaAddrs , 98.23%
info:   195960 blocks,   27.263 MegaMoves ,    6.006 MegaAddrs , 98.83%
info:   197082 blocks,   28.312 MegaMoves ,    6.172 MegaAddrs , 99.39%
fatal: o2i_ECPublicKey failed
Aborted (core dumped)

This is a fresh Ubuntu 12.04 install with 8Gb of ram. Any thoughts on why I got this message? The allbalances.txt file is created but is empty so I assume the file is not written until the command is completed.

***Disclaimer***
I am just barely above noob level on linux.

Yeah, I hit this too a couple of days back.

Turns out someone managed to include a few transactions in the blockchain
that send funds to invalid compressed keys, something my code assumed was
not possible.

I have a fix for it, I'll push it to the git repo sometimes today.

Fix pushed to github.

Im still getting this when I run allabalances.. 

[dirtycat]

now using a different machine.. I get

Code:

gato@50cal:~/blockparser$ ./parser all

info: Starting command "allBalances"

info: analyzing blockchain ...
fatal: Invalid argument: failed to open block chain file /home/gato/.bitcoin/blk0001.dat
Aborted (core dumped)
gato@50cal:~/blockparser$ 

everything is there.. soooooo.. I have no idea.
not my day lol

[dirtycat]

figured it out.  had my home directory encrypted.. disabled encrypt and all is well.. fun adventure.. btw great tool!

[runeks]

This looks cool. Do you have any plans to add a feature that allows the program to output the total balance for a specific bunch of addresses? Like:

./parser showBalance < addresses.txt

or alternatively

./parser showBalance -i addresses.txt

Where addresses.txt would contain a list of addresses (hash160/base58).

[runeks]

Cool. Just tried it. blockparser reports the balance of the address 991fd9bf50ad8d6a551efceb5c228d21bcc0fe92 to be 200.777, but blockchain.info says it's 351.06501343 BTC. Who's right?

bitcoin-qt says my block chain is up to date (last block was found 8 minutes ago).

Armory's block chain tool reports the same balance as blockparser (200.777) so it seems that this is valid. But why does this disagree with blockchain.info?

[runeks]

Great! Is it possible to read addresses from a file that just contains concatenated hash160 addresses as raw bytes? Ie. 20 bytes followed by 20 bytes etc. I use this format to save space when storing a large number of addresses. I tried modifying the code to do this, but it seems it would require substituting fgets with fread, and things started looking messy so I gave up.

[runeks]

The reason I ask is because I got curious over whether people have used insecure passwords to create brain wallets. For this purpose I've created 1.5 GB worth of addresses in that 20 byte raw format, out of a word list made by John the Ripper. So the reason is that even though there are only ~300 megs of different addresses in the block chain, there are (2^160)*20 bytes of possible addresses using the raw 20 byte format. Having the addresses lined up on 20 byte-boundaries also increases performance, I imagine, since I don't have to do any string parsing on the data.