Bitcoin Forum
December 03, 2016, 04:48:47 AM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 [4] 5 6 7 8 9 10 »  All
  Print  
Author Topic: .  (Read 34921 times)
jgarzik
Legendary
*
qt
Offline Offline

Activity: 1470


View Profile
August 02, 2012, 03:12:27 PM
 #61

FWIW the set of unspent tx-out's should fit nicely in RAM, for some time to come.

I know that's not helpful to applications doing historical queries, but it may be helpful for other queries.


Jeff Garzik, bitcoin core dev team and BitPay engineer; opinions are my own, not my employer.
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
1480740527
Hero Member
*
Offline Offline

Posts: 1480740527

View Profile Personal Message (Offline)

Ignore
1480740527
Reply with quote  #2

1480740527
Report to moderator
1480740527
Hero Member
*
Offline Offline

Posts: 1480740527

View Profile Personal Message (Offline)

Ignore
1480740527
Reply with quote  #2

1480740527
Report to moderator
1480740527
Hero Member
*
Offline Offline

Posts: 1480740527

View Profile Personal Message (Offline)

Ignore
1480740527
Reply with quote  #2

1480740527
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1480740527
Hero Member
*
Offline Offline

Posts: 1480740527

View Profile Personal Message (Offline)

Ignore
1480740527
Reply with quote  #2

1480740527
Report to moderator
vampire
Hero Member
*****
Offline Offline

Activity: 574



View Profile
August 02, 2012, 03:43:00 PM
 #62

znort987:

Could you add to parser.c:

#ifndef O_DIRECT
#define O_DIRECT 0x10000000
#endif

O_DIRECT isn't defined on OSX. Otherwise I was able to compile on my macbook with macports.

thallium205
Jr. Member
*
Offline Offline

Activity: 42


View Profile WWW
August 27, 2012, 05:55:41 AM
 #63

Hey all.

I developed an online tool that does the exact same kind of operations (grouping addresses together through connected components) in O(1) while giving you the ability to visualize an ownership network that is built on top of it.  For that first address you calculated, you can check out the results by going here: http://blockviewer.com/#/owns/1CjLmm25ty4aSjxzG8Er4qSiQ63bqaQGA8 and then clicking on the "owner" node (they are sort of hard to click on... I'm working on that).  That will pull up all the addresses associated with it, along with other information.

If you think this is interesting, check out my announcement post here -> https://bitcointalk.org/index.php?topic=103609.0
I don't mean to thread jack you all, but I thought you all would find this interesting.  If you would like to check more addresses, simply type it in in the search bar and select "Owner Address".  Then, as usual, click the owner node and start traversing the block chain!

Enjoy!
Chimsley
Jr. Member
*
Online Online

Activity: 38



View Profile
September 11, 2012, 07:24:48 PM
 #64

I installed this and started doing some of the examples in the readme file and everything is working until I ran allbalances.

I get this output.

Quote
xxxxx@xxxxxxxx:~/blockparser$ ./parser allbalances >allbalances.txt

info: Starting command "allBalances"

info: analyzing blockchain ...
info:        0 blocks,    0.000 MegaMoves ,    0.000 MegaAddrs ,  0.00%
info:   118089 blocks,    1.049 MegaMoves ,    0.381 MegaAddrs , 59.56%
info:   129462 blocks,    2.097 MegaMoves ,    0.722 MegaAddrs , 65.29%
info:   134099 blocks,    3.146 MegaMoves ,    1.060 MegaAddrs , 67.63%
info:   138049 blocks,    4.194 MegaMoves ,    1.462 MegaAddrs , 69.62%
info:   142392 blocks,    5.243 MegaMoves ,    1.844 MegaAddrs , 71.81%
info:   146931 blocks,    6.291 MegaMoves ,    2.164 MegaAddrs , 74.10%
info:   152726 blocks,    7.340 MegaMoves ,    2.481 MegaAddrs , 77.02%
info:   158931 blocks,    8.389 MegaMoves ,    2.733 MegaAddrs , 80.15%
info:   164693 blocks,    9.437 MegaMoves ,    2.953 MegaAddrs , 83.06%
info:   169636 blocks,   10.486 MegaMoves ,    3.182 MegaAddrs , 85.55%
info:   174740 blocks,   11.534 MegaMoves ,    3.410 MegaAddrs , 88.13%
info:   178761 blocks,   12.583 MegaMoves ,    3.635 MegaAddrs , 90.15%
info:   180687 blocks,   13.631 MegaMoves ,    3.811 MegaAddrs , 91.13%
info:   181868 blocks,   14.680 MegaMoves ,    3.968 MegaAddrs , 91.72%
info:   183095 blocks,   15.729 MegaMoves ,    4.125 MegaAddrs , 92.34%
info:   184314 blocks,   16.777 MegaMoves ,    4.273 MegaAddrs , 92.96%
info:   185046 blocks,   17.826 MegaMoves ,    4.407 MegaAddrs , 93.32%
info:   186241 blocks,   18.874 MegaMoves ,    4.558 MegaAddrs , 93.93%
info:   187702 blocks,   19.923 MegaMoves ,    4.754 MegaAddrs , 94.66%
info:   189164 blocks,   20.972 MegaMoves ,    4.931 MegaAddrs , 95.40%
info:   190250 blocks,   22.020 MegaMoves ,    5.094 MegaAddrs , 95.95%
info:   191531 blocks,   23.069 MegaMoves ,    5.262 MegaAddrs , 96.60%
info:   192657 blocks,   24.117 MegaMoves ,    5.449 MegaAddrs , 97.16%
info:   193834 blocks,   25.166 MegaMoves ,    5.630 MegaAddrs , 97.76%
info:   194764 blocks,   26.214 MegaMoves ,    5.815 MegaAddrs , 98.23%
info:   195960 blocks,   27.263 MegaMoves ,    6.006 MegaAddrs , 98.83%
info:   197082 blocks,   28.312 MegaMoves ,    6.172 MegaAddrs , 99.39%
fatal: o2i_ECPublicKey failed
Aborted (core dumped)


This is a fresh Ubuntu 12.04 install with 8Gb of ram. Any thoughts on why I got this message? The allbalances.txt file is created but is empty so I assume the file is not written until the command is completed.

***Disclaimer***
I am just barely above noob level on linux.
EskimoBob
Legendary
*
Offline Offline

Activity: 910


Quality Printing Services by Federal Reserve Bank


View Profile
September 11, 2012, 07:42:19 PM
 #65

I am having trouble compiling.
http://pastebin.com/TrfSecqA

From the README:

Code:
sudo apt-get install libssl-dev build-essential g++-4.4 libboost-all-dev libsparsehash-dev git-core perl

Did you do that ?


I am going to attempt building it in Gentoo.
(most of this stuff is probably installed)
Code:
emerge -atvu1 dev-libs/openssl dev-libs/boost dev-cpp/sparsehash dev-vcs/git dev-lang/perl


While reading what I wrote, use the most friendliest and relaxing voice in your head.
BTW, Things in BTC bubble universes are getting ugly....
Chimsley
Jr. Member
*
Online Online

Activity: 38



View Profile
September 12, 2012, 05:13:02 PM
 #66


Cool thanks znort987 for the future fix. I am just tinkering but I have seen other people on the forums doing serious analysis with this tool and I applaud you for releasing this to everyone.
JompinDox
Member
**
Offline Offline

Activity: 107


View Profile
September 20, 2012, 09:14:38 AM
 #67

sorry for the newb question:

is it possible to find out how many addresses containing over 500 btc have NOT been used since January 2011, for instance?

(not used = not used for sending coins)

Tips? 1ELECeJompinDox61L73eAUyaWpe3Q5HZB
Down with socks!
flatfly
Hero Member
*****
Offline Offline

Activity: 938


View Profile
September 21, 2012, 01:12:30 PM
 #68

Great, thanks!

Btw, are there any pre-built windows binaries available?

1111127SpvabYpoeDoiz5L7QPkfiSh2Q. Only donate if you have a reason to.
dooglus
Legendary
*
Offline Offline

Activity: 1988



View Profile
September 22, 2012, 12:02:03 AM
 #69

Great, thanks!

Btw, are there any pre-built windows binaries available?

Nope.
And there's unlikely ever going to be any.
haven't touched windows in 10 years and don't plan to do so ever again.

+1

organofcorti
Donator
Legendary
*
Offline Offline

Activity: 1946


Poor impulse control.


View Profile WWW
September 22, 2012, 12:44:04 AM
 #70

Great, thanks!

Btw, are there any pre-built windows binaries available?

Nope.
And there's unlikely ever going to be any.
haven't touched windows in 10 years and don't plan to do so ever again.


What, you're saying that we just have to work when we're at work? It's people like you that make it hard for me to be a slacker.

Bitcoin network and pool analysis 12QxPHEuxDrs7mCyGSx1iVSozTwtquDB3r
follow @oocBlog for new post notifications
Buffer Overflow
Legendary
*
Offline Offline

Activity: 1512



View Profile
September 22, 2012, 04:30:00 PM
 #71

haven't touched windows in 10 years and don't plan to do so ever again.

6 years for me; and counting.

xchrix
Hero Member
*****
Offline Offline

Activity: 901



View Profile WWW
September 27, 2012, 12:33:01 PM
 #72

great work znort!
is it also possible to use this parser for a litecoin blockchain? i think so...

unfortunately i only have debian 32bit so i have to organize a 64bit server for testing this.

www.cryptocoincharts.info - long term charts for 800+ coins like BTC, LTC, NXT, DOGE
www.cryptoassetcharts.info - charts for decentralized assets like NXT AE, XCP, MSC, ...
BTC donations: 1DRVMYRMFafdtXJF1tivwyoR1SF8LDNKWj
Bitrated user: cryptocoinchart.
xchrix
Hero Member
*****
Offline Offline

Activity: 901



View Profile WWW
September 27, 2012, 02:57:42 PM
 #73

ok i see. i am good at php coding but c++ is not my best friend Cheesy i dont think that i am able to provide some patches.

www.cryptocoincharts.info - long term charts for 800+ coins like BTC, LTC, NXT, DOGE
www.cryptoassetcharts.info - charts for decentralized assets like NXT AE, XCP, MSC, ...
BTC donations: 1DRVMYRMFafdtXJF1tivwyoR1SF8LDNKWj
Bitrated user: cryptocoinchart.
SgtSpike
Legendary
*
Offline Offline

Activity: 1344



View Profile
September 27, 2012, 09:17:14 PM
 #74

It'd be great if someone could host this on the web, maybe charging a small fee for each lookup or something.
SgtSpike
Legendary
*
Offline Offline

Activity: 1344



View Profile
September 27, 2012, 10:39:53 PM
 #75

It'd be great if someone could host this on the web, maybe charging a small fee for each lookup or something.


Mmmh, not really : this is designed to run a full linear sweep of the entire
blockchain for every query ... that's truly heavy duty (both raw I/O and CPU).

The moment 5 users hit the web site at the same time, the server will basically die.

The way blockchain.info does it is the right approach for what you describe:
they dump the blockchain into a DB with a crapload of pre-computed indices
and update said DB incrementally to keep the queryable version up to date.
I guess I just don't like blockchain.info's way of displaying the data it finds.  Maybe I need to get used to it more.

Regardless, jobs could be queued, and the resource-intensiveness is why I suggested a small fee for each lookup.

There are those of us who do not know linux well enough to run something like what you have created here, but would still like it to be accessible.  Wink
dirtycat
Sr. Member
****
Offline Offline

Activity: 455



View Profile
October 06, 2012, 05:08:17 AM
 #76

I installed this and started doing some of the examples in the readme file and everything is working until I ran allbalances.

I get this output.

Quote
xxxxx@xxxxxxxx:~/blockparser$ ./parser allbalances >allbalances.txt

info: Starting command "allBalances"

info: analyzing blockchain ...
info:        0 blocks,    0.000 MegaMoves ,    0.000 MegaAddrs ,  0.00%
info:   118089 blocks,    1.049 MegaMoves ,    0.381 MegaAddrs , 59.56%
info:   129462 blocks,    2.097 MegaMoves ,    0.722 MegaAddrs , 65.29%
info:   134099 blocks,    3.146 MegaMoves ,    1.060 MegaAddrs , 67.63%
info:   138049 blocks,    4.194 MegaMoves ,    1.462 MegaAddrs , 69.62%
info:   142392 blocks,    5.243 MegaMoves ,    1.844 MegaAddrs , 71.81%
info:   146931 blocks,    6.291 MegaMoves ,    2.164 MegaAddrs , 74.10%
info:   152726 blocks,    7.340 MegaMoves ,    2.481 MegaAddrs , 77.02%
info:   158931 blocks,    8.389 MegaMoves ,    2.733 MegaAddrs , 80.15%
info:   164693 blocks,    9.437 MegaMoves ,    2.953 MegaAddrs , 83.06%
info:   169636 blocks,   10.486 MegaMoves ,    3.182 MegaAddrs , 85.55%
info:   174740 blocks,   11.534 MegaMoves ,    3.410 MegaAddrs , 88.13%
info:   178761 blocks,   12.583 MegaMoves ,    3.635 MegaAddrs , 90.15%
info:   180687 blocks,   13.631 MegaMoves ,    3.811 MegaAddrs , 91.13%
info:   181868 blocks,   14.680 MegaMoves ,    3.968 MegaAddrs , 91.72%
info:   183095 blocks,   15.729 MegaMoves ,    4.125 MegaAddrs , 92.34%
info:   184314 blocks,   16.777 MegaMoves ,    4.273 MegaAddrs , 92.96%
info:   185046 blocks,   17.826 MegaMoves ,    4.407 MegaAddrs , 93.32%
info:   186241 blocks,   18.874 MegaMoves ,    4.558 MegaAddrs , 93.93%
info:   187702 blocks,   19.923 MegaMoves ,    4.754 MegaAddrs , 94.66%
info:   189164 blocks,   20.972 MegaMoves ,    4.931 MegaAddrs , 95.40%
info:   190250 blocks,   22.020 MegaMoves ,    5.094 MegaAddrs , 95.95%
info:   191531 blocks,   23.069 MegaMoves ,    5.262 MegaAddrs , 96.60%
info:   192657 blocks,   24.117 MegaMoves ,    5.449 MegaAddrs , 97.16%
info:   193834 blocks,   25.166 MegaMoves ,    5.630 MegaAddrs , 97.76%
info:   194764 blocks,   26.214 MegaMoves ,    5.815 MegaAddrs , 98.23%
info:   195960 blocks,   27.263 MegaMoves ,    6.006 MegaAddrs , 98.83%
info:   197082 blocks,   28.312 MegaMoves ,    6.172 MegaAddrs , 99.39%
fatal: o2i_ECPublicKey failed
Aborted (core dumped)


This is a fresh Ubuntu 12.04 install with 8Gb of ram. Any thoughts on why I got this message? The allbalances.txt file is created but is empty so I assume the file is not written until the command is completed.

***Disclaimer***
I am just barely above noob level on linux.

Yeah, I hit this too a couple of days back.

Turns out someone managed to include a few transactions in the blockchain
that send funds to invalid compressed keys, something my code assumed was
not possible.

I have a fix for it, I'll push it to the git repo sometimes today.



Fix pushed to github.


Im still getting this when I run allabalances..  Sad

poop!
dirtycat
Sr. Member
****
Offline Offline

Activity: 455



View Profile
October 06, 2012, 10:40:11 AM
 #77

now using a different machine.. I get

Code:
gato@50cal:~/blockparser$ ./parser all

info: Starting command "allBalances"

info: analyzing blockchain ...
fatal: Invalid argument: failed to open block chain file /home/gato/.bitcoin/blk0001.dat
Aborted (core dumped)
gato@50cal:~/blockparser$


everything is there.. soooooo.. I have no idea.
not my day lol

poop!
dirtycat
Sr. Member
****
Offline Offline

Activity: 455



View Profile
October 06, 2012, 11:52:41 AM
 #78

figured it out.  had my home directory encrypted.. disabled encrypt and all is well.. fun adventure.. btw great tool!

poop!
runeks
Legendary
*
Offline Offline

Activity: 924



View Profile WWW
October 07, 2012, 08:35:29 PM
 #79

This looks cool. Do you have any plans to add a feature that allows the program to output the total balance for a specific bunch of addresses? Like:

./parser showBalance < addresses.txt

or alternatively

./parser showBalance -i addresses.txt

Where addresses.txt would contain a list of addresses (hash160/base58).
runeks
Legendary
*
Offline Offline

Activity: 924



View Profile WWW
October 07, 2012, 10:10:06 PM
 #80

Cool. Just tried it. blockparser reports the balance of the address 991fd9bf50ad8d6a551efceb5c228d21bcc0fe92 to be 200.777, but blockchain.info says it's 351.06501343 BTC. Who's right?

bitcoin-qt says my block chain is up to date (last block was found 8 minutes ago).

Armory's block chain tool reports the same balance as blockparser (200.777) so it seems that this is valid. But why does this disagree with blockchain.info?
Pages: « 1 2 3 [4] 5 6 7 8 9 10 »  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!