Bitcoin Forum
April 23, 2018, 02:22:18 PM *
News: Latest stable version of Bitcoin Core: 0.16.0  [Torrent]. (New!)
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 [10] 11 12 13 »  All
  Print  
Author Topic: Get list of all addresses with a balance over x?  (Read 38993 times)
aplistir
Full Member
***
Offline Offline

Activity: 238
Merit: 104



View Profile
February 12, 2018, 06:55:01 PM
 #181


Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ?

I am interested in doing some blockchain archaelogy like this:
https://bitcointalk.org/index.php?topic=507458.0

I already have those for blocks 1-36288, but I would like to have them all the way until block 150000. (After that the extraNonce becomes meaningless.)

The extraNonce value for each block can be found from the block-reward transaction from coinbase.
https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted

Would be great if someone either has those, or can help me getting them myself.

My Address: 121f7zb2U4g9iM4MiJTDhEzqeZGHzq5wLh
1524493338
Hero Member
*
Offline Offline

Posts: 1524493338

View Profile Personal Message (Offline)

Ignore
1524493338
Reply with quote  #2

1524493338
Report to moderator
1524493338
Hero Member
*
Offline Offline

Posts: 1524493338

View Profile Personal Message (Offline)

Ignore
1524493338
Reply with quote  #2

1524493338
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1524493338
Hero Member
*
Offline Offline

Posts: 1524493338

View Profile Personal Message (Offline)

Ignore
1524493338
Reply with quote  #2

1524493338
Report to moderator
btctousd81
Sr. Member
****
Offline Offline

Activity: 378
Merit: 252


View Profile WWW
February 13, 2018, 04:36:23 AM
 #182


Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ?

I am interested in doing some blockchain archaelogy like this:
https://bitcointalk.org/index.php?topic=507458.0

I already have those for blocks 1-36288, but I would like to have them all the way until block 150000. (After that the extraNonce becomes meaningless.)

The extraNonce value for each block can be found from the block-reward transaction from coinbase.
https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted

Would be great if someone either has those, or can help me getting them myself.

what are you saying ?

satoshi secretly mined and has more than 50 btc which are from genesis block ?

starmyc
Member
**
Offline Offline

Activity: 84
Merit: 44

Software engineer


View Profile WWW
February 13, 2018, 10:14:24 AM
Merited by aplistir (1)
 #183


Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ?

I am interested in doing some blockchain archaelogy like this:
https://bitcointalk.org/index.php?topic=507458.0

I already have those for blocks 1-36288, but I would like to have them all the way until block 150000. (After that the extraNonce becomes meaningless.)

The extraNonce value for each block can be found from the block-reward transaction from coinbase.
https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted

Would be great if someone either has those, or can help me getting them myself.

Can you check this file: https://transfer.sh/oZFQr/extranonces.final.gz ? Format is height;hash;extranonce value.

I've got values for ~180k first blocks. Didn't check if all coinbase input scripts had the same format, just exported 2nd value pushed in stack of coinbase input script using my export tools. If values doesn't match yours, please send me your values so I can fix my scripts, but so far, it seems to match values from the order thread.

Cheers.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
aplistir
Full Member
***
Offline Offline

Activity: 238
Merit: 104



View Profile
February 13, 2018, 07:13:07 PM
 #184


Can you check this file: https://transfer.sh/oZFQr/extranonces.final.gz ? Format is height;hash;extranonce value.

I've got values for ~180k first blocks. Didn't check if all coinbase input scripts had the same format, just exported 2nd value pushed in stack of coinbase input script using my export tools. If values doesn't match yours, please send me your values so I can fix my scripts, but so far, it seems to match values from the order thread.

Excellent! Thank you.  Smiley
I have been looking for that information for some time now. I even tried some old blockchain parser, which could not do the job.

I checked the numbers against the ones I have, and the first 36288 extraNonce values are the same than the ones I had  Grin

My Address: 121f7zb2U4g9iM4MiJTDhEzqeZGHzq5wLh
starmyc
Member
**
Offline Offline

Activity: 84
Merit: 44

Software engineer


View Profile WWW
February 14, 2018, 02:56:28 AM
 #185


Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ?

I am interested in doing some blockchain archaelogy like this:
https://bitcointalk.org/index.php?topic=507458.0

what are you saying ?

satoshi secretly mined and has more than 50 btc which are from genesis block ?

On the first blocks mined, there were some input script on coinbase transaction (which is useless as it is not used at all in bitcoin's protocol). In this script, they were only 2 pushes in stack of 2 VLI: one for a timestamp (not sure), and another by an extranonce value. This value was used to alter the coinbase TX hash, thus the merkleroot hash, then the block hash value. I guess it was another variable which could be used to reach a valid block hash value (additional ot nonce & timestamp or re-ordering transactions).

This value is not existing anymore and recent blocks have a empty input script for coinbase transaction.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
Sakuraa
Newbie
*
Offline Offline

Activity: 5
Merit: 0


View Profile
February 16, 2018, 11:07:54 PM
 #186

Friend, please upload a new version or update the link to the old one
btctousd81
Sr. Member
****
Offline Offline

Activity: 378
Merit: 252


View Profile WWW
February 17, 2018, 04:35:56 AM
 #187

Friend, please upload a new version or update the link to the old one

i m not at machine., will need 2 days., watch this thread.

ivanxuu
Newbie
*
Offline Offline

Activity: 6
Merit: 0


View Profile
February 19, 2018, 08:53:09 AM
 #188

Hi everyone,

I've opensourced a small software to parse the chainstate & output all utxos with their addresses (including latest bech32) in CSV format. As for today, computation takes ~8 minutes & creates a 6 GB CSV file (there is 60M utxos).
Feel free to give it a try: https://github.com/mycroft/chainstate

Would you mind uploading that CSV file? It contains all addresses, even with no balance, right?
I've alredy tried to compile your code but I'm getting errors related to gmp library. If you can upload that I wouldn't mind reuploading to my own http server so it can be accessed to others.
starmyc
Member
**
Offline Offline

Activity: 84
Merit: 44

Software engineer


View Profile WWW
February 19, 2018, 09:55:39 AM
 #189

Would you mind uploading that CSV file? It contains all addresses, even with no balance, right?
I've alredy tried to compile your code but I'm getting errors related to gmp library. If you can upload that I wouldn't mind reuploading to my own http server so it can be accessed to others.

I can't for the moment & until the end of the week unfortunately.
If you have gmp librairies & headers installed, secp256k1 will use it. You'll have to edit the main Makefile and add "-lgmp" in the LDFLAGS line. It will build the binary using it.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
ivanxuu
Newbie
*
Offline Offline

Activity: 6
Merit: 0


View Profile
February 19, 2018, 01:25:32 PM
 #190

Thanks a bunch! That made it!

Now, I've made a copy of ~/.bitcoin/chainstate dir, and move it to the path where i've compiled your program (~/development/chainstate):

$ cp -rp ~/.bitcoin/chainstate ~/development/chainstate/state

But now I'm getting:

user@localhost:~/Deveopment/chainstate $ ./chainstate
chainstate: chainstate.cc:45: int main(): Assertion `idx[0] == 'C'' failed.


Which is weird because if I add the following line before and comment the assertion like this:

~  45         cout << "DBG: "<<idx[0] << " \n";                               
+  46         //assert(idx[0] == 'C');


Then I get lines like:

user@localhost:~/Deveopment/chainstate $ ./chainstate
DBG: 
Invalid output: 79656b5f65746163737566626f00 38c006 30080738760000
79656b5f65746163737566626f00;Invalid address or lost;30080738760000
last block: 06c03835a99fece306e4e25c7c7c7c34747a2ee3a3b177156a93b2ecdf7fd9a3
DBG: C
Invalid output: eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000 9729b525c0f657759ad3c11de5e525c596843cc30b84b975b5 4
eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000;Invalid address or lost;4
DBG: C
Invalid output: a59f2e72830363c38a438d12236a15d1ca3074ce980873bd7f3a1699f7010000 d139db52c05d8a0fb4bf2cc101c3916250098c52d03799b092 10000000000
a59f2e72830363c38a438d12236a15d1ca3074ce980873bd7f3a1699f7010000;Invalid address or lost;10000000000
DBG: C
Invalid output: 0118dd986e59473732239d39cb3b8890bf32677719dd8933b05f6614f4020000 83211539cb2ce3daeded5d37ada7692119b33dc8689a5058 1000000
0118dd986e59473732239d39cb3b8890bf32677719dd8933b05f6614f4020000;Invalid address or lost;1000000
DBG: C


What could it be?
starmyc
Member
**
Offline Offline

Activity: 84
Merit: 44

Software engineer


View Profile WWW
February 20, 2018, 05:05:44 AM
 #191

But now I'm getting:

user@localhost:~/Deveopment/chainstate $ ./chainstate
chainstate: chainstate.cc:45: int main(): Assertion `idx[0] == 'C'' failed.


Which is weird because if I add the following line before and comment the assertion like this:

~  45         cout << "DBG: "<<idx[0] << " \n";                               
+  46         //assert(idx[0] == 'C');


Then I get lines like:

user@localhost:~/Deveopment/chainstate $ ./chainstate
DBG: 
Invalid output: 79656b5f65746163737566626f00 38c006 30080738760000
79656b5f65746163737566626f00;Invalid address or lost;30080738760000
last block: 06c03835a99fece306e4e25c7c7c7c34747a2ee3a3b177156a93b2ecdf7fd9a3
DBG: C
Invalid output: eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000 9729b525c0f657759ad3c11de5e525c596843cc30b84b975b5 4
eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000;Invalid address or lost;4


What could it be?

I think I forgot to handle a case: When the chainstate is obfuscated. When it happens, a new record is added to database, hitting the assert condition and making the parsing go wrong.

I added the forgotten feature, but I'm not 100% sure it is ok. So far my tests were OK (for some reason, my main testing bitcoins db was clear of any obfuscation). Could you pull the source again from https://github.com/mycroft/chainstate and rebuild it to try it ? It would be really helpful.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
ivanxuu
Newbie
*
Offline Offline

Activity: 6
Merit: 0


View Profile
February 20, 2018, 11:17:20 AM
 #192


I think I forgot to handle a case: When the chainstate is obfuscated. When it happens, a new record is added to database, hitting the assert condition and making the parsing go wrong.

I added the forgotten feature, but I'm not 100% sure it is ok. So far my tests were OK (for some reason, my main testing bitcoins db was clear of any obfuscation). Could you pull the source again from https://github.com/mycroft/chainstate and rebuild it to try it ? It would be really helpful.


Your new commit made it possible. Thanks. It's working fine now  Smiley

Is anyone insterested in downloading the CSV file? I can upload it to internet if anyone is insterested.
phucthinh11061997
Newbie
*
Offline Offline

Activity: 18
Merit: 0


View Profile
February 20, 2018, 01:59:31 PM
 #193

Who knows if the balances_498754.csv file shared above contains the compressed or uncompressed format of the bitcoin public address?
aplistir
Full Member
***
Offline Offline

Activity: 238
Merit: 104



View Profile
February 20, 2018, 04:42:03 PM
 #194

Who knows if the balances_498754.csv file shared above contains the compressed or uncompressed format of the bitcoin public address?

It is impossible to know if a bitcoin address is made using a compressed or uncompressed public key. Every bitcoin address has many compressed and uncompressed public keys that will generate that address.
There are 2^160 possible addresses and 2^256 public keys, which makes about 2^96 different keys for each address

But you can make an educated guess based on the date when the address was created. During the last 3-4 years >99% of generated addresses would use compressed public keys. And the oldest ones would probably use uncompressed keys.

The only way to be certain is if there is a spend action from that address. then you can look at the published public key and you will know if it is compressed or not.

My Address: 121f7zb2U4g9iM4MiJTDhEzqeZGHzq5wLh
RebeccaCole
Jr. Member
*
Offline Offline

Activity: 41
Merit: 0


View Profile
February 26, 2018, 11:36:03 AM
 #195

Can't you just sort the output?
rustychainz
Newbie
*
Offline Offline

Activity: 1
Merit: 0


View Profile
March 03, 2018, 01:44:36 AM
 #196

anyone have an updated file? balances_498754.zip  is quite old.
starmyc
Member
**
Offline Offline

Activity: 84
Merit: 44

Software engineer


View Profile WWW
March 04, 2018, 06:50:58 PM
 #197

I've generated a new dump for all balances as of today.

Enjoy: https://transfer.sh/12aVfO/balances_20180304.out.gz

Cheers.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
P.
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
March 05, 2018, 12:49:44 PM
 #198

Need to ask .. as second and third values are

1111111111111111111114oLvT2;43338925513
111111111111111111112BEH2ro;10940

if I check via bitref (or any other tool),

second key balance is 65.57999243
third 0.00010940

seems like greater numbers are flawed somehow?
starmyc
Member
**
Offline Offline

Activity: 84
Merit: 44

Software engineer


View Profile WWW
March 05, 2018, 02:45:08 PM
 #199

Need to ask .. as second and third values are

1111111111111111111114oLvT2;43338925513
111111111111111111112BEH2ro;10940

if I check via bitref (or any other tool),

second key balance is 65.57999243
third 0.00010940

seems like greater numbers are flawed somehow?

You picked a unusable address (ripemd160 hash is 0x0000000000..., that's just lost coins) with more than 50000 utxos attached to it (I count 52057 utxos while blockchain.info only count 51302). Honestly, it will be hard to debug this one, as I don't know how blockchain.info fills its database.

By the way, I don't think there is a problem with big numbers. Other balances seems ok:

Code:
$ grep 1111116d87CjjDyP8SF5v1LTvUq22VFg balances.out
1111116d87CjjDyP8SF5v1LTvUq22VFg;8957970093

$ curl -s https://blockchain.info/fr/rawaddr/1111116d87CjjDyP8SF5v1LTvUq22VFg|grep final_balance
    "final_balance":8957970093,

Another sample:

Code:
$ grep 336xGpGweq1wtY4kRTuA4w6d7yDkBU9czU balances.out
336xGpGweq1wtY4kRTuA4w6d7yDkBU9czU;4897336319144

$ curl -s https://blockchain.info/fr/rawaddr/336xGpGweq1wtY4kRTuA4w6d7yDkBU9czU|grep final_balance
    "final_balance":4897336319144,

Cheers

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
P.
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
March 06, 2018, 08:24:28 AM
 #200

Thanks for explanation.
Another one is ..
there is one address that begins with 0e0 and few thousands of those starting with bc1. What does those mean?
T.
Pages: « 1 2 3 4 5 6 7 8 9 [10] 11 12 13 »  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!