|
Title: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 04, 2015, 12:22:13 AM I offer a bounty for anyone who develop/write a script/code/program to dump all known public keys ( not hash160 ) from bitcoin blockchain.
You can modify/edit/hack/add feature to the following project that i believe its much better to use than starting from scratch. https://github.com/znort987/blockparser Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: achow101 on October 04, 2015, 03:10:12 PM How much is the bounty?
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: OmegaStarScream on October 04, 2015, 03:15:35 PM How much is the bounty and should we use your project ? because I don't know C & C++ honestly so not going be able to use it however I may use C# AND GIVE IT a shoot .
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 04, 2015, 03:46:12 PM How much is the bounty? How much is the bounty and should we use your project ? because I don't know C & C++ honestly so not going be able to use it however I may use C# AND GIVE IT a shoot . Bounty is 200$ , that is not my project but it is a very good code to hack. you can go ahead and try with C# . https://github.com/znort987/blockparser/blob/4920bba202c648e83abade4a756edab03526524e/util.cpp#L248 Code: // Output script commonly found in block reward TX, pays to explicit pubKey Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: unhappyuser on October 04, 2015, 03:49:51 PM AFAIK using blockparser you can make dump of all public address hashes. All what you need is a comment an unneeded parts of code and hold only output of hashes (you must edit output string a bit). Then you must remove all unique strings from your output. And at finish convert all hashes using right encoding. I do not know C/C++ too but I have done this at some time so I can say that it is not hard to do. I'm also must say that your database must be synchronized with "-txindex=1" parameter. My database is not up-to-date ATM so I can not explain that right now...
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: achow101 on October 04, 2015, 03:52:32 PM How much is the bounty? How much is the bounty and should we use your project ? because I don't know C & C++ honestly so not going be able to use it however I may use C# AND GIVE IT a shoot . Bounty is 200$ , that is not my project but it is a very good code to hack. you can go ahead and try with C# . https://github.com/znort987/blockparser/blob/4920bba202c648e83abade4a756edab03526524e/util.cpp#L248 Code: // Output script commonly found in block reward TX, pays to explicit pubKey Unfortunately I'm no good at c++ so I cant modify blockparser Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: FruitsBasket on October 04, 2015, 03:57:07 PM hello xiazou, I don't know if u want a script but I know a website where u can find all private keys for free. The website is: http://buttcoins.com/ (http://buttcoins.com/). There are 3508851189009581679502151060869330540995077705426512254018338277015701863465 pages of keys, good luck!
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 04, 2015, 04:12:36 PM AFAIK using blockparser you can make dump of all public address hashes. All what you need is a comment an unneeded parts of code and hold only output of hashes (you must edit output string a bit). Then you must remove all unique strings from your output. And at finish convert all hashes using right encoding. I do not know C/C++ too but I have done this at some time so I can say that it is not hard to do. I'm also must say that your database must be synchronized with "-txindex=1" parameter. My database is not up-to-date ATM so I can not explain that right now... +1 , actually that's exactly what i want, but instead of cleaning up the code from unwanted code and functions. we can just make a new copy of a .cpp file for example dumpTX.cpp and modify it for our need ( dump only all the known public keys from the whole blockchain 'not hash160' ) OP_PUSHDATA(65, 0x0434417dd8d89deaf0f6481c2c160d6de0921624ef7b956f38eef9ed4a64e36877be84b77cdee 5a8d92b7d93694f89c3011bf1cbdf4fd7d8ca13b58a7bb4ab0804) P.S using blockparser doesn't need a fully synced blockchain. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 04, 2015, 04:18:05 PM How much is the bounty? How much is the bounty and should we use your project ? because I don't know C & C++ honestly so not going be able to use it however I may use C# AND GIVE IT a shoot . Bounty is 200$ , that is not my project but it is a very good code to hack. you can go ahead and try with C# . https://github.com/znort987/blockparser/blob/4920bba202c648e83abade4a756edab03526524e/util.cpp#L248 Code: // Output script commonly found in block reward TX, pays to explicit pubKey Unfortunately I'm no good at c++ so I cant modify blockparser No problem, but i'm not sure how fast that will work using rpc. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: unhappyuser on October 04, 2015, 05:37:06 PM OK, I have made a dirty callback for znort987's blockparser. As you said, it already works with part of blockchain. I have tested it on Ubuntu x86_64 with 3.13.0-65-generic kernel.
You can get it here: Code: https://mega.nz/#!ktxGjBYJ!Fm5RYsUZZ5PAa88Smb7R9ojG3MOx-yj450RUzF3sIy4 UPD.: tried this myself, seems good. In order to make blockparser, you must have following packages installed: Code: build-essential libsparsehash-dev libssl-dev libboost-dev After compiling you can run this command: Code: ./parser addrdump After this command finished you will see a text file named addresses.txt - this file will contain all outputs which blockchain contains. To remove all duplicates you can run this command: Code: sort -u addresses.txt And that is all! Code: P.S.: If it helped you then you can say me "Thank you" there: 15WkkJqxgQ2k8nXyhr3za9GYq2Jqpq9gyo ;) Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: amaclin on October 04, 2015, 06:53:42 PM Do you need public keys which occur in scriptPubKey or is scriptSig (including p2sh inner scripts) also?
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 04, 2015, 08:22:14 PM OK, I have made a dirty callback for znort987's blockparser. As you said, it already works with part of blockchain. I have tested it on Ubuntu x86_64 with 3.13.0-65-generic kernel. You can get it here: Code: https://mega.nz/#!ktxGjBYJ!Fm5RYsUZZ5PAa88Smb7R9ojG3MOx-yj450RUzF3sIy4 UPD.: tried this myself, seems good. In order to make blockparser, you must have following packages installed: Code: build-essential libsparsehash-dev libssl-dev libboost-dev After compiling you can run this command: Code: ./parser addrdump After this command finished you will see a text file named addresses.txt - this file will contain all outputs which blockchain contains. To remove all duplicates you can run this command: Code: sort -u addresses.txt And that is all! Code: P.S.: If it helped you then you can say me "Thank you" there: 15WkkJqxgQ2k8nXyhr3za9GYq2Jqpq9gyo ;) That works, but the output is the base58check of the hash160, what i need is the raw pubkey not hash from the output/input script: 0434417dd8d89deaf0f6481c2c160d6de0921624ef7b956f38eef9ed4a64e36877be84b77cdee5a 8d92b7d93694f89c3011bf1cbdf4fd7d8ca13b58a7bb4ab0804 Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: achow101 on October 04, 2015, 08:45:39 PM What OS will you be running this on?
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 04, 2015, 08:55:56 PM What OS will you be running this on? Win and Linux. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: achow101 on October 05, 2015, 12:03:41 AM I wrote the tool using Java and Bitcoin core rpc. You can download it here: https://drive.google.com/file/d/0Bxw3ip9QfNOUWGZFWFN1alNjSHM/view?usp=sharing
There are 4 versions, linux 32 bit, linux 64 bit, windows 32 bit, and windows 64 bit. It also comes packaged with the proper jre for the program to run. To run the tool, you need to run Bitcoin core in server mode (with -server flag or have server=1 in bitcoin.conf and have an rpcuser and rpcpassword set in bitcoin.conf) as well as with txindex enabled (-txindex flag in command or have txindex=1 in bitcoin.conf). If you are running it from the command line, you need to have the -reindex flag as well for the first time because txindex requires that Bitcoin Core reindex its databases to include all of the transactions. If you run it with the GUI, there will be a dialog that prompts you. The reindex will take a long time. The program will work at any time during the reindex, but it will not be able to grab all of the data since the databases won't be up to date until it is done. The tool works a little slowly, so be patient. You will need to run it for several hours in order to complete. The usage: Code: Tool which scrapes the entire blockchain for all of the pubkeys of all transactions If this satisfies you, please send the bounty to the address in my profile. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 06, 2015, 03:21:00 PM I wrote the tool using Java and Bitcoin core rpc. You can download it here: https://drive.google.com/file/d/0Bxw3ip9QfNOUWGZFWFN1alNjSHM/view?usp=sharing There are 4 versions, linux 32 bit, linux 64 bit, windows 32 bit, and windows 64 bit. It also comes packaged with the proper jre for the program to run. To run the tool, you need to run Bitcoin core in server mode (with -server flag or have server=1 in bitcoin.conf and have an rpcuser and rpcpassword set in bitcoin.conf) as well as with txindex enabled (-txindex flag in command or have txindex=1 in bitcoin.conf). If you are running it from the command line, you need to have the -reindex flag as well for the first time because txindex requires that Bitcoin Core reindex its databases to include all of the transactions. If you run it with the GUI, there will be a dialog that prompts you. The reindex will take a long time. The program will work at any time during the reindex, but it will not be able to grab all of the data since the databases won't be up to date until it is done. The tool works a little slowly, so be patient. You will need to run it for several hours in order to complete. The usage: Code: Tool which scrapes the entire blockchain for all of the pubkeys of all transactions If this satisfies you, please send the bounty to the address in my profile. Thanks for the effort, but this is very slow, i'm running it since yesterday and its still on blocks from year 2012. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: amaclin on October 06, 2015, 03:24:30 PM Thanks for the effort, but this is very slow, i'm running it since yesterday and its still on blocks from year 2012. Do you still need it?I have to ask my question one more time: Do you want the public keys which occur in outputs? Or may be you want also pubkeys from the transactions inputs? (pubkeys are also occur there) (Parsing the whole blockchain will be no more than 1 hour) Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 06, 2015, 03:44:06 PM Thanks for the effort, but this is very slow, i'm running it since yesterday and its still on blocks from year 2012. Do you still need it?I have to ask my question one more time: Do you want the public keys which occur in outputs? Or may be you want also pubkeys from the transactions inputs? (pubkeys are also occur there) (Parsing the whole blockchain will be no more than 1 hour) Yes, i need those pubkeys from outputs & inputs, only uncompressed , no pay to hash160 or multisig , only the available known pubkeys, for example : Code: 04cc8d85f5e7933cb18f13b97d165e1189c1fb3e9c98b0dd5446b2a1989883ff9e740a8a75da99cc59a21016caf7a7afd3e4e9e7952983e18d1ff70529d62e0ba1 Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: amaclin on October 06, 2015, 03:56:29 PM Yes, i need those pubkeys from outputs & inputs, only uncompressed , no pay to hash160 or multisig , only the available known pubkeys, for example : OK, I'll try to do it today. But why do you need only uncompressed? There are more compressed pubkeys 02xxxxx and 03xxxxx in blockchain Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 06, 2015, 04:06:25 PM Yes, i need those pubkeys from outputs & inputs, only uncompressed , no pay to hash160 or multisig , only the available known pubkeys, for example : OK, I'll try to do it today. But why do you need only uncompressed? There are more compressed pubkeys 02xxxxx and 03xxxxx in blockchain If you can ( if its possible ) uncompress them it would be great! Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: amaclin on October 06, 2015, 04:31:01 PM Yes, i need those pubkeys from outputs & inputs, only uncompressed , no pay to hash160 or multisig , only the available known pubkeys, for example : OK, I'll try to do it today. But why do you need only uncompressed? There are more compressed pubkeys 02xxxxx and 03xxxxx in blockchain If you can ( if its possible ) uncompress them it would be great! For example: public key for address 1JwSSubhmg6iPtRjtyqhUYYH7bZg3Lfy1T: Code: 0478D430274F8C5EC1321338151E9F27F4C676A008BDF8638D07C0B6BE9AB35C71A1518063243ACD4DFE96B66E3F2EC8013C8E072CD09B3834A19F81F659CC3455 Code: 0378D430274F8C5EC1321338151E9F27F4C676A008BDF8638D07C0B6BE9AB35C71 both these public keys (and addresses) are derived from one private key Code: C4BBCB1FBEC99D65BF59D85C8CB62EE2DB963F0FE106F483D9AFA73BD4E39A8A Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 06, 2015, 05:57:03 PM Yes, i need those pubkeys from outputs & inputs, only uncompressed , no pay to hash160 or multisig , only the available known pubkeys, for example : OK, I'll try to do it today. But why do you need only uncompressed? There are more compressed pubkeys 02xxxxx and 03xxxxx in blockchain If you can ( if its possible ) uncompress them it would be great! For example: public key for address 1JwSSubhmg6iPtRjtyqhUYYH7bZg3Lfy1T: Code: 0478D430274F8C5EC1321338151E9F27F4C676A008BDF8638D07C0B6BE9AB35C71A1518063243ACD4DFE96B66E3F2EC8013C8E072CD09B3834A19F81F659CC3455 Code: 0378D430274F8C5EC1321338151E9F27F4C676A008BDF8638D07C0B6BE9AB35C71 both these public keys (and addresses) are derived from one private key Code: C4BBCB1FBEC99D65BF59D85C8CB62EE2DB963F0FE106F483D9AFA73BD4E39A8A oh yes, so i need both cmpr. and ucmpr. , no need for mutltisig. thanks Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: waldistons on October 06, 2015, 08:13:21 PM Using RPC approach will take you ~3-4 weeks. I'm currently farming just addresses used, my app is runing almost a week and i'm 5 days away to block 300000. (the newer the block, the more transactions in block)
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 06, 2015, 09:12:21 PM Using RPC approach will take you ~3-4 weeks. I'm currently farming just addresses used, my app is runing almost a week and i'm 5 days away to block 300000. (the newer the block, the more transactions in block) You can use blockparser to dump all bitcoin addresses down to the last Satoshi + the 0 balance used addresses within 30 min. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: waldistons on October 07, 2015, 07:57:12 AM Quote Compute and print the balance for all keys ever used in a TX since the beginning of time (30 seconds) I call those 30 seconds bullshit and let me explain why: 1) current blockchain size is 43.5 GB (all blk*.dat files) 2) even keeping blockchain on ssd, most ssd disks have THEORETHICAL read speed 500 MB/s 3) let's assume they work with max theorethical speed: 500 MB/s * 30 seconds = 15 GB will be read UNLESS: a) code doesn't read whole blocks and parses only small part of block size b) raid of SSD disks, can give couple GB/S read speeds. Please correct me if I'm wrong. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 07, 2015, 12:49:07 PM Quote Compute and print the balance for all keys ever used in a TX since the beginning of time (30 seconds) I call those 30 seconds bullshit and let me explain why: 1) current blockchain size is 43.5 GB (all blk*.dat files) 2) even keeping blockchain on ssd, most ssd disks have THEORETHICAL read speed 500 MB/s 3) let's assume they work with max theorethical speed: 500 MB/s * 30 seconds = 15 GB will be read UNLESS: a) code doesn't read whole blocks and parses only small part of block size b) raid of SSD disks, can give couple GB/S read speeds. Please correct me if I'm wrong. who said 30 sec ;D Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: waldistons on October 07, 2015, 05:41:47 PM Quote was from original readme file :P
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 07, 2015, 08:56:06 PM Quote was from original readme file :P ah, that readme file is old i think. ;) Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: unhappyuser on October 09, 2015, 05:42:02 PM Oh, that one is not solved yet?... I can try make an another callback for znort blockparser, if this will be good for you.
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 09, 2015, 07:58:12 PM Oh, that one is not solved yet?... I can try make an another callback for znort blockparser, if this will be good for you. Great, ill be waiting! Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: unhappyuser on October 10, 2015, 10:25:18 AM Great, ill be waiting! But, please... why you are not accepting a knightdk solution? Are you tried to use more RPC threads and point bitcoind to unresponsive proxy address? Maybe you can get better results.Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: XaiZou on October 10, 2015, 12:26:17 PM Great, ill be waiting! But, please... why you are not accepting a knightdk solution? Are you tried to use more RPC threads and point bitcoind to unresponsive proxy address? Maybe you can get better results.Yes, im using rpcthreads=1000 and the connection is direct no proxy ( all localhost ) but it is very slow. Maybe you can play with blockparser rawdump.cpp , transaction scripts code is there. but need some cleanup from other unwanted things. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: achow101 on October 10, 2015, 03:34:06 PM Great, ill be waiting! But, please... why you are not accepting a knightdk solution? Are you tried to use more RPC threads and point bitcoind to unresponsive proxy address? Maybe you can get better results.Yes, im using rpcthreads=1000 and the connection is direct no proxy ( all localhost ) but it is very slow. Maybe you can play with blockparser rawdump.cpp , transaction scripts code is there. but need some cleanup from other unwanted things. Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: achow101 on October 10, 2015, 06:55:54 PM Here is another version of mine. It still requires txindex but this time it will do multithreading to hopefully run faster.
usage: Code: Tool which scrapes the entire blockchain for all of the pubkeys of all transactions Download: https://drive.google.com/file/d/0Bxw3ip9QfNOUY3EwS0Z3RUxqanc/view?usp=sharing Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: btc_enigma on October 11, 2015, 04:44:57 AM I am writing a much faster version that reads blocks from disk ... using bitcoinabe and bitcointools. Please wait for my submission before releasing bounty
-Thanks Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: btc_enigma on October 11, 2015, 06:23:23 AM Here is the script https://github.com/shivaenigma/bitcoin-abe
Directly reads blocks from bitcoin data directory. Prints some debug information on console like current block hash and 'Found x public keys' . You can redirect stdout to /dev/null for speed up My bitcoin address to claim bounty is in my profile - Thanks Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: photon_coin on October 11, 2015, 06:55:09 AM many have done this & a while ago there was a website with them,
not sure of the purpose since it is a long list suggested reading : bitcoin wiki & http://crypto.stackexchange.com/questions/1170/best-way-to-reduce-chance-of-hash-collisions-multiple-hashes-or-larger-hash (http://crypto.stackexchange.com/questions/1170/best-way-to-reduce-chance-of-hash-collisions-multiple-hashes-or-larger-hash) Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: btc_enigma on October 13, 2015, 05:11:30 AM XaiZou have you tried to out the script ? Waiting for a response
Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: btc_enigma on October 14, 2015, 06:11:19 AM Typical of a new member , announcing bounty and then disappearing ! Should have asked for an escrow . What a sham !
I will wait for a day ... else I will give XaiZou a negative trust and ask moderator to ban the userid Title: Re: [BOUNTY] for devloping/writing a script/code/program to dump all publickeys Post by: unhappyuser on October 14, 2015, 02:30:23 PM I think there is must be a rule where user at least must sign a message using private BTC address which contains enough funds for covering an announced bounty...
|