WitoldC
Newbie
Offline
Activity: 78
Merit: 0
|
|
January 03, 2018, 02:19:21 PM |
|
There is ';' instead ',' You must replace all in editor. 1CG4LbEXoBus2egJS8SBh3DDPTrSykzFMG;942800 1Jt1Yng68p6Pd3pYWc1W1nxWSZSx9PZNto;2100390 32i3fvUTZkq2zeHBuosYDkiSCyMDhP62eo;9592347
|
|
|
|
blue2358
Newbie
Offline
Activity: 2
Merit: 0
|
|
January 10, 2018, 06:00:04 PM |
|
@daboehla would you have a new hash160 file with all hashes for all addresses?
thanks in advance!
|
|
|
|
daboehla
|
|
January 11, 2018, 07:34:08 AM |
|
@daboehla would you have a new hash160 file with all hashes for all addresses?
thanks in advance!
Still waiting for my new PC... I think about somewhere next week I can make a fresh one.
|
|
|
|
btctousd81
|
|
January 11, 2018, 08:33:15 AM |
|
give me few hours, ill upload latest one.
|
|
|
|
webchris
|
|
January 11, 2018, 10:43:13 PM |
|
give me few hours, ill upload latest one.
Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you?
|
|
|
|
btctousd81
|
|
January 12, 2018, 01:15:48 AM Last edit: January 12, 2018, 05:55:03 AM by btctousd81 |
|
give me few hours, ill upload latest one.
Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you? nope, only addresses having balance. edit: here it is https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z
format addresss, hash160, amount
|
|
|
|
blue2358
Newbie
Offline
Activity: 2
Merit: 0
|
|
January 13, 2018, 10:50:25 PM |
|
thanks @btctousd81.
would you give the script that allows to create this csv? did you do it in bash or python or anything else?
|
|
|
|
Anti-Cen
Member
Offline
Activity: 210
Merit: 26
High fees = low BTC price
|
|
January 13, 2018, 11:17:20 PM |
|
it says "In order to use bitcoinquery you need a Bitcoind RPC server" I want to do it from windows without running a full node and doing RPC to the local node See https://bitcointalk.org/index.php?topic=2748620.new#newLooks like i need some form of Berkeley-DB to run in windows to read Block.dat files that is not so easy to come by in windows and yes I know it's all spyware Will upload if i get anything working that should sum all balances (I hope) but it will be windows based
|
Mining is CPU-wars and Intel, AMD like it nearly as much as big oil likes miners wasting electricity. Is this what mankind has come too.
|
|
|
Anti-Cen
Member
Offline
Activity: 210
Merit: 26
High fees = low BTC price
|
|
January 13, 2018, 11:33:42 PM |
|
Nice so did you do it from windows or Linux without using a wrapper around someones mega-big API or running a full-node and using RPC ? I am trying to code this myself to read block.dat from several types of forked BC from Bitcoin so I need to go back to raw files I think and then see what happens after a fork date to the data so off the shelf API's won't help me out. Will be interesting to see who has money in the forks and are not using it
|
Mining is CPU-wars and Intel, AMD like it nearly as much as big oil likes miners wasting electricity. Is this what mankind has come too.
|
|
|
btctousd81
|
|
January 14, 2018, 03:16:35 AM |
|
thanks @btctousd81.
would you give the script that allows to create this csv? did you do it in bash or python or anything else?
Nice so did you do it from windows or Linux without using a wrapper around someones mega-big API or running a full-node and using RPC ? I am trying to code this myself to read block.dat from several types of forked BC from Bitcoin so I need to go back to raw files I think and then see what happens after a fork date to the data so off the shelf API's won't help me out. Will be interesting to see who has money in the forks and are not using it i have full node running at home, on linux centos 7 dedicated to only bitcoind. there is no single readymade script to get all addresses having balance. what i did was i used rusty-blockparser to get all unspent outputs in csv. then loaded it in myql then some queries to get data in proper format and bitcoin-tool to get address to hash160. then i have this php script which gets run every 4-6 hours and parses all new blocks using rpc. and updates my mysql db. it was time consuming task took me 2-3 days to get everything in db. it would be great if someone could create app which can directly read chainstate db. parsing blockchain is pretty simple using rpc but its fuckin slow as hell. every output is +1 and old amount + new amount while every input is -1 and old amount - new amount this is my logic to get uptodate all addresses having balance .. hope this helps., i could upload regular updated db daily but my home net has very slow upload speed so it takes around 7-8 hours to upload above dump. ------------------------------- edit: if you want only addresses having balance not care about the amount of btc its holding, then just run rusty-blockparser with unspentcsv callback you wiill get huge csv dump file then just use grep sed something like that to only get addresses. the parser takes around 8 -12 hours., even on my amd fx 8350 , 32 gig dedicated machine.
|
|
|
|
Anti-Cen
Member
Offline
Activity: 210
Merit: 26
High fees = low BTC price
|
|
January 15, 2018, 11:51:50 AM |
|
i have full node running at home, on linux centos 7 dedicated to only bitcoind.
Yes that's my killer because I run Windows spyware version 10 and is too old to move over and learn Linux and most the time I can make apps that sing and dance on windows without any trouble at all. in fact i am the best " string butcher" in the world
|
Mining is CPU-wars and Intel, AMD like it nearly as much as big oil likes miners wasting electricity. Is this what mankind has come too.
|
|
|
coder0x15
Jr. Member
Offline
Activity: 36
Merit: 3
|
|
January 15, 2018, 09:28:01 PM Last edit: January 16, 2018, 12:52:09 AM by coder0x15 |
|
It doesn't matter what OS you have. Blockchain is equal and fully cross platform. I mean blk*.dat binaries and so on. @Anti-Cen, "string butcher", so please show us your script that extract all non-zero ballances from blockchain
|
|
|
|
initstring
Newbie
Offline
Activity: 7
Merit: 0
|
|
January 28, 2018, 12:43:53 AM |
|
edit: here it is https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z
Hi @btctousd81, Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time. Either way, thanks!
|
|
|
|
btctousd81
|
|
January 28, 2018, 01:46:39 AM |
|
edit: here it is https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z
Hi @btctousd81, Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time. Either way, thanks! give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow., thanks
|
|
|
|
initstring
Newbie
Offline
Activity: 7
Merit: 0
|
|
January 29, 2018, 07:01:34 AM |
|
give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow.,
thanks
Thank you very much! I'll keep an eye on the thread. Much appreciated!
|
|
|
|
blocklife
Copper Member
Newbie
Offline
Activity: 81
Merit: 0
Look around you , nothing is secure
|
|
January 29, 2018, 10:35:01 AM |
|
Wouldnt it be easiers if you pulled all discovered addresses from an existing db then query for there balances and filter out the ones < x
Problem solved. ?
|
The purpose of humanity : Genesis Chapter 1 (Rule)
|
|
|
webchris
|
|
January 29, 2018, 03:21:12 PM |
|
Wouldnt it be easiers if you pulled all discovered addresses from an existing db then query for there balances and filter out the ones < x
Problem solved. ?
Then you are relying on the other database to be up-to-date. Plus that db is going to be pretty large as there are quite a few discovered addresses.
|
|
|
|
initstring
Newbie
Offline
Activity: 7
Merit: 0
|
|
January 29, 2018, 07:48:09 PM |
|
Wouldnt it be easiers if you pulled all discovered addresses from an existing db then query for there balances and filter out the ones < x
Problem solved. ?
It's fairly easy to pull this info from a full node. The full node I run is in a VM with 4GB RAM, and the method I'm familiar with ( https://github.com/znort987/blockparser) requires a machine with closer to 128GB.
|
|
|
|
btctousd81
|
|
January 30, 2018, 02:46:03 AM |
|
here it is latest dump https://www.transfernow.net/51dss251ddg5format btc address,hash160,amount in satoshis
[root@btcnode tmp]# head btctousd81_29jan2018.csv 1111111111111111111114oLvT2,0000000000000000000000000000000000000000,6531128743 111111111111111111112BEH2ro,000000000000000000000000000000000000000a,10940 111111111111111111112xT3273,0000000000000000000000000000000000000011,5340 1111111111111111111141MmnWZ,000000000000000000000000000000000000001a,5340 111111111111111111114ysyUW1,0000000000000000000000000000000000000023,5340 11111111111111111111BZbvjr,0000000000000000000000000000000000000001,1028212 11111111111111111111CJawggc,0000000000000000000000000000000000000064,1548 11111111111111111111HV1eYjP,0000000000000000000000000000000000000092,2730 11111111111111111111HeBAGj,0000000000000000000000000000000000000002,5481 11111111111111111111QekFQw,0000000000000000000000000000000000000003,1 [root@btcnode tmp]# tail btctousd81_29jan2018.csv 1DpBda3jw6x2rbkSJUFrBfUPKgFbZsr5t9,8c8deefad99de1daffac1446a01132266c9d58fa,35264328 1JtY892wdpUfeVqg3nH3fed2whZBi9xTf,036217897bf7eb792d129b962e8d478e2030ac94,19446553 19b8mLDpqbUwZCZ8Sa9TbMj2ofhcUwc5HF,5e35a15c10dd14e888b58320f737142c48e2eea6,3366861 15SQ4c9BRsR77hbBLBXxGi8h7V7pDFtShG,30ae274c7101a903e1cce0d429383b2d680c947f,10524100 1HB4EbQygbDBqj4DeRWrEHvqEyPdW2k9B7,b168df40270271f6d71e2cd961e40f58e86f7d9e,2882 1H9KeUz92d3DwdTdnH2dR4tjF9Q1ma8uHW,b114e7c464188535cdea560ac484e609d92e07ee,2182583 1GxScqUcg5MZRrkQQeTziivX6CfVTywCXh,af06263ce147c366a49e12964e50f7106e8368e1,3294 3BceAG61bUsfBxb64JpMKB5TuE1mqzPkao,6cdd6d3eb7084e3487eadb47bcec761c87ca966e,540545 1LsweYaesdzt86Ze2WSQQHso5AjoNDRikv,da0cce25e3b57eaa2822ca328a5581a9a694e2ee,3739000 15ozPLgWzBokpRUbNecatNqqDbfpADFtUb,34c38a43d285e03e0a0b4bf65ca0a6f9ae8c97e6,349051
|
|
|
|
initstring
Newbie
Offline
Activity: 7
Merit: 0
|
|
January 30, 2018, 03:47:17 AM |
|
here it is latest dump
...
Awesome, thank you so much! I owe you one.
|
|
|
|
|