Bitcoin Forum
May 08, 2024, 11:49:24 PM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 2 3 4 5 6 7 [8] 9 10 11 12 13 14 15 16 17 »  All
  Print  
Author Topic: Get list of all addresses with a balance over x?  (Read 43257 times)
WitoldC
Newbie
*
Offline Offline

Activity: 78
Merit: 0


View Profile
January 03, 2018, 02:19:21 PM
 #141

There is ';' instead ',' You must replace all in editor.

Code:
1CG4LbEXoBus2egJS8SBh3DDPTrSykzFMG;942800
1Jt1Yng68p6Pd3pYWc1W1nxWSZSx9PZNto;2100390
32i3fvUTZkq2zeHBuosYDkiSCyMDhP62eo;9592347
Remember that Bitcoin is still beta software. Don't put all of your money into BTC!
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1715212164
Hero Member
*
Offline Offline

Posts: 1715212164

View Profile Personal Message (Offline)

Ignore
1715212164
Reply with quote  #2

1715212164
Report to moderator
1715212164
Hero Member
*
Offline Offline

Posts: 1715212164

View Profile Personal Message (Offline)

Ignore
1715212164
Reply with quote  #2

1715212164
Report to moderator
1715212164
Hero Member
*
Offline Offline

Posts: 1715212164

View Profile Personal Message (Offline)

Ignore
1715212164
Reply with quote  #2

1715212164
Report to moderator
blue2358
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
January 10, 2018, 06:00:04 PM
 #142

@daboehla would you have a new hash160 file with all hashes for all addresses?

thanks in advance!
daboehla
Sr. Member
****
Offline Offline

Activity: 490
Merit: 258



View Profile
January 11, 2018, 07:34:08 AM
 #143

@daboehla would you have a new hash160 file with all hashes for all addresses?

thanks in advance!
Still waiting for my new PC... I think about somewhere next week I can make a fresh one.
btctousd81
Sr. Member
****
Offline Offline

Activity: 434
Merit: 270


View Profile WWW
January 11, 2018, 08:33:15 AM
 #144

give me few hours, ill upload latest one.

webchris
Member
**
Offline Offline

Activity: 142
Merit: 10


View Profile WWW
January 11, 2018, 10:43:13 PM
 #145

give me few hours, ill upload latest one.

Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you?

Join a Safe Shared LUX Masternode -> https://www.luxmasternode.com
btctousd81
Sr. Member
****
Offline Offline

Activity: 434
Merit: 270


View Profile WWW
January 12, 2018, 01:15:48 AM
Last edit: January 12, 2018, 05:55:03 AM by btctousd81
 #146

give me few hours, ill upload latest one.

Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you?

nope, only addresses having balance.

edit: here it is

Code:
https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z
format

Code:
addresss, hash160, amount

blue2358
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
January 13, 2018, 10:50:25 PM
 #147

thanks @btctousd81.

would you give the script that allows to create this csv?
did you do it in bash or python or anything else?
Anti-Cen
Member
**
Offline Offline

Activity: 210
Merit: 26

High fees = low BTC price


View Profile
January 13, 2018, 11:17:20 PM
 #148

Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery

it says "In order to use bitcoinquery you need a Bitcoind RPC server"

I want to do it from windows without running a full node and doing RPC to the local node
See https://bitcointalk.org/index.php?topic=2748620.new#new
Looks like i need some form of Berkeley-DB to run in windows to read Block.dat files that is not so easy to come
by in windows and yes I know it's all spyware

Will upload if i get anything working that should sum all balances (I hope)
but it will be windows based





Mining is CPU-wars and Intel, AMD like it nearly as much as big oil likes miners wasting electricity. Is this what mankind has come too.
Anti-Cen
Member
**
Offline Offline

Activity: 210
Merit: 26

High fees = low BTC price


View Profile
January 13, 2018, 11:33:42 PM
 #149


Nice so did you do it from windows or Linux without using a wrapper around someones
mega-big API or running a full-node and using RPC ?

I am trying to code this myself to read block.dat from several  types of forked BC  from Bitcoin
so I need to go back to raw files I think and then see what happens after a fork date to the data
so off the shelf API's won't help me out.

Will be interesting to see who has money in the forks and are not using it




Mining is CPU-wars and Intel, AMD like it nearly as much as big oil likes miners wasting electricity. Is this what mankind has come too.
btctousd81
Sr. Member
****
Offline Offline

Activity: 434
Merit: 270


View Profile WWW
January 14, 2018, 03:16:35 AM
 #150

thanks @btctousd81.

would you give the script that allows to create this csv?
did you do it in bash or python or anything else?


Nice so did you do it from windows or Linux without using a wrapper around someones
mega-big API or running a full-node and using RPC ?

I am trying to code this myself to read block.dat from several  types of forked BC  from Bitcoin
so I need to go back to raw files I think and then see what happens after a fork date to the data
so off the shelf API's won't help me out.

Will be interesting to see who has money in the forks and are not using it





i have full node running at home, on linux centos 7 dedicated to only bitcoind.

there is no single readymade script to get all addresses having balance.

what i did was i used rusty-blockparser to get all unspent outputs in csv.
then loaded it in myql
then some queries to get data in proper format and bitcoin-tool to get address to hash160.

then i have this php script which gets run every 4-6 hours and parses all new blocks using rpc. and updates my mysql db.

it was time consuming task took me 2-3 days to get everything in db.

it would be great if someone could create app which can directly read chainstate db.

parsing blockchain is pretty simple using rpc but its fuckin slow as hell.

every output is +1 and old amount + new amount
while
every input is -1 and old amount - new amount

this is my logic to get uptodate all addresses having balance ..

hope this helps.,

i could upload regular updated db daily but my home net has very slow upload speed so it takes around 7-8 hours to upload above dump.

-------------------------------

edit:

if you want only addresses having balance not care about the amount of btc its holding, then just run

rusty-blockparser with unspentcsv callback

you wiill get huge csv dump file then just use grep sed something like that to only get addresses.

the parser takes around 8 -12 hours., even on my amd fx 8350 , 32 gig dedicated machine.

Anti-Cen
Member
**
Offline Offline

Activity: 210
Merit: 26

High fees = low BTC price


View Profile
January 15, 2018, 11:51:50 AM
 #151

i have full node running at home, on linux centos 7 dedicated to only bitcoind.

Yes that's my killer because I run Windows spyware version 10 and is too old to
move over and learn Linux and most the time I can make apps that sing and dance
on windows without any trouble at all.

in fact i am the best "string butcher" in the world

Mining is CPU-wars and Intel, AMD like it nearly as much as big oil likes miners wasting electricity. Is this what mankind has come too.
coder0x15
Jr. Member
*
Offline Offline

Activity: 36
Merit: 3


View Profile
January 15, 2018, 09:28:01 PM
Last edit: January 16, 2018, 12:52:09 AM by coder0x15
 #152

It doesn't matter what OS you have. Blockchain is equal and fully cross platform. I mean blk*.dat binaries and so on.
@Anti-Cen, "string butcher", so please show us your script that extract all non-zero ballances from blockchain Smiley
initstring
Newbie
*
Offline Offline

Activity: 7
Merit: 0


View Profile
January 28, 2018, 12:43:53 AM
 #153

Quote

edit: here it is

Code:
https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z

Hi @btctousd81,

Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time.

Either way, thanks!
btctousd81
Sr. Member
****
Offline Offline

Activity: 434
Merit: 270


View Profile WWW
January 28, 2018, 01:46:39 AM
 #154

Quote

edit: here it is

Code:
https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z

Hi @btctousd81,

Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time.

Either way, thanks!

give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow.,

thanks

initstring
Newbie
*
Offline Offline

Activity: 7
Merit: 0


View Profile
January 29, 2018, 07:01:34 AM
 #155


give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow.,

thanks

Thank you very much! I'll keep an eye on the thread. Much appreciated!
blocklife
Copper Member
Newbie
*
Offline Offline

Activity: 81
Merit: 0

Look around you , nothing is secure


View Profile WWW
January 29, 2018, 10:35:01 AM
 #156

Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones < x

Problem solved. ?

The purpose of humanity : Genesis Chapter 1 (Rule)
webchris
Member
**
Offline Offline

Activity: 142
Merit: 10


View Profile WWW
January 29, 2018, 03:21:12 PM
 #157

Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones < x

Problem solved. ?

Then you are relying on the other database to be up-to-date. Plus that db is going to be pretty large as there are quite a few discovered addresses.

Join a Safe Shared LUX Masternode -> https://www.luxmasternode.com
initstring
Newbie
*
Offline Offline

Activity: 7
Merit: 0


View Profile
January 29, 2018, 07:48:09 PM
 #158

Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones < x

Problem solved. ?

It's fairly easy to pull this info from a full node. The full node I run is in a VM with 4GB RAM, and the method I'm familiar with (https://github.com/znort987/blockparser) requires a machine with closer to 128GB.
btctousd81
Sr. Member
****
Offline Offline

Activity: 434
Merit: 270


View Profile WWW
January 30, 2018, 02:46:03 AM
 #159

here it is latest dump

https://www.transfernow.net/51dss251ddg5


format

Code:
btc address,hash160,amount in satoshis

Code:
[root@btcnode tmp]# head btctousd81_29jan2018.csv
1111111111111111111114oLvT2,0000000000000000000000000000000000000000,6531128743
111111111111111111112BEH2ro,000000000000000000000000000000000000000a,10940
111111111111111111112xT3273,0000000000000000000000000000000000000011,5340
1111111111111111111141MmnWZ,000000000000000000000000000000000000001a,5340
111111111111111111114ysyUW1,0000000000000000000000000000000000000023,5340
11111111111111111111BZbvjr,0000000000000000000000000000000000000001,1028212
11111111111111111111CJawggc,0000000000000000000000000000000000000064,1548
11111111111111111111HV1eYjP,0000000000000000000000000000000000000092,2730
11111111111111111111HeBAGj,0000000000000000000000000000000000000002,5481
11111111111111111111QekFQw,0000000000000000000000000000000000000003,1

Code:
[root@btcnode tmp]# tail btctousd81_29jan2018.csv
1DpBda3jw6x2rbkSJUFrBfUPKgFbZsr5t9,8c8deefad99de1daffac1446a01132266c9d58fa,35264328
1JtY892wdpUfeVqg3nH3fed2whZBi9xTf,036217897bf7eb792d129b962e8d478e2030ac94,19446553
19b8mLDpqbUwZCZ8Sa9TbMj2ofhcUwc5HF,5e35a15c10dd14e888b58320f737142c48e2eea6,3366861
15SQ4c9BRsR77hbBLBXxGi8h7V7pDFtShG,30ae274c7101a903e1cce0d429383b2d680c947f,10524100
1HB4EbQygbDBqj4DeRWrEHvqEyPdW2k9B7,b168df40270271f6d71e2cd961e40f58e86f7d9e,2882
1H9KeUz92d3DwdTdnH2dR4tjF9Q1ma8uHW,b114e7c464188535cdea560ac484e609d92e07ee,2182583
1GxScqUcg5MZRrkQQeTziivX6CfVTywCXh,af06263ce147c366a49e12964e50f7106e8368e1,3294
3BceAG61bUsfBxb64JpMKB5TuE1mqzPkao,6cdd6d3eb7084e3487eadb47bcec761c87ca966e,540545
1LsweYaesdzt86Ze2WSQQHso5AjoNDRikv,da0cce25e3b57eaa2822ca328a5581a9a694e2ee,3739000
15ozPLgWzBokpRUbNecatNqqDbfpADFtUb,34c38a43d285e03e0a0b4bf65ca0a6f9ae8c97e6,349051

initstring
Newbie
*
Offline Offline

Activity: 7
Merit: 0


View Profile
January 30, 2018, 03:47:17 AM
 #160

here it is latest dump

...

Awesome, thank you so much! I owe you one. Smiley
Pages: « 1 2 3 4 5 6 7 [8] 9 10 11 12 13 14 15 16 17 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!