blkXXXX.dat to csv [blockchain parser]

[Sinsix]

Hello.

I want to parser all blkXXXX.dat to json and then to csv to make my own database for analytic work but I just keep failing. I wonder if there is anyone to help me. I would be very grateful.

Looking for blockchain parser for windows10

EDIT: I have tried this https://github.com/spooktheducks/local-blockchain-parser but I am getting problem https://gyazo.com/6e1c5a38e75dd4a57a916a592b01fdb8

[1715165679]

1715165679

[1715165679]

1715165679

[1715165679]

1715165679

[nc50lc]

EDIT: I have tried this https://github.com/spooktheducks/local-blockchain-parser but I am getting problem

You might have written an extra "r" to your Bitcoin blocks directory during the initial setup of the parser.
There shouldn't be any "r" folder there unless you've created one and moved your blocks dir.
According to the "readme", you can change it by editing the "wlff-blockchain.json" file from local-blockchain-parser's installation directory.

[Sinsix]

EDIT: I have tried this https://github.com/spooktheducks/local-blockchain-parser but I am getting problem
https://i.gyazo.com/6e1c5a38e75dd4a57a916a592b01fdb8.png

You might have written an extra "r" to your Bitcoin blocks directory during the initial setup of the parser.
There shouldn't be any "r" folder there unless you've created one and moved your blocks dir.
According to the "readme", you can change it by editing the "wlff-blockchain.json" file from local-blockchain-parser's installation directory.

The thing is i set the direction correctly but it auto-adds the r . When I delete it it says wrong path...

[nc50lc]

The thing is i set the direction correctly but it auto-adds the r .

Try to set it after closing local-blockchain-parser and all of its background process(es).

When I delete it it says wrong path...

Of course it will, there will be no dat file directory.
If just the "r", I have no other idea aside from you've given the wrong path.

I haven't used that parser but you need to know that most of them are incapable of parsing blk.dat files with SegWit data in it.
Somewhere around blk00971.dat+.

[Sinsix]

The thing is i set the direction correctly but it auto-adds the r .

Try to set it after closing local-blockchain-parser and all of its background process(es).

When I delete it it says wrong path...

Of course it will, there will be no dat file directory.
If just the "r", I have no other idea aside from you've given the wrong path.

I haven't used that parser but you need to know that most of them are incapable of parsing blk.dat files with SegWit data in it.
Somewhere around blk00971.dat+.

nah nothing works... I need the blockchain to json to csv for future analytic work but I keep failing to do so I would pay with gold for anything that works

[PrimeNumber7]

nah nothing works... I need the blockchain to json to csv for future analytic work but I keep failing to do so I would pay with gold for anything that works

How much are you offering?

This should not be very difficult if you have bitcoin core running.

[Wynn1427]

Not running bitcoin core myself so that wouldn't be an option on my end. Good information from nc50lc and segwit data/structure changes that must be taken into account for any parser requirements.

Just got data block 600947 and was 8.2mb with 2774 transactions.

json without tx's and raw data are as follows:

https://i.imgur.com/N4oH2ZS.png
https://i.imgur.com/qIFbqiX.png
https://i.imgur.com/tvNSK5R.png

Trying to wrap this around my head how to organize data in .csv file and be of use for your request?     

Just a FYI, been awhile since I wrote any personal code for data collection/organizing/scraping of information, but been following the blockchain technology the last few years closely and figure reading/writing some code is only a positive to being active on the forum and in space.

[awertheim]

I've been building a python library that scans Core and assembles several tables into .xlsx files (which you could easily save as .csv instead). It's not public or on GitHub yet though

[awertheim]

This will probably do exactly what you're looking to do..

https://pypi.org/project/bitcoin-etl/#description

[coder0x15]

You can try this one https://github.com/ragestack/blockchain-parser