|
Title: Will it ever be possible to separate chainstate and blocks folder? Post by: cellard on March 01, 2018, 06:52:33 PM I have been looking at the documentation on the latest 0.16 update and I see that we can finally allocate the wallet.dat file anywhere we want including any other hard drive which is cool, but still this doesn't solve the problem of having to have chainstate and blocks in the same place.
The ideal setup would be to have your blocks folder in an HDD and then the rest on an SSD for maximum speed while not cluttering your expensive SSD space with blocks. Even if you use prune mode eventually it will be a pain in the ass to sync on your SSD since SSD space is very expensive and usually you will want to use it for other things too. If we could use HDD for blocks and SSD for chainstate it would lower the costs of running a node at decent speeds a lot. Will this ever be possible and how long are we from seeing that? I remember asking a long time ago about wallet separated from root folder and got told it was not possible and unsafe, yet it is now possible, so I would like to ask about this. Title: Re: Will it ever be possible to separate chainstate and blocks folder? Post by: achow101 on March 01, 2018, 08:11:31 PM Will this ever be possible It should be possible to do now with symlinking. But to actually have configuration options, I'm not sure.and how long are we from seeing that? No such time estimates can be given since no one is working on it and it is not a priority.I remember asking a long time ago about wallet separated from root folder and got told it was not possible and unsafe, yet it is now possible, so I would like to ask about this. What people were asking for in the past is not possible and is still unsafe. What happens now is only possible because of datadir structure changes that move wallet things into their own separate directory.Title: Re: Will it ever be possible to separate chainstate and blocks folder? Post by: cellard on March 02, 2018, 01:09:18 PM Will this ever be possible It should be possible to do now with symlinking. But to actually have configuration options, I'm not sure.and how long are we from seeing that? No such time estimates can be given since no one is working on it and it is not a priority.I remember asking a long time ago about wallet separated from root folder and got told it was not possible and unsafe, yet it is now possible, so I would like to ask about this. What people were asking for in the past is not possible and is still unsafe. What happens now is only possible because of datadir structure changes that move wallet things into their own separate directory.But I remember I asked about symlinking method to separate chainstate folder from blocks folder and also other members also asked about it and basically the consensus was that it was very unsafe and would corrupt the block or chainstate files... what has changed since then? Or when you say possible, you mean it can be done but it is still unsafe even with the latest version? Im just not sure what you mean. I think you mean that nothing has changed and it's still unsafe but I want to be sure... but I predict that im going to be stuck with an HDD. Title: Re: Will it ever be possible to separate chainstate and blocks folder? Post by: achow101 on March 02, 2018, 03:27:28 PM But I remember I asked about symlinking method to separate chainstate folder from blocks folder and also other members also asked about it and basically the consensus was that it was very unsafe and would corrupt the block or chainstate files... what has changed since then? Or when you say possible, you mean it can be done but it is still unsafe even with the latest version? Im just not sure what you mean. Nothing has changed and it's probably still unsafe to symlink the blocks folder.I think you mean that nothing has changed and it's still unsafe but I want to be sure... but I predict that im going to be stuck with an HDD. Title: Re: Will it ever be possible to separate chainstate and blocks folder? Post by: LoyceV on March 02, 2018, 04:20:49 PM It should be possible to do now with symlinking. I can confirm this, it's exactly what I did with my blocks-directory (my .bitcoin-directory is on my SSD now).As an alternative (although not something I prefer) you could mount a small dedicated partition on your chainstate location. But I remember I asked about symlinking method to separate chainstate folder from blocks folder and also other members also asked about it and basically the consensus was that it was very unsafe and would corrupt the block or chainstate files... As far as I know, the unsafe part happens if your symlinked location becomes unavailable. That's not something I worry about on my own system though (worst case I'll need to restore a backup).Title: Re: Will it ever be possible to separate chainstate and blocks folder? Post by: Thirdspace on March 02, 2018, 11:10:22 PM But I remember I asked about symlinking method to separate chainstate folder from blocks folder and also other members also asked about it and basically the consensus was that it was very unsafe and would corrupt the block or chainstate files... As far as I know, the unsafe part happens if your symlinked location becomes unavailable. That's not something I worry about on my own system though (worst case I'll need to restore a backup).can we recover/rebuild one by using the other? which one is more important? recently my wallet (btx based on btc) ask to rebuild the blocks because corrupted issue but it keeps failing on rebuilding the blocks and I ended syncing from my last backup every now and then I make backup by copying blocks and chainstate folders, is this the correct way to backup blockchains? Title: Re: Will it ever be possible to separate chainstate and blocks folder? Post by: theymos_away on March 03, 2018, 01:15:03 AM I was wondering about the actual connection between blocks and chainstate folders can we recover/rebuild one by using the other? which one is more important? recently my wallet (btx based on btc) ask to rebuild the blocks because corrupted issue but it keeps failing on rebuilding the blocks and I ended syncing from my last backup every now and then I make backup by copying blocks and chainstate folders, is this the correct way to backup blockchains? See: https://en.bitcoin.it/wiki/Data_directory#Transferability https://en.bitcoin.it/wiki/Splitting_the_data_directory I've never heard of any problems symlinking the blocks or chainstate directories, as long as they remain accessible, of course. Symlinking files related to the wallet is more dangerous due to BDB's weirdness. |