Bitcoin Forum
May 05, 2024, 11:10:40 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: Reindexing blocks on disk...  (Read 3639 times)
twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
April 22, 2013, 11:58:43 PM
 #1

I have been seeing this message a lot the past couple of weeks.    bitcoin also no longer works
well when I tell it to store all the data files on my NAS as I like to do from my laptops.

What the heck changed to make the latest bitcoin so flakey with the block store now?  Never had these issues for a couple of years till recently.


█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
1714907440
Hero Member
*
Offline Offline

Posts: 1714907440

View Profile Personal Message (Offline)

Ignore
1714907440
Reply with quote  #2

1714907440
Report to moderator
1714907440
Hero Member
*
Offline Offline

Posts: 1714907440

View Profile Personal Message (Offline)

Ignore
1714907440
Reply with quote  #2

1714907440
Report to moderator
Even in the event that an attacker gains more than 50% of the network's computational power, only transactions sent by the attacker could be reversed or double-spent. The network would not be destroyed.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1714907440
Hero Member
*
Offline Offline

Posts: 1714907440

View Profile Personal Message (Offline)

Ignore
1714907440
Reply with quote  #2

1714907440
Report to moderator
1714907440
Hero Member
*
Offline Offline

Posts: 1714907440

View Profile Personal Message (Offline)

Ignore
1714907440
Reply with quote  #2

1714907440
Report to moderator
toffoo
Sr. Member
****
Offline Offline

Activity: 408
Merit: 261



View Profile
April 23, 2013, 12:11:17 AM
 #2

OS version?

twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
April 23, 2013, 12:33:31 AM
 #3

OS version?


Windows 7

█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
kjj
Legendary
*
Offline Offline

Activity: 1302
Merit: 1024



View Profile
April 23, 2013, 03:50:47 AM
 #4

If I had to guess, I'd say the switch from BDB in <= 0.7.x to leveldb in >=0.8

17Np17BSrpnHCZ2pgtiMNnhjnsWJ2TMqq8
I routinely ignore posters with paid advertising in their sigs.  You should too.
twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
May 09, 2013, 06:45:55 AM
 #5

If I had to guess, I'd say the switch from BDB in <= 0.7.x to leveldb in >=0.8

Once again I find myself waiting six hours so far for a block index.

I really wish they had not put that message that an update to 0.8.1 was mandatory.  While I proposed awhile back getting rid of bdb as a requirement for licensing reasons,  taking it out as an option before the alternative was ready for prime time was a bad move.   Should have been abstracted, so at least production wallets could be kept with on more stable code.  Now I have to debate trying to downgrade or not.

 

█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
gmaxwell
Moderator
Legendary
*
expert
Offline Offline

Activity: 4158
Merit: 8382



View Profile WWW
May 10, 2013, 06:57:30 PM
 #6

BDB is still used for the wallets.  Making it optional for the blockchain had far too much testing risk, as inconsistencies in blockchain behavior across the network can cause forking problems. Testing just one backed was already hard enough.

Six hours sounds like a redownload, not a reindex. Can you provide more information about your OS and hardware?

Quote
bitcoin also no longer works well when I tell it to store all the data files on my NAS as I like to do from my laptops
Yes, this is a known (but not known at the time of 0.8.0's release) issue.
twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
May 10, 2013, 07:18:13 PM
 #7

BDB is still used for the wallets.  Making it optional for the blockchain had far too much testing risk, as inconsistencies in blockchain behavior across the network can cause forking problems. Testing just one backed was already hard enough.

Six hours sounds like a redownload, not a reindex. Can you provide more information about your OS and hardware?

Quote
bitcoin also no longer works well when I tell it to store all the data files on my NAS as I like to do from my laptops
Yes, this is a known (but not known at the time of 0.8.0's release) issue.

I  think it would be less risk to have as a fall back then to force all new clients to use a new db engine, especially since you can't force everyone to update at once, it gives you a fall back if issues arise in the new engine behaving differently without having to lose any other improvements.   Ah well, too late for that either way.

I actually think I could re-download faster then six hours. I definitely could with the older version but 0.8.1  is much slower.
The software itself says it is reindexing blocks on disk.. while this happens.

The issue is on my windows 7 64bit    laptop,   i7 Q 820  processor, 8gb ram. NAS is a synology.   Works well still with alt chains, but no longer with bitcoin.    Any other details that may help?


█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
May 10, 2013, 07:53:54 PM
 #8

It this thread https://bitcointalk.org/index.php?topic=182529.msg1927645#msg1927645  it looks like someone else is also having issues with the client saying it takes hours to open  etc.   seems like it may be similar issues.   Want to pm him to see if he can also maybe test the rc?  Or want me to do it? Or?

█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
desired_username
Hero Member
*****
Offline Offline

Activity: 879
Merit: 1013


View Profile
May 11, 2013, 10:15:21 AM
 #9

I don't want to create a separate thread just yet.

My bitcoin qt client worked fine for years up until approx 16 hours ago.

My client is running 24/7. I left the PC working OK for the night and when I woke up it was syncing and at the moment it still does.

I ruled out networking issues, I updated the client to the latest available from bitcoin.org, I have 17 active connections.

It doesn't seem to be able to catch up with the blockchain, it seems to stuck at blocks 16h ago.


Can someone please help me?


While I was creating the screenshot it went back to 17h ago....wtf

twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
May 11, 2013, 10:23:14 AM
 #10

oes.

I ruled out networking issues, I updated the client to the latest available from bitcoin.org, I have 17 active connections.


This thread is starting to move to a 0.8.2rc thead.  By latest available is that the one you mean?

From https://bitcointalk.org/index.php?topic=201124.0 ?

█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
desired_username
Hero Member
*****
Offline Offline

Activity: 879
Merit: 1013


View Profile
May 11, 2013, 11:21:19 AM
 #11

I have downloaded it from bitcoin.org, and it was 0.8.1. I assumed that is the latest version.

should I try the rc1?

in the mean time, it goes backwards...now it says last block was 18h ago.... arrgh
desired_username
Hero Member
*****
Offline Offline

Activity: 879
Merit: 1013


View Profile
May 11, 2013, 11:23:43 AM
 #12

OS is win7 64bit

16GB ram

pcie ssd

i7 at 4ghz

.....
desired_username
Hero Member
*****
Offline Offline

Activity: 879
Merit: 1013


View Profile
May 11, 2013, 12:10:57 PM
 #13

OS is win7 64bit

16GB ram

pcie ssd

i7 at 4ghz

.....


Sorry for spamming the hell out of this thread, but I'm very concerned now.

Switched to RC1, and it still have troubles catching up, it's now on "19h ago" and I only have 8 connections despite that port forward works ok.

anyone care to help? if there's a better place to ask please direct me there
twobits (OP)
Sr. Member
****
Offline Offline

Activity: 574
Merit: 250



View Profile
May 25, 2013, 01:37:39 PM
 #14

Here is my update with the rc1.  It took over 24 hours to reindex  the first run.  Since then it has not had to reindex, so much better, however it is still slow as molasses downloading the new blocks compared to older versions.

█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
███
███
███
███
███
███
███
███
███
HyperQuant.net
Platform for Professional Asset Management
███
███
███
███
███
███
███
███
███
WhitePaper
One-Pager
███
███
███
███
███
███
███
███
███
Telegram 
Facebook
Twitter
Medium
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
███
█████                █████      ███████             
█████                ███    █████████████       
█████                ██  █████████████████   
█████                █  ██████              ██████ 
█████                    ████                      ████ 
█████████████  █████                        ████
█████████████  █████                        ████
█████████████  █████                        ████
█████                    █████                             
█████                █  ██████              ███████
█████                ██  ███████████    █████ 
█████                ███    █████████    ████   
█████                █████      ███████    ██
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!