Title: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 12:58:57 PM
Hey there, I finally got my blockchain synced up with bitcoin core and now I'm trying to get armory online. However I'm getting some errors and it seems to stay stuck scanning the database in offline mode. Any help figuring it out much appreciated. The part of the logfile that seems most relevant is here: Log file opened at 08:36:44: /home/henry/.armory/dbLog.txt
-INFO - 08:36:44: (main.cpp:32) Running on 2 threads
-INFO - 08:36:44: (main.cpp:33) Ram usage level: 4
-INFO - 08:36:44: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO - 08:36:44: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO - 08:36:44: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 08:36:44: (BDM_Server.h:263) Listening on port 51460
-INFO - 08:36:44: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO - 08:36:44: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN - 08:36:44: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO - 08:36:44: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO - 08:36:44: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO - 08:36:44: (Blockchain.cpp:248) Organizing chain
-INFO - 08:36:44: (Blockchain.cpp:370) Organized chain in 0s
-INFO - 08:36:44: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO - 08:36:44: (lmdb_wrapper.cpp:388) Opening databases...
-ERROR - 08:36:44: (BitcoinP2P.cpp:1032) caught exception in processDataStackThread: invalid varint size
-INFO - 08:36:44: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO - 08:36:44: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO - 08:36:44: (DatabaseBuilder.cpp:134) scanning new blocks from #1 to #0
-INFO - 08:36:44: (BlockchainScanner.cpp:52) no history to scan
-ERROR - 08:36:44: (BlockchainScanner.cpp:1229) Cannot find block with hash
-ERROR - 08:36:44: (BDM_mainthread.cpp:306) BDM thread failed: std::exception
-INFO - 08:36:44: (BDM_Server.cpp:1114) registered bdv: 10b2739563b20a3dfe28
-INFO - 08:36:44: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 08:36:44: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 08:36:44: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 08:36:44: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 08:36:44: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 08:36:44: (BlockchainScanner.cpp:451) Was looking for id #4294967295 And the rest of the logfile is here: http://termbin.com/v7gp (http://termbin.com/v7gp) Any help much appreciated! Thanks, Henry
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 01:18:04 PM
Reading other posts, I tried doing a git pull to update, ran armory again, similar situation, still stuck on scanning, but it looks a little different now: https://i.imgur.com/SanLMp4.pngAnd the new logfile: http://termbin.com/9zhl (http://termbin.com/9zhl) Any help much appreciated.
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 02:28:03 PM
Updated armory, recompiled it, basically did git checkout, git pull, autogen, submodule init, submodule update, make and make install. Tried again, now I get this: Log file opened at 10:23:31: /home/henry/.armory/dbLog.txt
-INFO - 10:23:31: (main.cpp:32) Running on 2 threads
-INFO - 10:23:31: (main.cpp:33) Ram usage level: 4
-INFO - 10:23:31: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO - 10:23:31: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO - 10:23:31: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 10:23:31: (BDM_Server.h:263) Listening on port 52437
-INFO - 10:23:31: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO - 10:23:31: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN - 10:23:31: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO - 10:23:31: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO - 10:23:31: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO - 10:23:31: (Blockchain.cpp:248) Organizing chain
-INFO - 10:23:31: (Blockchain.cpp:370) Organized chain in 0s
-INFO - 10:23:31: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO - 10:23:31: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 10:23:31: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO - 10:23:31: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO - 10:23:31: (BDM_supportClasses.cpp:1890) Enabling zero-conf tracking
-INFO - 10:23:31: (BitcoinP2P.cpp:947) Connected to Bitcoin node
-INFO - 10:23:31: (BDM_Server.cpp:1114) registered bdv: e4c3af14d20b95bf104d
-INFO - 10:23:31: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 10:23:31: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 10:23:31: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 10:23:31: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 10:23:31: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 10:23:31: (BlockchainScanner.cpp:451) Was looking for id #4294967295 Next I'll try switching from bitcoin 0.15.0.1 to 15
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 02:44:42 PM
So, I've now downgraded bitcoin core to version 0.15.0.0, and now when I run armory, it does show "connected (0 blocks)" in the lower right corner (first time I've seen that! woohoo!) but it still doesn't seem to be loading the database correctly. Screenshot: https://i.imgur.com/3FV3abi.pngLogfile: Log file opened at 10:39:57: /home/henry/.armory/dbLog.txt
-INFO - 10:39:57: (main.cpp:32) Running on 2 threads
-INFO - 10:39:57: (main.cpp:33) Ram usage level: 4
-INFO - 10:39:57: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO - 10:39:57: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO - 10:39:57: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 10:39:57: (BDM_Server.h:263) Listening on port 62746
-INFO - 10:39:57: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO - 10:39:57: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN - 10:39:57: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO - 10:39:57: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO - 10:39:57: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO - 10:39:57: (Blockchain.cpp:248) Organizing chain
-INFO - 10:39:57: (Blockchain.cpp:370) Organized chain in 0s
-INFO - 10:39:57: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO - 10:39:57: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 10:39:57: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO - 10:39:57: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO - 10:39:57: (BDM_supportClasses.cpp:1890) Enabling zero-conf tracking
-INFO - 10:39:57: (BDM_Server.cpp:1114) registered bdv: d7844602586a413b4d22
-INFO - 10:39:57: (BitcoinP2P.cpp:947) Connected to Bitcoin node
-INFO - 10:39:57: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 10:39:57: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 10:39:57: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 10:39:57: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 10:39:57: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 10:39:57: (BlockchainScanner.cpp:451) Was looking for id #4294967295 Any help would be great! Thanks again Henry
Title: Re: Stuck in scanning
Post by: PhoenixFire on October 01, 2017, 03:36:55 PM
Hey there,
Lets try to narrow down your issues.
Armory 0.96.2 and lower don't play nice with Bitcoin Core 0.15.0.1, as you seem to have found out in your last two posts.
This was fixed with the next release: 0.96.3 and 0.15.0.1 will work together.
It looks like you're running 0.96.2 and Core 0.15(.0.0) in your last post, which should work but might need a nudge:
Try shutting Armory down (including ArmoryDB) and then deleting the databases folder (/home/henry/.armory/databases) in case anything broken has been carried over.
Additionally is your Core node configured with "server=1" ?
If not, then (re)start Core. Make sure it is synced fully then start Armory. See how that goes! :)
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 04:56:28 PM
ok, so, I'm running Armory 96.3 I did not have server=1 set in my bitcoin core conf, i set that in .bitcoin/bitcoin.conf and restarted core; When I run Armory, it shows this screen: https://i.imgur.com/dgXhMZR.pngAnd the log file is http://termbin.com/68sf (http://termbin.com/68sf) The relevant part/new part of the log file is Log file opened at 12:51:03: /home/henry/.armory/dbLog.txt
-INFO - 12:51:03: (main.cpp:32) Running on 2 threads
-INFO - 12:51:03: (main.cpp:33) Ram usage level: 4
-INFO - 12:51:03: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO - 12:51:03: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO - 12:51:03: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 12:51:03: (BDM_Server.h:263) Listening on port 54406
-INFO - 12:51:03: (BitcoinP2P.cpp:947) Connected to Bitcoin node
-INFO - 12:51:03: (nodeRPC.cpp:57) RPC connection established
-INFO - 12:51:03: (nodeRPC.cpp:346) Node is ready
-INFO - 12:51:03: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO - 12:51:03: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN - 12:51:03: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO - 12:51:03: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO - 12:51:03: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO - 12:51:03: (Blockchain.cpp:248) Organizing chain
-INFO - 12:51:03: (Blockchain.cpp:370) Organized chain in 0s
-INFO - 12:51:03: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO - 12:51:03: (lmdb_wrapper.cpp:388) Opening databases...
-INFO - 12:51:03: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO - 12:51:03: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO - 12:51:03: (BDM_supportClasses.cpp:1890) Enabling zero-conf tracking
-INFO - 12:51:03: (BDM_Server.cpp:1114) registered bdv: 9b4b78f585354c16094f
-INFO - 12:51:04: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 12:51:04: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 12:51:04: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 12:51:04: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 12:51:04: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 12:51:04: (BlockchainScanner.cpp:451) Was looking for id #4294967295
[EDIT:] this log and screenshot were taken after deleting the database folder, adding the server=1 to bitcoin core conf, restarting bitcoin core and starting armory. Any help greatly appreciated.
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 05:01:17 PM
Since it should work with 96.3 and 15.0.1, I'm going to restore my bitcoin core back to 15.0.1 and see if that makes a difference.
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 05:07:52 PM
So, I have now updated bitcoin core to 15.0.1 again; I'm looking at the debug window in core and I may have found a problem or an answer, https://i.imgur.com/Rp1ZSuP.pngWhere it says "Memory Pool" and "current number of transactions," that number is not staying put, it's growing -- will i need to wait for it to finish before it will work?
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 05:14:06 PM
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 06:23:15 PM
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 06:27:50 PM
Looking in my bitcoin.conf I see I have a line "prune=550" will this cause problems?
Title: Re: Stuck in scanning
Post by: goatpig on October 01, 2017, 06:31:04 PM
Looking in my bitcoin.conf I see I have a line "prune=550" will this cause problems?
I don't think the pruning is tanking your node, but it won't work with Armory anyways.
Title: Re: Stuck in scanning
Post by: PhoenixFire on October 01, 2017, 08:02:22 PM
Looking in my bitcoin.conf I see I have a line "prune=550" will this cause problems?
I don't think the pruning is tanking your node, but it won't work with Armory anyways. Ooof, yeah. Armory needs a full ~145GB node, not a pruned one :( Will you have enough space available for this once you turn off pruning? As for why core is failing... not sure. I'd have thought if Armory was starting core itself too (there is a setting for this by default), then you'd be able to find bitcoin process it spawns. Hate to fall back to this, but restart system? To answer another question: Where it says "Memory Pool" and "current number of transactions," that number is not staying put, it's growing -- will i need to wait for it to finish before it will work?
This is the current amount of transactions that are pending and waiting to be mined into a block. Not something to worry about as a user, except for figuring out transaction fees :)
Title: Re: Stuck in scanning
Post by: HenryRomp on October 01, 2017, 08:22:11 PM
Ok; I had not intended to make my node a pruned node. Bummer. Now I've restarted the whole process and am currently syncing the blockchain. I have the space, but my network connection is painfully slow, so it will be a while. I'll post here again when I am able to try again.
I'm not sure why core wouldn't run, but I restarted the machine and now it will. But now I'm back to "progress increase %0.56 per hour" ... Be back in a week or so I figure...
|
