Stuck in scanning

[HenryRomp]

Hey there,
I finally got my blockchain synced up with bitcoin core and now I'm trying to get armory online.
However I'm getting some errors and it seems to stay stuck scanning the database in offline mode. Any help figuring it out much appreciated.

The part of the logfile that seems most relevant is here:

Code:

Log file opened at 08:36:44: /home/henry/.armory/dbLog.txt
-INFO  - 08:36:44: (main.cpp:32) Running on 2 threads
-INFO  - 08:36:44: (main.cpp:33) Ram usage level: 4
-INFO  - 08:36:44: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO  - 08:36:44: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO  - 08:36:44: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 08:36:44: (BDM_Server.h:263) Listening on port 51460
-INFO  - 08:36:44: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO  - 08:36:44: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN  - 08:36:44: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO  - 08:36:44: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO  - 08:36:44: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO  - 08:36:44: (Blockchain.cpp:248) Organizing chain 
-INFO  - 08:36:44: (Blockchain.cpp:370) Organized chain in 0s
-INFO  - 08:36:44: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO  - 08:36:44: (lmdb_wrapper.cpp:388) Opening databases...
-ERROR - 08:36:44: (BitcoinP2P.cpp:1032) caught exception in processDataStackThread: invalid varint size
-INFO  - 08:36:44: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO  - 08:36:44: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO  - 08:36:44: (DatabaseBuilder.cpp:134) scanning new blocks from #1 to #0
-INFO  - 08:36:44: (BlockchainScanner.cpp:52) no history to scan
-ERROR - 08:36:44: (BlockchainScanner.cpp:1229) Cannot find block with hash 
-ERROR - 08:36:44: (BDM_mainthread.cpp:306) BDM thread failed: std::exception
-INFO  - 08:36:44: (BDM_Server.cpp:1114) registered bdv: 10b2739563b20a3dfe28
-INFO  - 08:36:44: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 08:36:44: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 08:36:44: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 08:36:44: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 08:36:44: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 08:36:44: (BlockchainScanner.cpp:451) Was looking for id #4294967295

And the rest of the logfile is here: http://termbin.com/v7gp

Any help much appreciated!

Thanks,

Henry

[1714160801]

1714160801

[1714160801]

1714160801

[1714160801]

1714160801

[1714160801]

1714160801

[1714160801]

1714160801

[HenryRomp]

Reading other posts, I tried doing a git pull to update, ran armory again, similar situation, still stuck on scanning, but it looks a little different now:

And the new logfile:
http://termbin.com/9zhl
Any help much appreciated.

[HenryRomp]

Updated armory, recompiled it, basically did git checkout, git pull, autogen, submodule init, submodule update, make and make install.

Tried again, now I get this:

Code:

Log file opened at 10:23:31: /home/henry/.armory/dbLog.txt
-INFO  - 10:23:31: (main.cpp:32) Running on 2 threads
-INFO  - 10:23:31: (main.cpp:33) Ram usage level: 4
-INFO  - 10:23:31: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO  - 10:23:31: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO  - 10:23:31: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 10:23:31: (BDM_Server.h:263) Listening on port 52437
-INFO  - 10:23:31: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO  - 10:23:31: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN  - 10:23:31: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO  - 10:23:31: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO  - 10:23:31: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO  - 10:23:31: (Blockchain.cpp:248) Organizing chain 
-INFO  - 10:23:31: (Blockchain.cpp:370) Organized chain in 0s
-INFO  - 10:23:31: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO  - 10:23:31: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 10:23:31: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO  - 10:23:31: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO  - 10:23:31: (BDM_supportClasses.cpp:1890) Enabling zero-conf tracking
-INFO  - 10:23:31: (BitcoinP2P.cpp:947) Connected to Bitcoin node
-INFO  - 10:23:31: (BDM_Server.cpp:1114) registered bdv: e4c3af14d20b95bf104d
-INFO  - 10:23:31: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 10:23:31: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 10:23:31: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 10:23:31: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 10:23:31: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 10:23:31: (BlockchainScanner.cpp:451) Was looking for id #4294967295

Next I'll try switching from bitcoin 0.15.0.1 to 15

[HenryRomp]

So, I've now downgraded bitcoin core to version 0.15.0.0, and now when I run armory, it does show "connected (0 blocks)" in the lower right corner (first time I've seen that! woohoo!) but it still doesn't seem to be loading the database correctly.

Screenshot:


Logfile:

Code:

Log file opened at 10:39:57: /home/henry/.armory/dbLog.txt
-INFO  - 10:39:57: (main.cpp:32) Running on 2 threads
-INFO  - 10:39:57: (main.cpp:33) Ram usage level: 4
-INFO  - 10:39:57: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO  - 10:39:57: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO  - 10:39:57: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 10:39:57: (BDM_Server.h:263) Listening on port 62746
-INFO  - 10:39:57: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO  - 10:39:57: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN  - 10:39:57: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO  - 10:39:57: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO  - 10:39:57: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO  - 10:39:57: (Blockchain.cpp:248) Organizing chain 
-INFO  - 10:39:57: (Blockchain.cpp:370) Organized chain in 0s
-INFO  - 10:39:57: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO  - 10:39:57: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 10:39:57: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO  - 10:39:57: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO  - 10:39:57: (BDM_supportClasses.cpp:1890) Enabling zero-conf tracking
-INFO  - 10:39:57: (BDM_Server.cpp:1114) registered bdv: d7844602586a413b4d22
-INFO  - 10:39:57: (BitcoinP2P.cpp:947) Connected to Bitcoin node
-INFO  - 10:39:57: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 10:39:57: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 10:39:57: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 10:39:57: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 10:39:57: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 10:39:57: (BlockchainScanner.cpp:451) Was looking for id #4294967295

Any help would be great!

Thanks again

Henry

[PhoenixFire]

Hey there,

Lets try to narrow down your issues.

Armory 0.96.2 and lower don't play nice with Bitcoin Core 0.15.0.1, as you seem to have found out in your last two posts.
This was fixed with the next release: 0.96.3 and 0.15.0.1 will work together.

It looks like you're running 0.96.2 and Core 0.15(.0.0) in your last post, which should work but might need a nudge:
Try shutting Armory down (including ArmoryDB) and then deleting the databases folder (/home/henry/.armory/databases) in case anything broken has been carried over.
Additionally is your Core node configured with "server=1" ?
If not, then (re)start Core. Make sure it is synced fully then start Armory. See how that goes!

[HenryRomp]

ok, so,
I'm running Armory 96.3
I did not have server=1 set in my bitcoin core conf, i set that in .bitcoin/bitcoin.conf and restarted core;
When I run Armory, it shows this screen:

And the log file is http://termbin.com/68sf
The relevant part/new part of the log file is

Code:

Log file opened at 12:51:03: /home/henry/.armory/dbLog.txt
-INFO  - 12:51:03: (main.cpp:32) Running on 2 threads
-INFO  - 12:51:03: (main.cpp:33) Ram usage level: 4
-INFO  - 12:51:03: (BlockUtils.cpp:915) blkfile dir: /home/henry/.bitcoin/blocks
-INFO  - 12:51:03: (BlockUtils.cpp:916) lmdb dir: /home/henry/.armory/databases
-INFO  - 12:51:03: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 12:51:03: (BDM_Server.h:263) Listening on port 54406
-INFO  - 12:51:03: (BitcoinP2P.cpp:947) Connected to Bitcoin node
-INFO  - 12:51:03: (nodeRPC.cpp:57) RPC connection established
-INFO  - 12:51:03: (nodeRPC.cpp:346) Node is ready
-INFO  - 12:51:03: (BlockUtils.cpp:1108) Executing: doInitialSyncOnLoad
-INFO  - 12:51:03: (DatabaseBuilder.cpp:199) Reading headers from db
-WARN  - 12:51:03: (lmdb_wrapper.cpp:1241) No headers in DB yet!
-INFO  - 12:51:03: (DatabaseBuilder.cpp:238) Found 1 headers in db
-INFO  - 12:51:03: (DatabaseBuilder.cpp:71) updating HEADERS db
-INFO  - 12:51:03: (Blockchain.cpp:248) Organizing chain 
-INFO  - 12:51:03: (Blockchain.cpp:370) Organized chain in 0s
-INFO  - 12:51:03: (DatabaseBuilder.cpp:76) updated HEADERS db in 0s
-INFO  - 12:51:03: (lmdb_wrapper.cpp:388) Opening databases...
-INFO  - 12:51:03: (DatabaseBuilder.cpp:1231) verifying txfilters integrity
-INFO  - 12:51:03: (DatabaseBuilder.cpp:1314) done checking txfilters
-INFO  - 12:51:03: (BDM_supportClasses.cpp:1890) Enabling zero-conf tracking
-INFO  - 12:51:03: (BDM_Server.cpp:1114) registered bdv: 9b4b78f585354c16094f
-INFO  - 12:51:04: (BDM_supportClasses.cpp:401) Starting address registration process
-ERROR - 12:51:04: (lmdb_wrapper.cpp:1503) Headers DB has no block at height: 0
-ERROR - 12:51:04: (lmdb_wrapper.cpp:1483) No headers at height 0
-ERROR - 12:51:04: (BlockchainScanner.cpp:445) Missing file map for output scan, this is unexpected
-ERROR - 12:51:04: (BlockchainScanner.cpp:447) Has the following block files:
-ERROR - 12:51:04: (BlockchainScanner.cpp:451) Was looking for id #4294967295

[EDIT:] this log and screenshot were taken after deleting the database folder, adding the server=1 to bitcoin core conf, restarting bitcoin core and starting armory.

Any help greatly appreciated.

[HenryRomp]

Since it should work with 96.3 and 15.0.1, I'm going to restore my bitcoin core back to 15.0.1 and see if that makes a difference.

[HenryRomp]

So, I have now updated bitcoin core to 15.0.1 again;
I'm looking at the debug window in core and I may have found a problem or an answer,

Where it says "Memory Pool" and "current number of transactions," that number is not staying put, it's growing -- will i need to wait for it to finish before it will work?

[HenryRomp]

And here's a screenshot of armory, where it says 96.3:

[HenryRomp]

Ok, now I don't know what I did, but bitcoin core won't launch anymore.





It's not already running, I checked, there's no bitcoind or bitcoin-anything process running; I'm pretty confused.

[HenryRomp]

Looking in my bitcoin.conf I see I have a line "prune=550" will this cause problems?

[goatpig]

Looking in my bitcoin.conf I see I have a line "prune=550" will this cause problems?

I don't think the pruning is tanking your node, but it won't work with Armory anyways.

[PhoenixFire]

Looking in my bitcoin.conf I see I have a line "prune=550" will this cause problems?

I don't think the pruning is tanking your node, but it won't work with Armory anyways.

Ooof, yeah. Armory needs a full ~145GB node, not a pruned one
Will you have enough space available for this once you turn off pruning?

As for why core is failing... not sure. I'd have thought if Armory was starting core itself too (there is a setting for this by default), then you'd be able to find bitcoin process it spawns.
Hate to fall back to this, but restart system?


To answer another question:

Where it says "Memory Pool" and "current number of transactions," that number is not staying put, it's growing -- will i need to wait for it to finish before it will work?

This is the current amount of transactions that are pending and waiting to be mined into a block. Not something to worry about as a user, except for figuring out transaction fees

[HenryRomp]

Ok; I had not intended to make my node a pruned node. Bummer. Now I've restarted the whole process and am currently syncing the blockchain. I have the space, but my network connection is painfully slow, so it will be a while. I'll post here again when I am able to try again.

I'm not sure why core wouldn't run, but I restarted the machine and now it will. But now I'm back to "progress increase %0.56 per hour" ... Be back in a week or so I figure...