"fatal internal error" while syncing

[Schleicher]

My Bitcoin-Qt 0.11.0 is crashing while trying to synchronize.
I have tried using a different drive for the datadir, but no luck.
Does anyone here have an idea what's going on?

Code:

2015-08-14 17:14:17 Pre-allocating up to position 0xa00000 in rev00032.dat
2015-08-14 17:14:17 UpdateTip: new best=00000000000003f78e891f2f37bda8f19fd79382cf85c2ed8252eb99520a29e1  height=212323  log2_work=69.167755  tx=9923341  date=2012-12-15 21:06:37 progress=0.053906  cache=59.1MiB(76331tx)
2015-08-14 17:14:17 UpdateTip: new best=0000000000000344768511ad45867140b137973ad87a450ecd9734b8a2071157  height=212324  log2_work=69.167787  tx=9923438  date=2012-12-15 21:09:27 progress=0.053906  cache=59.3MiB(76403tx)
2015-08-14 17:14:17 UpdateTip: new best=000000000000024818032064296539ee9041c326e313c793c82e2c140abe9123  height=212325  log2_work=69.167818  tx=9923449  date=2012-12-15 21:36:04 progress=0.053906  cache=59.3MiB(76423tx)
2015-08-14 17:14:17 UpdateTip: new best=0000000000000488f6356e0992792c90a3da83af6fab23c0afad41c91190b202  height=212326  log2_work=69.16785  tx=9923916  date=2012-12-15 21:54:49 progress=0.053909  cache=59.5MiB(76784tx)
2015-08-14 17:14:17 UpdateTip: new best=0000000000000458be6fd55eda478a50d8f01e18511a66ccc0f18734bd3db92f  height=212327  log2_work=69.167881  tx=9923917  date=2012-12-15 22:05:34 progress=0.053909  cache=59.5MiB(76785tx)
2015-08-14 17:14:17 UpdateTip: new best=00000000000002427357b2eb8f3902133dfb30e085fe5e6416697200339346a6  height=212328  log2_work=69.167913  tx=9923918  date=2012-12-15 22:10:55 progress=0.053909  cache=59.5MiB(76786tx)
2015-08-14 17:14:17 UpdateTip: new best=00000000000001b771d46de74704241940a8c72387cca469202bc9417882d4e3  height=212329  log2_work=69.167944  tx=9924655  date=2012-12-15 22:27:48 progress=0.053913  cache=60.3MiB(77279tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000022ecee2d0fc2fa1df6c7fb4b6f8ea1f75361ccd9d4fa2d924bb  height=212330  log2_work=69.167976  tx=9925049  date=2012-12-15 22:31:22 progress=0.053915  cache=60.3MiB(77391tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000003a3d565cbdc75a0033c077bafd441c53d8792bc6aad0f18c5e8  height=212331  log2_work=69.168007  tx=9925596  date=2012-12-15 22:52:00 progress=0.053918  cache=60.6MiB(77668tx)
2015-08-14 17:14:18 UpdateTip: new best=0000000000000131852e4efe49f1a61fd1efa0ae8d2c9c9135ac4acea06d8919  height=212332  log2_work=69.168039  tx=9925668  date=2012-12-15 22:51:08 progress=0.053918  cache=60.6MiB(77668tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000029cde516d06002e28f1a74889267abc792b9a1a9cf738967a1d  height=212333  log2_work=69.16807  tx=9925760  date=2012-12-15 23:00:05 progress=0.053919  cache=60.6MiB(77694tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000000568d962c8cd7ccdd33954b753694e728c0221196e7729d748f  height=212334  log2_work=69.168102  tx=9926339  date=2012-12-15 23:21:47 progress=0.053922  cache=60.7MiB(78023tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000007aa7abef3317ea16c4678596b5c3d709c044dd17dca0474a30  height=212335  log2_work=69.168133  tx=9926555  date=2012-12-15 23:29:02 progress=0.053923  cache=60.7MiB(78053tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000000a7e91f67b57a93ccaf9552d38d7b6b14c91d6e4947b4d99599  height=212336  log2_work=69.168165  tx=9926897  date=2012-12-15 23:32:57 progress=0.053925  cache=60.8MiB(78222tx)
2015-08-14 17:14:18 UpdateTip: new best=0000000000000209d9e0a099e2959e0670a7796a264b7c63128a77682cb2653b  height=212337  log2_work=69.168196  tx=9927151  date=2012-12-15 23:41:07 progress=0.053926  cache=60.8MiB(78342tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000004498e48644dee31060cacbc0c76c8665215efd594f590515713  height=212338  log2_work=69.168228  tx=9927152  date=2012-12-15 23:46:51 progress=0.053926  cache=60.8MiB(78343tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000003b21b965ed11fff29d3f966b44eb0e6878bf60b020ae4497e3a  height=212339  log2_work=69.168259  tx=9927279  date=2012-12-15 23:46:53 progress=0.053927  cache=60.9MiB(78420tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000002cb161af128fb737ca78851ecde96151d6a3deace1bc7b4fdbe  height=212340  log2_work=69.168291  tx=9927285  date=2012-12-15 23:55:33 progress=0.053927  cache=61.1MiB(78435tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000004201c4e7036b150ac0f88e814fffe7d8287e36ae1453fb9a061  height=212341  log2_work=69.168322  tx=9927856  date=2012-12-16 00:09:33 progress=0.053930  cache=61.4MiB(78609tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000040dac069a53f458da0225fe86eb231126d37f6c3c642ebd5819  height=212342  log2_work=69.168354  tx=9928194  date=2012-12-16 00:20:14 progress=0.053932  cache=61.7MiB(78867tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000001ac34400d19620e27a68d6d6085cedba4bfa8cf24b0e45195e9  height=212343  log2_work=69.168385  tx=9928240  date=2012-12-16 00:19:40 progress=0.053932  cache=61.7MiB(78878tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000008fc45b93262a851f51354644e94691575d8152f48d32c92895  height=212344  log2_work=69.168417  tx=9929006  date=2012-12-16 00:49:30 progress=0.053936  cache=62.3MiB(79569tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000002bd640adb4a549517f269d731cceecb1ce0e086b09a619b14a4  height=212345  log2_work=69.168448  tx=9929405  date=2012-12-16 01:39:05 progress=0.053938  cache=62.7MiB(80374tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000030ab9f4381ba3b58dec650d255be2447024469156668420f24c  height=212346  log2_work=69.16848  tx=9930228  date=2012-12-16 02:27:06 progress=0.053943  cache=62.9MiB(81148tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000000efe53f705bb3c267ca727aa91155343015165453642abe259f  height=212347  log2_work=69.168511  tx=9930954  date=2012-12-16 02:51:50 progress=0.053947  cache=63.0MiB(81656tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000001ddb48f8cba93451f87054669c53876f0a62457f636527b5640  height=212348  log2_work=69.168543  tx=9931316  date=2012-12-16 02:52:41 progress=0.053949  cache=63.1MiB(81730tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000003f13ea5cb9d8c5e714d17a93d2d45784a59f22e238be5695547  height=212349  log2_work=69.168574  tx=9931448  date=2012-12-16 03:15:07 progress=0.053950  cache=63.1MiB(81830tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000002675912fed544e185c5880fd34538b5738ba72577b98313d36b  height=212350  log2_work=69.168606  tx=9931709  date=2012-12-16 03:20:51 progress=0.053951  cache=63.2MiB(82002tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000016fcca2a5076549da54f3eed18f1e34d96a6c4442ed8add0962  height=212351  log2_work=69.168637  tx=9931765  date=2012-12-16 03:21:38 progress=0.053951  cache=63.2MiB(81995tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000000da559ecb7d6af2b1f3754bbe7a207f1fc6619714bd72c87acb  height=212352  log2_work=69.168668  tx=9931880  date=2012-12-16 03:34:04 progress=0.053952  cache=63.2MiB(82075tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000002c6e632dcc98f5b8f32ca77d491b5d8a73920f441e887fbcdf9  height=212353  log2_work=69.1687  tx=9931895  date=2012-12-16 03:34:16 progress=0.053952  cache=63.2MiB(82083tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000003627e63e34d4c7e6463d4209d27a8a68ae35caa3c1b1022b49d  height=212354  log2_work=69.168731  tx=9932277  date=2012-12-16 04:10:27 progress=0.053954  cache=63.2MiB(82136tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000008997bad6cc8a72c38dfd55497090f4029307837f101649da28  height=212355  log2_work=69.168763  tx=9932352  date=2012-12-16 04:15:16 progress=0.053954  cache=63.2MiB(82187tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000033c35bf84d00f253f98126491d8c3945efc2801699cfe0e79a3  height=212356  log2_work=69.168794  tx=9932472  date=2012-12-16 04:23:36 progress=0.053955  cache=63.3MiB(82226tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000035e10446be51350c7f20f235a0dbaa126f8eda121dde9c040ac  height=212357  log2_work=69.168826  tx=9932634  date=2012-12-16 04:42:07 progress=0.053956  cache=63.3MiB(82311tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000014dd86acb7a78120fc1271ef5ac3a37689eb8bf29f4cc177bb9  height=212358  log2_work=69.168857  tx=9932801  date=2012-12-16 04:43:20 progress=0.053957  cache=63.3MiB(82369tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000030d6d63126325405ed0609f7198a9dfb320fb1e6c9cadac4426  height=212359  log2_work=69.168889  tx=9932941  date=2012-12-16 04:53:00 progress=0.053958  cache=63.3MiB(82400tx)
2015-08-14 17:14:19 UpdateTip: new best=0000000000000189401374f1a656165ce784e7df9d17fbe614fa38d3e65bdc92  height=212360  log2_work=69.16892  tx=9933664  date=2012-12-16 05:07:54 progress=0.053962  cache=63.4MiB(82692tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000029d3f020620488bf5f13dde5acdc3ae7df0a0c0e84349098718  height=212361  log2_work=69.168952  tx=9933917  date=2012-12-16 05:24:45 progress=0.053963  cache=63.5MiB(82737tx)
2015-08-14 17:14:20 Corruption: block checksum mismatch
2015-08-14 17:14:20 *** System error while flushing: Database corrupted

[Lauda]

When was the last time that you synchronized your client or did you start fresh with QT 0.11.0? If you're around 212k then you are quite behind. It seems that something is corrupted within your database.
Once you provide us with more information then we can suggest the best possible way for you to fix this.

[Schleicher]

When was the last time that you synchronized your client or did you start fresh with QT 0.11.0? If you're around 212k then you are quite behind. It seems that something is corrupted within your database.
Once you provide us with more information then we can suggest the best possible way for you to fix this.

That was a fresh sync from scratch.
I have only kept my old wallet.dat

My system:
AMD Phenom II X4
Windows 10 64bit
500GB free space on both disks
8GB RAM

[achow101]

It looks like you have a database error. Just reindex the database and that should fix the problem.

[Schleicher]

It looks like you have a database error. Just reindex the database and that should fix the problem.

I have tried that already.
After some time there's the same error.

By the way: the Windows RAM Test didn't find anything.

[Lauda]

That was a fresh sync from scratch.
I have only kept my old wallet.dat
-snip-

Have you synced from scratch on the other disk as well or have you continued after receiving the error on the first one? It could possibly be a HDD problem (not likely, but still a possibility).

[Schleicher]

That was a fresh sync from scratch.
I have only kept my old wallet.dat
-snip-

Have you synced from scratch on the other disk as well [...]?

Yes

It could possibly be a HDD problem (not likely, but still a possibility).

I have tried this with two different HDDs:
One Samsung SSD (1TB, 500GB free)
One Western Digital HDD (4TB, 500GB free)

[Lauda]

Okay, let me tell you something right away. Remove Windows 10. Microsoft made everyone accept a weird EULA that lets them take a lot of information, probably including the password of your wallet.
Next up, have you considered removing Bitcoin everything and all files/registry entries related to it and install again?

[Schleicher]

Update:
Now I'm using Bitcoin XT to sync the stuff.
So far no errors.
I don't know if this is coincidence.
When the syncing is done I will try to switch back to Bitcoin Core and see what happens.

[Schleicher]

Syncing with a fresh Bitcoin XT didn't work either.
Now I'm out of ideas.
Windows 10 bug maybe?

[cr1776]

Syncing with a fresh Bitcoin XT didn't work either.
Now I'm out of ideas.
Windows 10 bug maybe?

If you can boot into an older version on the same hardware, it would be a good test to see if that solves it.

[unsoindovo]

you've tried to download the torrent blockchain???

here you can find all official bitcoin builds:
https://bitcoin.org/bin/
here you can download the official torrent blockchain to synchronize fast and easily
https://bitcoin.org/bin/block-chain/

good luck!!!

[Schleicher]

Update:
I have tried Win 7 with Virtualbox.
No luck. Error while syncing.

Now I'm going to write my own program to test the RAM.

[achow101]

Update:
I have tried Win 7 with Virtualbox.
No luck. Error while syncing.

Now I'm going to write my own program to test the RAM.

Do you happen to have an antivirus enabled? It is known that antivirus software can be corrupt the database files by reading the files at the same time Bitcoin Core is. If you do have an antivirus, be sure to add the data directory to its exceptions list. Also check that Windows Defender (or whatever the OS antivirus is) is either disabled or also has the data directory as an exception.

[z0rg1nc]

The same error with ubuntu 15.04 and 0.11.1. System and Core Gui installed from scratch.

LevelDB read failure: Corruption: block checksum mismatch
Corruption: block checksum mismatch
Error reading from database: Database corrupted

I tried delete last blk files, but it started full reindex now... Not nice at all and i'm not sure it'll help.
Environment - just client receiving blocks, no problem for months and yesterday i have started getting those messages "Error reading from database shutting down".

P.S. For BitMoney clients - no worry, it's not production servers.

=============================
Added. Yep it didn't help, around -2y30w throws "fatal internal occured".

Code:

2015-12-15 23:43:42 LoadExternalBlockFile: Processing out of order child 000000000000008981568e0fc5fcac3de234910c09aa644d4e42235599f119ce of 00000000000000456bcd68f888f1af4d9c5ecf807fd23f328acd9410c1d0fa81
2015-12-15 23:43:42 UpdateTip: new best=000000000000008981568e0fc5fcac3de234910c09aa644d4e42235599f119ce  height=236075  log2_work=70.025365  tx=17758940  date=2013-05-13 23:42:13 progress=0.080332  cache=54.7MiB(22676tx)
2015-12-15 23:43:42 LoadExternalBlockFile: Processing out of order child 00000000000000831a5c3450d1122cc9e4bdb5c712c2a830da5c81b742dea03c of 000000000000008981568e0fc5fcac3de234910c09aa644d4e42235599f119ce
2015-12-15 23:43:42 UpdateTip: new best=00000000000000831a5c3450d1122cc9e4bdb5c712c2a830da5c81b742dea03c  height=236076  log2_work=70.025422  tx=17759402  date=2013-05-13 23:50:06 progress=0.080334  cache=55.2MiB(23183tx)
2015-12-15 23:43:42 LoadExternalBlockFile: Processing out of order child 00000000000000f53fd89d1c8cdfcc89181e6092234ccbe2953955d08f53619f of 00000000000000831a5c3450d1122cc9e4bdb5c712c2a830da5c81b742dea03c
2015-12-15 23:43:42 UpdateTip: new best=00000000000000f53fd89d1c8cdfcc89181e6092234ccbe2953955d08f53619f  height=236077  log2_work=70.02548  tx=17759597  date=2013-05-13 23:50:55 progress=0.080335  cache=62.6MiB(23658tx)
2015-12-15 23:43:43 Corruption: block checksum mismatch
2015-12-15 23:43:43 *** System error while flushing: Database corrupted
2015-12-15 23:46:34 ERROR: ProcessNewBlock: ActivateBestChain failed
2015-12-15 23:46:34 net thread interrupt
2015-12-15 23:46:35 addcon thread interrupt
2015-12-15 23:46:35 opencon thread interrupt
2015-12-15 23:46:35 scheduler thread interrupt
2015-12-15 23:46:35 msghand thread interrupt
2015-12-15 23:46:35 Shutdown: In progress...
2015-12-15 23:46:35 RPCAcceptHandler: Error: Operation canceled
2015-12-15 23:46:35 StopNode()
2015-12-15 23:46:35 Corruption: block checksum mismatch
2015-12-15 23:46:35 *** System error while flushing: Database corrupted
2015-12-15 23:46:37 Shutdown: done

[z0rg1nc]

After deletion everything but bitcoin.conf and wallet.dat started syncing from scratch, and again on -2y30w got "fatal error". Mounted btc directory to another physical drive + zfs so i think it is not hardware problem. RAM check on host show no errors.

https://github.com/bitcoin/bitcoin/issues/6528 looks the right place to report this experience.

Code:

2015-12-17 00:35:19 UpdateTip: new best=000000000000005bb239fc8ff69c2d9fd33d1d23532dcebcb24192758f1baba3  height=237055  log2_work=70.080825  tx=18133567  date=2013-05-20 12:51:09 progress=0.081912  cache=4.8MiB(3525tx)
2015-12-17 00:35:19 UpdateTip: new best=000000000000015767a84949b0bbf7ba25c24515e6198fd57909b8d3d1d7a7f5  height=237056  log2_work=70.08088  tx=18133568  date=2013-05-20 12:51:48 progress=0.081912  cache=4.8MiB(3526tx)
2015-12-17 00:35:19 UpdateTip: new best=0000000000000156d33717e7055beb017cd07e0d044fc7a4a364cf459d148aa1  height=237057  log2_work=70.080936  tx=18134049  date=2013-05-20 12:55:01 progress=0.081914  cache=5.0MiB(4225tx)
2015-12-17 00:35:20 UpdateTip: new best=00000000000000ce70375942e44e5a5f5f2192afecdc178fe0fe240bb8310d1c  height=237058  log2_work=70.080991  tx=18134844  date=2013-05-20 13:18:02 progress=0.081917  cache=5.9MiB(5339tx)
2015-12-17 00:35:20 UpdateTip: new best=00000000000001679e03844bc5e651ff9394b57f4612a43e555fc5cedab5c3b2  height=237059  log2_work=70.081047  tx=18135625  date=2013-05-20 13:51:19 progress=0.081921  cache=6.2MiB(6234tx)
2015-12-17 00:35:20 UpdateTip: new best=000000000000001a74e886007d45abf8feae6668516e35462fe207f0bfe48b7e  height=237060  log2_work=70.081102  tx=18135989  date=2013-05-20 14:02:32 progress=0.081923  cache=6.9MiB(7048tx)
2015-12-17 00:35:20 UpdateTip: new best=0000000000000027162a00ff456c8f1f2a37ac915714c17b9d2c622dab9b94e6  height=237061  log2_work=70.081158  tx=18136400  date=2013-05-20 14:03:09 progress=0.081924  cache=7.0MiB(7490tx)
2015-12-17 00:35:20 UpdateTip: new best=00000000000000f6f3787321ff929f44a9bfc0e75ac54ac90157e5bf5dd23cb6  height=237062  log2_work=70.081213  tx=18136619  date=2013-05-20 14:14:18 progress=0.081925  cache=7.4MiB(7899tx)
2015-12-17 00:35:20 UpdateTip: new best=0000000000000158fc5cee0bcac58973ddc158e4891df80eef7c67f78e5cd47e  height=237063  log2_work=70.081269  tx=18136747  date=2013-05-20 14:17:25 progress=0.081926  cache=7.8MiB(8135tx)
2015-12-17 00:35:20 LevelDB read failure: Corruption: block checksum mismatch
2015-12-17 00:35:20 Corruption: block checksum mismatch

Code:

2015-12-17 09:36:10 init message: Rescanning...
2015-12-17 09:36:10 Rescanning last 1101 blocks (from block 235950)...
2015-12-17 09:36:10  rescan                    1ms
2015-12-17 09:36:10 init message: Activating best chain...
2015-12-17 09:36:11 UpdateTip: new best=000000000000008bdabb35a3ce5f85b8c3a11ffefd5a29defcd4c786e271f8a9  height=237052  log2_work=70.080658  tx=18132299  date=2013-05-20 11:49:50 progress=0.081864  cache=1.2MiB(809tx)
2015-12-17 09:36:11 UpdateTip: new best=00000000000000b9f7b4bfaee1287b3e51fd534cdb30f42c482dfff7f714f6d3  height=237053  log2_work=70.080714  tx=18132304  date=2013-05-20 12:10:02 progress=0.081864  cache=1.3MiB(820tx)
2015-12-17 09:36:11 UpdateTip: new best=00000000000000afe58811aea548dac4d6f4fd8c9c2b88836c84170ab52b03b8  height=237054  log2_work=70.080769  tx=18133326  date=2013-05-20 12:35:09 progress=0.081869  cache=3.6MiB(3003tx)
2015-12-17 09:36:12 UpdateTip: new best=000000000000005bb239fc8ff69c2d9fd33d1d23532dcebcb24192758f1baba3  height=237055  log2_work=70.080825  tx=18133567  date=2013-05-20 12:51:09 progress=0.081870  cache=4.3MiB(3525tx)
2015-12-17 09:36:12 UpdateTip: new best=000000000000015767a84949b0bbf7ba25c24515e6198fd57909b8d3d1d7a7f5  height=237056  log2_work=70.08088  tx=18133568  date=2013-05-20 12:51:48 progress=0.081870  cache=4.3MiB(3526tx)
2015-12-17 09:36:12 UpdateTip: new best=0000000000000156d33717e7055beb017cd07e0d044fc7a4a364cf459d148aa1  height=237057  log2_work=70.080936  tx=18134049  date=2013-05-20 12:55:01 progress=0.081872  cache=4.5MiB(4225tx)
2015-12-17 09:36:12 UpdateTip: new best=00000000000000ce70375942e44e5a5f5f2192afecdc178fe0fe240bb8310d1c  height=237058  log2_work=70.080991  tx=18134844  date=2013-05-20 13:18:02 progress=0.081876  cache=5.4MiB(5339tx)
2015-12-17 09:36:12 UpdateTip: new best=00000000000001679e03844bc5e651ff9394b57f4612a43e555fc5cedab5c3b2  height=237059  log2_work=70.081047  tx=18135625  date=2013-05-20 13:51:19 progress=0.081879  cache=5.8MiB(6234tx)
2015-12-17 09:36:13 UpdateTip: new best=000000000000001a74e886007d45abf8feae6668516e35462fe207f0bfe48b7e  height=237060  log2_work=70.081102  tx=18135989  date=2013-05-20 14:02:32 progress=0.081881  cache=6.5MiB(7048tx)
2015-12-17 09:36:13 UpdateTip: new best=0000000000000027162a00ff456c8f1f2a37ac915714c17b9d2c622dab9b94e6  height=237061  log2_work=70.081158  tx=18136400  date=2013-05-20 14:03:09 progress=0.081883  cache=6.6MiB(7490tx)
2015-12-17 09:36:13 UpdateTip: new best=00000000000000f6f3787321ff929f44a9bfc0e75ac54ac90157e5bf5dd23cb6  height=237062  log2_work=70.081213  tx=18136619  date=2013-05-20 14:14:18 progress=0.081884  cache=7.0MiB(7899tx)
2015-12-17 09:36:13 UpdateTip: new best=0000000000000158fc5cee0bcac58973ddc158e4891df80eef7c67f78e5cd47e  height=237063  log2_work=70.081269  tx=18136747  date=2013-05-20 14:17:25 progress=0.081884  cache=7.3MiB(8135tx)
2015-12-17 09:36:13 LevelDB read failure: Corruption: block checksum mismatch
2015-12-17 09:36:13 Corruption: block checksum mismatch
2015-12-17 09:36:53 Error reading from database: Database corrupted

ADDED: Again cleared folder and started from scratch, now it breaks on -3y20w.

Code:

2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 ERROR: AcceptToMemoryPool: non-final
2015-12-17 16:21:21 UpdateTip: new best=00000000000001d6d4788d6a592c1de1cad36f3afd73945f1134dafbdb6ee591  height=190831  log2_work=68.44494  tx=5312321  date=2012-07-26 09:01:24 progress=0.023975  cache=45.2MiB(87519tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000006176d92fb8c68bcf66707c4443c757368ca6a68a381dce1a724  height=190832  log2_work=68.444969  tx=5312822  date=2012-07-26 09:05:49 progress=0.023977  cache=45.4MiB(87741tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000251f113fb5253ed00927c5d4fb8cd64b7df8a509e101d28fd8e  height=190833  log2_work=68.444998  tx=5312845  date=2012-07-26 09:03:44 progress=0.023977  cache=45.4MiB(87763tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000001ef2b3106e718229dc1dca59c0d1f90bc15f31bece5a2ba21ba  height=190834  log2_work=68.445027  tx=5312861  date=2012-07-26 09:03:30 progress=0.023978  cache=45.4MiB(87773tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000003d24f3aee02110ed0998ea7bb521369d69859b6ccbe8f85d570  height=190835  log2_work=68.445056  tx=5313006  date=2012-07-26 09:12:30 progress=0.023978  cache=45.4MiB(87846tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000006784669e3cb65a00abc476ebf88548f9fbb5c93857cc7522ec3  height=190836  log2_work=68.445084  tx=5313044  date=2012-07-26 09:15:37 progress=0.023978  cache=45.4MiB(87870tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000032b664bc8e7a2f933ba1786ffdfb1319760dd23443b0591cfc9  height=190837  log2_work=68.445113  tx=5313167  date=2012-07-26 09:20:32 progress=0.023979  cache=45.4MiB(87931tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000734c022665edb16ade5758714f9efff3c8ce50a7b6ea474a439  height=190838  log2_work=68.445142  tx=5313198  date=2012-07-26 09:24:27 progress=0.023979  cache=45.4MiB(87928tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000772f26d74a3c8dd81c5979028b6de4b1121a0e02f81ec79fc43  height=190839  log2_work=68.445171  tx=5313476  date=2012-07-26 09:34:17 progress=0.023980  cache=45.4MiB(87950tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000076c563fed4e29af47a8a80dfc2f7ea93c575b9685932fa95c5d  height=190840  log2_work=68.445199  tx=5313506  date=2012-07-26 09:34:48 progress=0.023980  cache=45.4MiB(87966tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000006502e265793cc30e7c65dbb0e0cf2771eb7c32186b0758aa38f  height=190841  log2_work=68.445228  tx=5313546  date=2012-07-26 09:48:28 progress=0.023981  cache=45.5MiB(87995tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000003eb7ae690b34ad7d2337ac33beef1988829e612d083e7f7deda  height=190842  log2_work=68.445257  tx=5313629  date=2012-07-26 09:51:56 progress=0.023981  cache=45.5MiB(87997tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000436e2bb1095660be7758aa9577702b27deae1ffab1532aeb22e  height=190843  log2_work=68.445286  tx=5314168  date=2012-07-26 10:21:34 progress=0.023983  cache=45.5MiB(88263tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000023aa38af8965b48d7034af58549f8ad0c3006b9ec178d85beaf  height=190844  log2_work=68.445315  tx=5314563  date=2012-07-26 10:45:04 progress=0.023985  cache=45.6MiB(88427tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000006048636032919ff6f057e7aa8f194d52bcdf95034920cafa228  height=190845  log2_work=68.445343  tx=5314693  date=2012-07-26 10:52:51 progress=0.023986  cache=45.6MiB(88519tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000087cd31e6e57b1cfeecb374478abd86a71be9ff9cd15883d3bf1  height=190846  log2_work=68.445372  tx=5315366  date=2012-07-26 11:16:18 progress=0.023989  cache=45.7MiB(88920tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000002544c73345c8fcb1c247913ef02eadef0cebbd9bc935c78366a  height=190847  log2_work=68.445401  tx=5315442  date=2012-07-26 11:22:58 progress=0.023989  cache=45.7MiB(88962tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000015e70e97ce832030f0b46a773034bf443559acb69c7940ac9cb  height=190848  log2_work=68.44543  tx=5315558  date=2012-07-26 11:23:50 progress=0.023990  cache=45.8MiB(89055tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000000890636de111808352064d0191649036b64eb442640f8725284  height=190849  log2_work=68.445458  tx=5315575  date=2012-07-26 11:47:15 progress=0.023990  cache=45.8MiB(89058tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000018218e194ccab1e4651cd986f67fc95dfe1c322854699c14f63  height=190850  log2_work=68.445487  tx=5315703  date=2012-07-26 11:32:33 progress=0.023990  cache=45.8MiB(89133tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000709dcc3d777d59eaf68ba58c9aded0d36e45ab2bee03b7456a1  height=190851  log2_work=68.445516  tx=5315740  date=2012-07-26 11:34:47 progress=0.023991  cache=45.8MiB(89130tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000004bbd1df1baca0adf5bff335c32997308399c00f7cde0ce8c0bc  height=190852  log2_work=68.445545  tx=5315804  date=2012-07-26 11:35:33 progress=0.023991  cache=45.8MiB(89083tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000000a2e6470e7cdde39658f49da168421a65104890f2561295a410  height=190853  log2_work=68.445574  tx=5316279  date=2012-07-26 11:58:21 progress=0.023993  cache=45.9MiB(89331tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000064d087b8e375e37fa8bbb813b93317509ceb1e5678362ada989  height=190854  log2_work=68.445602  tx=5316330  date=2012-07-26 11:59:02 progress=0.023993  cache=45.9MiB(89325tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000036ee83ebf562a56ec4714384fe2ddef4577e62a040a859eaf71  height=190855  log2_work=68.445631  tx=5316403  date=2012-07-26 12:07:32 progress=0.023994  cache=45.9MiB(89379tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000071907372ff4b3ca5e64e67fe454e59789598b204486c4aef404  height=190856  log2_work=68.44566  tx=5316424  date=2012-07-26 12:09:52 progress=0.023994  cache=45.9MiB(89396tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000027ea334136de8080462bdf1d8ff2507b2d0a28e9e29c8eff94c  height=190857  log2_work=68.445689  tx=5316552  date=2012-07-26 12:31:02 progress=0.023994  cache=45.9MiB(89454tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000004012a0b35a242691bbea04640c8faa692abce3e99f46f62db5  height=190858  log2_work=68.445717  tx=5317133  date=2012-07-26 12:42:13 progress=0.023997  cache=46.2MiB(89646tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000000aaad7878bfbb9cdc6f3940c64ed013ad37a03bdbf7316f5165  height=190859  log2_work=68.445746  tx=5317647  date=2012-07-26 12:43:34 progress=0.023999  cache=46.3MiB(89980tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000006855ed11ed23f9eb11579c799426e0d9cae310974ba09654844  height=190860  log2_work=68.445775  tx=5317663  date=2012-07-26 12:48:23 progress=0.023999  cache=46.3MiB(90002tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000044b9a3ac728dd8d7f799cc6e550cc0839dd4f43f474b0259d2b  height=190861  log2_work=68.445804  tx=5317771  date=2012-07-26 12:57:36 progress=0.024000  cache=46.3MiB(90019tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000003434fc80bd3c112ebd0c28c1974773a0b82f7b5bd313b64615b  height=190862  log2_work=68.445833  tx=5317772  date=2012-07-26 12:58:00 progress=0.024000  cache=46.3MiB(90020tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000008f97deece94bc73c5f08e84e34556ef6a00b03d6bef41d69d54  height=190863  log2_work=68.445861  tx=5317838  date=2012-07-26 12:59:10 progress=0.024000  cache=46.4MiB(90245tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000382efc74c6429325beeaba7a907cd9828fb2c87bc97a510b3ab  height=190864  log2_work=68.44589  tx=5318204  date=2012-07-26 13:07:17 progress=0.024002  cache=46.3MiB(90092tx)
2015-12-17 16:21:21 UpdateTip: new best=000000000000077e4e25abceff0f8de3ab148fd2d8a57bb77e51f4a8aa3e43b6  height=190865  log2_work=68.445919  tx=5318460  date=2012-07-26 13:13:33 progress=0.024003  cache=46.3MiB(89831tx)
2015-12-17 16:21:21 UpdateTip: new best=0000000000000033966584f20455ff9f8279e96d57de3f6f396cabe0497d3557  height=190866  log2_work=68.445948  tx=5318635  date=2012-07-26 13:16:34 progress=0.024004  cache=46.3MiB(89913tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000001ba30d7f0fc51d53e6b4d7486099bf8233bdcc4032761410ab7  height=190867  log2_work=68.445976  tx=5318765  date=2012-07-26 13:24:09 progress=0.024004  cache=46.3MiB(90004tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000003386549eb14510218063524c94ea5b4414176c72fc3e1bc90df  height=190868  log2_work=68.446005  tx=5318846  date=2012-07-26 13:27:14 progress=0.024005  cache=46.3MiB(89967tx)
2015-12-17 16:21:21 UpdateTip: new best=00000000000000d232c7ca882e3f87eeba00923a2529ddc954bbcd3864dcbbb4  height=190869  log2_work=68.446034  tx=5318866  date=2012-07-26 13:28:48 progress=0.024005  cache=46.3MiB(89978tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000005c988ded8737f29385de054cd7912dc75d8fbf25406a2d57d75  height=190870  log2_work=68.446063  tx=5318875  date=2012-07-26 13:38:22 progress=0.024005  cache=46.3MiB(89983tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000007e8d7bc0d3cbc4794ac1928c9ba4135b034f09925f12c9068b1  height=190871  log2_work=68.446091  tx=5318876  date=2012-07-26 13:38:14 progress=0.024005  cache=46.3MiB(89984tx)
2015-12-17 16:21:22 UpdateTip: new best=0000000000000171aeb04575102d507f22c3d7a20df1791c6fc9e1ee7afe7bed  height=190872  log2_work=68.44612  tx=5319457  date=2012-07-26 13:44:32 progress=0.024007  cache=46.4MiB(90167tx)
2015-12-17 16:21:22 UpdateTip: new best=0000000000000428b768c93b2965dab539dbf3002a8a29bb3fa04ddc7ec34168  height=190873  log2_work=68.446149  tx=5319484  date=2012-07-26 13:48:07 progress=0.024007  cache=46.4MiB(90137tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000006e7a7046558bab064be8b5a210ab934aefc9792b81e93d26961  height=190874  log2_work=68.446178  tx=5319587  date=2012-07-26 13:53:09 progress=0.024008  cache=46.4MiB(90206tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000006d8fb314322bbe2e2d25ef2885b66c47cb00434db9aa070199d  height=190875  log2_work=68.446206  tx=5319892  date=2012-07-26 13:57:55 progress=0.024009  cache=46.4MiB(90268tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000071084d0f3dc6716e4a5ec13ed07410abe22d717253fe3546f1f  height=190876  log2_work=68.446235  tx=5319904  date=2012-07-26 14:03:25 progress=0.024009  cache=46.4MiB(90279tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000086d959962827ffe1f21dac4fd691d8c9f7ba992a9cd931695e2  height=190877  log2_work=68.446264  tx=5320020  date=2012-07-26 14:13:26 progress=0.024010  cache=46.4MiB(90374tx)
2015-12-17 16:21:22 UpdateTip: new best=0000000000000304d2b3b87c01eaf75bf03d226f2200128ddc1c3200b4f77c68  height=190878  log2_work=68.446293  tx=5320031  date=2012-07-26 14:14:16 progress=0.024010  cache=46.4MiB(90383tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000063c1a72ec45b2ff65ae862747195af7e51b3119a6ff09eff17e  height=190879  log2_work=68.446321  tx=5320534  date=2012-07-26 14:35:22 progress=0.024012  cache=46.4MiB(90496tx)
2015-12-17 16:21:22 UpdateTip: new best=0000000000000239fba99d6eb19c13600f86c6d6835c261c41d70ff9e65abfd2  height=190880  log2_work=68.44635  tx=5320543  date=2012-07-26 14:50:53 progress=0.024012  cache=46.4MiB(90506tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000023efcc5c89727c2b7a9d4590b968fa940a19e4b8b537e5ce3e7  height=190881  log2_work=68.446379  tx=5320575  date=2012-07-26 15:02:06 progress=0.024012  cache=46.4MiB(90516tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000000e93e458232fec8bf2ddadd7382d9fe486065f02621e5eb9fa7  height=190882  log2_work=68.446408  tx=5321059  date=2012-07-26 15:22:26 progress=0.024015  cache=46.5MiB(90705tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000060a78403a02025e2a74713232a0dec50ac0b9fd20d850ab66af  height=190883  log2_work=68.446436  tx=5321293  date=2012-07-26 15:24:54 progress=0.024016  cache=46.6MiB(90974tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000003d17ef8d590720b184366ce05809259f4b595dc0d4f29c1a0e7  height=190884  log2_work=68.446465  tx=5321436  date=2012-07-26 15:32:43 progress=0.024016  cache=46.6MiB(91087tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000004900df551269a8aeabc7bd9906d962d829328223e3e23eead13  height=190885  log2_work=68.446494  tx=5321447  date=2012-07-26 15:46:31 progress=0.024016  cache=46.6MiB(91094tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000007f926cad56503c9a65f0a2b7cbcee72907f700ebb418d0ef0b7  height=190886  log2_work=68.446523  tx=5321479  date=2012-07-26 15:49:59 progress=0.024016  cache=46.6MiB(91116tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000069238de7941e86208d7247587c10c7ae298d28178619ea9b980  height=190887  log2_work=68.446552  tx=5321970  date=2012-07-26 15:59:22 progress=0.024019  cache=46.6MiB(91165tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000006f4aa58b35817e56d44e390a843f82e2d9220ed89de866fefc6  height=190888  log2_work=68.44658  tx=5322087  date=2012-07-26 15:57:28 progress=0.024019  cache=46.6MiB(91179tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000006995d9ffe02d38e20eaaa6ef64e37e4405fd4827690e17bfae1  height=190889  log2_work=68.446609  tx=5322725  date=2012-07-26 16:20:55 progress=0.024022  cache=46.7MiB(91412tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000001e2feeb1e73fcb3a42fbc6a29d4b2b8da4359df4bc59ee4f096  height=190890  log2_work=68.446638  tx=5323669  date=2012-07-26 16:37:13 progress=0.024026  cache=46.7MiB(91596tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000001ff0c04019ff25558e88736f202b7e6522c6a311fc295bcc1c  height=190891  log2_work=68.446667  tx=5323906  date=2012-07-26 16:55:47 progress=0.024027  cache=46.8MiB(91859tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000005b69e7d30d1f0107b3b9d330ae3f2107ed81269c0d9c4f6bc67  height=190892  log2_work=68.446695  tx=5324162  date=2012-07-26 16:53:11 progress=0.024029  cache=46.8MiB(91943tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000007d90b680291ce272aa4fb28aa540fe24fee9f20676d69ed5fd1  height=190893  log2_work=68.446724  tx=5324303  date=2012-07-26 17:22:12 progress=0.024029  cache=46.9MiB(92065tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000004a3e5d1d94f01b04e4e6312e8ee4198313d269b7711b352fb11  height=190894  log2_work=68.446753  tx=5324304  date=2012-07-26 17:23:07 progress=0.024029  cache=46.9MiB(92066tx)
2015-12-17 16:21:22 UpdateTip: new best=000000000000016d898144fcd11e70a9c1c39904d77b65a26e05488e2558f58a  height=190895  log2_work=68.446782  tx=5324313  date=2012-07-26 17:25:02 progress=0.024029  cache=46.9MiB(92072tx)
2015-12-17 16:21:22 UpdateTip: new best=00000000000008e19c79451adacd7c603a91be7fe928c21cd75f81cd3778d938  height=190896  log2_work=68.44681  tx=5324452  date=2012-07-26 17:39:23 progress=0.024030  cache=46.9MiB(92141tx)
2015-12-17 16:21:22 UpdateTip: new best=0000000000000829ea020a2cd93a4f1b4bfbe395c3b7ea14166d7271fa1134a3  height=190897  log2_work=68.446839  tx=5324576  date=2012-07-26 17:50:42 progress=0.024030  cache=46.9MiB(92205tx)
2015-12-17 16:21:22 LevelDB read failure: Corruption: block checksum mismatch
2015-12-17 16:21:22 Corruption: block checksum mismatch
2015-12-17 16:24:52 Error reading from database: Database corrupted

Even with 3GB RAM.

ADDED: After zfs rollback to -3y22w moment I passed -3y20w point without problem, at -3y16w now.
ADDED: Update to 11.2 didn't help, the app works random time after snapshot rollback and crushing again.
ADDED: purge and reinstall didn't help.

[tl121]

Synchronizing the bitcoin client from scratch involves downloading many GB of data and performing many hours of complex computations and database accesses.  It serves as an extreme test of your computer's data integrity, in that in a few hours it makes your computer work the equivalent of many months of normal use.  If you have a slightly flaky computer system that crashes once a month or so in normal use it may be perfectly usable for accessing email and surfing the web, but  it will be totally unsuitable for running the bitcoin core client, especially during initial synchronization.

If you have an option your best bet would be to try using a completely separate computer system.  If this is impossible or inconvent then you can still use Bitcoin by using a lightweight client.  I suggest either Electrum or Multiibit-HD.

[z0rg1nc]

Synchronizing the bitcoin client from scratch involves downloading many GB of data and performing many hours of complex computations and database accesses.  It serves as an extreme test of your computer's data integrity, in that in a few hours it makes your computer work the equivalent of many months of normal use.  If you have a slightly flaky computer system that crashes once a month or so in normal use it may be perfectly usable for accessing email and surfing the web, but  it will be totally unsuitable for running the bitcoin core client, especially during initial synchronization.

If you have an option your best bet would be to try using a completely separate computer system.  If this is impossible or inconvent then you can still use Bitcoin by using a lightweight client.  I suggest either Electrum or Multiibit-HD.

Host machine is powerful PC, btc data dir works on raid1 with new (1 year or around) HDDs, chkdsk (5 stages) and SMART showed no errors. But i think you are right, still looks like some my hardware problem (tried on different VM with ubuntu 14.04 and got the same error). Electrum or Multibit don't have core compliant API support as I know and it's required.

Some heisenbug - i can just start Bitcoin Core again and it continues to work without any problems or starting crushing. Though after chkdsk got only 1 fatal error and reached almost -1y30w, definitely should try new HDD.

[avw1982]

My Bitcoin-Qt 0.11.0 is crashing while trying to synchronize.
I have tried using a different drive for the datadir, but no luck.
Does anyone here have an idea what's going on?

Code:

2015-08-14 17:14:17 Pre-allocating up to position 0xa00000 in rev00032.dat
2015-08-14 17:14:17 UpdateTip: new best=00000000000003f78e891f2f37bda8f19fd79382cf85c2ed8252eb99520a29e1  height=212323  log2_work=69.167755  tx=9923341  date=2012-12-15 21:06:37 progress=0.053906  cache=59.1MiB(76331tx)
2015-08-14 17:14:17 UpdateTip: new best=0000000000000344768511ad45867140b137973ad87a450ecd9734b8a2071157  height=212324  log2_work=69.167787  tx=9923438  date=2012-12-15 21:09:27 progress=0.053906  cache=59.3MiB(76403tx)
2015-08-14 17:14:17 UpdateTip: new best=000000000000024818032064296539ee9041c326e313c793c82e2c140abe9123  height=212325  log2_work=69.167818  tx=9923449  date=2012-12-15 21:36:04 progress=0.053906  cache=59.3MiB(76423tx)
2015-08-14 17:14:17 UpdateTip: new best=0000000000000488f6356e0992792c90a3da83af6fab23c0afad41c91190b202  height=212326  log2_work=69.16785  tx=9923916  date=2012-12-15 21:54:49 progress=0.053909  cache=59.5MiB(76784tx)
2015-08-14 17:14:17 UpdateTip: new best=0000000000000458be6fd55eda478a50d8f01e18511a66ccc0f18734bd3db92f  height=212327  log2_work=69.167881  tx=9923917  date=2012-12-15 22:05:34 progress=0.053909  cache=59.5MiB(76785tx)
2015-08-14 17:14:17 UpdateTip: new best=00000000000002427357b2eb8f3902133dfb30e085fe5e6416697200339346a6  height=212328  log2_work=69.167913  tx=9923918  date=2012-12-15 22:10:55 progress=0.053909  cache=59.5MiB(76786tx)
2015-08-14 17:14:17 UpdateTip: new best=00000000000001b771d46de74704241940a8c72387cca469202bc9417882d4e3  height=212329  log2_work=69.167944  tx=9924655  date=2012-12-15 22:27:48 progress=0.053913  cache=60.3MiB(77279tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000022ecee2d0fc2fa1df6c7fb4b6f8ea1f75361ccd9d4fa2d924bb  height=212330  log2_work=69.167976  tx=9925049  date=2012-12-15 22:31:22 progress=0.053915  cache=60.3MiB(77391tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000003a3d565cbdc75a0033c077bafd441c53d8792bc6aad0f18c5e8  height=212331  log2_work=69.168007  tx=9925596  date=2012-12-15 22:52:00 progress=0.053918  cache=60.6MiB(77668tx)
2015-08-14 17:14:18 UpdateTip: new best=0000000000000131852e4efe49f1a61fd1efa0ae8d2c9c9135ac4acea06d8919  height=212332  log2_work=69.168039  tx=9925668  date=2012-12-15 22:51:08 progress=0.053918  cache=60.6MiB(77668tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000029cde516d06002e28f1a74889267abc792b9a1a9cf738967a1d  height=212333  log2_work=69.16807  tx=9925760  date=2012-12-15 23:00:05 progress=0.053919  cache=60.6MiB(77694tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000000568d962c8cd7ccdd33954b753694e728c0221196e7729d748f  height=212334  log2_work=69.168102  tx=9926339  date=2012-12-15 23:21:47 progress=0.053922  cache=60.7MiB(78023tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000007aa7abef3317ea16c4678596b5c3d709c044dd17dca0474a30  height=212335  log2_work=69.168133  tx=9926555  date=2012-12-15 23:29:02 progress=0.053923  cache=60.7MiB(78053tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000000a7e91f67b57a93ccaf9552d38d7b6b14c91d6e4947b4d99599  height=212336  log2_work=69.168165  tx=9926897  date=2012-12-15 23:32:57 progress=0.053925  cache=60.8MiB(78222tx)
2015-08-14 17:14:18 UpdateTip: new best=0000000000000209d9e0a099e2959e0670a7796a264b7c63128a77682cb2653b  height=212337  log2_work=69.168196  tx=9927151  date=2012-12-15 23:41:07 progress=0.053926  cache=60.8MiB(78342tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000004498e48644dee31060cacbc0c76c8665215efd594f590515713  height=212338  log2_work=69.168228  tx=9927152  date=2012-12-15 23:46:51 progress=0.053926  cache=60.8MiB(78343tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000003b21b965ed11fff29d3f966b44eb0e6878bf60b020ae4497e3a  height=212339  log2_work=69.168259  tx=9927279  date=2012-12-15 23:46:53 progress=0.053927  cache=60.9MiB(78420tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000002cb161af128fb737ca78851ecde96151d6a3deace1bc7b4fdbe  height=212340  log2_work=69.168291  tx=9927285  date=2012-12-15 23:55:33 progress=0.053927  cache=61.1MiB(78435tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000004201c4e7036b150ac0f88e814fffe7d8287e36ae1453fb9a061  height=212341  log2_work=69.168322  tx=9927856  date=2012-12-16 00:09:33 progress=0.053930  cache=61.4MiB(78609tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000040dac069a53f458da0225fe86eb231126d37f6c3c642ebd5819  height=212342  log2_work=69.168354  tx=9928194  date=2012-12-16 00:20:14 progress=0.053932  cache=61.7MiB(78867tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000001ac34400d19620e27a68d6d6085cedba4bfa8cf24b0e45195e9  height=212343  log2_work=69.168385  tx=9928240  date=2012-12-16 00:19:40 progress=0.053932  cache=61.7MiB(78878tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000008fc45b93262a851f51354644e94691575d8152f48d32c92895  height=212344  log2_work=69.168417  tx=9929006  date=2012-12-16 00:49:30 progress=0.053936  cache=62.3MiB(79569tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000002bd640adb4a549517f269d731cceecb1ce0e086b09a619b14a4  height=212345  log2_work=69.168448  tx=9929405  date=2012-12-16 01:39:05 progress=0.053938  cache=62.7MiB(80374tx)
2015-08-14 17:14:18 UpdateTip: new best=000000000000030ab9f4381ba3b58dec650d255be2447024469156668420f24c  height=212346  log2_work=69.16848  tx=9930228  date=2012-12-16 02:27:06 progress=0.053943  cache=62.9MiB(81148tx)
2015-08-14 17:14:18 UpdateTip: new best=00000000000000efe53f705bb3c267ca727aa91155343015165453642abe259f  height=212347  log2_work=69.168511  tx=9930954  date=2012-12-16 02:51:50 progress=0.053947  cache=63.0MiB(81656tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000001ddb48f8cba93451f87054669c53876f0a62457f636527b5640  height=212348  log2_work=69.168543  tx=9931316  date=2012-12-16 02:52:41 progress=0.053949  cache=63.1MiB(81730tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000003f13ea5cb9d8c5e714d17a93d2d45784a59f22e238be5695547  height=212349  log2_work=69.168574  tx=9931448  date=2012-12-16 03:15:07 progress=0.053950  cache=63.1MiB(81830tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000002675912fed544e185c5880fd34538b5738ba72577b98313d36b  height=212350  log2_work=69.168606  tx=9931709  date=2012-12-16 03:20:51 progress=0.053951  cache=63.2MiB(82002tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000016fcca2a5076549da54f3eed18f1e34d96a6c4442ed8add0962  height=212351  log2_work=69.168637  tx=9931765  date=2012-12-16 03:21:38 progress=0.053951  cache=63.2MiB(81995tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000000da559ecb7d6af2b1f3754bbe7a207f1fc6619714bd72c87acb  height=212352  log2_work=69.168668  tx=9931880  date=2012-12-16 03:34:04 progress=0.053952  cache=63.2MiB(82075tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000002c6e632dcc98f5b8f32ca77d491b5d8a73920f441e887fbcdf9  height=212353  log2_work=69.1687  tx=9931895  date=2012-12-16 03:34:16 progress=0.053952  cache=63.2MiB(82083tx)
2015-08-14 17:14:19 UpdateTip: new best=00000000000003627e63e34d4c7e6463d4209d27a8a68ae35caa3c1b1022b49d  height=212354  log2_work=69.168731  tx=9932277  date=2012-12-16 04:10:27 progress=0.053954  cache=63.2MiB(82136tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000008997bad6cc8a72c38dfd55497090f4029307837f101649da28  height=212355  log2_work=69.168763  tx=9932352  date=2012-12-16 04:15:16 progress=0.053954  cache=63.2MiB(82187tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000033c35bf84d00f253f98126491d8c3945efc2801699cfe0e79a3  height=212356  log2_work=69.168794  tx=9932472  date=2012-12-16 04:23:36 progress=0.053955  cache=63.3MiB(82226tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000035e10446be51350c7f20f235a0dbaa126f8eda121dde9c040ac  height=212357  log2_work=69.168826  tx=9932634  date=2012-12-16 04:42:07 progress=0.053956  cache=63.3MiB(82311tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000014dd86acb7a78120fc1271ef5ac3a37689eb8bf29f4cc177bb9  height=212358  log2_work=69.168857  tx=9932801  date=2012-12-16 04:43:20 progress=0.053957  cache=63.3MiB(82369tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000030d6d63126325405ed0609f7198a9dfb320fb1e6c9cadac4426  height=212359  log2_work=69.168889  tx=9932941  date=2012-12-16 04:53:00 progress=0.053958  cache=63.3MiB(82400tx)
2015-08-14 17:14:19 UpdateTip: new best=0000000000000189401374f1a656165ce784e7df9d17fbe614fa38d3e65bdc92  height=212360  log2_work=69.16892  tx=9933664  date=2012-12-16 05:07:54 progress=0.053962  cache=63.4MiB(82692tx)
2015-08-14 17:14:19 UpdateTip: new best=000000000000029d3f020620488bf5f13dde5acdc3ae7df0a0c0e84349098718  height=212361  log2_work=69.168952  tx=9933917  date=2012-12-16 05:24:45 progress=0.053963  cache=63.5MiB(82737tx)
2015-08-14 17:14:20 Corruption: block checksum mismatch
2015-08-14 17:14:20 *** System error while flushing: Database corrupted

Silent corruption in raid arrays is absolutely possible. Its possible this is an issue with leveldb, but it seems more likely there are silent errors somewhere in your disk/raid controller/etc.

[Hannu]

Thats why i like raspnode it not collapse like windows (kernel fault, bluescreen)