Innonsilicon Crashing every 1-2 days

[jadrew1020]

Hello,

I have recently purchased Innonsilicon A9 Zmasters, I was wondering if anyone could help me out. The machines are brand new and they seem to crash every 1-2 days, does anyone know what could be the cause of this, at first I thought it could be the pool that keeps going down so I switched to a different pool but the machines still seem to be crashing every 1-2 days. I did some research online and some people say it could be caused by the fan speed readjusting itself all the time.

Here is my miner log history:
Oct 04 12:32:43 InnoMiner sgminer[3300]: Stratum from pool 0 detected new block
Oct 04 12:32:47 InnoMiner sgminer[3300]: Accepted 37eaf11d Diff 0/274768 HLT 2
Oct 04 12:32:56 InnoMiner sgminer[3300]: Accepted cd3289a5 Diff 0/274768 HLT 2
Oct 04 12:32:58 InnoMiner sgminer[3300]: Accepted 24a23470 Diff 0/274768 HLT 1
Oct 04 12:33:01 InnoMiner sgminer[3300]: Accepted 36a97ece Diff 0/274768 HLT 1
Oct 04 12:33:05 InnoMiner sgminer[3300]: Accepted 258ee9b9 Diff 0/274768 HLT 2
Oct 04 12:33:17 InnoMiner sgminer[3300]: Accepted 04d96c12 Diff 0/274768 HLT 2
Oct 04 12:33:18 InnoMiner sgminer[3300]: Accepted 28b0b189 Diff 0/274768 HLT 1
Oct 04 12:33:19 InnoMiner sgminer[3300]: Pool 0 difficulty changed to 000038e38e38e38e380000000000000000000000000000000000000000000000
Oct 04 12:33:19 InnoMiner sgminer[3300]: Stratum from pool 0 requested work restart
Oct 04 12:33:19 InnoMiner sgminer[3300]: 1: chip 9: stale nonce 0xb3cfcff4
Oct 04 12:33:20 InnoMiner sgminer[3300]: FAN SPEED TARGET set to 27
Oct 04 12:33:20 InnoMiner sgminer[3300]: fan speed set to 20, TARGET is 27
Oct 04 12:33:21 InnoMiner sgminer[3300]: Accepted 296729c2 Diff 0/294918 HLT 0
Oct 04 12:33:22 InnoMiner sgminer[3300]: FAN SPEED TARGET set to 26
Oct 04 12:33:24 InnoMiner sgminer[3300]: FAN SPEED TARGET set to 25
Oct 04 12:33:31 InnoMiner sgminer[3300]: Accepted 1ddb5e41 Diff 0/294918 HLT 1
Oct 04 12:33:34 InnoMiner sgminer[3300]: Accepted 37498372 Diff 0/294918 HLT 1
Oct 04 12:33:41 InnoMiner sgminer[3300]: Accepted 1acef25d Diff 0/294918 HLT 0
Oct 04 12:33:45 InnoMiner sgminer[3300]: Repeat data!
Oct 04 12:33:45 InnoMiner sgminer[3300]: Notice!!! Error Nonce
Oct 04 12:33:45 InnoMiner sgminer[3300]: HLT0: invalid nonce - HW error
Oct 04 12:33:45 InnoMiner sgminer[3300]: 0: chip 7: invalid nonce 0xb44fdff4
Oct 04 12:33:45 InnoMiner sgminer[3300]: nonce_ranges_processed less than 0

If anyone could help me it would be appreciated!

[Ambros]

Is it crashing completely, meaning that you have to physically unplug it to restart or the web interfaces/ssh remain available?
 

[imine2]

Hello,

I have recently purchased Innonsilicon A9 Zmasters, I was wondering if anyone could help me out. The machines are brand new and they seem to crash every 1-2 days, does anyone know what could be the cause of this, at first I thought it could be the pool that keeps going down so I switched to a different pool but the machines still seem to be crashing every 1-2 days. I did some research online and some people say it could be caused by the fan speed readjusting itself all the time.

Here is my miner log history:
Oct 04 12:32:43 InnoMiner sgminer[3300]: Stratum from pool 0 detected new block
Oct 04 12:32:47 InnoMiner sgminer[3300]: Accepted 37eaf11d Diff 0/274768 HLT 2
Oct 04 12:32:56 InnoMiner sgminer[3300]: Accepted cd3289a5 Diff 0/274768 HLT 2
Oct 04 12:32:58 InnoMiner sgminer[3300]: Accepted 24a23470 Diff 0/274768 HLT 1
Oct 04 12:33:01 InnoMiner sgminer[3300]: Accepted 36a97ece Diff 0/274768 HLT 1
Oct 04 12:33:05 InnoMiner sgminer[3300]: Accepted 258ee9b9 Diff 0/274768 HLT 2
Oct 04 12:33:17 InnoMiner sgminer[3300]: Accepted 04d96c12 Diff 0/274768 HLT 2
Oct 04 12:33:18 InnoMiner sgminer[3300]: Accepted 28b0b189 Diff 0/274768 HLT 1
Oct 04 12:33:19 InnoMiner sgminer[3300]: Pool 0 difficulty changed to 000038e38e38e38e380000000000000000000000000000000000000000000000
Oct 04 12:33:19 InnoMiner sgminer[3300]: Stratum from pool 0 requested work restart
Oct 04 12:33:19 InnoMiner sgminer[3300]: 1: chip 9: stale nonce 0xb3cfcff4
Oct 04 12:33:20 InnoMiner sgminer[3300]: FAN SPEED TARGET set to 27
Oct 04 12:33:20 InnoMiner sgminer[3300]: fan speed set to 20, TARGET is 27
Oct 04 12:33:21 InnoMiner sgminer[3300]: Accepted 296729c2 Diff 0/294918 HLT 0
Oct 04 12:33:22 InnoMiner sgminer[3300]: FAN SPEED TARGET set to 26
Oct 04 12:33:24 InnoMiner sgminer[3300]: FAN SPEED TARGET set to 25
Oct 04 12:33:31 InnoMiner sgminer[3300]: Accepted 1ddb5e41 Diff 0/294918 HLT 1
Oct 04 12:33:34 InnoMiner sgminer[3300]: Accepted 37498372 Diff 0/294918 HLT 1
Oct 04 12:33:41 InnoMiner sgminer[3300]: Accepted 1acef25d Diff 0/294918 HLT 0
Oct 04 12:33:45 InnoMiner sgminer[3300]: Repeat data!
Oct 04 12:33:45 InnoMiner sgminer[3300]: Notice!!! Error Nonce
Oct 04 12:33:45 InnoMiner sgminer[3300]: HLT0: invalid nonce - HW error
Oct 04 12:33:45 InnoMiner sgminer[3300]: 0: chip 7: invalid nonce 0xb44fdff4
Oct 04 12:33:45 InnoMiner sgminer[3300]: nonce_ranges_processed less than 0

If anyone could help me it would be appreciated!

https://bitcointalk.org/index.php?topic=5041973.msg46410529#msg46410529

Do all 4 cables from the fan's have good connection with controlboards ? ? ?

how often do they readjust fanspeed?

You write A9 ZMaster's with meaning more then one!

If they all "crash" after about the same time then it's probably the memory that gets full and they REBOOT.
If they crash simultaniously then it's more probably a power issue.
If they do a REBOOT at the same time it might be a problem with internet connection  (or connectionproblem with the miningpool you are using).
(What do the logs say?)

If they all chrash and it's not related to memory getting full and not bad cable connection it might have something to do with hight ambient temp and coolingproblem or even more likely problem with power fluctuation from the wall sockets to PSU's and/or from PSU's to the A9's.

If its memory getting full:
If you point one at prohashing.com and one at some other place like nanopool, flypool or whatever you will likely see that the one at prohashing doesn't fill upp its memory like the others.

If you compere how much the different miningpools fill up the logs there is your answer to whats happening.


Good luck!

[jadrew1020]

Is it crashing completely, meaning that you have to physically unplug it to restart or the web interfaces/ssh remain available?
 

I don't have to physically restart them it but they restart themselves every 1-2 days what is the reason for this can you help, please.

Thanks,

[jadrew1020]

Hello,

I have recently purchased Innonsilicon A9 Zmasters, I was wondering if anyone could help me out. The machines are brand new and they seem to crash every 1-2 days, does anyone know what could be the cause of this, at first I thought it could be the pool that keeps going down so I switched to a different pool but the machines still seem to be crashing every 1-2 days. I did some research online and some people say it could be caused by the fan speed readjusting itself all the time.

Here is my miner log history:

Oct 05 13:37:37 InnoMiner sgminer[11230]: Accepted 2cff5783 Diff 0/294918 HLT 2
Oct 05 13:37:40 InnoMiner sgminer[11230]: Stratum from pool 0 requested work restart
Oct 05 13:37:51 InnoMiner sgminer[11230]: Accepted 2f3a4aad Diff 0/294918 HLT 1
Oct 05 13:37:53 InnoMiner sgminer[11230]: Accepted 0df51292 Diff 0/294918 HLT 0
Oct 05 13:37:59 InnoMiner sgminer[11230]: Solution verification1 failed!
Oct 05 13:37:59 InnoMiner sgminer[11230]: Notice!!! Error Nonce
Oct 05 13:37:59 InnoMiner sgminer[11230]: HLT2: invalid nonce - HW error
Oct 05 13:37:59 InnoMiner sgminer[11230]: 2: chip 1: invalid nonce 0xb34fbff4
Oct 05 13:38:00 InnoMiner sgminer[11230]: nonce_ranges_processed less than 0
Oct 05 13:38:01 InnoMiner sgminer[11230]: Accepted 2649372d Diff 0/294918 HLT 0
Oct 05 13:38:02 InnoMiner kernel: systemd-journal invoked oom-killer: gfp_mask=0x14000c0(GFP_KERNEL), nodemask=(null), order=0, oom_score_adj=0
Oct 05 13:38:02 InnoMiner kernel: CPU: 1 PID: 752 Comm: systemd-journal Not tainted 4.14.0-xilinx #1
Oct 05 13:38:02 InnoMiner kernel: Hardware name: Xilinx Zynq Platform
Oct 05 13:38:02 InnoMiner kernel: [<c010e62c>] (unwind_backtrace) from [<c010a844>] (show_stack+0x10/0x14)
Oct 05 13:38:02 InnoMiner kernel: [<c010a844>] (show_stack) from [<c06742a8>] (dump_stack+0x80/0x9c)
Oct 05 13:38:02 InnoMiner kernel: [<c06742a8>] (dump_stack) from [<c01973d0>] (dump_header.constprop.3+0x84/0x1ec)
Oct 05 13:38:02 InnoMiner kernel: [<c01973d0>] (dump_header.constprop.3) from [<c0196a18>] (oom_kill_process+0xb0/0x41c)
Oct 05 13:38:02 InnoMiner kernel: [<c0196a18>] (oom_kill_process) from [<c0197260>] (out_of_memory+0x340/0x3e8)
Oct 05 13:38:02 InnoMiner kernel: [<c0197260>] (out_of_memory) from [<c019ad38>] (__alloc_pages_nodemask+0x818/0x8c8)
Oct 05 13:38:02 InnoMiner kernel: [<c019ad38>] (__alloc_pages_nodemask) from [<c019adf8>] (__get_free_pages+0x10/0x20)
Oct 05 13:38:02 InnoMiner kernel: [<c019adf8>] (__get_free_pages) from [<c021da88>] (proc_pid_readlink+0x4c/0x108)
Oct 05 13:38:02 InnoMiner kernel: [<c021da88>] (proc_pid_readlink) from [<c01e1758>] (vfs_readlink+0x34/0xdc)
Oct 05 13:38:02 InnoMiner kernel: [<c01e1758>] (vfs_readlink) from [<c01d7bac>] (SyS_readlinkat+0xa0/0xd0)
Oct 05 13:38:02 InnoMiner kernel: [<c01d7bac>] (SyS_readlinkat) from [<c0106da0>] (ret_fast_syscall+0x0/0x48)
Oct 05 13:38:02 InnoMiner kernel: Mem-Info:
Oct 05 13:38:02 InnoMiner kernel: active_anon:55918 inactive_anon:3115 isolated_anon:0
active_file:7 inactive_file:62 isolated_file:0
unevictable:0 dirty:0 writeback:0 unstable:0
slab_reclaimable:219 slab_unreclaimable:1193
mapped:399 shmem:3414 pagetables:212 bounce:0
free:488 free_pcp:84 free_cma:42
Oct 05 13:38:02 InnoMiner kernel: Node 0 active_anon:223672kB inactive_anon:12460kB active_file:28kB inactive_file:248kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:1596kB dirty:0kB writeback:0kB shmem:13656kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
Oct 05 13:38:02 InnoMiner kernel: Normal free:2248kB min:1928kB low:2408kB high:2888kB active_anon:223672kB inactive_anon:12460kB active_file:212kB inactive_file:240kB unevictable:0kB writepending:0kB present:262144kB managed:250564kB mlocked:0kB kernel_stack:592kB pagetables:848kB bounce:0kB free_pcp:132kB local_pcp:0kB free_cma:168kB
Oct 05 13:38:02 InnoMiner kernel: lowmem_reserve[]: 0 0 0
Oct 05 13:38:02 InnoMiner kernel: Normal: 107*4kB (UMC) 33*8kB (UMC) 28*16kB (UMC) 10*32kB (UC) 4*64kB (UM) 2*128kB (UM) 1*256kB (U) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2228kB
Oct 05 13:38:02 InnoMiner kernel: 3463 total pagecache pages
Oct 05 13:38:02 InnoMiner kernel: 0 pages in swap cache
Oct 05 13:38:02 InnoMiner kernel: Swap cache stats: add 0, delete 0, find 0/0
Oct 05 13:38:02 InnoMiner kernel: Free swap = 0kB
Oct 05 13:38:02 InnoMiner kernel: Total swap = 0kB
Oct 05 13:38:02 InnoMiner kernel: 65536 pages RAM
Oct 05 13:38:02 InnoMiner kernel: 0 pages HighMem/MovableOnly
Oct 05 13:38:02 InnoMiner kernel: 2895 pages reserved
Oct 05 13:38:02 InnoMiner kernel: 4096 pages cma reserved
Oct 05 13:38:02 InnoMiner kernel: [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
Oct 05 13:38:02 InnoMiner kernel: [ 752] 0 752 5782 395 7 0 0 0 systemd-journal
Oct 05 13:38:02 InnoMiner kernel: [ 936] 0 936 1489 99 5 0 0 -1000 systemd-udevd
Oct 05 13:38:02 InnoMiner kernel: [ 1277] 1008 1277 3827 66 7 0 0 0 systemd-timesyn
Oct 05 13:38:02 InnoMiner kernel: [ 1278] 1007 1278 1584 64 5 0 0 0 systemd-resolve
Oct 05 13:38:02 InnoMiner kernel: [ 1281] 0 1281 17030 9836 27 0 0 0 dm-monitor
Oct 05 13:38:02 InnoMiner kernel: [ 1282] 0 1282 588 7 3 0 0 0 getty
Oct 05 13:38:02 InnoMiner kernel: [ 1283] 1000 1283 1179 59 5 0 0 -900 dbus-daemon
Oct 05 13:38:02 InnoMiner kernel: [ 1296] 0 1296 2924 269 8 0 0 0 php-fpm
Oct 05 13:38:02 InnoMiner kernel: [ 1310] 0 1310 1138 68 4 0 0 -1000 sshd
Oct 05 13:38:02 InnoMiner kernel: [ 1312] 0 1312 802 73 4 0 0 0 nginx
Oct 05 13:38:02 InnoMiner kernel: [ 1313] 33 1313 856 119 4 0 0 0 nginx
Oct 05 13:38:02 InnoMiner kernel: [ 1315] 0 1315 11092 96 12 0 0 0 swupdate
Oct 05 13:38:02 InnoMiner kernel: [ 1317] 1006 1317 1531 69 5 0 0 0 systemd-network
Oct 05 13:38:02 InnoMiner kernel: [ 1336] 0 1336 6226 102 8 0 0 0 swupdate
Oct 05 13:38:02 InnoMiner kernel: [11230] 0 11230 68573 44458 102 0 0 0 cgminer
Oct 05 13:38:02 InnoMiner kernel: Out of memory: Kill process 11230 (cgminer) score 690 or sacrifice child
Oct 05 13:38:02 InnoMiner kernel: Killed process 11230 (cgminer) total-vm:274292kB, anon-rss:177832kB, file-rss:0kB, shmem-rss:0kB
Oct 05 13:38:02 InnoMiner kernel: oom_reaper: reaped process 11230 (cgminer), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Oct 05 13:38:02 InnoMiner systemd[1]: cgminer.service: Main process exited, code=killed, status=9/KILL
Oct 05 13:38:02 InnoMiner systemd[1]: cgminer.service: Failed with result 'signal'.
Oct 05 13:38:02 InnoMiner systemd[1]: cgminer.service: Service hold-off time over, scheduling restart.
Oct 05 13:38:02 InnoMiner systemd[1]: cgminer.service: Scheduled restart job, restart counter is at 1.
Oct 05 13:38:02 InnoMiner systemd[1]: Stopped sgminer4a9.
Oct 05 13:38:02 InnoMiner systemd[1]: Starting sgminer4a9...
Oct 05 13:38:03 InnoMiner systemd[1]: Started sgminer4a9.



It seems to me it runs out of memory! What can i do to fix this. Do I need to change pool or will all pools eventually fill up their log space?

Thanks

[imine2]

It seems to me it runs out of memory! What can i do to fix this. Do I need to change pool or will all pools eventually fill up their log space?

Thanks

It's totally my own conclusion that the problem with A9's restarting because memory full is because of the logs filling up.
This I have found to be true and I have not seen anybody with any other explanation  to why the A9 memory fills up so fast until they restart.

Innosilicon are posting in this forum and they can hardly have missed my comments about this so the fact that there is no firmware or other solution to this problem is because Innosilicon apperantly don't have one.

The only solution I can offer so far is mining at prohashing.com because the logs don't fill up like on other miningpools.
I think that is a good alternative especially if you convert to BTC and/or some other cryptos.
Conversion is instantanious.

Please share if you find any other solution!