[DEVICE] SimpleRigResetter - Auto reboot crashed rigs - Extension Boards !!!

[tytanick]

Tested SRR today, everything working fine. Good job, tytanick!

Is it possible to control SRR with windows tool from remote location, not only from local network?
Or maybe it is good to have tool, integrated into simpleminingOS, similar to SRR-Tool for windows.

Thanx. 

Yep, there will be such things in some time

[Q_R_V]

Tested SRR with 8 rigs connected. It works flawlessly in auto restart mode and manual management mode via remote desktop on smartphone.
I can manage my rigs when lying on a couch and eating potato chips.
Build quality is high, wooden backplate is decent and smells nice but some kind of enclosure would be even better.
Would recommend.

[citronick]

Tested SRR with 8 rigs connected. It works flawlessly in auto restart mode and manual management mode via remote desktop on smartphone.
I can manage my rigs when lying on a couch and eating potato chips.
Build quality is high, wooden backplate is decent and smells nice but some kind of enclosure would be even better.
Would recommend.

Could you share your settings please?

[Q_R_V]

Could you share your settings please?

Watchdog max delay: 250 seconds
Long reset length: 3 minutes
Watchdog frequency: 10

[tytanick]

Could you share your settings please?

Watchdog max delay: 250 seconds
Long reset length: 3 minutes
Watchdog frequency: 10

In next firmware release this watchdog will be up to 10x bigger so 2500 seconds.

[citronick]

Could you share your settings please?

Watchdog max delay: 250 seconds
Long reset length: 3 minutes
Watchdog frequency: 10

Thanks QRV.

Tytanick - next release, please have enable labelling those balloons according to their rig names - possible?

[citronick]

Tytanick - I have finally finished installing the SRRs and have some questions and assumptions below:
can you help go through and see if I did the correct steps. My setup is multiple SRR in one network/farm.
Thanks!

0. All of my rigs are on smOS. And I use the Windows SRR Tool to manage the SRRs.

1. If I am not using any Windows rigs to be connected to SRR, do I need to do anything in the "LOCAL AGENT" part in SRR Tool?

1. What is "PC Number" on Windows SRR Tool?

2. If I have multiple SRRs in the same network -- do I change the UDP port for each SRR?

3. My guess is that for watchdog to work, you have to have the Windows SRR Tool to be opened.... or watchdog is running in service background and will work even with Windows SRR Tool NOT launched?

4. I have renamed the SRR hostname according to my environment, and also changed the IP address to 10.88.88.1, 10.88.88.2 and so on.

5. I am using 1 single PC to launch 4 SRR Tool windows (because I am using 4 x SRRs on my farm)... on first SRR, I have installed the SRR agent in LOCAL AGENT. Pressing SAVE will enable WATCHDOG and "CONFIGURED with :00000x". Do I need to do the same process for the other SRRs? It doesnt seem to give me any option to install in setting up the 2nd SRR.

6. After installing and assigning the SRR details in smOS, I could fully control all rigs. Fast, long resets and powerdown, power on - no issues. If I choose watchdog delay = 0, the farm is stable and responding well to manual actions. However, when I put 250 seconds in watchdog delay, I can see several rigs are randomly going offline and online - I am assuming watchdog is working.... but seems strange that this happens whenever I choose 250 seconds max delay. For now I use watchdog delay =0 and it doesnt do anything .... and I am assuming watchdog is listening to all the rigs attached to the SRR unit.

7.

[tytanick]

RED are my reply

Tytanick - I have finally finished installing the SRRs and have some questions and assumptions below:
can you help go through and see if I did the correct steps. My setup is multiple SRR in one network/farm.
Thanks!

0. All of my rigs are on smOS. And I use the Windows SRR Tool to manage the SRRs.

1. If I am not using any Windows rigs to be connected to SRR, do I need to do anything in the "LOCAL AGENT" part in SRR Tool?
Nope, Local agent part is only for Windows rigs

1. What is "PC Number" on Windows SRR Tool?
This is slot number in SRR 1,2,3,4,5,6,7,8 (you have printed on board jp1 jp2....), This misleading test will be fixed in next SRR release

2. If I have multiple SRRs in the same network -- do I change the UDP port for each SRR?
No, dont change this

3. My guess is that for watchdog to work, you have to have the Windows SRR Tool to be opened.... or watchdog is running in service background and will work even with Windows SRR Tool NOT launched?
You can close SRR Tool, its only for configuring SRR Board, and then after you write config you can close it. Watchdog service is running inside SRR Board.

4. I have renamed the SRR hostname according to my environment, and also changed the IP address to 10.88.88.1, 10.88.88.2 and so on.
On, its up to you how to name them
Also IP address is optional, it will be more used when Web panel for SRR will come with future firmware release.
As now all communication happens via broadcast (it uses MAC to communicate). IP here is optional.

5. I am using 1 single PC to launch 4 SRR Tool windows (because I am using 4 x SRRs on my farm)... on first SRR, I have installed the SRR agent in LOCAL AGENT. Pressing SAVE will enable WATCHDOG and "CONFIGURED with :00000x". Do I need to do the same process for the other SRRs? It doesnt seem to give me any option to install in setting up the 2nd SRR.
Local Agent is still only for WINDOWS RIGS. As you dont have them you should not use this at all.
Anyway  if you are using windows rigs then
Open SRR Tool on windows rig1 and set SERIAL number and port number of SRR that this rig is connected to.
As you are using my Simplemining OS, just click near each rig MORE -> SRR.
If your rig is connected to SRR with serial 000034 to port number 5 then enter in those options serial 000034 and slot 5

6. After installing and assigning the SRR details in smOS, I could fully control all rigs. Fast, long resets and powerdown, power on - no issues. If I choose watchdog delay = 0, the farm is stable and responding well to manual actions. However, when I put 250 seconds in watchdog delay, I can see several rigs are randomly going offline and online - I am assuming watchdog is working.... but seems strange that this happens whenever I choose 250 seconds max delay. For now I use watchdog delay =0 and it doesnt do anything .... and I am assuming watchdog is listening to all the rigs attached to the SRR unit.
Hmm strange.
It will reset only if there is a problemwith specific rig.
If your rigs are resetting randomly with no apparent reason then something is wrong.
Please check if you have good options written in simpelmining dashboard config.
So is you are using SRR 000007 with port 5, check if resetting this rig manually will work and it resets 5th and not other rig.
If everything is set right then it wont reset rig until something is wrong with it.
Please check if port number you entered in config corresponds with port number that is written on SRR Board itself near this slot.
Also all rigs and SRR are in the same network right ?
If all those things are correct and still you have problem then please write to me at admin@simplemining.net  and i will check all this via team viewer
Meaby bug, meaby misconfigured, i need to check it.
7.

[philipma1957]

as for the max 250 time  you have a problem
 
but at min  0 time no problems

test 240 see if problems like that of 250 show up

test 90 see if problems show up

test 5 see if problems show up

[tytanick]

as for the max 250 time  you have a problem
 
but at min  0 time no problems

test 240 see if problems like that of 250 show up

test 90 see if problems show up

test 5 see if problems show up

I spoke with my SRR developer, there will be max 2500 seconds in watchdog in next Firmware release.
We have limit of 255 value, so we need to to it *10.
So the setting will be 10,20,30,40 seconds....... 2500seconds
When time comes and i will release first firmware upgrade, i will write special instructions with changelog and what you need to know before and after upgrade.

[xleejohnx]

been playing around with the SRR trying to gather up a good review

one thing is will the SRR turn on a rig from a complete power down state?
if so how? i cant make it turn on a rig other than doing it manual from the SRR config tool

[citronick]

RED are my reply

Tytanick - I have finally finished installing the SRRs and have some questions and assumptions below:
can you help go through and see if I did the correct steps. My setup is multiple SRR in one network/farm.
Thanks!

0. All of my rigs are on smOS. And I use the Windows SRR Tool to manage the SRRs.

1. If I am not using any Windows rigs to be connected to SRR, do I need to do anything in the "LOCAL AGENT" part in SRR Tool?
Nope, Local agent part is only for Windows rigs
>> Ah I see. The SRR Tool and Tool for Windows, maybe should be labelled (LOCAL AGENT (Windows only) - so that it dont confuse users.

1. What is "PC Number" on Windows SRR Tool?
This is slot number in SRR 1,2,3,4,5,6,7,8 (you have printed on board jp1 jp2....), This misleading test will be fixed in next SRR release
>> OK. Since I am Linux only - I dont have to touch this part.

2. If I have multiple SRRs in the same network -- do I change the UDP port for each SRR?
No, dont change this
>> got it.

3. My guess is that for watchdog to work, you have to have the Windows SRR Tool to be opened.... or watchdog is running in service background and will work even with Windows SRR Tool NOT launched?
You can close SRR Tool, its only for configuring SRR Board, and then after you write config you can close it. Watchdog service is running inside SRR Board.
>> Ah OK - now this makes more sense. I think I will do this and let it be for 24 hours to see if SRR is working. Hopefully I can see a live resetting in action otherwise by 24 hours -- all rigs should be all green.

4. I have renamed the SRR hostname according to my environment, and also changed the IP address to 10.88.88.1, 10.88.88.2 and so on.
On, its up to you how to name them
Also IP address is optional, it will be more used when Web panel for SRR will come with future firmware release.
As now all communication happens via broadcast (it uses MAC to communicate). IP here is optional.
>> OK - understood.

5. I am using 1 single PC to launch 4 SRR Tool windows (because I am using 4 x SRRs on my farm)... on first SRR, I have installed the SRR agent in LOCAL AGENT. Pressing SAVE will enable WATCHDOG and "CONFIGURED with :00000x". Do I need to do the same process for the other SRRs? It doesnt seem to give me any option to install in setting up the 2nd SRR.
Local Agent is still only for WINDOWS RIGS. As you dont have them you should not use this at all.
Anyway  if you are using windows rigs then
Open SRR Tool on windows rig1 and set SERIAL number and port number of SRR that this rig is connected to.
As you are using my Simplemining OS, just click near each rig MORE -> SRR.
If your rig is connected to SRR with serial 000034 to port number 5 then enter in those options serial 000034 and slot 5
>> OK. I just disregard the windows part. All rigs and slot assignments have been completed in smOS's SRR menu.

6. After installing and assigning the SRR details in smOS, I could fully control all rigs. Fast, long resets and powerdown, power on - no issues. If I choose watchdog delay = 0, the farm is stable and responding well to manual actions. However, when I put 250 seconds in watchdog delay, I can see several rigs are randomly going offline and online - I am assuming watchdog is working.... but seems strange that this happens whenever I choose 250 seconds max delay. For now I use watchdog delay =0 and it doesnt do anything .... and I am assuming watchdog is listening to all the rigs attached to the SRR unit.
Hmm strange.
It will reset only if there is a problemwith specific rig.
If your rigs are resetting randomly with no apparent reason then something is wrong.
Please check if you have good options written in simpelmining dashboard config.
So is you are using SRR 000007 with port 5, check if resetting this rig manually will work and it resets 5th and not other rig.
If everything is set right then it wont reset rig until something is wrong with it.
Please check if port number you entered in config corresponds with port number that is written on SRR Board itself near this slot.
Also all rigs and SRR are in the same network right ?
If all those things are correct and still you have problem then please write to me at admin@simplemining.net  and i will check all this via team viewer
Meaby bug, meaby misconfigured, i need to check it.
7.
>> I will set 250 max delay, 3 minute long reset, and close all SRR Windows Tools. Hopefully I can see a live resetting in action otherwise by 24 hours -- all rigs should be all green.

[dance191]

Any chance of an API or letting us know some "hack" to control the rigs through some script we have running (other than killing SRR-Agent-Linux-v2.sh on each machine)?

I can quickly see where I will be monitoring my rigs at a pool and will need to reboot rigs based on what a script sees at the pool.  The GUI is nice for lots of people, but some way to talk to the SRR through code for me takes it to the next level!  Any chance of an API or simply some hints at how to hack talking to the SRR?  For example, someway to talk to the SRR and tell it to reboot machine #5 would be ideal.

Also, what is the login/password for the SRR?  If I can get on the SRR I am sure I could hack something together.

Overall, it looks to be a great product!

[citronick]

Tytanick....

on the smOS, is it possible to show SRR activities.

For example:

When SRR is triggered, maybe that row for that a rig, has some indicator/flashing to show that SRR in is progress.

I have my dashboard displayed 24x7 for monitoring purposes and it will be good to see SRR is working.

Thanks

[tytanick]

Any chance of an API or letting us know some "hack" to control the rigs through some script we have running (other than killing SRR-Agent-Linux-v2.sh on each machine)?

I can quickly see where I will be monitoring my rigs at a pool and will need to reboot rigs based on what a script sees at the pool.  The GUI is nice for lots of people, but some way to talk to the SRR through code for me takes it to the next level!  Any chance of an API or simply some hints at how to hack talking to the SRR?  For example, someway to talk to the SRR and tell it to reboot machine #5 would be ideal.

Also, what is the login/password for the SRR?  If I can get on the SRR I am sure I could hack something together.

Overall, it looks to be a great product!

Yes, sure.
You can hack. There is already API which is using SRR Tool for communicating and local agent scripts.
Ok so here is reset script:

Code:

#!/bin/bash

# REQUIRED packages: socat

# INPUTY
serial="000002"
port="3"

serial=`echo $serial | xargs`
port=`echo $port | xargs`
port=`printf %02X $(( ${port} -1 ))`

firstByte="FF"
byteCount="0008"
action="53"
mac="485053$serial"

checksum=`printf %02X $(( (0x${byteCount:0:2} + 0x${byteCount:2:2} + 0x$action + 0x${mac:0:2} + 0x${mac:2:2} + 0x${mac:4:2} + 0x${mac:6:2} + 0x${mac:8:2} + 0x${mac:10:2} + 0x$port)%0x100  ))`
packet="$firstByte$byteCount$action$mac$port$checksum"
echo "Wysyłam pakiet o następującej zawartości: $packet"

echo -n "$packet" | xxd -r -p |socat - UDP-DATAGRAM:255.255.255.255:1051,broadcast

If you want to turn ON rig then change action to 51
If you want to turn OFF rig then change action to 52

Here is list you can easly use with this script
0x51 - turn on rig
0x52 - turn off rig
0x53 - fast reset rig
0x55 - keepalive
0x58 - long reset

Rest is little bit more difficult like reading and writing settings - for this better use Windows Tool

[tytanick]

Tytanick....

on the smOS, is it possible to show SRR activities.

For example:

When SRR is triggered, maybe that row for that a rig, has some indicator/flashing to show that SRR in is progress.

I have my dashboard displayed 24x7 for monitoring purposes and it will be good to see SRR is working.

Thanks

That would be difficult to do on SM OS as SRR isnt communicating with it.
To test if its working its best to unplug rig 1, and see if it reboots after specified time, then rig 2 etc etc
Also there wound need to be hard hang of rig becasue if only gpu hangs and system sees that it triggers software linux reboot.
Anyway try to uplugging RJ45 from the rig you want to check if it will reset.

[xleejohnx]

Tytanick....

on the smOS, is it possible to show SRR activities.

For example:

When SRR is triggered, maybe that row for that a rig, has some indicator/flashing to show that SRR in is progress.

I have my dashboard displayed 24x7 for monitoring purposes and it will be good to see SRR is working.

Thanks

That would be difficult to do on SM OS as SRR isnt communicating with it.
To test if its working its best to unplug rig 1, and see if it reboots after specified time, then rig 2 etc etc
Also there wound need to be hard hang of rig becasue if only gpu hangs and system sees that it triggers software linux reboot.
Anyway try to uplugging RJ45 from the rig you want to check if it will reset.

Can the SRR turn on a rig from a cold start automatically?

[tytanick]

Tytanick....

on the smOS, is it possible to show SRR activities.

For example:

When SRR is triggered, maybe that row for that a rig, has some indicator/flashing to show that SRR in is progress.

I have my dashboard displayed 24x7 for monitoring purposes and it will be good to see SRR is working.

Thanks

That would be difficult to do on SM OS as SRR isnt communicating with it.
To test if its working its best to unplug rig 1, and see if it reboots after specified time, then rig 2 etc etc
Also there wound need to be hard hang of rig becasue if only gpu hangs and system sees that it triggers software linux reboot.
Anyway try to uplugging RJ45 from the rig you want to check if it will reset.

Can the SRR turn on a rig from a cold start automatically?

Right now not.
Still thinkg what is multi best option.
Now its normal resetting in loop.

[dance191]

Any chance of an API or letting us know some "hack" to control the rigs through some script we have running (other than killing SRR-Agent-Linux-v2.sh on each machine)?

I can quickly see where I will be monitoring my rigs at a pool and will need to reboot rigs based on what a script sees at the pool.  The GUI is nice for lots of people, but some way to talk to the SRR through code for me takes it to the next level!  Any chance of an API or simply some hints at how to hack talking to the SRR?  For example, someway to talk to the SRR and tell it to reboot machine #5 would be ideal.

Also, what is the login/password for the SRR?  If I can get on the SRR I am sure I could hack something together.

Overall, it looks to be a great product!

Yes, sure.
You can hack. There is already API which is using SRR Tool for communicating and local agent scripts.
Ok so here is reset script:

Code:

#!/bin/bash

# REQUIRED packages: socat

# INPUTY
serial="000002"
port="3"

serial=`echo $serial | xargs`
port=`echo $port | xargs`
port=`printf %02X $(( ${port} -1 ))`

firstByte="FF"
byteCount="0008"
action="53"
mac="485053$serial"

checksum=`printf %02X $(( (0x${byteCount:0:2} + 0x${byteCount:2:2} + 0x$action + 0x${mac:0:2} + 0x${mac:2:2} + 0x${mac:4:2} + 0x${mac:6:2} + 0x${mac:8:2} + 0x${mac:10:2} + 0x$port)%0x100  ))`
packet="$firstByte$byteCount$action$mac$port$checksum"
echo "Wysyłam pakiet o następującej zawartości: $packet"

echo -n "$packet" | xxd -r -p |socat - UDP-DATAGRAM:255.255.255.255:1051,broadcast

If you want to turn ON rig then change action to 51
If you want to turn OFF rig then change action to 52

Here is list you can easly use with this script
0x51 - turn on rig
0x52 - turn off rig
0x53 - fast reset rig
0x55 - keepalive
0x58 - long reset

Rest is little bit more difficult like reading and writing settings - for this better use Windows Tool

Beautiful, this is exactly what I needed.  With 51, 52 & 55 you can do just about everything so that is all I need.  Thank you very much Tytanick!

[citronick]

Any chance of an API or letting us know some "hack" to control the rigs through some script we have running (other than killing SRR-Agent-Linux-v2.sh on each machine)?

I can quickly see where I will be monitoring my rigs at a pool and will need to reboot rigs based on what a script sees at the pool.  The GUI is nice for lots of people, but some way to talk to the SRR through code for me takes it to the next level!  Any chance of an API or simply some hints at how to hack talking to the SRR?  For example, someway to talk to the SRR and tell it to reboot machine #5 would be ideal.

Also, what is the login/password for the SRR?  If I can get on the SRR I am sure I could hack something together.

Overall, it looks to be a great product!

Yes, sure.
You can hack. There is already API which is using SRR Tool for communicating and local agent scripts.
Ok so here is reset script:

Code:

#!/bin/bash

# REQUIRED packages: socat

# INPUTY
serial="000002"
port="3"

serial=`echo $serial | xargs`
port=`echo $port | xargs`
port=`printf %02X $(( ${port} -1 ))`

firstByte="FF"
byteCount="0008"
action="53"
mac="485053$serial"

checksum=`printf %02X $(( (0x${byteCount:0:2} + 0x${byteCount:2:2} + 0x$action + 0x${mac:0:2} + 0x${mac:2:2} + 0x${mac:4:2} + 0x${mac:6:2} + 0x${mac:8:2} + 0x${mac:10:2} + 0x$port)%0x100  ))`
packet="$firstByte$byteCount$action$mac$port$checksum"
echo "Wysyłam pakiet o następującej zawartości: $packet"

echo -n "$packet" | xxd -r -p |socat - UDP-DATAGRAM:255.255.255.255:1051,broadcast

If you want to turn ON rig then change action to 51
If you want to turn OFF rig then change action to 52

Here is list you can easly use with this script
0x51 - turn on rig
0x52 - turn off rig
0x53 - fast reset rig
0x55 - keepalive
0x58 - long reset

Rest is little bit more difficult like reading and writing settings - for this better use Windows Tool

Beautiful, this is exactly what I needed.  With 51, 52 & 55 you can do just about everything so that is all I need.  Thank you very much Tytanick!

Hey dance191 -- please do share your app once completed. Thanks!