Quote
CUDA: Device: 3 Thread exited with code: 77
CUDA: Device: 4 Thread exited with code: 77
CUDA: Device: 2 Thread exited with code: 77
CUDA: Device: 1 Thread exited with code: 77
CUDA: Device: 0 Thread exited with code: 77
ERROR: Some workers are stopped. Attempt to restart: 1
CUDA: Device: 0 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 1 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 2 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 3 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 4 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 0 Thread exited with code: 46
CUDA: Device: 1 Thread exited with code: 46
CUDA: Device: 2 Thread exited with code: 46
CUDA: Device: 3 Thread exited with code: 46
CUDA: Device: 4 Thread exited with code: 46
ERROR: Some workers are stopped. Attempt to restart: 2
CUDA: Device: 0 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 0 Thread exited with code: 46
CUDA: Device: 1 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 1 Thread exited with code: 46
CUDA: Device: 2 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 2 Thread exited with code: 46
CUDA: Device: 3 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 3 Thread exited with code: 46
CUDA: Device: 4 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 4 Thread exited with code: 46
CUDA: Device: 4 Thread exited with code: 77
CUDA: Device: 2 Thread exited with code: 77
CUDA: Device: 1 Thread exited with code: 77
CUDA: Device: 0 Thread exited with code: 77
ERROR: Some workers are stopped. Attempt to restart: 1
CUDA: Device: 0 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 1 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 2 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 3 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 4 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 0 Thread exited with code: 46
CUDA: Device: 1 Thread exited with code: 46
CUDA: Device: 2 Thread exited with code: 46
CUDA: Device: 3 Thread exited with code: 46
CUDA: Device: 4 Thread exited with code: 46
ERROR: Some workers are stopped. Attempt to restart: 2
CUDA: Device: 0 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 0 Thread exited with code: 46
CUDA: Device: 1 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 1 Thread exited with code: 46
CUDA: Device: 2 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 2 Thread exited with code: 46
CUDA: Device: 3 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 3 Thread exited with code: 46
CUDA: Device: 4 GeForce GTX 1070, 8192 MB M0
CUDA: Device: 4 Thread exited with code: 46
Yeah, the same thing is happening over here..