eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 01:51:01 AM |
|
How goes the attack. I am still noticing stratum and getwork miners having connection issues from time to time.
Alright, I loaded up the status on the Chicago stratum server and noticed it was having a "soft crash" where the pool dumped the connections and started fresh once ever few hours. Not a HUGE deal (<1 second of downtime each time it happens), but certainly not ideal. Running the Chicago stratum server in a debugger to see if I can find out what's going on next time it happens.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
Joshwaa
|
|
December 06, 2012, 02:10:06 AM |
|
How goes the attack. I am still noticing stratum and getwork miners having connection issues from time to time.
Alright, I loaded up the status on the Chicago stratum server and noticed it was having a "soft crash" where the pool dumped the connections and started fresh once ever few hours. Not a HUGE deal (<1 second of downtime each time it happens), but certainly not ideal. Running the Chicago stratum server in a debugger to see if I can find out what's going on next time it happens. This must have been the problem I was experiencing. It was about once every two hours for me. All my cgiminers went thru it fine but one. Thats how I noticed it would keep saying loosing shares and locking up. Oh well. Hope its all fixed.
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 03:06:51 AM |
|
How goes the attack. I am still noticing stratum and getwork miners having connection issues from time to time.
Alright, I loaded up the status on the Chicago stratum server and noticed it was having a "soft crash" where the pool dumped the connections and started fresh once ever few hours. Not a HUGE deal (<1 second of downtime each time it happens), but certainly not ideal. Running the Chicago stratum server in a debugger to see if I can find out what's going on next time it happens. This must have been the problem I was experiencing. It was about once every two hours for me. All my cgiminers went thru it fine but one. Thats how I noticed it would keep saying loosing shares and locking up. Oh well. Hope its all fixed. The bug popped up again and was caught in the debugger. I've restarted the pool with auto-restart now, while I work on a fix. Sorry for any downtime since the only way to catch it is to make sure the pool doesn't restart itself once it happens.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 03:22:24 AM |
|
A test patch has been deployed on the Chicago stratum server for the bug that was causing a crash. It's set to restart on failure, so worst case scenario you may lose 1 second of connectivity every few hours if it does not work. It has some extra debug lines added so if it doesn't work I can hopefully catch it on the next pass. Sorry for the downtime once again. I've known there was a small crash happening every 12+ hours last week, but thought that I had it fixed when I updated the Stratum code to support PPLNS. It just happened more often these last 24 hours now that the DE server has been merged with the Chicago servers temporarily.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
Joshwaa
|
|
December 06, 2012, 03:28:41 AM |
|
Thanks again for all your hard work! No problems in the last 3 hrs for me.
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 03:56:58 AM |
|
New patch in place. Found the main cause of this problem.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
Joshwaa
|
|
December 06, 2012, 04:01:23 AM |
|
Hope so. Just saw a few of my miners go back to getwork from stratum. I must say you fix stuff quick as hell!
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 04:03:58 AM |
|
It looks like there are some people who are either attacking the Stratum pool, or simply running a completely broken implementation of the protocol. If you're running some kind of custom Stratum miner and it broke tonight as a result of my patch, please send me an email.
EDIT: Shoot, it looks like it's slush's stratum proxy sending some kind of keep-alive message (no method, just "error": null, "id": 1, "result": null)
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
RyanRed
|
|
December 06, 2012, 04:09:31 AM |
|
I seem to be getting server not responding while ming a lot right now. But then it seems to pick itself back up.
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 04:12:26 AM |
|
I seem to be getting server not responding while ming a lot right now. But then it seems to pick itself back up.
There have been a LOT of server restarts in the last hour trying to figure out what's been crashing it. I have a fix in place, but it turns out it completely broke slush's stratum proxy. I have a NEW fix in place that should allow Slush's proxy to connect, while still avoiding the crash issue.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 06:17:44 AM |
|
So far so good. Sorry again for the ~1 hour of high connectivity issues. It's really tough to debug an issue like what was happening, outside of letting it happen again with extensive debug information displaying in real-time.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
mikesheadroom
Member
Offline
Activity: 72
Merit: 10
|
|
December 06, 2012, 01:18:46 PM |
|
I'm sure you're pretty busy with everything going on, but will the port80 server be making a comeback?
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 04:08:27 PM Last edit: December 06, 2012, 04:37:33 PM by eleuthria |
|
I'm sure you're pretty busy with everything going on, but will the port80 server be making a comeback?
Yes, the port80 server should be back by tomorrow. Update after last night's hour of instability: The fix to the Stratum server seems to have gone in perfectly. Software has been up for about 12 hours without a single reset. I also did a quick restart to bitcoind (doesn't reset the stratum server) to help fix a potential issue with stales.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
RyanRed
|
|
December 06, 2012, 04:50:39 PM |
|
Thanks for all the hard work! Love the new stat layout btw
|
|
|
|
fcmatt
Legendary
Offline
Activity: 2072
Merit: 1001
|
|
December 06, 2012, 05:00:27 PM |
|
the newest cgminer sure cannot handle such server problems. 5 out of 6 of them crashed. and this is probably why I will quit mining with gpus some day soon. just do not feel like messing with it anymore for what it brings in.
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 05:03:54 PM |
|
the newest cgminer sure cannot handle such server problems. 5 out of 6 of them crashed. and this is probably why I will quit mining with gpus some day soon. just do not feel like messing with it anymore for what it brings in.
Newest cgminer (or any after 2.8.3) should be able to handle disconnects. I know some versions of the proxy may have had issues if you were connecting through that. Regardless, the issue has been fixed now, and it was mostly the side-effects of the DDoS attack.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
fcmatt
Legendary
Offline
Activity: 2072
Merit: 1001
|
|
December 06, 2012, 05:13:23 PM |
|
the newest cgminer sure cannot handle such server problems. 5 out of 6 of them crashed. and this is probably why I will quit mining with gpus some day soon. just do not feel like messing with it anymore for what it brings in.
Newest cgminer (or any after 2.8.3) should be able to handle disconnects. I know some versions of the proxy may have had issues if you were connecting through that. Regardless, the issue has been fixed now, and it was mostly the side-effects of the DDoS attack. no proxy. newest cgminer as of last week or so. running on 3 different boxes. two instances on each box. only one survived. i realize it is not your fault. you need to do what you have to do to run your business. the whole mining thing just gets old after a while for the rewards. maybe diff will drop this dec. one can only hope.
|
|
|
|
eleuthria (OP)
Legendary
Offline
Activity: 1750
Merit: 1007
|
|
December 06, 2012, 05:16:00 PM Last edit: December 06, 2012, 05:51:49 PM by eleuthria |
|
24 Hour Earnings stat is back, located on the top "dashboard" bar. Currently only showing PPS earnings. Working on getting PPLNS added to the figure in the next hour.
UPDATE: PPLNS is now included in the 24 hour statistic. It looks pretty accurate from my small farm. If anybody thinks the stat looks wrong, please send me a PM with your findings so I can double check my math with yours. Remember that PPLNS is subject to variance, and I think [not positive] yesterday was ~15% below expectation after just a brief look.
|
RIP BTC Guild, April 2011 - June 2015
|
|
|
Frequency
|
|
December 06, 2012, 07:22:03 PM |
|
24 Hour Earnings stat is back, located on the top "dashboard" bar. Currently only showing PPS earnings. Working on getting PPLNS added to the figure in the next hour.
UPDATE: PPLNS is now included in the 24 hour statistic. It looks pretty accurate from my small farm. If anybody thinks the stat looks wrong, please send me a PM with your findings so I can double check my math with yours. Remember that PPLNS is subject to variance, and I think [not positive] yesterday was ~15% below expectation after just a brief look.
Yep.. saw it.. thanks for not only the work but ur efford to keeps us up2date over and over again... great.job.
|
COINDER COINDER
|
|
|
GernMiester
|
|
December 06, 2012, 11:39:57 PM |
|
Is the PPLNS details working? It shows me 0 shares in current shift and well that is not right. I changed to PPS and the shares are counted immediatly. So I switch back to PPLNS and it is still at 0 and so are a few shifts that I know the miners were hashing away in. The 100% fee just sucks
|
|
|
|
|