[~1000 GH/sec] BTC Guild - 0% Fee Pool, LP, SSL, Full Precision, and More

[eleuthria]

Reporting my observation:

Everytime a block is found, 2 of my 3 workers automatically switch to my backup pool.
Which means there must be some idle or connection error when a round is finished.

You can also notice right before last block was found we're at 2000G+,
we dropped to 1700-1800G after finding a block.

The idles when we find a block are the root of the invalid problem.  I thought it was related to the calculation script, but I've profiled the time it takes to complete the different steps and the entire thing only runs for about 5 seconds, only about 1 second per server.

I'm thinking this is related to a bitcoind patch or the long poll keepalive patch.

[jjiimm_64]

NEW BLOCK FOUND, pleaaaaase let it be valid!

#   Block Link   Date/Time   Duration   Shares   Validity   My Shares   Earned   Donated   Details
1566
Fetching   2011-07-12 19:40:35   2:30:09   4287311   119 until confirmed   1700   0.01982594   0.00000000   
View

if you donated 2.5% instead of 0.  then you wouldn't worry if it was valid or not.

[fcmatt]

connections problems to us.btcguild.com right now. maybe you are on the server tweaking things. unsure.
miners just getting disconnected, pause, then pick back up after a few seconds. idles. etc...

[eleuthria]

Just changed the pushpool configurations on US West.  Spoke with jine eariler, and there is some unknown bug in the Longpoll Keep-alive patch, which could very well be the culprit for a number of the problems today.

The next step if this doesn't improve stability is rolling back to pushpool and bitcoind stock code rather than the RPC keepalive/built in long polling versions.  Running out of items to cross off the list of trouble makers.



UPDATE:  ~50 minuets later.  497 shares on my phoenix miners (the "worst" for stales), 0 rejected.  0 idles.  0 long poll disconnects.  Looking promising.

[dinker]

All of my workers just got dropped again(They will be back after some minutes)
I don't know if it's because we just solved a block or something eles.

and pool hash dropped to 1600Gh from 2000Gh.

[irishmick]

Well good news maybe.

I ended up having to restart my miners and surprisingly it ended up being ~roughly~ the same time as a round started.

My miners show

913.52 Mhash/sec - 886 Accepted - 5 Rejected = .564% Rejected

at the same +- minute BTCGuild shows: 896 (0)

I hope you're not counting stales so people stop bitching? How do I submit stales automatically lol;o)

But my apologies, this is supposed to be a kudos for low stales. So Kudos. lol sorry it sounds weak now.

[Eri]

my luck was in the positive thanks to last night but it seems all I'm getting now is errors on us/uswest. had a fratcion of my shares go through but that is way low, could have been bad luck combined with errors though. ive been getting these errors for hours.

[boaz2020]

Zero stales. It's great.

[eleuthria]

Stales are indeed GREATLY reduced (they're not gone, and I'm sure someone will come in complaining about 91.13% stales right after I go to bed).  The load balancer is now functioning far better on US West.  It still seems to be getting an idle when the server manages to find a block, but it only lasts about 10-15 seconds based on monitoring my personal miners.

[jjiimm_64]

Really nice work eleu.

Totals   5,955.69 MH/s   1009 (0)   0% on 1k shares

[d.james]

It still seems to be getting an idle when the server manages to find a block, but it only lasts about 10-15 seconds based on monitoring my personal miners.

Any plans to fix that in the future? 10-15seconds is enough time to knock my miners into backup mode.
Also, 10-15 seconds of idle time is roughly 1% wasted for a 25min round, which adds up in the long run.

I can confirm the stale shares has been greatly improved, good work!

[eleuthria]

It still seems to be getting an idle when the server manages to find a block, but it only lasts about 10-15 seconds based on monitoring my personal miners.

Any plans to fix that in the future? 10-15seconds is enough time to knock my miners into backup mode.
Also, 10-15 seconds of idle time is roughly 1% wasted for a 25min round, which adds up in the long run.

I can confirm the stale shares has been greatly improved, good work!

I just tweaked the load balancer (which is what caused the idles and disconnects), and when we found a block I only saw about 3 seconds idle time, from the pushpool instance that actually found the block.  This time it didn't kill off the LP connection/server connection, just a short idle spurt.  I'm working on finding out if its the LB or Pushpool that is causing the final small delay.  It may be pushpool hanging for a moment while it opens up SQL connections with the other servers to publish the new block.

Timeline for the rest of the week/weekend can be found at: http://www.btcguild.com/timeline.php

[jjiimm_64]

thanks again.

I was wondering if you can make the list of workers sorted?  I did not put all my workers in at one time and it is hard to distinguish between one rig and another.

btw, your interface for monitoring is what keeps me, not the 0% fee

txs
Jim

[eleuthria]

thanks again.
I was wondering if you can make the list of workers sorted?  I did not put all my workers in at one time and it is hard to distinguish between one rig and another.
btw, your interface for monitoring is what keeps me, not the 0% fee
txs
Jim

Worker stats are now in alphabetical order as they were before the DDoS.  Not included on the timeline is the ability to have a resettable share/stale counter rather than just round/total.  Reset stats should be back on the 14th.

[jjiimm_64]

ok,  thats it.  I'm donating 5% for a while.   

Thanks again. 
Jiim

[asfas16123]

Will the eu server be back?

[eleuthria]

Will the eu server be back?

I'm shopping around for a host that can offer hardware similar to what is in place in US West.  My goal is to consolidate us down to 2-3 servers with roughly the same setup, each one capable of holding well over 2.5 TH/sec, since we were around 3.2 TH and still growing before the DDoSes took us down.  The second server is being shipped to Texas tomorrow and will eventually replace US Central & East.  So far the only comparable EU servers I've found cost nearly twice as the US ones do, which is funny considering the old server hardware was significantly cheaper in EU.

For those afraid of losing East and Central - US West was a project that I've been preparing for since we hit 2 TH/sec a few weeks ago.  There is no way to iron out these bugs in a test environment, due to the nature of the problems (block solving, long-polling, and a massive number of unique IPs hitting a source-based load balancer).  The kinks have almost been completely ironed out based on the last couple hours (and block solves), and the new Central wont be replacing the old servers until I'm positive it can handle the load as well or better than the current servers.

[hi]

Hi

can Ufasoft  miners mine at your pool?

Hi

[Eri]

Hi

can Ufasoft  miners mine at your pool?

Hi

yes they can. create a shortcut for the exe, right click it and go to properties. add the following to the end of the target line but use your info instead. (without the quotation marks)

 "-o http://username_workername:password@us.btcguild.com:8332"

you can also do 'useast' or 'uscentral' instead of 'us'/'uswest'. these last twi being the new server.

[jme621]

anywhere i am not seeing that you can tell if you have solved a block or not? not that it matters but just nice to know for personal satisfaction lol