bitHopper: Python Pool Hopper Proxy

[organofcorti]

The timeouts are caused by the pool on purpose though because we're identified by IP and user/workername as offending hoppers (see burnbacks post a few pages back). How will client side worker management get around this?

ok, client side worker are not really needed to solve this as bithopper could just split getwork requests through its workers; but i am very sure that missing them is the reason we got currupted (NOT stale) shares)

but i think its easier to implement - as you "always" know worker 1 goes to pool worker 1 and so on.

Yeah the main way people appear to identify bitthopper is the corrupted shares issue and its user-agent. I change the json user agent in work.py (lines 61 & 83) to match a common miner.

and are you getting good work with bitclockers? If so could you pm me with details? Save me the trial and error of figuring out which bits to change 

[1713565824]

1713565824

[1713565824]

1713565824

[1713565824]

1713565824

[licutis]

.

[bitcoindaddy]

Yeah the main way people appear to identify bitthopper is the corrupted shares issue and its user-agent. I change the json user agent in work.py (lines 61 & 83) to match a common miner.

Here's the relevant code and what I changed it to (I hope this could be included in the official version):

Code:

diff --git a/work.py b/work.py
index 7063219..aeeaa34 100644
--- a/work.py
+++ b/work.py
@@ -58,7 +58,7 @@ def jsonrpc_lpcall(agent,server, url, update):
     request = json.dumps({'method':'getwork', 'params':[], 'id':i}, ensure_ascii = True)
     i = i +1
     
-    header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['bitHopper'],'Content-Type': ['application/
+    header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['poclbm/20110709'],'Content-Type': ['applic
     d = agent.request('GET', "http://" + url, Headers(header), None)
     d.addErrback(print_error)
     body = yield d
@@ -80,7 +80,7 @@ def jsonrpc_call(agent, server, data , set_lp):
         request = json.dumps({'method':'getwork', 'params':data, 'id':i}, ensure_ascii = True)
         i = i +1
         
-        header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['bitHopper'],'Content-Type': ['applicat
+        header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['poclbm/20110709'],'Content-Type': ['ap
         d = agent.request('POST', "http://" + server['mine_address'], Headers(header), StringProducer(request))
         response = yield d
         header = response.headers

[enmaku]

so my latest annoyance/confusion: If I go to localhost:8337/stats it works fine - if I go to 192.168.1.xxx:8337/stats it works fine - if I go to <external_address>:8337/stats it does not work fine. I've got my router set to forward 8337 and just to verify I fired up ryouiki's mod and I can still access that stats page with the external IP, just not c00w's version. Is c00w's version set to only allow HTTP connections from localhost or something? If so, how do I change that?

[organofcorti]

Yeah the main way people appear to identify bitthopper is the corrupted shares issue and its user-agent. I change the json user agent in work.py (lines 61 & 83) to match a common miner.

Here's the relevant code and what I changed it to (I hope this could be included in the official version):

....

Nice - that's actually a great heads up that there's a new poclbm version available! Git me up baby.

hooo-ever it might be not such a good idea to post such goodies here since it's monitored by pool ops. There's a speakeasy i know of....

[bitcoindaddy]

so my latest annoyance/confusion: If I go to localhost:8337/stats it works fine - if I go to 192.168.1.xxx:8337/stats it works fine - if I go to <external_address>:8337/stats it does not work fine. I've got my router set to forward 8337 and just to verify I fired up ryouiki's mod and I can still access that stats page with the external IP, just not c00w's version. Is c00w's version set to only allow HTTP connections from localhost or something? If so, how do I change that?

I'm doing the same thing and it is working fine. Make sure you are doing TCP forwarding, check the internal IP address to make sure it matches the rule in your router. Check if you are running any firewall rules with "iptables -L".

[enmaku]

so my latest annoyance/confusion: If I go to localhost:8337/stats it works fine - if I go to 192.168.1.xxx:8337/stats it works fine - if I go to <external_address>:8337/stats it does not work fine. I've got my router set to forward 8337 and just to verify I fired up ryouiki's mod and I can still access that stats page with the external IP, just not c00w's version. Is c00w's version set to only allow HTTP connections from localhost or something? If so, how do I change that?

I'm doing the same thing and it is working fine. Make sure you are doing TCP forwarding, check the internal IP address to make sure it matches the rule in your router. Check if you are running any firewall rules with "iptables -L".

I'll reiterate: If I run ryouiki's mod which also listens on 8337 and attempt to access that stats page from the external IP it works correctly. If I close ryouiki's mod and open c00w's main branch I can no longer connect via the outside world. Obviously the problem is not in my TCP forwarding settings, firewall rules, etc else it would fail on ryouiki's mod too.

[Sukrim]

hooo-ever it might be not such a good idea to post such goodies here since it's monitored by pool ops. There's a speakeasy i know of....

Well, what shall they do - UserAgent ban/annoy all poclbm users?

If yes, we can just rotate between headers of all miners...

[organofcorti]

hooo-ever it might be not such a good idea to post such goodies here since it's monitored by pool ops. There's a speakeasy i know of....

Well, what shall they do - UserAgent ban/annoy all poclbm users?

If yes, we can just rotate between headers of all miners...

weeeeeell, i was kinda speaking generally. And putting in a plug for another forum 

[paraipan]

so my latest annoyance/confusion: If I go to localhost:8337/stats it works fine - if I go to 192.168.1.xxx:8337/stats it works fine - if I go to <external_address>:8337/stats it does not work fine. I've got my router set to forward 8337 and just to verify I fired up ryouiki's mod and I can still access that stats page with the external IP, just not c00w's version. Is c00w's version set to only allow HTTP connections from localhost or something? If so, how do I change that?

usually soho routers don't allow you to access external interface from the same pc you redirect the port to (80 for example) instead try to acces it through an external web proxy (http://hidemyass.com/) or from a pc outside your local lan

[enmaku]

so my latest annoyance/confusion: If I go to localhost:8337/stats it works fine - if I go to 192.168.1.xxx:8337/stats it works fine - if I go to <external_address>:8337/stats it does not work fine. I've got my router set to forward 8337 and just to verify I fired up ryouiki's mod and I can still access that stats page with the external IP, just not c00w's version. Is c00w's version set to only allow HTTP connections from localhost or something? If so, how do I change that?

usually soho routers don't allow you to access external interface from the same pc you redirect the port to (80 for example) instead try to acces it through an external web proxy (http://hidemyass.com/) or from a pc outside your local lan

Never had that problem before but that seems to have done it... So weird.

Thanks!

Edit: I'm using a router that's been flashed to DD-WRT so even though it's a soho router it's not exactly a stock soho router.

Edit #2: Holy crap, look who just hit hero member when he wasn't paying attention 

[organofcorti]

you'll always be my hero 

[organofcorti]

getting the following error which is preventing the database from updating:

Code:

Traceback (most recent call last):
  File "bitHopper.py", line 39, in __init__
    self.db = database.Database(self)
  File "/home/user/bitHopper/database.py", line 32, in __init__
    call.start(60)
  File "/usr/lib/python2.6/dist-packages/twisted/internet/task.py", line 163, in start
    self()
  File "/usr/lib/python2.6/dist-packages/twisted/internet/task.py", line 194, in __call__
    d = defer.maybeDeferred(self.f, *self.a, **self.kw)
--- <exception caught here> ---
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 133, in maybeDeferred
    result = f(*args, **kw)
  File "/home/user/bitHopper/database.py", line 73, in write_database
    self.update_user_shares_db()
  File "/home/user/bitHopper/database.py", line 144, in update_user_shares_db
    self.curs.execute(sql)
sqlite3.OperationalError: no such column: user

Also, any easy way to reset the db to start from scratch?

[enmaku]

you'll always be my hero 

Heeeeey getting pretty close there yourself 494 

[Clipse]

getting the following error which is preventing the database from updating:

Code:

Traceback (most recent call last):
  File "bitHopper.py", line 39, in __init__
    self.db = database.Database(self)
  File "/home/user/bitHopper/database.py", line 32, in __init__
    call.start(60)
  File "/usr/lib/python2.6/dist-packages/twisted/internet/task.py", line 163, in start
    self()
  File "/usr/lib/python2.6/dist-packages/twisted/internet/task.py", line 194, in __call__
    d = defer.maybeDeferred(self.f, *self.a, **self.kw)
--- <exception caught here> ---
  File "/usr/lib/python2.6/dist-packages/twisted/internet/defer.py", line 133, in maybeDeferred
    result = f(*args, **kw)
  File "/home/user/bitHopper/database.py", line 73, in write_database
    self.update_user_shares_db()
  File "/home/user/bitHopper/database.py", line 144, in update_user_shares_db
    self.curs.execute(sql)
sqlite3.OperationalError: no such column: user

Also, any easy way to reset the db to start from scratch?

Just delete the stats.db file.

[hawks5999]

Edit #2: Holy crap, look who just hit hero member when he wasn't paying attention 

http://youtu.be/Dq0llrCYtCQ?t=1m18s

[hawks5999]

Code:

diff --git a/work.py b/work.py
index 7063219..aeeaa34 100644
--- a/work.py
+++ b/work.py
@@ -58,7 +58,7 @@ def jsonrpc_lpcall(agent,server, url, update):
     request = json.dumps({'method':'getwork', 'params':[], 'id':i}, ensure_ascii = True)
     i = i +1
     
-    header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['bitHopper'],'Content-Type': ['application/
+    header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['poclbm/20110709'],'Content-Type': ['applic
     d = agent.request('GET', "http://" + url, Headers(header), None)
     d.addErrback(print_error)
     body = yield d
@@ -80,7 +80,7 @@ def jsonrpc_call(agent, server, data , set_lp):
         request = json.dumps({'method':'getwork', 'params':data, 'id':i}, ensure_ascii = True)
         i = i +1
         
-        header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['bitHopper'],'Content-Type': ['applicat
+        header = {'Authorization':["Basic " +base64.b64encode(server['user']+ ":" + server['pass'])], 'User-Agent': ['poclbm/20110709'],'Content-Type': ['ap
         d = agent.request('POST', "http://" + server['mine_address'], Headers(header), StringProducer(request))
         response = yield d
         header = response.headers

So this begs the question why we'd ever use bitHopper as UA string?
And the followup:
should  'User-Agent': ['phoenix/v1.5'], be used if mining with phoenix or is it all the same?

[Clipse]

So, btcworld.de should be scraping the poolspeed from the main page and not the statistics page (shares etc obviously should scrape from statistics page)

Anyone got a way around scraping from 2 locations. Statistics page caching is messing with poolspeed updates.

[gooie]

is anyone able to mine from arsbitcoin with bithopper? for some reason it refuses to switch to that pool even though it's not lagging and I've disabled the other backup pools.

[anty]

is anyone able to mine from arsbitcoin with bithopper? for some reason it refuses to switch to that pool even though it's not lagging and I've disabled the other backup pools.

Yes, I mined some hours ago on arsbitcoin.