bitHopper: Python Pool Hopper Proxy

[cirz8]

Getting other strange errors instead  

Code:

[22:24:16] New Block: df739d3e11737cea607de1d6d1abf12243475b547cce964c0000006d00000000
[22:24:16] Block Owner bitclockers
Announcing: *** New Block {bitclockers} - df739d3e11737cea607de1d6d1abf12243475b547cce964c0000006d00000000
New Block: {bitclockers} - df739d3e11737cea607de1d6d1abf12243475b547cce964c0000006d00000000
Server selected: bitclockers
[22:24:16] Setting Block Owner bitclockers:df739d3e11737cea607de1d6d1abf12243475b547cce964c0000006d00000000
Clean Up...
[22:24:16] LP triggered serving miner
[22:24:16] LP triggered serving miner
[22:24:16] LP triggered serving miner
[22:24:16] LP triggered serving miner
[22:24:16] LP Call http://pool.bitclockers.com:8332/LP
Disconnected...
Connecting...
Connect returned
Connecting...
Disconnected...
[22:24:27] RPC request [e37ba000] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [73fef000] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:27] RPC request [getwork] submitted to btcpool24_pps
[22:24:29] RPC request [97a05000] submitted to btcpool24_pps
[22:24:32] RPC request [b8b5a000] submitted to btcpool24_pps
[22:24:36] RPC request [getwork] submitted to btcpool24_pps
Connecting...
Disconnected...
[22:24:37] RPC request [getwork] submitted to btcpool24_pps
[22:24:38] RPC request [getwork] submitted to btcpool24_pps
[22:24:40] RPC request [9af33000] submitted to btcpool24_pps
[22:24:41] RPC request [4733b000] submitted to btcpool24_pps
[22:24:43] RPC request [1517a000] submitted to btcpool24_pps
Connecting...
Disconnected...
[22:24:47] RPC request [getwork] submitted to btcpool24_pps
[22:24:48] RPC request [getwork] submitted to btcpool24_pps
[22:24:48] RPC request [getwork] submitted to btcpool24_pps
[22:24:50] RPC request [9ef1b000] submitted to btcpool24_pps
[22:24:50] RPC request [2850d000] submitted to btcpool24_pps
[22:24:51] RPC request [6f222000] submitted to btcpool24_pps
[22:24:52] RPC request [e5723000] submitted to btcpool24_pps
[22:24:52] RPC request [cd350000] submitted to btcpool24_pps
[22:24:56] RPC request [1a8a1000] submitted to btcpool24_pps
[22:24:56] RPC request [53aa6000] submitted to btcpool24_pps
Connecting...
Disconnected...
[22:24:58] RPC request [getwork] submitted to btcpool24_pps
[22:24:58] RPC request [getwork] submitted to btcpool24_pps
[22:24:59] RPC request [getwork] submitted to btcpool24_pps
[22:25:04] writing to database

I did a Reset Scheduler, Reset Shares and a Reload Config because it was mining a 55% pool, and this happened.

Code:

[22:33:57] User forced configuration reload
[22:33:57] bclc:        1805702   481.9gh/s
[22:33:57] Error in pool api for bclc
[22:33:57] slush:       3188133   1858.9gh/s    120min.
[22:33:57] Error in pool api for slush
[22:33:58] swepool:     4275231   5.7gh/s       28682min.
[22:33:58] Error in pool api for swepool
[22:33:58] deepbit:     1805849   5666.0gh/s
[22:33:58] Error in pool api for deepbit
[22:33:58] btcserv:     1182024
[22:33:58] Error in pool api for btcserv
[22:33:58] mtred:       1750283   65.8gh/s
[22:33:58] Error in pool api for mtred
[22:33:58] digbtc:      944779
[22:33:58] Error in pool api for digbtc
[22:33:58] btcworld:    2393821
[22:33:58] Error in pool api for btcworld
[22:33:58] triple:      5888418
[22:33:58] Error in pool api for triple
[22:33:58] eligius:     1953976
[22:33:58] Error in pool api for eligius
[22:33:58] bitclockers: 2974953   177.1gh/s
[22:33:58] Error in pool api for bitclockers
[22:33:58] polmine:     3062234   153.2gh/s     1333min.
[22:33:58] Error in pool api for polmine
[22:33:58] btcpool24_pps:       2377859
[22:33:58] Error in pool api for btcpool24_pps
[22:33:58] arsbitcoin:  1514402
[22:33:58] Error in pool api for arsbitcoin
[22:33:58] btcpool24_prop:      2377859
[22:33:58] Error in pool api for btcpool24_prop
[22:33:58] bcpool:      2813      187.6gh/s     1min.
[22:33:58] Setting Block Owner bcpool:df739d3e11737cea607de1d6d1abf12243475b547cce964c0000006d00000000
[22:33:58] Error in pool api for bcpool
[22:33:58] btcg:        1806133   1796.0gh/s
[22:33:58] Error in pool api for btcg
[22:33:59] RPC request [1f114000] submitted to digbtc
[22:33:59] RPC request [getwork] submitted to digbtc
[22:33:59] btcmonkey:   4104500   2.1gh/s
[22:33:59] Error in pool api for btcmonkey
[22:33:59] ozco:        1161611   69.7gh/s      606min.
[22:33:59] Error in pool api for ozco
[22:33:59] unitedminers:842278
[22:33:59] Error in pool api for unitedminers
[22:34:00] RPC request [458fa000] submitted to digbtc
[22:34:00] RPC request [832f1000] submitted to digbtc
[22:34:01] RPC request [ccf0b000] submitted to digbtc
[22:34:04] RPC request [bea87000] submitted to digbtc
[22:34:04] writing to database
Connecting...
Disconnected...
[22:34:05] RPC request [getwork] submitted to digbtc
[22:34:07] RPC request [getwork] submitted to digbtc
[22:34:09] RPC request [getwork] submitted to digbtc
[22:34:11] RPC request [d4530000] submitted to digbtc
Connecting...
Disconnected...
[22:34:16] RPC request [ffaa6000] submitted to digbtc
[22:34:16] RPC request [getwork] submitted to digbtc
[22:34:17] RPC request [getwork] submitted to digbtc
[22:34:20] New Block: fe38f61b8b0316e92c6ea67133fcb3429bcb2d85399cef8f0000084500000000
[22:34:20] Block Owner bitclockers
Announcing: *** New Block {bitclockers} - fe38f61b8b0316e92c6ea67133fcb3429bcb2d85399cef8f0000084500000000
Clean Up...
[22:34:21] RPC request [getwork] submitted to digbtc
[22:34:21] RPC request [getwork] submitted to digbtc
[22:34:21] RPC request [getwork] submitted to digbtc
Connecting...
Disconnected...
[22:34:27] RPC request [getwork] submitted to digbtc
[22:34:27] RPC request [getwork] submitted to digbtc
[22:34:27] RPC request [getwork] submitted to digbtc
[22:34:28] RPC request [getwork] submitted to digbtc
[22:34:28] RPC request [getwork] submitted to digbtc
[22:34:29] RPC request [getwork] submitted to digbtc
[22:34:30] RPC request [getwork] submitted to digbtc
Connecting...
Disconnected...
[22:34:38] RPC request [getwork] submitted to digbtc
[22:34:38] RPC request [abec1000] submitted to digbtc
[22:34:39] RPC request [getwork] submitted to digbtc
[22:34:41] RPC request [getwork] submitted to digbtc
[22:34:42] RPC request [32c2d000] submitted to digbtc
[22:34:43] RPC request [1fd35000] submitted to digbtc
[22:34:44] RPC request [8484c000] submitted to digbtc
Connecting...
Disconnected...
[22:34:47] RPC request [537be000] submitted to digbtc
[22:34:48] RPC request [getwork] submitted to digbtc
[22:34:50] RPC request [getwork] submitted to digbtc
[22:34:52] RPC request [a95de000] submitted to digbtc
[22:34:52] RPC request [getwork] submitted to digbtc
[22:34:52] RPC request [f58da000] submitted to digbtc
[22:34:53] RPC request [c93f0000] submitted to digbtc
Connecting...
Disconnected...
[22:34:55] RPC request [0c07d000] submitted to digbtc
[22:34:56] RPC request [f016e000] submitted to digbtc
[22:34:59] RPC request [getwork] submitted to digbtc
[22:35:00] RPC request [getwork] submitted to digbtc
[22:35:02] RPC request [getwork] submitted to digbtc
[22:35:03] RPC request [87b29000] submitted to digbtc
[22:35:04] writing to database
[22:35:05] slush:       3213434   1855.9gh/s    121min.
[22:35:05] Error in pool api for slush
[22:35:05] Error in pool api for swepool
[22:35:05] bclc:        1813261   481.9gh/s
[22:35:05] Error in pool api for bclc
Traceback (most recent call last):
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 267, in <module>
    main()
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 263, in main
    reactor.run()
  File "/usr/lib/python2.6/dist-packages/twisted/internet/base.py", line 1165, in run
    self.mainLoop()
  File "/usr/lib/python2.6/dist-packages/twisted/internet/base.py", line 1174, in mainLoop
    self.runUntilCurrent()
--- <exception caught here> ---
  File "/usr/lib/python2.6/dist-packages/twisted/internet/base.py", line 796, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/pool.py", line 415, in update_api_server
    self.bitHopper.scheduler.update_api_server(server)
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/scheduler.py", line 637, in update_api_server
    if info['role'] in ['info', 'disable'] and info['slice'] > 0:
exceptions.KeyError: 'slice'
Connecting...
Disconnected...
[22:35:06] triple:      5888592
[22:35:06] Error in pool api for triple
[22:35:06] deepbit:     1896408   5657.0gh/s
[22:35:06] Error in pool api for deepbit
[22:35:08] Error in pool api for digbtc
[22:35:09] polmine:     3064949   152.2gh/s     1341min.
[22:35:09] Error in pool api for polmine
Traceback (most recent call last):
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 267, in <module>
    main()
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 263, in main
    reactor.run()
  File "/usr/lib/python2.6/dist-packages/twisted/internet/base.py", line 1165, in run
    self.mainLoop()
  File "/usr/lib/python2.6/dist-packages/twisted/internet/base.py", line 1174, in mainLoop
    self.runUntilCurrent()
--- <exception caught here> ---
  File "/usr/lib/python2.6/dist-packages/twisted/internet/base.py", line 796, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/pool.py", line 415, in update_api_server
    self.bitHopper.scheduler.update_api_server(server)
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/scheduler.py", line 637, in update_api_server
    if info['role'] in ['info', 'disable'] and info['slice'] > 0:
exceptions.KeyError: 'slice'

Are those ^Connecting|Disconnected related to the --p2pLP?
con/dis started after a new block was detected anyway, bitclockers is in info-mode

Shares are not updated, only rejects.
No user is in the list, but at the top the "pool @xxxxMHash" correct

Restarted bh and now no dis/con after a block was detected, got vote info instead.

[spectra]

@joulesbeef, @teukon,

A quick look at pident suggests that it is quite easy to tell when a certain pool has finished a block so I assume that the remaining problem is finding a pool which doesn't detect and ban pool-hopping behaviour.  Again, I know little about the existing practical situation and am speaking purely in terms of theory and mathematics.  I'm sure if I mined with a proportional pool I'd know more but I'm with simplecoin.us (which uses PPLNS) specifically so I don't have to worry about implementing pool hopping.

The "guess thing" you describe is a good idea when you have partial information.

All I meant to point out is that if one would like to pool hop with a big proportional pool and is having difficulty with the LP aspect then they can at least make some gains by using the information on the bitcoin network (if the pool is sufficiently large).

Check https://bitcointalk.org/index.php?topic=33732.msg423533#msg423533

If that guy's math is right (there might be other variables to consider), teukon might not be too wrong by assuming deepbit most of the time. I think bitHopper is already doing better than that, though, and it is still improving... but I lack the numbers to back that up.

WRT using pident method... unless it improves, I would not use it alone. They report 36% accuracy in the score system! So, much better to flip a coin.

[r2edu]

share count is broken in version 0.2.1-21, always showing "0/stales  // 0.0% or infinity%"

[spiccioli]

All I meant to point out is that if one would like to pool hop with a big proportional pool and is having difficulty with the LP aspect then they can at least make some gains by using the information on the bitcoin network (if the pool is sufficiently large).

cool with out a doubt it is a strategy that can work on pools the size of deepbit.


Pident is ok.. but does have high error rate as well. Higher for some pools than others but it is an option.


The only truely effective anti hopping technique is a fair payout system. The rest can be gotten around by means of varying difficulty... derpbit being one of the hardest.


not every pool hates us.. which is nice. IMO the best payout method that keeps us happy and their users happy, is  to have a choice between prop and pps.

WE could then hop them on prop, and use pps for backup and set back up to jump to the poll with the most shares over all. This way when they are on a really long block(and hate us the most at this time, mainly cause we are not there), we can come back and help them finish it out.(which we do on occasion anyways for pools we like even if they dont have pps) And we can be quite effective at ending blocks from hell.  An extra 150gh is a welcome site when you are on a 5 million plus share drought.

joulesbeef,

what about "hopping" the same pool (like abcpool mtred) which has both payment methods. ?

you just need to create two accounts on them, one set to prop and the other to PPS and, from the pool perspective, the total GHs never change.

am I wrong?

spiccioli.

[teukon]

@joulesbeef, @teukon,

A quick look at pident suggests that it is quite easy to tell when a certain pool has finished a block so I assume that the remaining problem is finding a pool which doesn't detect and ban pool-hopping behaviour.  Again, I know little about the existing practical situation and am speaking purely in terms of theory and mathematics.  I'm sure if I mined with a proportional pool I'd know more but I'm with simplecoin.us (which uses PPLNS) specifically so I don't have to worry about implementing pool hopping.

The "guess thing" you describe is a good idea when you have partial information.

All I meant to point out is that if one would like to pool hop with a big proportional pool and is having difficulty with the LP aspect then they can at least make some gains by using the information on the bitcoin network (if the pool is sufficiently large).

Check https://bitcointalk.org/index.php?topic=33732.msg423533#msg423533

If that guy's math is right (there might be other variables to consider), teukon might not be too wrong by assuming deepbit most of the time. I think bitHopper is already doing better than that, though, and it is still improving... but I lack the numbers to back that up.

WRT using pident method... unless it improves, I would not use it alone. They report 36% accuracy in the score system! So, much better to flip a coin.

Yes, what he says seems solid to me.  Combining this with the fact that you don't lose anything from guessing deepbit incorrectly but you do gain something from guessing deepbit correctly means you can make significant gains.  Throw LP into the mix as the following post suggests and you have even higher gains.  Indeed, you could almost certainly use LP knowledge from all of the proportional pools together to improve your gains even further.

Honestly, 36% accuracy doesn't seem so bad given how many different pools there are.  I agree that if there were only two pools and every block came from one or the other then 36% is worse than flipping a coin.  Perhaps pident already makes use of the LP information from all of the pools to make their best guess.

I dislike this race to the bottom on hiding information.  It is reminiscent of copyright holders trying to prevent people from copying disks using all manner of trickery and obfuscation.  Hopefully you guys will be successful in overcoming the defence put up by proportional pools and make some BTC in the process.  Best of luck!

[joulesbeef]

joulesbeef,

what about "hopping" the same pool (like abcpool mtred) which has both payment methods. ?

you just need to create two accounts on them, one set to prop and the other to PPS and, from the pool perspective, the total GHs never change.

am I wrong?

spiccioli.

yeah that is what i meant and who i was refering too. btcpool24 does this as well. so does deepbit.

I use bcpool24 and mtred pps as backup and jump to the one with the most shares... So I am not always there, but I do help on the long blocks.
there users seem much happier with a pps option, so it all works out I think.

smaller pools which rarely do pps for fear of not being able to cover it, really should reconsider, they are the ones we help and hurt the most.

pools like deepbit we arent even a blip on their radar.. but a small pool we can be ten times their normal hash rate. Great on finding the small blocks quick, but then the long blocks are hard as they are back to less than 10gh trying to get 5 million shares. If they went pps we would help and reduce their variance.

[cirz8]

286b10a is a no go it seems
started with

Code:

--scheduler=AltSliceScheduler --altslicesize=180 --p2pLP

Code:

[22:58:18] Updating Difficulty
[22:58:23] 1805700.8361937
[22:58:23] Updating NameCoin Difficulty
[22:58:28] 94037.96
[22:58:28] Checking Database
[22:58:28] writing to database
[22:58:28] Selecting scheduler: AltSliceScheduler
[22:58:28] [scheduler-altslice] Initializing AltSliceScheduler...
[22:58:28] [scheduler-altslice]  - Min Slice Size: 60
[22:58:28] [scheduler-altslice]  - Slice Size: 180
Traceback (most recent call last):
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 267, in <module>
    main()
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 252, in main
    bithopper_instance.select_best_server()
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/bitHopper.py", line 116, in select_best_server
    server_name = self.scheduler.select_best_server()
  File "/home/bithopper/bin/bitHopper/bitHopper_2011_08_19_2205/scheduler.py", line 359, in select_best_server
    if info['slice'] > 0:
KeyError: 'slice'

[joulesbeef]

Code:

        Traceback (most recent call last):
        Failure: exceptions.KeyError: 'user'

2011-08-19 17:10:44-0400 [-] Connect returned

doesnt seem to be much of an issue but it;s there.

[Grinder]

I use bcpool24 and mtred pps as backup and jump to the one with the most shares... So I am not always there, but I do help on the long blocks.

Unfortunately, you should only do that if you really want to hurt the pool. Assuming it uses the same rounds for both proportional and PPS it will receive less than it pays you for the shares when the block is finally solved. The PPS part only averages out right for the pool owner when the PPS users put at least the same hashing power in short rounds as in long.

[joulesbeef]

i actually asked the pool ops first, they had no problem with it. I didnt ask deepbit op but i dont use them for backup.

[murfshake]

Edit... something wrong.

[lucita777]

Unfortunately, you should only do that if you really want to hurt the pool. Assuming it uses the same rounds for both proportional and PPS it will receive less than it pays you for the shares when the block is finally solved. The PPS part only averages out right for the pool owner when the PPS users put at least the same hashing power in short rounds as in long.

But if they put less effort, then there is less shares to pay for. To hurt PPS pool you would actually need to not submit the winning shares.

[organofcorti]

Unfortunately, you should only do that if you really want to hurt the pool. Assuming it uses the same rounds for both proportional and PPS it will receive less than it pays you for the shares when the block is finally solved. The PPS part only averages out right for the pool owner when the PPS users put at least the same hashing power in short rounds as in long.

But if they put less effort, then there is less shares to pay for. To hurt PPS pool you would actually need to not submit the winning shares.

I agree with Grinder. Hopping prop and pps at the same pool at opposite ends of the round is a double whammy. We all know that hopping early on prop is no disadvantage to a pool but does disadvantage it's full time miners. However, any time you submit shares on pps at total shares > 1*difficulty, you are getting more for the pps share than it's worth, which disadvantages the pool.

I'm not sure why the pool ops are ok with that. I'm probably missing something.

[cirz8]

altslicer is broken, when there are no pools with 43% or lower one gets this message

Code:

[scheduler-altslice] Re-Slicing...
No servers to slice, picking a backup...

But instead of going live with a backup pool it takes a normal pool with the lowest share, even if it has way over 43%

Version: 98b7557
Command line: --scheduler=AltSliceScheduler --altslicesize=180 --p2pLP

[r2edu]

^ same problem here, and "user shares" keep showing 0... i try with: 0.2.1-21/24/25/26, same errors with those

went back to 0.2.1-13

[joulesbeef]

Unfortunately, you should only do that if you really want to hurt the pool. Assuming it uses the same rounds for both proportional and PPS it will receive less than it pays you for the shares when the block is finally solved. The PPS part only averages out right for the pool owner when the PPS users put at least the same hashing power in short rounds as in long.

But if they put less effort, then there is less shares to pay for. To hurt PPS pool you would actually need to not submit the winning shares.

I agree with Grinder. Hopping prop and pps at the same pool at opposite ends of the round is a double whammy. We all know that hopping early on prop is no disadvantage to a pool but does disadvantage it's full time miners. However, any time you submit shares on pps at total shares > 1*difficulty, you are getting more for the pps share than it's worth, which disadvantages the pool.

I'm not sure why the pool ops are ok with that. I'm probably missing something.

no that makes sense, they probably dont realize it, that's all. When I asked the mtred admin he seemed interested that we would come back and help finish off a large block, thought his users would like that. This might be worth something to some people, to go ahead and get passed a long block and get back to more profitable times. But worth more to miners than a pool op. For the most part normal pool hopping doesnt hurt the op and can help (if we donate or they have fees), and just hurts the users, maybe this is some share the pain. and small pools do benefit by keeping us longer so they can advert a higher hash rate. Last the pay 7% less than arsbitcoin, so perhaps he has worked out about how much we might cost them. 7% for the rare times I am on backup might not be too bad for him. Might even be a bonus.

but i suspect, he just didnt think about it at the time, and only listened to my words. I did ask though, I was concerned as mtred requires you to have a totally different account. not only would it be a dead giveaway, but mtred has been cool with us thus far, so I owed him to ask.  Perhaps I will bring it up again, because it is strickly hurting the op. 

[cirz8]

^ same problem here, and "user shares" keep showing 0... i try with: 0.2.1-21/24/25/26, same errors with those

went back to 0.2.1-13

Two questions:
1) How do you check which version one have in that format(0.2.1-x)?
2) I'm no git guru, is it possible to download to a specific commit and have it stop there, since you seem to have lots of versions? (my git knowledge go as far as clone and pull)

[paraipan]

^ same problem here, and "user shares" keep showing 0... i try with: 0.2.1-21/24/25/26, same errors with those

went back to 0.2.1-13

Two questions:
1) How do you check which version one have in that format(0.2.1-x)?
2) I'm no git guru, is it possible to download to a specific commit and have it stop there, since you seem to have lots of versions? (my git knowledge go as far as clone and pull)

pls have patience ppl, the bleeding edge got a little off because c00w was rearranging lots of code, continue reporting the errors and try using  

Code:

--debug > error.log

param. to really help debugging faster. Thanks

@cirz8  you could try "git help" or "git pull help" to view how to pull specific versions

@r2edu it's tough I know but we're testing and using it at the same time, when using the newest ver. try saving a log if it gives you troubles

[MrWizard]

Suddenly getting constant:

Error in pool api for deepbit

Tried but could not fix it with my limited skills.  Anybody got any ideas?

[paraipan]

Suddenly getting constant:

Error in pool api for deepbit

Tried but could not fix it with my limited skills.  Anybody got any ideas?

look here, should give you a clue