[ANN] Stratum mining protocol - ASIC ready

[antirack]

Lol, it's all there as far as I can tell. The config _IS_ complete

Including DB_USERCACHE_TIME and also made sure I get my quotes right
(I had the single quotes ' missing around the sha256 for the password, but that did not solve the above error message).

Merry xmas and thanks for your contribution! Small donation coming your way soon.

[Nicksasa]

Lol, it's all there as far as I can tell. The config _IS_ complete

Including DB_USERCACHE_TIME and also made sure I get my quotes right
(I had the single quotes ' missing around the sha256 for the password, but that did not solve the above error message).

Merry xmas and thanks for your contribution! Small donation coming your way soon.

You're sure you removed those ''' above and under the db config right ?

Btw generalfault I'm having some weird problem with your fork, http://pastie.org/private/9ewm30rcqbp98t6xjkyvg and it doesn't seem to be listening for connections

[generalfault]

Lol, it's all there as far as I can tell. The config _IS_ complete

Including DB_USERCACHE_TIME and also made sure I get my quotes right
(I had the single quotes ' missing around the sha256 for the password, but that did not solve the above error message).

Merry xmas and thanks for your contribution! Small donation coming your way soon.

You're sure you removed those ''' above and under the db config right ?

Btw generalfault I'm having some weird problem with your fork, http://pastie.org/private/9ewm30rcqbp98t6xjkyvg and it doesn't seem to be listening for connections

what is on port 9332 ? is that your bitcoind trusted port? if so, is bitcoind running?
My guess is that it's not connecting to bitcoind rpc what does bitcoind getinfo say?
can you telnet localhost 9332 ?

If it can't connect to bitcoind then it won't start (It just waits for it to come up.)

[generalfault]

Lol, it's all there as far as I can tell. The config _IS_ complete

Including DB_USERCACHE_TIME and also made sure I get my quotes right
(I had the single quotes ' missing around the sha256 for the password, but that did not solve the above error message).

Merry xmas and thanks for your contribution! Small donation coming your way soon.

ok, well it may not be picking up the config at all, or it's using some other config.py

so let's say you checkout into mining-pool ... you should have

mining-pool/conf/config_sample.py
mining-pool/conf/config.py
mining-pool/launcher.tac

make sure you don't have any other config.py files.... then:
cd mining-pool
twistd -ny launcher.tac -l -

If in doubt, delete conf/config.py, recopy conf/config_sample.py to conf/config.py set the bare minimum of settings (bitcoin port, wallet address etc...) and try again.

[joshstandalone]

Thanks a lot, now i understand all works fine now
does stratum use pps reward payee type or score like slushs pool ?

[Nicksasa]

Lol, it's all there as far as I can tell. The config _IS_ complete

Including DB_USERCACHE_TIME and also made sure I get my quotes right
(I had the single quotes ' missing around the sha256 for the password, but that did not solve the above error message).

Merry xmas and thanks for your contribution! Small donation coming your way soon.

You're sure you removed those ''' above and under the db config right ?

Btw generalfault I'm having some weird problem with your fork, http://pastie.org/private/9ewm30rcqbp98t6xjkyvg and it doesn't seem to be listening for connections

what is on port 9332 ? is that your bitcoind trusted port? if so, is bitcoind running?
My guess is that it's not connecting to bitcoind rpc what does bitcoind getinfo say?
can you telnet localhost 9332 ?

If it can't connect to bitcoind then it won't start (It just waits for it to come up.)

It's connecting to litecoind which has the rpc port on 9332 (yes i know the hashing of the data needs to be changed to scrypt and diff1 adjusted). Same port etc on the regular stratum-mining loads up without any problem(and mining works, after changing some btc-specific things like the doublesha256 on the data).

Edit: Found the problem, litecoind getblocktemplate is version 1.

[Askit2]

Thanks a lot, now i understand all works fine now
does stratum use pps reward payee type or score like slushs pool ?

It depends on the pool you use. I use Eclipse so I use DGM but I could pick to use Eclipse's PPS.

[joshstandalone]

http://pastebin.com/Ns158VNG
this looks fine?since i setted up with blocknotify

                                #       If using the blocknotify script (recommended) set = to MERKLE_REFRESH_INTERVAL
                                #       (No reason to poll if we're getting pushed notifications)
and generalfault

explain this?
both should be turned on ?
because i dont understand how you writen this?
and yes if i am on VPS what you suggest me prevhash or merkle what will take lower load ?

[antirack]

It's working now, thanks again for making me go through conf/config.py again.
I know nothing about Python as you can probably tell. If anybody wants me to copy and paste some command line to get this up and running on an Ubuntu server let me know.

I noticed that there is a problem when using MySQL. MySQL is filling up with processes that are stuck in 'Waiting for table metadata lock'. It becomes completely unresponsive after a while. I tried two different mysql servers with the same results (one on localhost, one on another server in the local network). Using sqlite it works so far. I haven't tried 'none'.

http://pastebin.com/Euyst33L

One more thing, how would I run update_submodules? I am now running the proxy on a different host and could probably run it as a separate instance, but having it together with the pool might make sense.

[slush]

You did not read all
http://pastebin.com/dpgyvsX0
check this out
why ProtocolException ? there is some problem with twisted version?

I think ProtocolException has been already explained. I'll take a look at that deprecation warning, but it isn't anything serious and it should work without a problem.

[generalfault]

Thanks a lot, now i understand all works fine now
does stratum use pps reward payee type or score like slushs pool ?

It depends on the pool you use. I use Eclipse so I use DGM but I could pick to use Eclipse's PPS.

As askit2 said, it all depends on the pool you use. If you are using slush's or mine, then there are no payouts split to workers it all just goes into the address you specify in the config.

I'm not planning on integrating any payout modules as i use it for solo mining, and figure that should be left to the pool operators (but all the share info is in the db for them to use to do the calculations.)

[generalfault]

http://pastebin.com/Ns158VNG
this looks fine?since i setted up with blocknotify

                                #       If using the blocknotify script (recommended) set = to MERKLE_REFRESH_INTERVAL
                                #       (No reason to poll if we're getting pushed notifications)
and generalfault

explain this?
both should be turned on ?
because i dont understand how you writen this?
and yes if i am on VPS what you suggest me prevhash or merkle what will take lower load ?

If you are using the blocknotify script then set PREVHASH_REFRESH_INTERVAL = to the same value as MERKLE_REFRESH_INTERVAL
so:
PREVHASH_REFRESH_INTERVAL = 60
MERKLE_REFRESH_INTERVAL = 60

we never really want to turn off new block checking completely as a failsafe (just in case blocknotify doesn't work for ANY reason, we don't want to be hashing a bad block forever.)
you really need both.....
prevhash = check for a new block, if it is there, send out the notifies and throw away any old possible solutions since they are now invalid
merkle = roll in any new transactions, send out notifies, DO NOT throw away any old possible solutions since they are still valid (just don't include the latest transactions.)

[joshstandalone]

Okay, now i understand all
http://pastebin.com/9nFmYQuU
check this about web stats, i am not sure that i understand this messages?
all other about server works like charm, thanks to slush and you, i mean in this very good bitcoin pool

[generalfault]

It's working now, thanks again for making me go through conf/config.py again.
I know nothing about Python as you can probably tell. If anybody wants me to copy and paste some command line to get this up and running on an Ubuntu server let me know.

I noticed that there is a problem when using MySQL. MySQL is filling up with processes that are stuck in 'Waiting for table metadata lock'. It becomes completely unresponsive after a while. I tried two different mysql servers with the same results (one on localhost, one on another server in the local network). Using sqlite it works so far. I haven't tried 'none'.

http://pastebin.com/Euyst33L

One more thing, how would I run update_submodules? I am now running the proxy on a different host and could probably run it as a separate instance, but having it together with the pool might make sense.

I'll have to take a look at the mysql bit. I have a guess but I'll have to confirm it.

the update_submodules script just does a git checkout my (very slightly modified) stratum-proxy into the externals directory, github has been up and down the last couple days though, so it's kinda at the mercy of github

[antirack]

If you are using transactions, then it may be that the new processes (CREATE TABLE) waits indefinitely since the database updates/inserts are not committed.

A quick fix would be to use the CREATE TABLE statements when the pool starts up (or when you actually connect to the database and no other connection is open). Or not to use transactions.

[joshstandalone]

slush, when we mine, we dont need to put -u parametar , we can work without it right?
and this implementation of mysql does not need to be used to mine, it will work normal also without any base?base is used only for stats?

[slush]

slush, when we mine, we dont need to put -u parametar , we can work without it right?

Yes, '-u' parameter is optional, proxy will use usernames provided by workers.

and this implementation of mysql does not need to be used to mine, it will work normal also without any base?base is used only for stats?

All forks with included database support are optional, there's no need for database for mining itself.

[joshstandalone]

thanks a lot slush
you helped much, i think now i understand all

2012-12-28 23:30:32,874 INFO interfaces interfaces.on_submit_share # 00000000a4779fb5d407f215ae3b8866e663305c22b50d8088574427b3eebb4f (1) valid
2012-12-28 23:31:44,111 INFO interfaces interfaces.on_submit_share # 00000000017e265469361adab6f1935d1e7af2b3728c7e491a58c034bc0be963 (171) valid
2012-12-28 23:32:12,113 INFO interfaces interfaces.on_submit_share # 00000000137d2a68b52dfe0abd1df8216f1883eccd6fb08e93154c1bb7322cad (13) valid
explain me this
this is number of shares? 1 171 and 13 ?or valid sent shares?

[antirack]

thanks a lot slush
you helped much, i think now i understand all

2012-12-28 23:30:32,874 INFO interfaces interfaces.on_submit_share # 00000000a4779fb5d407f215ae3b8866e663305c22b50d8088574427b3eebb4f (1) valid
2012-12-28 23:31:44,111 INFO interfaces interfaces.on_submit_share # 00000000017e265469361adab6f1935d1e7af2b3728c7e491a58c034bc0be963 (171) valid
2012-12-28 23:32:12,113 INFO interfaces interfaces.on_submit_share # 00000000137d2a68b52dfe0abd1df8216f1883eccd6fb08e93154c1bb7322cad (13) valid
explain me this
this is number of shares? 1 171 and 13 ?or valid sent shares?

It's the share difficulty.

interfaces.py line 55:

Code:

        log.info("%s (%s) %s %s" % (block_hash, share_diff, 'valid' if is_valid else 'INVALID', worker_name))

[lenny_]

My main pool BitMinter is offline at this moment. Stratum Proxy is crashing and displaying very strange errors instead of nice timeout handling:

Code:

--- <exception caught here> ---
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", line 134, in maybeDeferred
    result = f(*args, **kw)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/worker_registry.py", line 37, in authorize
    d = self.f.rpc('mining.authorize', [worker_name, password])
  File "/usr/local/lib/python2.6/dist-packages/stratum-0.2.11-py2.6.egg/stratum/socket_transport.py", line 89, in rpc
    raise custom_exceptions.TransportException("Not connected")
stratum.custom_exceptions.TransportException: Not connected
Unhandled error in Deferred:
Unhandled Error
Traceback (most recent call last):
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/server.py", line 156, in process
    self.render(resrc)
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/server.py", line 191, in render
    body = resrc.render(self)
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/resource.py", line 216, in render
    return m(request)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/getwork_listener.py", line 163, in render_POST
    d = defer.maybeDeferred(self.workers.authorize, worker_name, password)
--- <exception caught here> ---
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", line 134, in maybeDeferred
    result = f(*args, **kw)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/worker_registry.py", line 37, in authorize
    d = self.f.rpc('mining.authorize', [worker_name, password])
  File "/usr/local/lib/python2.6/dist-packages/stratum-0.2.11-py2.6.egg/stratum/socket_transport.py", line 89, in rpc
    raise custom_exceptions.TransportException("Not connected")
stratum.custom_exceptions.TransportException: Not connected
Unhandled error in Deferred:
Unhandled Error
Traceback (most recent call last):
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/server.py", line 156, in process
    self.render(resrc)
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/server.py", line 191, in render
    body = resrc.render(self)
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/resource.py", line 216, in render
    return m(request)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/getwork_listener.py", line 163, in render_POST
    d = defer.maybeDeferred(self.workers.authorize, worker_name, password)
--- <exception caught here> ---
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", line 134, in maybeDeferred
    result = f(*args, **kw)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/worker_registry.py", line 37, in authorize
    d = self.f.rpc('mining.authorize', [worker_name, password])
  File "/usr/local/lib/python2.6/dist-packages/stratum-0.2.11-py2.6.egg/stratum/socket_transport.py", line 89, in rpc
    raise custom_exceptions.TransportException("Not connected")
stratum.custom_exceptions.TransportException: Not connected
Unhandled error in Deferred:
Unhandled Error
Traceback (most recent call last):
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/server.py", line 156, in process
    self.render(resrc)
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/server.py", line 191, in render
    body = resrc.render(self)
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/web/resource.py", line 216, in render
    return m(request)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/getwork_listener.py", line 163, in render_POST
    d = defer.maybeDeferred(self.workers.authorize, worker_name, password)
--- <exception caught here> ---
  File "/usr/local/lib/python2.6/dist-packages/Twisted-12.2.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py", line 134, in maybeDeferred
    result = f(*args, **kw)
  File "/home/pioruns/stratum-mining-proxy/mining_libs/worker_registry.py", line 37, in authorize
    d = self.f.rpc('mining.authorize', [worker_name, password])
  File "/usr/local/lib/python2.6/dist-packages/stratum-0.2.11-py2.6.egg/stratum/socket_transport.py", line 89, in rpc
    raise custom_exceptions.TransportException("Not connected")
stratum.custom_exceptions.TransportException: Not connected

Miner (Ztex BTCMiner) is reporting errors as well:

Code:

2012-12-29T12:16:55: 001-0: ztex_ufm1_15y1-04A3919EA0-4: Error: jsonParse: Parameter `data' not found: Disabling URL http://localhost:4990 for 60s

When restarted, Stratum proxy reporting:

Code:

2012-12-29 12:23:31,334 INFO proxy jobs.<module> # Using C extension for midstate speedup. Good!
2012-12-29 12:23:52,471 WARNING proxy mining_proxy.main # Stratum proxy version: 1.3.0
2012-12-29 12:23:52,472 WARNING proxy mining_proxy.main # Trying to connect to Stratum pool at mint.bitminter.com:5050
Unhandled error in Deferred:
Unhandled Error
Traceback (most recent call last):
Failure: stratum.custom_exceptions.TransportException: SocketTransportClientFactory connection timed out
2012-12-29 12:25:52,474 ERROR proxy client_service.on_timeout # Connection to upstream pool timed out
2012-12-29 12:27:52,474 ERROR proxy client_service.on_timeout # Connection to upstream pool timed out

And when proxy restarted, BTCMiner correctly reporting connecting problem (instead of errors on jsonParse):

Code:

001-0: ztex_ufm1_15y1-04A346F601-4: Error: Connection refused: Disabling URL http://localhost:4990 for 60s

I am using:

Code:

Linux 2.6.32-5-amd64 x86_64 GNU/Linux
Description:    Debian GNU/Linux 6.0.6 (squeeze)
Python 2.6.6
Current stratum-mining-proxy version:
commit 27e8dce29b82c300a66dc28017dedad1b06e3519