How to build your own Multipool - the Open Source Way

[MCDev]

WOW!!! Based on your post, took the time to get Redis-Commander working and it's fantastic.  Had it on a test vm on digital ocean and couldn't get to it.  Then figured out it was my TMG2010 outbound rules.  Fixed that and it worked.  Repeated the process on what will become my public host that I'm using privately at the moment with 10+ coins, and WOW!!

So much info!  I'm a lot more familiar with SQL Server and would love to work out dumping the data to that and run background jobs on 1 to 5 minute intervals but I'm going to spend some time with Redis.  Thanks for the PUSH  

[stoner19]

to have a github repo for this would be awesome!

[utahjohn]

Bump ... Where is our lead dev from OP

[paradigmflux]

Sorry for not updating in forever.
Thanks for the people who have been messaging me with thanks.
To the others who are asking to hire me to set them up a pool - eventually I will get this all in the public domain, then I would appreciate any donations made.

i will see about getting a github repo with everything checked into it before I shut down the http://burstmultipool.com site.

My other, main pool, is http://hashrate.org (it was my first and is pretty much my only long term pool - it's for NXT)

[utahjohn]

OK will do some testing on one of my boxes, I really interested in algo switching, has this all been ironed out?, I'd like to quota mine X11 multicoin + diamond on my boxes, I currently quota mine on all DMD pools, just finishing up my US mirror of miningfield.com pools and all my DMD hashrate goin to my mirror right now ... http://utahjohn.ddns.net, so far still beta see https://bitcointalk.org/index.php?topic=580725.msg9178778#msg9178778
Only pool I have finished on my US mirror is DMD right now, and just beta testing it.

This was in regards to sgminer-dev v5 with stock NOMP+MPOS,
I want a multipool profit switching NOMP LOL and coin->BTC->coin of choice payout (DMD)

I'll add a port at my end, on another VM for DMD multipool, dunno if miningfield is interested but I am

[infernoman]

to anyone who is considering trying to do this on a "home built" pc think again unless you have a LOT of money invested into your rig. I'm running an i7 3970x at 4.5ghz with 28 gb of ram. and only 21 for the VM. currently the VM still maxes out the memory and ends up maxing out my entire pc memory. i have seen loads on my cpu upwards of 70% and have finally gotten them to lower doing some adjustments to the configs. ANOTHER THING
if you want your damn database to save so that when you restart your redis server?

add this to the bottom of EVERY single one of those scripts that paradigmflux posted and the database will save every 5 or 10 minutes how ever often you set it.

redis-cli save

[paradigmflux]

to anyone who is considering trying to do this on a "home built" pc think again unless you have a LOT of money invested into your rig. I'm running an i7 3970x at 4.5ghz with 28 gb of ram. and only 21 for the VM. currently the VM still maxes out the memory and ends up maxing out my entire pc memory. i have seen loads on my cpu upwards of 70% and have finally gotten them to lower doing some adjustments to the configs. ANOTHER THING
if you want your damn database to save so that when you restart your redis server?

add this to the bottom of EVERY single one of those scripts that paradigmflux posted and the database will save every 5 or 10 minutes how ever often you set it.

redis-cli save

It's a lot easier to just configure redis to save every X number of writes.
inside your redis.conf file, make sure that you have this section exactly like this:

Code:

# Save the DB on disk:
#
#   save <seconds> <changes>
#
#   Will save the DB if both the given number of seconds and the given
#   number of write operations against the DB occurred.
#
#   In the example below the behaviour will be to save:
#   after 900 sec (15 min) if at least 1 key changed
#   after 300 sec (5 min) if at least 10 keys changed
#   after 60 sec if at least 10000 keys changed
#
#   Note: you can disable saving at all commenting all the "save" lines.
#
#   It is also possible to remove all the previously configured save
#   points by adding a save directive with a single empty string argument
#   like in the following example:
#
#   save ""

save 900 1
save 300 10
save 60 10000

also make sure you bind your local redis instance to 127.0.0.1 with this in that same config file:

Code:

bind 127.0.0.1

Then as long as you have it set up like this, it should automatically reload all of the redis data as soon as you re-start redis-server with the same redis.conf file:

Code:

# The filename where to dump the DB
dbfilename dump.rdb

# The working directory.
#
# The DB will be written inside this directory, with the filename specified
# above using the 'dbfilename' configuration directive.
#
# The Append Only File will also be created inside this directory.
#
# Note that you must specify a directory here, not a file name.
dir /var/lib/redis/

[elitemobb]

So any idea what is causing this error?

TypeError: Cannot call method 'toString' of undefined
    at resolveDefs (/home/james/nomp/node_modules/dot/doT.js:52:55)
    at Object.doT.template (/home/james/nomp/node_modules/dot/doT.js:90:33)
    at /home/james/nomp/libs/website.js:84:33
    at fs.js:207:20
    at Object.oncomplete (fs.js:107:15)

I did notice to that in the section where you have the code for stats.js it appears to that you are wanting us to create a new website.js.  I did that and removed the code from stats.js

[/code

Delete the stock website.js file as well, make a new one:
/code]

Were you ever able to resolve this error?

[hhfbrg]

Very interesting subject, I'd like to hear more! 

[MCDev]

Any news or updates?  Still watching and destroying my NOMP installs

[fragar10]

I am getting this error. Any help would be appreciated.

/home/frank/nomp/libs/stats.js:560
    var portalApi = new api(logger, portalConfig, poolConfigs);
                    ^
TypeError: object is not a function
    at new module.exports (/home/frank/nomp/libs/stats.js:560:21)
    at new module.exports (/home/frank/nomp/libs/api.js:11:36)
    at new module.exports (/home/frank/nomp/libs/website.js:29:21)
    at Object.<anonymous> (/home/frank/nomp/init.js:80:13)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Function.Module.runMain (module.js:497:10)
    at startup (node.js:119:16)
2014-12-05 02:21:29 [Master]   [Website] Website process died, spawning replacement...

[tencentcoin]

this tutorial is very useful for the miner and dev

thanks for the share. i will try this way to build my own

[utahjohn]

bump ...paradigmflux where r u?

[pjcltd]

I am getting this error. Any help would be appreciated.

/home/frank/nomp/libs/stats.js:560
    var portalApi = new api(logger, portalConfig, poolConfigs);
                    ^
TypeError: object is not a function
    at new module.exports (/home/frank/nomp/libs/stats.js:560:21)
    at new module.exports (/home/frank/nomp/libs/api.js:11:36)
    at new module.exports (/home/frank/nomp/libs/website.js:29:21)
    at Object.<anonymous> (/home/frank/nomp/init.js:80:13)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Function.Module.runMain (module.js:497:10)
    at startup (node.js:119:16)
2014-12-05 02:21:29 [Master]   [Website] Website process died, spawning replacement...

Hi
What command are you useing to start nomp ?

[paradigmflux]

hey guys
i noticed someone started a github based on this thread
https://github.com/sigwo/unified-node-open-mining-portal

i'm going to try and contribute a bunch more developments

[YarkoL]

Ok, so I'm finally trying out this guide. I've got a NOMP
with two scrypt coins, Monacoin and Wildbeastbitcoin.

When I execute the shell script in post #11
I see this output:

Code:

(integer) 0
(integer) 0
monacoin

ignore worker
(standard_in) 1: syntax error
wildbeastbitcoin

ignore worker
(standard_in) 1: syntax error
(standard_in) 1: syntax error
(integer) 1

I'm not at all familiar with bash scripts, so I don't know where the syntax errors come from...

This is what redis gives me after running the script:

Code:

127.0.0.1:6379> keys *
 1) "Pool_Stats:avgHR:"
 2) "coinVersionBytes"
 3) "monacoin:shares:roundCurrent"
 4) "Pool_Stats:avgHR:scrypt"
 5) "statHistory"
 6) "Coin_Names_scrypt"
 7) "monacoin:stats"
 8) "Coin_Algos"
 9) "Coin_Names"
10) "wildbeastbitcoin:stats"
11) "wildbeastbitcoin:shares:roundCurrent"

Does it look like it should..?

[YarkoL]

Silly me, I needed just to run the script while
having worker(s) mining. Still getting syntax errors,
but the script works, since I now have the
worker hashrates getting written into Redis.

On to the next step. Fun stuff!

[silversurfer1958]

Interesting but way above my abilities at the mo, would be great to build more pools though to maybe help with the 51% problem.
Maybe if a number of pools were set up and encouraged pool hopping, that would draw people away from the big pools.
Great job putting it all together.

[hdmediaservices]

Do you all address the duplicate shares exploit?

[l8nit3]

first off great tutorial! my question for you is does this method work with the updated unomp aswell? and if so is there a way to send the auxpow coins for auto-exchange aswell?  so they can be paid out to the user? (unomp has the auxpow merged mining ability, it just doesnt pay them out yet)