Bitcoin Forum
April 23, 2024, 09:45:36 PM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
  Home Help Search Login Register More  
  Show Posts
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 [50] 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 »
981  Bitcoin / Pools / Re: 'How to hop' blog on: November 15, 2011, 11:45:22 PM
Of course, the only reward system that satisfies these two properties is PPLNS with N=1.
Yeah, that's what I call "the hopping immunity theorem". I'll add a proof in AoBpmrs as soon as I determine the most general conditions under which I am able to prove it.

Good.  The simple form of the theorem that is suggested by the two conditions I gave is easy to prove but it would be nice to say something more along the lines of "If X is a hop-proof pool then there must exist a function f and ...".  This shouldn't be tough (kind of fun really) but as I said a while back I've not done any of the maths for pooled mining and instead am enjoying just going with rough intuition (which frequently leads to my making false assertions but that's fine).  Good luck with this, not that you'll need it.

May I ask what you do for a living Meni?
A bit off-topic isn't it? Wink

I used to be an algorithm researcher in a small internet startup. I recently moved to a 20%-time position there so I can focus on Bitcoil.

If you've been following my posts you'll know I'm a fan of "off-topic".

This, by the way, is my 1000th post.

Congrats!  It's a shame you don't get higher status than "Hero Member".
982  Bitcoin / Pools / Re: [130 GH/s] yourbtc.net - DGM - Merged Mining - Registration Open - 0% Fee - API on: November 15, 2011, 04:42:29 PM
Err... PPS pools aren't hoppable by nature.  Can you clarify what you mean?  The de facto definition of hoppable is a pool where one can gain a monetary advantage by only submitting shares during a limited time/shares (typically 43.x% or 46.x%, I forget which) window.  While you could hop to and from a PPS pool, it will gain you no advantage.  So while every pool is hoppable, only certain pools will realize an advantage to a hopper.  Those that won't are typically considered unhoppable.  PPS falls into this definition by default.
In its most general scope, "hoppable" means the relative attractiveness of mining for a pool is different at different times. If the block reward is fixed, PPS isn't hoppable. When block rewards are variable (which they are to some extent now and more so going forward), the attractiveness is measured relatively to the momentary block reward. If a PPS pool literally offers a fixed pay per share, its attractiveness relative to the block reward is constantly changing, and it becomes hoppable - you mine there when the rewards is more than the solo average, and mine elsewhere when it is less. Now it doesn't matter, but in the future a correct PPS pool will always offer a reward of (1-f)pB per share where B is the block reward at the time it was submitted. Other hopping-proof methods can also adapt to this new reality by incorporating the current block reward into the share's score (at the cost of additional variance for the operator). By implementing this now, yourbtc is indeed less hoppable than the currently implemented PPS. (I'm not sure how it is in EMC. I don't know if I emphasized this point when we corresponded about the scoring.)

See also section "Variable block rewards" of AoBpmrs.

Yes, this is pretty much all I meant.  Most PPS pools right now pay an amount per share which depends on difficulty but not transaction fee rewards.  This is insignificant in the grand scheme of things right now, I just thought it was interesting.

Also, I've always used "hoppable" with reference to solo mining rather than the PPS reward system or as a general relative property.
983  Bitcoin / Pools / Re: Non Merged Mining Pools ? on: November 15, 2011, 04:27:53 PM
That's exactly it. Misunderstanding how it works. I thought that your miners would be split between the two coins, jumping from one to the other, or whatever. But if you say that people merge mining will get the same amount of BTC as those using pools that are only mining BTC, then I'll stick with the merged mining.

Seems a bit hocus pocus to me, but I'll believe you. Hell, it was the original NMC run, way back, that paid for all my equipment, therefore I am very glad to be involved in it again Smiley

Unfortunately, the profitability of merged mining over normal Bitcoin mining has fallen quite a lot since it was first rolled out but it's still a nice bonus (about 3.6% right now).  There was a period after merged mining became available that Namecoin mining was actually more profitable than Bitcoin mining (so the merged mining bonus was over 100%)!  Namecoin difficulty is still rising fast so this bonus should continue to drop.
984  Bitcoin / Pools / Re: 'How to hop' blog on: November 15, 2011, 04:15:40 PM
As far as I understand it, DGM simply interpolates between PPLNS and Geom
That's not what it does. It's on a spectrum that has exponential-PPLNS on one end and Geom on the other, but it doesn't just pay out a convex combination of the respective rewards.

If you just design a reward system with shares decaying in value at some random rate you prescribe then most likely the pool will be hoppable.
That's not really it. You can use any decay function (and linear decay gives the best variance/maturity tradeoff). But you must maintain a steady state with some combination of round crossing and correctly tuned variable fee. Suppose you take the geometric method, in which the operator's score is specified as 1/(r-1). If you choose to make the score any less, you incentivize mining in young rounds; if you make it any higher, you incentivize mining in old rounds; only with this exact score the profitability is always the same.

This is why the proportional reward system is hoppable; the decay is not the same as that required by the mathematics.
There's nothing wrong with the decay in proportional. It's equivalent to exponential decay with r=1. If you do this with infinite score fee and correspondingly infinite negative fixed fee, you get PPS which is hopping-proof. The problem is that people try to use it with 0 score fee.

My apologies, I had to dash while I was composing this post and didn't have time to read it.  By "interpolate" I didn't mean to suggest any particular mathematical way of calculating payouts but rather just meant to suggest that by varying one of the parameters you would obtain a continuum of reward systems from PPLNS to Geom.  I admit this was a poor choice of word but couldn't think of anything better at the time.  Spectrum is a good word for this.

As for the "decay" part I was being particularly dense when I wrote this and I'm sorry for any confusion caused (I'll edit my earlier post if I can).  I somehow managed to get the idea in my head that it would be possible to have a non-hoppable reward system where for each block the full reward is paid out according to the shares submitted in that round.  I was talking about the "decay" in value such a share submitted to such a pool must experience before the end of the round (and thought it would exist and be some kind of exponential decay).  Of course, the only reward system that satisfies these two properties is PPLNS with N=1.  I was flatly wrong, "That's not really it" was just kindness Wink.

After a quick read of your initial post about the Geometric method I see what you are saying about Prop and PPS.

May I ask what you do for a living Meni?
985  Bitcoin / Pools / Re: 'How to hop' blog on: November 15, 2011, 09:48:30 AM
Upon reflection, it seems like the second paragraph's concern is also unfounded. As long as each share's value is independently evaluated, it shouldn't make a difference. If a pool has some other policy, like "if you leave for three hours your reward is cut in half", this would "connect" the value of shares you submit now to future shares you submit.

Yes.  The goal of many of the reward systems is to ensure that each submitted share has the same expected value.  PPLNS does this (unless carelessly implemented), PPS does this (this too can be implemented in a way that is technically hoppable thanks to the transaction fee reward), and Geom does this.  As far as I understand it, DGM simply interpolates between PPLNS and Geom is a spectrum of different non-hoppable reward systems ranging from PPLNS to Geom and, consequently, takes an additional parameter.  If a reward system has this property and pays all rewards out in a timely manner then it simply cannot be hopped (for the time issue, compare DGM to SMPPS).

The interesting aspect is that, for a fixed difficulty and hashrate, the number of blocks generated in a certain period is very well modelled by the Poisson distribution (equivalently, the time until the next block is found is very well modelled by the exponential distribution).  Consequently there is a natural "decay", not built into Bitcoin by design, but simply a mathematical phenomenon.  If you just design a reward system with shares decaying in value at some random rate you prescribe then most likely the pool will be hoppable.  The decay must exactly match that required by the mathematics.  This is why the proportional reward system is hoppable; the decay is not the same as that required by the mathematics.  Nonsense
986  Bitcoin / Pools / Re: Non Merged Mining Pools ? on: November 15, 2011, 09:30:02 AM
It is just not submitted to the Namecoind in the first place, so there's no test as to whether or not it's a valid share.  It's kind of a pointless feature IMHO, but I had a couple people ask for it.  Maybe some people just hate Namecoin?

Good.  I would imagine that some people opting out of merged mining are specifically wanting to not support the Namecoin network.  Honestly though, knowing the mining community I would expect most people opting out mistakenly believe that doing so will boost their Bitcoin income.
987  Bitcoin / Pools / Re: Non Merged Mining Pools ? on: November 14, 2011, 08:31:28 PM
At Eclipse, you have the option of turning off your Merged Mining if you want.  https://eclipsemc.com

If a miner at your pool opts out of merged mining and they submit a share which would generate a Namecoin block is the winning hash not broadcast?  I couldn't find anything on the "Pool Disccusion" page about it.
988  Bitcoin / Pools / Re: [130 GH/s] yourbtc.net - DGM - Merged Mining - Registration Open - 0% Fee - API on: November 14, 2011, 08:14:32 PM
As soon as we migrated to the new server (which could be tomorrow) poolserverj will be updated to the newest release and of course bitcoind 0.5.
When we got that working, the total reward (B) for each submitted share will be block reward + transactionfees that would be incluced if the share would solve the block.

Eta should be next week!

Cool!  With such an update I believe it could be argued that yourbtc.net is less hoppable than most existing (possibly all) PPS pools! Smiley
989  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 14, 2011, 07:31:47 PM
you don't have to, we have ppl around that can simulate any situation over a long period of time...

Simulations are one thing, real life data is quite another. I am disappointed by the (lack of) response from the PPLNS proponents/supporters, though. This test could potential prove their very important point that PPLNS reward method does not negatively impact the intermittent miner over the long run, compared to other methods.

No takers?

The simulations are really only suitable for illustrating a particular reward system, it is mathematics that establishes whether or not a reward system impacts intermittent miners.

A real data test will be difficult to perform for a number of reasons.  I fear all that could be gleaned from such a test is which pool "currently" performs the best and say nothing conclusive about future performance or about reward systems.
990  Bitcoin / Pools / Re: [130 GH/s] yourbtc.net - DGM - Merged Mining - Registration Open - 0% Fee - API on: November 14, 2011, 07:25:27 PM
I've just gotten back and am glad to see that this pool is doing well (aside from the continuing server instability issue).  Reaching 200 GH/s, if only briefly, was unbelievable.  Does anyone know what caused this spike in hashing power?

@urstroyer: What's the situation with regard to the correct proportioning of share scores with respect to currently available transaction fees?  I noticed that while merged mining and the new PoolServerJ were being discussed that bitcoind 0.5 was mentioned (I forget where).  Certainly I'm not asking for such a tweak in the near future, I'm merely curious about the current state of affairs.
991  Bitcoin / Pools / Re: [80 GH/s] yourbtc.net - DGM - Merged Mining - Registration Open - 0% Fee - API on: November 11, 2011, 12:56:44 AM
The pool has to run 100% flawless before more miners will come over...

Agreed.  With an average 3 outages a day over the last week I'd expect people to be leaving this pool in droves.  Given the fierce competition out there between the pools one can't expect a near future promise of stability to last for long.


Just ordered a REALLY nice new server for loads of new capacity, those outages will be history soon. This is a really expensive one but you are worth the money!

Awesome!  Have fun with the upgrade (it's always satisfying to work with new hardware).


Nice to read, I'll up my donations a bit to help you out :-)

I was particularly impressed to see that the pending donation is nearly 1% of the pending payout, a huge improvement (not long ago it was only 0.3%).
992  Bitcoin / Mining / Re: Are pools more efficient? on: November 11, 2011, 12:47:48 AM
Good points.  Never thought about it but lack of LP is going to cost you 1% to 5% depending on card speed. 

Just set your maximum scan time to 1 second. This means you'll lose a maximum of ~144 seconds of mining a day or 0.166%. You'll usually lose  more effort than that from pools due to other issues (stales, bugs, network latency).

Pools can't do this because all the users would slam them. But it's a perfectly reasonable thing when running on your own. (not that running pushpool with LP locally is much of an issue).



That seems sensible to me.  Long polling shouldn't be necessary for a local network at all (not that it hurts).  I would argue that, even with long polling, pool miners will have more of a stales problem than solo miners.
993  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 10, 2011, 07:00:52 PM
Quote
To clarify, when you say "expect" are you referring to the concept of "expected value" from the theory of probability or something more along the lines of "a high chance of receiving at least a certain amount".
From my recommendation of using PPS pools in this scenario it should be clear that I meant the latter.

It wasn't clear to me but I did suspect we might be working from different definitions of "expect".  Thanks for clearing that up.  You might consider putting a note about that in your text for mathematicians and gamblers.

Quote
If you are concerned about the latter it would be worth pointing out that mining for a few hours at a small PPLNS pool (say N = [difficulty]) has a definite, positive, non-negligible probability of paying out 0 BTC (similar to how a lottery ticket can end up being worthless).  This is one aspect of PPLNS that many miners (even 24/7 miners) find psychologically difficult to handle and, consequently, I feel it is a fair criticism of the reward system.
I did not want to bring that up in order to avoid adding further technicality in this particular thread that attempts from the beginning to be non-technical. The PPLNS method also does away with the concept of rounds (or rather, it disregards round boundaries), which is another psychological hurdle for the average joe. Once a round is finished, if you have submitted shares, you expect (no relation to probability theory) to receive some reward. Fancy mathematics will have a hard time convincing the miner to wait for the long run when his rewards will average out.

I'd argue that warning people that there's a real chance they could get no reward for a few hours mining at a PPLNS pool is far from technical.

Yes, round boundaries are done away with too and this is a little more technical and possibly could be omitted.  I agree that it is another hurdle as many miners think of a share as being part of a block rather than simply a proof-of-work packet.  It can be confusing that a share found in one round can still be generating income many rounds later.
994  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 10, 2011, 06:47:53 PM
Quote
Quote
There ain't no such thing as a free lunch. PPS needs to take a fee to maintain stability; and, conversely, PPS has a lot of advantages so it is reasonable to pay a fee for it. I think going forward we'll have stable 1%-2% fee PPS pools.

zero-fee PPS pools do exist. Whether they are sustainable over the long run is another matter altogether and quite beyond the scope pf this discussion. Whether fees are reasonable or not can only be decided by the open market system. Users will not accept fees if they do not perceive getting adequate value for that fee (as long as there is a lower fee alternative available).

Agreed.  This is not a place for discussing the viability of various pool systems but for helping miners select a pool which works for them.  No-fee PPS pools do exist and, even without merged mining, such a pool is a decent choice for a miner.
995  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 10, 2011, 06:37:03 PM
Scores decay exponentially if the miner is disconnected. How is that not punishing the disconnection?
[/quote]
The score for previous shares decays exponentially whether the miner disconnects or not. Remaining connected doesn't stop the decay, it just replenishes the score with the score of the new shares.
[/quote]

Yes, this seems to be a common misunderstanding and so I think is very much worth including in your work kislam.  Scores are not designed to decay to attack intermittent miners and thereby reduce pool hopping, they are there to ensure that the expected value of a submitted share is independent of the current round age.
996  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 10, 2011, 06:23:39 PM
And please let off with the "Same Value in the Long Term" argument. While perfectly valid in statistical terms, it has little relevance to the intermittent miner since it's far more important to know how much reward he/she can expect to earn for a given period of mining.

To clarify, when you say "expect" are you referring to the concept of "expected value" from the theory of probability or something more along the lines of "a high chance of receiving at least a certain amount".

If you are concerned about the latter it would be worth pointing out that mining for a few hours at a small PPLNS pool (say N = [difficulty]) has a definite, positive, non-negligible probability of paying out 0 BTC (similar to how a lottery ticket can end up being worthless).  This is one aspect of PPLNS that many miners (even 24/7 miners) find psychologically difficult to handle and, consequently, I feel it is a fair criticism of the reward system.

Do you have a thread where you talk about possible far future scenarios for mining?  Both the topics of possible reward systems and number/sizes of pools would make for interesting discussion.
No coherent thread, but here's a short version of my vision: There will be several low-fee PPS pools, acting as a proxy to a p2pool as a backend. There will be many getwork servers, and people will freely mix-and-match their pool and getwork server(s). Oblivious shares will be used to prevent block withholding. Larger miners will skip the PPS pool and participate directly in the p2pool.

Interesting.  I might also expect a large array of small PPLNS (or similar) pools.  If there were one such pool a miner may well want to send 2% of their hashing power to increase their variance and expected income so such a setup seems stable.  That's juts a knee-jerk reaction though, I think I'll give this some thought.
997  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 10, 2011, 05:28:25 PM
Interesting.  I see that a proportional pool (assuming no pool hoppers) proves more of a problem for random intermittent miners versus 24/7 miners than a similar PPLNS pool (regardless of the value of N) (which in turn is more problematic than most other reward systems).  However, I don't have much of a feel for the value of N at which the share-based variance at PPLNS is similar to that of a proportional share.  Have you calculated such a value of N or merely shown that it is less than [difficulty]/2.

Also, I completely agree.  I'm not clear exactly on what the "intermittent issue" is but based only on the name I can safely say that if it's a problem for PPLNS then it's a bigger problem for proportional (certainly for N=[difficulty], arguably for all N).
It's in AoBPMRS. Prop variance is roughly (pB)^2*ln(D), PPLNS variance is (pB)^2/X. So you need X > (1/ln(D)), or roughly N = 7.1% of the difficulty. The number is different if metric other than vanilla variance is used, but for any reasonable one X=1 (which IMO is a better parameter than 1/2) makes PPLNS better than prop.

Thanks for this, a neat little bit of trivia.  I honestly didn't expect the tipping point to be as small as N = 0.071*[difficulty].

Try not to let the trolls bother you.  I hope you find posting on this forum entertaining.

Given how slowly and painfully the mining community is processing "reward systems" I fear auditing is very much a future concern (and one I'm somewhat interested in).  Do you have a thread where you talk about possible far future scenarios for mining?  Both the topics of possible reward systems and number/sizes of pools would make for interesting discussion.
998  Bitcoin / Pools / Re: Which is the best pool for mining? - A guide for choosing the right pool on: November 10, 2011, 12:00:40 PM
Quote
proportionate pools do not have the intermittent issue
That's wrong. Even setting aside the hopping issue, proportional pools have higher variance than a PPLNS pool with the default parameters. So if PPLNS is bad for intermittent miners, so is proportional.

Interesting.  I see that a proportional pool (assuming no pool hoppers) proves more of a problem for random intermittent miners versus 24/7 miners than a similar PPLNS pool (regardless of the value of N) (which in turn is more problematic than most other reward systems).  However, I don't have much of a feel for the value of N at which the share-based variance at PPLNS is similar to that of a proportional share.  Have you calculated such a value of N or merely shown that it is less than [difficulty]/2.

Also, I completely agree.  I'm not clear exactly on what the "intermittent issue" is but based only on the name I can safely say that if it's a problem for PPLNS then it's a bigger problem for proportional (certainly for N=[difficulty], arguably for all N).
999  Bitcoin / Mining / Re: Are pools more efficient? on: November 10, 2011, 10:06:50 AM
  • Long polling (don't continue checking old "lottery tickets" after they expire, get new ones instead)

Is that right?  I thought long polling was all about helping the mining software and bitcoind communicate and thereby reducing the proportion of invalid shares.  If both pieces of software are on the same private network such communication should be a non-issue.  To me, the interesting communication problem is the broadcasting of a new block to all existing bitcoind nodes.

Could someone explain long polling or give me a link?  Particularly I'd like to know whether or not it improves on bitcoind's current block broadcasting and, if so, how?
1000  Bitcoin / Pools / Re: [80 GH/s] yourbtc.net - DGM - Merged Mining - Registration Open - 0% Fee - API on: November 10, 2011, 09:34:23 AM
The pool has to run 100% flawless before more miners will come over...

Agreed.  With an average 3 outages a day over the last week I'd expect people to be leaving this pool in droves.  Given the fierce competition out there between the pools one can't expect a near future promise of stability to last for long.
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 [50] 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 »
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!