Bitcoin Forum
March 30, 2024, 08:10:46 AM *
News: Latest Bitcoin Core release: 26.0 [Torrent]
 
   Home   Help Search Login Register More  
Warning: One or more bitcointalk.org users have reported that they strongly believe that the creator of this topic is a scammer. (Login to see the detailed trust ratings.) While the bitcointalk.org administration does not verify such claims, you should proceed with extreme caution.
Pages: [1]
  Print  
Author Topic: What's best for Deepbit is best for Bitcoin  (Read 3296 times)
genjix (OP)
Legendary
*
Offline Offline

Activity: 1232
Merit: 1071


View Profile
May 09, 2011, 12:40:01 AM
 #1

Observing now the hashrate distribution and knowing someone who sold their BTC because of the current distribution... it would seem in the best interests financially of both Deepbit miners and the Bitcoin economy as a whole if Deepbit were to branch out and 'de-monopolize'. I'm not sure exactly how these mining pools work. If Deepbit is using closed software which gives them an edge, I hope that their members have access to the code of that software... otherwise it is very damaging the the confidence of the entire BTC world and this will no doubt negatively effect the bottom line of the Deepbit miners.

Perhaps I'm a non-technical noob, but please let me know why this disparity exists.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
genjix (OP)
Legendary
*
Offline Offline

Activity: 1232
Merit: 1071


View Profile
May 09, 2011, 12:40:36 AM
 #2

BTW, this is not genjix (I didn't realize I was signed into his account)
[Tycho]
Hero Member
*****
Offline Offline

Activity: 742
Merit: 500



View Profile WWW
May 09, 2011, 12:44:20 AM
 #3

Possible way to help with this situation:

http://bitcointalk.org/index.php?topic=7622.0

Welcome to my bitcoin mining pool: https://deepbit.net - Both payment schemes (including PPS), instant payout, no invalid blocks !
ICBIT Trading platform : USD/BTC futures trading, Bitcoin difficulty futures (NEW!). Third year in bitcoin business.
xenon481
Sr. Member
****
Offline Offline

Activity: 406
Merit: 250



View Profile
May 09, 2011, 12:44:26 AM
 #4

BTW, this is not genjix (I didn't realize I was signed into his account)

So, who is this then, and why would you be logged into his account?

Tips Appreciated: 171TQ2wJg7bxj2q68VNibU75YZB22b7ZDr
bitlotto
Hero Member
*****
Offline Offline

Activity: 672
Merit: 500


BitLotto - best odds + best payouts + cheat-proof


View Profile WWW
May 09, 2011, 12:50:31 AM
 #5

BTW, this is not genjix (I didn't realize I was signed into his account)
LOL what?  Huh

*Next Draw Feb 1*  BitLotto: monthly raffle (0.25 BTC per ticket) Completely transparent and impossible to manipulate who wins. TOR
TOR2WEB
Donations to: 1JQdiQsjhV2uJ4Y8HFtdqteJsZhv835a8J are appreciated.
PwrLeveld
Member
**
Offline Offline

Activity: 336
Merit: 10


Computta Mine Your Own BTC


View Profile
May 09, 2011, 12:53:40 AM
 #6

LOL what?  Huh
x2

Dear GOD/GODS and/or MEMBERS OF SUPER-INTELLIGENT ALIEN CIVILIZATIONS: Please let CHAUL JHIN KIM win the NEW ZEALAND POWERBALL JACKPOT. He will use the money to set up his own RESEARCH LAB and find the CURES for CANCER and AGING! He will release the CURES into the PUBLIC DOMAIN! (a la Jonas Salk) EVERYONE regardless of wealth will no longer need to SUFFER! CHILDHOOD CANCER will also be HISTORY! Thank you! - A Faithful Believer. P.S. If anyone is reading this then please pray with me!
genjix (OP)
Legendary
*
Offline Offline

Activity: 1232
Merit: 1071


View Profile
May 09, 2011, 01:21:05 AM
Last edit: May 09, 2011, 01:49:39 AM by genjix
 #7

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Friend of mine. I logged onto his PC without telling him because my internet was acting up.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)

iQEcBAEBAgAGBQJNx0QcAAoJEH8nvZxjT+xntDUIAJCDWzrK8zVf0D9jhTp4T55y
+5IMN4O6tPyJt6DUoKbCGmacRzINservU9HckaN29N2/Dtqw+P5nJIdHWR9so7Rj
b0DAMu/gFdkHdbeIbKL1oFHz6OE9Pql7tNjN+jhvAvT8sdywwDFm32360TluXXdj
twSO1vKUQVMsLpghsUntnB6Xc1rY5+O3Kb+1TmouvvwfLvhOZQ0F+J1wVadCOOqV
Ee/SphySrtDi0zHoYgUo/xYQ13HwWhhb7RCIMU9k6kNoL0pSISnmBGGZvf256E8+
rBiQ4N6BhBTa46MvvWlzekE64scpGgsyIRCpffX3kHskQWGAZWAurI8I2R4p+hA=
=uttF
-----END PGP SIGNATURE-----

http://www.bitcoin.org/genjix.gpg
marcus_of_augustus
Legendary
*
Offline Offline

Activity: 3920
Merit: 2347


Eadem mutata resurgo


View Profile
May 09, 2011, 02:45:25 AM
Last edit: May 09, 2011, 03:11:38 AM by moa
 #8

There is an incentive to not mine with deepbit.net (or any other pool) as it gets too big, particularly for the smaller miners.

The pool is there to smooth out the variance. But if the pool is finding blocks too quickly then a smaller, proportional miner may not get that many shares of each short block found and variance starts to return again, and more luck is involved. If you go pay-per-share this is smoothed out but at the cost of 10% fee with deepbit.net.

The smaller miners are better off with a pool that is finding blocks over a good period of time ... 1-2 hours, so that their share of the pool is well-represented and has had time to average out.

I'm sure if someone is interested, there is some mathematics to be done here that will give you an optimum size of a pool to associate with (as percentage of total network) dependent upon on the miner's hash power (as percentage of the pool), in order to minimise variance .... if that is what you are after.

Robust payments, low fees, info API's, and other bells 'n whistles maybe what you are looking for in a pool also.

anodyne
Full Member
***
Offline Offline

Activity: 518
Merit: 100


View Profile
May 09, 2011, 03:23:14 AM
 #9

Couldn't that "short block variance" be mitigated by calculating rewards/shares for multiple blocks instead of dividing them one by one? With a straight, proportional payout system it would simply mean that shares for blocks that are found in less than XX minutes are transferred to the next block.

Bitcoins: solid enough to build pyramids.
marcus_of_augustus
Legendary
*
Offline Offline

Activity: 3920
Merit: 2347


Eadem mutata resurgo


View Profile
May 09, 2011, 04:41:25 AM
 #10

Couldn't that "short block variance" be mitigated by calculating rewards/shares for multiple blocks instead of dividing them one by one? With a straight, proportional payout system it would simply mean that shares for blocks that are found in less than XX minutes are transferred to the next block.

Maybe, but you'd have to get a "big" pool operator to implement that ... it becomes quite a messy calculation of who's working harder on which particular block, who was luckier on which block, rolling averages over multiple blocks, time-depreciating share values to stop "pool hopping" attack, etc.

Bottom line is, right now the little guys are losing out when a pool gets too big, their variance starts going up again.

grndzero
Sr. Member
****
Offline Offline

Activity: 392
Merit: 250


View Profile
May 09, 2011, 04:49:32 AM
 #11

Couldn't that "short block variance" be mitigated by calculating rewards/shares for multiple blocks instead of dividing them one by one? With a straight, proportional payout system it would simply mean that shares for blocks that are found in less than XX minutes are transferred to the next block.

Maybe, but you'd have to get a "big" pool operator to implement that ... it becomes quite a messy calculation of who's working harder on which particular block, who was luckier on which block, rolling averages over multiple blocks, time-depreciating share values to stop "pool hopping" attack, etc.

Bottom line is, right now the little guys are losing out when a pool gets too big, their variance starts going up again.

Lucky there's at least 4 other smaller pools to pick from, 5 if slush is back up and stable.

Ubuntu Desktop x64 -  HD5850 Reference - 400Mh/s w/ cgminer  @ 975C/325M/1.175V - 11.6/2.1 SDK
Donate if you find this helpful: 1NimouHg2acbXNfMt5waJ7ohKs2TtYHePy
Meni Rosenfeld
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1054



View Profile WWW
May 09, 2011, 09:12:58 AM
Last edit: May 09, 2011, 11:59:29 AM by Holy-Fire
 #12

The pool is there to smooth out the variance. But if the pool is finding blocks too quickly then a smaller, proportional miner may not get that many shares of each short block found and variance starts to return again, and more luck is involved.
That's false. You'll have (proportionally) more variance per block but this is more than offset by the reduced variance in the number of blocks per time unit.

I think that under some simplifying assumptions, the best way to reduce variance is to put all your mining in the largest pool, even if it is as high as 100% of the network. I'll need to do some calculations to verify this part.

1EofoZNBhWQ3kxfKnvWkhtMns4AivZArhr   |   Who am I?   |   bitcoin-otc WoT
Bitcoil - Exchange bitcoins for ILS (thread)   |   Israel Bitcoin community homepage (thread)
Analysis of Bitcoin Pooled Mining Reward Systems (thread, summary)  |   PureMining - Infinite-term, deterministic mining bond
marcus_of_augustus
Legendary
*
Offline Offline

Activity: 3920
Merit: 2347


Eadem mutata resurgo


View Profile
May 09, 2011, 09:38:10 AM
 #13

The pool is there to smooth out the variance. But if the pool is finding blocks too quickly then a smaller, proportional miner may not get that many shares of each short block found and variance starts to return again, and more luck is involved.
That's false. You'll have (proportionally) more variance per block but this is more than offset by the reduced variance in the number of blocks per time unit.

I think that under some simplifying assumptions, the best way to reduce variance is to put all your mining in the largest pool, even if it is as high as 100% of the network.

I think you'll find you are false. You've discounted the granularity involved that the difficulty 1 share system of scoring is placing on the problem.

The ultra short rounds that the big pools get more frequently are essential for reducing the variance but a small miner can easily have a big fat "NONE" sitting in the shares column from one of these rounds. Because they could not find a difficulty 1 share in the same time it took the pool to find the block, they have no way to participate in the pool's mechanism for reducing variance for these ultra short rounds. It is the ultra-short rounds that have a large effect in bringing the variance back in the miners favour. Otherwise they are only toiling away on the longer blocks and not sharing in the ultra-short ones where they can 'make up' lots of lost time.

[Tycho]
Hero Member
*****
Offline Offline

Activity: 742
Merit: 500



View Profile WWW
May 09, 2011, 09:41:18 AM
 #14

The pool is there to smooth out the variance. But if the pool is finding blocks too quickly then a smaller, proportional miner may not get that many shares of each short block found and variance starts to return again, and more luck is involved.
That's false. You'll have (proportionally) more variance per block but this is more than offset by the reduced variance in the number of blocks per time unit.

I think that under some simplifying assumptions, the best way to reduce variance is to put all your mining in the largest pool, even if it is as high as 100% of the network.

I think you'll find you are false. You've discounted the granularity involved that the difficulty 1 share system of scoring is placing on the problem.

The ultra short rounds that the big pools get more frequently are essential for reducing the variance but a small miner can easily have a big fat "NONE" sitting in the shares column from one of these rounds. Because they could not find a difficulty 1 share in the same time it took the pool to find the block, they have no way to participate in the pool's mechanism for reducing variance for these ultra short rounds. It is the ultra-short rounds that have a large effect in bringing the variance back in the miners favour. Otherwise they are only toiling away on the longer blocks and not sharing in the ultra-short ones where they can 'make up' lots of lost time.
Actually he is right.
Yes, a slow miner will see some "None"'s for short blocks, but sometimes he will hit such block too and it will be balanced out.
I am sure about this.

Welcome to my bitcoin mining pool: https://deepbit.net - Both payment schemes (including PPS), instant payout, no invalid blocks !
ICBIT Trading platform : USD/BTC futures trading, Bitcoin difficulty futures (NEW!). Third year in bitcoin business.
marcus_of_augustus
Legendary
*
Offline Offline

Activity: 3920
Merit: 2347


Eadem mutata resurgo


View Profile
May 09, 2011, 10:11:18 AM
 #15

Quote
Yes, a slow miner will see some "None"'s for short blocks, but sometimes he will hit such block too and it will be balanced out.

But can he ever make up for the 0.5 or 0.75 of a share, i.e. the partial share that he should have got for the ultra-short round?

Maybe it will be balanced out, eventually. The bigger question is how long will it take to make back the losses on a bad run?

In other words, what is the ultra-short block variance for a small miner?

Remember the primary idea of the pool is to reduce the variance for a smaller miner

Meni Rosenfeld
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1054



View Profile WWW
May 09, 2011, 10:40:08 AM
Last edit: May 09, 2011, 10:54:48 AM by Holy-Fire
 #16

Quote
Yes, a slow miner will see some "None"'s for short blocks, but sometimes he will hit such block too and it will be balanced out.

But can he ever make up for the 0.5 or 0.75 of a share, i.e. the partial share that he should have got for the ultra-short round?

Maybe it will be balanced out, eventually. The bigger question is how long will it take to make back the losses on a bad run?

In other words, what is the ultra-short block variance for a small miner?

Remember the primary idea of the pool is to reduce the variance for a smaller miner
I've spent a lot of time pondering variance of pool payouts. I don't think I'm wrong. All my calculations work on the share level and I definitely did not disregard share granularity. I can bring out the heavy-duty math if you'd like, but the calculations involved are very easy to understand (if you know a bit about Poisson processes) yet very cumbersome to communicate, so I don't think this is worth the trouble.

Let's say a small miner mined for an hour and got 1 share. It doesn't matter if the pool got one block or two in that time, he still has 1 share in a single block. Since we know nothing else about this block, the amount of shares in it is distributed exponentially and the participant's payout will have a given mean and variance, which are the same in both scenarios.

If the miner has a significant portion of the pool it becomes more complicated, but it's complicated in the direction of further favoring larger pools.

For a proportional pool, in the limit where the miner has a negligible portion of the pool, his variance per share submitted is p^2(1-p+ln(p))/(p-1), and this is additive in the number of shares (p = 1/difficulty). It does not depend on any other factors. When the miner has a larger share of the pool his shares become correlated and his variance increases, so it's better to be in a larger pool.

Of course, it is my opinion that people should start using hopping-proof scoring methods instead of proportional (and I'll once again debunk the myth that they are in some ways disadvantageous for small miners).

1EofoZNBhWQ3kxfKnvWkhtMns4AivZArhr   |   Who am I?   |   bitcoin-otc WoT
Bitcoil - Exchange bitcoins for ILS (thread)   |   Israel Bitcoin community homepage (thread)
Analysis of Bitcoin Pooled Mining Reward Systems (thread, summary)  |   PureMining - Infinite-term, deterministic mining bond
marcus_of_augustus
Legendary
*
Offline Offline

Activity: 3920
Merit: 2347


Eadem mutata resurgo


View Profile
May 09, 2011, 11:04:52 AM
 #17


Okay, write it up (sounds like you've done it mostly anyway) and I'll take a look ... I'm interested how that works, if nothing else. Doesn't have to be flash, just the meat.

And your basic contention is that smaller miners are better off in bigger pools?

(This would be a big issue if the network is driven towards everybody mining for the same pool.)

[Tycho]
Hero Member
*****
Offline Offline

Activity: 742
Merit: 500



View Profile WWW
May 09, 2011, 11:14:49 AM
 #18

And your basic contention is that smaller miners are better off in bigger pools?
We are trying to say that those super-short blocks are harmless for slow miners.

The pool doesn't needs to be the only one.

Welcome to my bitcoin mining pool: https://deepbit.net - Both payment schemes (including PPS), instant payout, no invalid blocks !
ICBIT Trading platform : USD/BTC futures trading, Bitcoin difficulty futures (NEW!). Third year in bitcoin business.
Meni Rosenfeld
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1054



View Profile WWW
May 09, 2011, 11:58:09 AM
 #19

Okay, write it up (sounds like you've done it mostly anyway) and I'll take a look ... I'm interested how that works, if nothing else. Doesn't have to be flash, just the meat.

And your basic contention is that smaller miners are better off in bigger pools?
It's the other way around. For tiny miners it makes absolutely no difference what is the size of their pool. It's the bigger miners that are better off in a bigger pool.

Let's say a miner submits a share at a random point in time. Let A be the event the the share was submitted for a given round, and X the eventual number of shares in this round. Then $P(X=x) \propto p(1-p)^{x-1}$ (exponential distribution) and $P(A|X=x) \propto x$ (the more shares in a round, the higher its chance to include a given share). By Bayes' formula, $P(X=x|A) \propto P(X=x)P(A|X=x) = p(1-p)^{x-1}x$. Summing for x>=1 gives $P(X=x|A) = p^2(1-p)^{x-1}x$.
The payout received for this share, in units of block reward, is 1/x. So the expected payout is $\sum_{x=1}^{\infty}p^2(1-p)^{x-1}x/x=p$, as expected (pun unintended). The expectation of the squared payout is $\sum_{x=1}^{\infty}p^2(1-p)^{x-1}x/x^2=p^2\log p/(p-1)$, so the variance is $p^2(1-p+\log p)/(p-1)$.
As you can see, this does not depend on any additional factors such as the size of the pool. When several shares are submitted, if the miner is tiny then they will be uncorrelated and their variance is additive. As the pool becomes smaller the variance for the miner increases.

If you're not convinced this accurately models the situation (well, it doesn't, but it doesn't deviate in ways that are relevant for this discussion), you can write a simple computer simulation of the dynamics and see that the variance is smaller in a larger pool.


(This would be a big issue if the network is driven towards everybody mining for the same pool.)
It is. There are threads for discussing this problem.

1EofoZNBhWQ3kxfKnvWkhtMns4AivZArhr   |   Who am I?   |   bitcoin-otc WoT
Bitcoil - Exchange bitcoins for ILS (thread)   |   Israel Bitcoin community homepage (thread)
Analysis of Bitcoin Pooled Mining Reward Systems (thread, summary)  |   PureMining - Infinite-term, deterministic mining bond
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!