Title: Adi Shamir's paper on bitcoin Post by: auzaar on October 16, 2012, 06:30:53 PM Has this already been posted here?
http://eprint.iacr.org/2012/584.pdf Quote Abstract. The Bitcoin scheme is a rare example of a large scale global payment system in which all the transactions are publicly accessible (but in an anonymous way). We downloaded the full history of this scheme, and analyzed many statistical properties of its associated transaction graph. In this paper we answer for the rst time a variety of interesting questions about the typical behavior of account owners, how they acquire and how they spend their Bitcoins, the balance of Bitcoins they keep in their accounts, and how they move Bitcoins between their various accounts in order to better protect their privacy. In addition, we isolated all the large transactions in the system, and discovered that almost all of them are closely related to a single large transaction that took place in November 2010, even though the associated users apparently tried to hide this fact with many strange looking long chains and fork-merge structures in the transaction graph. Title: Re: Adi Shamir's paper on bitcoin Post by: davout on October 16, 2012, 06:44:45 PM Not on my watch
Title: Re: Adi Shamir's paper on bitcoin Post by: Atlas on October 16, 2012, 06:46:45 PM Sponsored by the Citi Foundation
Title: Re: Adi Shamir's paper on bitcoin Post by: auzaar on October 16, 2012, 06:49:42 PM Sponsored by the Citi Foundation I was about to paste that, "This research was supported by the Citi Foundation." so big guys are having a look at it Title: Re: Adi Shamir's paper on bitcoin Post by: stevegee58 on October 16, 2012, 06:54:59 PM Nonetheless it was an interesting read.
Title: Re: Adi Shamir's paper on bitcoin Post by: davidj411 on October 16, 2012, 06:59:51 PM you guys know who this is right? one of the founding fathers of modern day cryptography. case in point: RSA, the S stands for Shamir.
Who cares about the Citi Foundation link. On an unrelated note, I think its ironic that Citibank funded the Nazis and Shamir is Israeli. Title: Re: Adi Shamir's paper on bitcoin Post by: Raoul Duke on October 16, 2012, 07:01:17 PM Was I the only person to find odd that they would download/parse blockchain.info webpages instead of downloading the blockchain itself and working with it? lol
Title: Re: Adi Shamir's paper on bitcoin Post by: auzaar on October 16, 2012, 07:17:10 PM Was I the only person to find odd that they would download/parse blockchain.info webpages instead of downloading the blockchain itself and working with it? lol may be they found official client too cumbersome to use, scraping webpages is much easier :) Title: Re: Adi Shamir's paper on bitcoin Post by: Atlas on October 16, 2012, 07:20:26 PM Was I the only person to find odd that they would download/parse blockchain.info webpages instead of downloading the blockchain itself and working with it? lol may be they found official client too cumbersome to use, scraping webpages is much easier :) Title: Re: Adi Shamir's paper on bitcoin Post by: LightRider on October 16, 2012, 07:38:14 PM Quote Bitcoins are digital coins Wrong in the first sentence. Does not bode well. Title: Re: Adi Shamir's paper on bitcoin Post by: davout on October 16, 2012, 07:41:24 PM The figures about Instawallet do not seem correct, on May 13th there were 103,513 wallets having at least one incoming transaction, the paper mentions 23,649 different addresses (one wallet = one address on Instawallet).
Source : Code: SELECT COUNT(*) Title: Re: Adi Shamir's paper on bitcoin Post by: Roy Badami on October 16, 2012, 09:04:57 PM Having not read (and barely skimmed) the paper:
It does bother me that the paper does not contain the word 'change'. Any statistical analysis of bitcoin transactions that doesn't discuss the notion of change is likely to be flawed, since the ambiguity as to which output is the 'real' transfer and which is the change is one of the major ambiguities in the public blockchain. I'm prepared to consider the possibility that they understand the concepts but just not the terminology (and hence my naive search for the word 'change' failed to find their discussion of this). But I'd like to see some discussion as to whether the patterns they see in these apparently large transactions could adequately be explained simply by the normal mechanisms of change when spending large coins, and a quick skim doesn't find such a discussion. I worry that their finding of these chains that end up transfering coins back to the sender are just the normal process of sending change back to new addresses in the same wallet, only to be susequently combined again in a future transaction. Still, intersting to see Shamir as co-author on a paper. For him to get second billing, I imagine that probably means that the work was primarily done by a student of his who he supervised - but still. To know that bitcoin is on Adi Shamir's radar is certainly interesting. roy Title: Re: Adi Shamir's paper on bitcoin Post by: davout on October 16, 2012, 09:14:00 PM It does bother me that the paper does not contain the word 'change'. Any statistical analysis of bitcoin transactions that doesn't discuss the notion of change is likely to be flawed, since the ambiguity as to which output is the 'real' transfer and which is the change is one of the major ambiguities in the public blockchain. They accounted for it, not specifically as change but seeing those as loops to the same owner in the transactions graph.Title: Re: Adi Shamir's paper on bitcoin Post by: elux on October 16, 2012, 11:09:58 PM Interestingly: Today I saw Adi Shamir (you know, the S in RSA) and managed to talk with him a bit about Bitcoin. Title: Re: Adi Shamir's paper on bitcoin Post by: kaerf on October 16, 2012, 11:42:10 PM Quote Here is our first surprising discovery. The total number of BTC’s in the system is linear in the number of blocks. Each block is associated with the generation of 50 new BTC’s and thus there are 9,000,050 BTC’s in our graph of owners (generated from the 180,001 blocks between block number zero and block number 180,000). However, if we sum up the amounts accumulated at the 609,270 addresses which only receive and never send BTC’s, we see that their owners have actually put aside in some kind of “saving accounts” 7,019,100 BTC’s, which are almost 78% of all existing BTC’s. 59.7% of all the coins are “old coins” which were received more than three month before the cut off date (May 13th 2012), Quantitative Analysis of the Full Bitcoin Transaction Graph 7 and still had not triggered any outgoing transactions. This means that there are much fewer BTC’s in circulation than previously presumed. 7M unused coins...where are the hoarders at?! Title: Re: Adi Shamir's paper on bitcoin Post by: kwukduck on October 17, 2012, 12:54:32 AM I wouldn't be surprised if a big number of those were just gone because the user trashed his wallet or lost it in some other way, remember that btc weren't always worth 12 bucks....
my friends trashed a few thousand bitcoins too in the early days... Title: Re: Adi Shamir's paper on bitcoin Post by: bg002h on October 17, 2012, 02:08:00 AM What happened November 2010? Anyone remember?
When did Gavin present at the CIA? I had forgotten about Bitcoin between summer 2010 and the bubble... Addendum 4/27/2011 is when Gavin posted he would preset at the CIA. Title: Re: Adi Shamir's paper on bitcoin Post by: johnyj on October 17, 2012, 02:49:53 AM I suppose, in the early days, lot's of coins are lost due to their almost non-existent value, application uninstalled, hard drive erased, computer sold out, etc...
So the total amount of BTC in existing are much lower than advertised 21 million Title: Re: Adi Shamir's paper on bitcoin Post by: jgarzik on October 17, 2012, 01:46:48 PM At least one of this paper's fundamental assumptions is flawed. Posted this gist going into detail: Peer review of "Quantitative Analysis of the Full Bitcoin Transaction Graph" https://gist.github.com/3901921 (https://gist.github.com/3901921) Comments welcome. If there is further criticism that may be added to the gist, speak up. Title: Re: Adi Shamir's paper on bitcoin Post by: Jan on October 17, 2012, 01:54:01 PM Interesting read. Shamir is a BIG name in crypto world. Academia is really digging in now. Had to lol at the html scraping stuff though. I'll contact them to offer them my blockchain observer.
Title: Re: Adi Shamir's paper on bitcoin Post by: Akka on October 17, 2012, 02:01:15 PM Quote Here is our first surprising discovery. The total number of BTC’s in the system is linear in the number of blocks. Each block is associated with the generation of 50 new BTC’s and thus there are 9,000,050 BTC’s in our graph of owners (generated from the 180,001 blocks between block number zero and block number 180,000). However, if we sum up the amounts accumulated at the 609,270 addresses which only receive and never send BTC’s, we see that their owners have actually put aside in some kind of “saving accounts” 7,019,100 BTC’s, which are almost 78% of all existing BTC’s. 59.7% of all the coins are “old coins” which were received more than three month before the cut off date (May 13th 2012), Quantitative Analysis of the Full Bitcoin Transaction Graph 7 and still had not triggered any outgoing transactions. This means that there are much fewer BTC’s in circulation than previously presumed. 7M unused coins...where are the hoarders at?! Wow, 7M sitting there (OK maybe minus a few thousand lost coins) and waiting to crash the market. That makes me feel unwell. Also, this gives a new light to market capitalization so ca. 3M alive coins â 12$ --> 36M$. That's how tiny BTC still is. Title: Re: Adi Shamir's paper on bitcoin Post by: Raoul Duke on October 17, 2012, 02:02:33 PM Had to lol at the html scraping stuff though. At least I wasn't the only one. The replies I got when I talked about that a few posts back where just :-X Title: Re: Adi Shamir's paper on bitcoin Post by: hashman on October 17, 2012, 03:20:38 PM Quote Here is our first surprising discovery. The total number of BTC’s in the system is linear in the number of blocks. Each block is associated with the generation of 50 new BTC’s and thus there are 9,000,050 BTC’s in our graph of owners (generated from the 180,001 blocks between block number zero and block number 180,000). However, if we sum up the amounts accumulated at the 609,270 addresses which only receive and never send BTC’s, we see that their owners have actually put aside in some kind of “saving accounts” 7,019,100 BTC’s, which are almost 78% of all existing BTC’s. 59.7% of all the coins are “old coins” which were received more than three month before the cut off date (May 13th 2012), Quantitative Analysis of the Full Bitcoin Transaction Graph 7 and still had not triggered any outgoing transactions. This means that there are much fewer BTC’s in circulation than previously presumed. 7M unused coins...where are the hoarders at?! Wow, 7M sitting there (OK maybe minus a few thousand lost coins) and waiting to crash the market. That makes me feel unwell. Also, this gives a new light to market capitalization so ca. 3M alive coins â 12$ --> 36M$. That's how tiny BTC still is. Is this supposed to be news? If we all heeded Satoshi's idea to always use a new address, 100% of the bitcoins would be in "savings" or unused wallets. The fact that 22% of coins are sitting in addresses that have been used tells us what exactly? Even if the 78% is a valid estimate of the amount "put aside as savings", who cares? We all know speculation on future value is a primary driver of today's bitcoin value. Isn't one of the core functionalities of the systems as a store of value? The fact that people are using it as such, though not exactly proven by the analysis, is hardly a surpirse. Title: Re: Adi Shamir's paper on bitcoin Post by: Spekulatius on October 17, 2012, 03:50:35 PM Didnt read the paper,
But I wonder how they managed to determine the exact number of unique address owners: Quote They found there were about 3.12 million accounts, which are known as "addresses" in Bitcoin parlance. They belonged to about 1.5 different owners, on average, since there's no limit on how many addresses a single individual may possess. quoted from this ars technica article (http://arstechnica.com/tech-policy/2012/10/78-percent-of-bitcoin-currency-stashed-under-digital-mattress-study-finds/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+arstechnica%2Findex+%28Ars+Technica+-+All+content%29&utm_content=Google+Reader) because I have read many times over that it is very hard if not impossible to determine with high probability the addresses that belong to one single entity, unless one uses outside information like web wallet login data or statements from the alleged owners that they own this or that address. Title: Re: Adi Shamir's paper on bitcoin Post by: lile on October 17, 2012, 03:54:30 PM Didnt read the paper, But I wonder how they managed to determine the exact number of unique address owners: Quote They found there were about 3.12 million accounts, which are known as "addresses" in Bitcoin parlance. They belonged to about 1.5 different owners, on average, since there's no limit on how many addresses a single individual may possess. quoted from this ars technica article (http://arstechnica.com/tech-policy/2012/10/78-percent-of-bitcoin-currency-stashed-under-digital-mattress-study-finds/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+arstechnica%2Findex+%28Ars+Technica+-+All+content%29&utm_content=Google+Reader) because I have read many times over that it is very hard if not impossible to determine with high probability the addresses that belong to one single entity, unless one uses outside information like web wallet login data or statements from the alleged owners that they own this or that address. If coin X gets split to 100 different addresses, and then a high percentage of those eventually end up at address Y, there's a pretty high probability that the owner of address Y is the same as owner of address X. Title: Re: Adi Shamir's paper on bitcoin Post by: jgarzik on October 17, 2012, 03:59:56 PM But I wonder how they managed to determine the exact number of unique address owners: Read the gist link (above). Their paper includes assumptions about addresses that are obviously wrong: Quote A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses, as it is demanded by the Bitcoin system that "Whoever sent this transaction owns all of these addresses". This legal requirement is also technically ensured by the fact that each received amount must have a cryptographic digital signature that unlocks it from the prior transaction. Title: Re: Adi Shamir's paper on bitcoin Post by: niko on October 17, 2012, 04:15:32 PM Wow, 7M sitting there (OK maybe minus a few thousand lost coins) and waiting to crash the market. That makes me feel unwell. What makes you think these coins are "waiting to crash the market"? Perhaps it's simply savings? You can cash out savings without crashing the market - sell slowly in different markets, etc. Also, keep in mind that many early coins were lost. I mined a block in late 2010, and never bothered to save them when reformatting the hdd. It was all very new and very complicated, and simply not worth the effort. Also, this gives a new light to market capitalization so ca. 3M alive coins â 12$ --> 36M$. That's how tiny BTC still is. Title: Re: Adi Shamir's paper on bitcoin Post by: DublinBrian on October 17, 2012, 05:12:44 PM Wow, 7M sitting there (OK maybe minus a few thousand lost coins) and waiting to crash the market. That makes me feel unwell. When those 7 million BTC are spent, they will just as likely be spent on goods and services, as on USD exchanges.Theres no reason to believe these coins will be sold for fiat and "crash the market". Title: Re: Adi Shamir's paper on bitcoin Post by: sunnankar on October 17, 2012, 05:30:36 PM If coin X gets split to 100 different addresses, and then a high percentage of those eventually end up at address Y, there's a pretty high probability that the owner of address Y is the same as owner of address X. I do not accept the unreasoned legal conclusion that there are 'owners of addresses'. Please, show me some legal authority and then make the case for why there are 'owners of addresses'. You may want to follow this thread (https://bitcointalk.org/index.php?topic=115257.0) where I started stirring the pot on this legal issue with this question: Whether 'bitcoins', the unit of account in the open source software governed under the MIT license, constitute property? Title: Re: Adi Shamir's paper on bitcoin Post by: lile on October 17, 2012, 05:38:04 PM If coin X gets split to 100 different addresses, and then a high percentage of those eventually end up at address Y, there's a pretty high probability that the owner of address Y is the same as owner of address X. I do not accept the unreasoned legal conclusion that there are 'owners of addresses'. Please, show me some legal authority and then make the case for why there are 'owners of addresses'. You may want to follow this thread (https://bitcointalk.org/index.php?topic=115257.0) where I started stirring the pot on this legal issue with this question: Whether 'bitcoins', the unit of account in the open source software governed under the MIT license, constitute property? Fair enough, maybe it was poorly stated. I'll restate: If coin X gets split to 100 different addresses, and then a high percentage of those eventually end up at address Y, there's a pretty high probability that the person (or a group of people) knowing the private key to address Y is the same as the person (or a group of people) knowing the private key to address X. However, jgarzik made a good point, online wallets made this assumption incorrect. Title: Re: Adi Shamir's paper on bitcoin Post by: zby on October 17, 2012, 06:31:37 PM But I wonder how they managed to determine the exact number of unique address owners: Read the gist link (above). Their paper includes assumptions about addresses that are obviously wrong: Quote A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses, as it is demanded by the Bitcoin system that "Whoever sent this transaction owns all of these addresses". This legal requirement is also technically ensured by the fact that each received amount must have a cryptographic digital signature that unlocks it from the prior transaction. Care to explain? This is also how I think about the protocol - I am not sure if multi-sigs are switched on - but even if they have been recently these transactions would be easy to count and I am sure that they don't amount to much yet. If we set aside muti-sigs - then each transaction is broadcasted from a single computer and then it is verified that the broadcaster had all the private keys for all the input addresses - so the sender is always one 'program', it is possible that this program is controlled by a group of people - but then I would not expect that to be very common. Title: Re: Adi Shamir's paper on bitcoin Post by: kjj on October 17, 2012, 07:18:17 PM But I wonder how they managed to determine the exact number of unique address owners: Read the gist link (above). Their paper includes assumptions about addresses that are obviously wrong: Quote A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses, as it is demanded by the Bitcoin system that "Whoever sent this transaction owns all of these addresses". This legal requirement is also technically ensured by the fact that each received amount must have a cryptographic digital signature that unlocks it from the prior transaction. I would say that he is right for certain values of "all". If you pick a transaction at random from the chain, the odds are overwhelmingly high that a single owner controlled all of the input. Thus, he is "mostly right", and his conclusions are likely to be approximately correct. Fortunately, that will change over time as we develop easier ways to do multi-party inputs, and as web services with shared wallets become more common. I always try to discourage people from multiple wallet schemes because shared wallets obfuscate things in a good way. Consider the Model T, an early car. Conclusions drawn from study of that car are likely to be mostly right when most cars are like that, but they don't have to stay mostly right as cars diversify and grow ever more complex. Title: Re: Adi Shamir's paper on bitcoin Post by: mcdett on October 17, 2012, 07:46:47 PM Quote Here is our first surprising discovery. The total number of BTC’s in the system is linear in the number of blocks. Each block is associated with the generation of 50 new BTC’s and thus there are 9,000,050 BTC’s in our graph of owners (generated from the 180,001 blocks between block number zero and block number 180,000). However, if we sum up the amounts accumulated at the 609,270 addresses which only receive and never send BTC’s, we see that their owners have actually put aside in some kind of “saving accounts” 7,019,100 BTC’s, which are almost 78% of all existing BTC’s. 59.7% of all the coins are “old coins” which were received more than three month before the cut off date (May 13th 2012), Quantitative Analysis of the Full Bitcoin Transaction Graph 7 and still had not triggered any outgoing transactions. This means that there are much fewer BTC’s in circulation than previously presumed. 7M unused coins...where are the hoarders at?! Wow, 7M sitting there (OK maybe minus a few thousand lost coins) and waiting to crash the market. That makes me feel unwell. Also, this gives a new light to market capitalization so ca. 3M alive coins â 12$ --> 36M$. That's how tiny BTC still is. This goes way back to one of my root fears of bitcoin. That a very large amount of them are held by a very small group of people in a stationary state. This is not sour grapes in that I feel that I don't have enough and deserve more (I only deserve what I've worked for). ** START ASSUMPTION ** Assume: A very small group of people own almost 30% of all coins ever to be minted (almost 70% now) Assume: Bitcoin becomes very large (1 btc == 50k usd, puts total market value of btc at 1 trillion usd (change this number to whatever dreams you may have for btc in the future of human kind)) This is being beholden to an unknown entity that could wage massive war, change society (for better or worse) implement controls to limit peoples ability to access btc (destroy it after they run the show) aka access they value of peoples work output. This would probably be the largest concentration of wealth in the history of human kind. At least when the king has all the money we know how to keep him happy. When an anonymous group of people holds this, our futures are unknown. I don't like the unknown. I don't like that I don't know the intentions of the holders of the 7MM btc's are. Can anyone name for me a small group of people that controls the world economy? Do we like those names (if any)? Do we want to repeat that? Is there anything we can do about it... probably not. ** END ASSUMPTION ** Title: Re: Adi Shamir's paper on bitcoin Post by: Raoul Duke on October 17, 2012, 08:04:40 PM Most of those stationary bitcoins are on the hands of Artforz lol
Title: Re: Adi Shamir's paper on bitcoin Post by: Atlas on October 17, 2012, 08:13:03 PM Most of those stationary bitcoins are on the hands of Artforz lol 2027: Artforz is declared supreme ruler of Earth due to owning most of the world's wealth. Meanwhile, in London, the Rothschild family declares bankruptcy. Title: Re: Adi Shamir's paper on bitcoin Post by: jgarzik on October 17, 2012, 08:43:25 PM But I wonder how they managed to determine the exact number of unique address owners: Read the gist link (above). Their paper includes assumptions about addresses that are obviously wrong: Quote A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses, as it is demanded by the Bitcoin system that "Whoever sent this transaction owns all of these addresses". This legal requirement is also technically ensured by the fact that each received amount must have a cryptographic digital signature that unlocks it from the prior transaction. I would say that he is right for certain values of "all". If you pick a transaction at random from the chain, the odds are overwhelmingly high that a single owner controlled all of the input. Thus, he is "mostly right", and his conclusions are likely to be approximately correct. Not really. For shared wallet sites, the shared wallet site controlled all of the input, but wouldn't necessarily be the "owner" of those funds. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 17, 2012, 09:02:41 PM hmm, either Shamir has gotten "old and ignorant" (like Stallman?) or someone else did this "study" and he just put the name.
The conclustion of "72% hoarding" doesn't sound high to me. My personal "hoarding percentage" is even higher. On a side-note: I don't think it's likely that many coins got "lost" (as many seem to believe) at all. I'd be willing to bet it's <5% of all coins. Title: Re: Adi Shamir's paper on bitcoin Post by: mcdett on October 17, 2012, 09:10:04 PM When those 7 million BTC are spent, they will just as likely be spent on goods and services, as on USD exchanges. Theres no reason to believe these coins will be sold for fiat and "crash the market". There's no proof that they'll be used for goods and services. When one person (small cabal of people) owns 30% of the worlds wealth, it is more powerful to yield that wealth in modifying society for your whims then it is to use it on goods and services. If you look at the major finical players (soros, buffett, gross, etc (they combined control less then 1% of the economy)) they operate on another level. They are found influencing government to enhance they're financial power (look at soros's hand in the eu). They don't make stock bets, they make phone calls to presidents and talk policy. They don't spend their wealth on goods and services (that won't grow their power/influence) they use their wealth to modify political structures which change society in making themselves largess. When you own 30% you are THE political structure. My simple fear is that I spend all of this time helping build btc out (on the bet my btc will be worth more), and it ends up being that the holders of the 30% are some quasi napoleonic dictators who think the world is best when they sit on top of it.... dictating it. People would say, "why the f weren't you concerned about this lopsided wealth holding on something you were betting on, it was so obvious." Title: Re: Adi Shamir's paper on bitcoin Post by: benjamindees on October 17, 2012, 09:15:59 PM What happened November 2010? Anyone remember? It seems the first Slashdot story was in July '10. But I seem to recall one in October or November as well. http://news.slashdot.org/story/10/07/11/1747245/Bitcoin-Releases-Version-03 Title: Re: Adi Shamir's paper on bitcoin Post by: repentance on October 17, 2012, 09:19:39 PM People would say, "why the f weren't you concerned about this lopsided wealth holding on something you were betting on, it was so obvious." Of course people are going to say that. Why on earth would you think that a Bitcoin economy would be any different than a conventional economy in terms of wealth disparity? Hell, you see people begging for the same kind of financial markets and products which lead to recessions in the real world and somehow expecting a different result. People think that because they got in on the ground floor they are going to be part of the 1% (or 30%). They seem to forget that everyone else is also trying to be part of the 1%, too. Title: Re: Adi Shamir's paper on bitcoin Post by: mcdett on October 17, 2012, 09:29:29 PM Why on earth would you think that a Bitcoin economy would be any different than a conventional economy in terms of wealth disparity? Show me 1 (just one) modern, free economy in which .001% [1] of the people own 70% [2] of the wealth. Just one. Otherwise you're not thinking this through. [1] assume cabal is 10 people and this number should reflect the percentage of those people against the number of people using btc today, so I may not have this number right, and someone can correct me [2] 10MM btc in circualtion today 7MM is 70% of that Title: Re: Adi Shamir's paper on bitcoin Post by: Akka on October 17, 2012, 09:34:49 PM And here come the news:
http://arstechnica.com/tech-policy/2012/10/78-percent-of-bitcoin-currency-stashed-under-digital-mattress-study-finds/ Title: Re: Adi Shamir's paper on bitcoin Post by: cypherdoc on October 17, 2012, 09:39:13 PM Why on earth would you think that a Bitcoin economy would be any different than a conventional economy in terms of wealth disparity? Show me 1 (just one) modern, free economy in which .001% [1] of the people own 70% [2] of the wealth. Just one. Otherwise you're not thinking this through. [1] assume cabal is 10 people and this number should reflect the percentage of those people against the number of people using btc today, so I may not have this number right, and someone can correct me [2] 10MM btc in circualtion today 7MM is 70% of that lets say you're right and that .001% [1] of the people own 70% [2] of the wealth. why do you assume, quite unnaturally, that they will hold those coins as the price level rises to your target? as the price rises, these ppl will naturally start to sell at differing points on the way up until the "fair" price of Bitcoin is reached (whatever that is). at that point the vast # of Bitcoins in circulation will be much more equally distributed and it will act more as a currency than as a store of wealth. Title: Re: Adi Shamir's paper on bitcoin Post by: FreshJR on October 17, 2012, 09:47:20 PM Man, my laundering strategy in on there. :'(
That's crazy on how they analyzed all that data. My bet is that they had a program to parse it. Title: Re: Adi Shamir's paper on bitcoin Post by: repentance on October 17, 2012, 09:54:31 PM Why on earth would you think that a Bitcoin economy would be any different than a conventional economy in terms of wealth disparity? Show me 1 (just one) modern, free economy in which .001% [1] of the people own 70% [2] of the wealth. Just one. Otherwise you're not thinking this through. [1] assume cabal is 10 people and this number should reflect the percentage of those people against the number of people using btc today, so I may not have this number right, and someone can correct me [2] 10MM btc in circualtion today 7MM is 70% of that mcdett's assertion was that 30% of people controlling 70% of wealth is somehow unheard of. In the US alone, 20% of people control 80% - 90% of the wealth (95% if you exclude home ownership and calculate only financial wealth). Title: Re: Adi Shamir's paper on bitcoin Post by: Raize on October 17, 2012, 10:01:26 PM Was I the only person to find odd that they would download/parse blockchain.info webpages instead of downloading the blockchain itself and working with it? lol No, this is/was bizarre. I think one of the previous research papers even published a modified version of Gavin's code to do a full extract, not to mention there are open source tools for this now already. Maybe they didn't have time to download the Blockchain or didn't want to risk actually using the client for some reason. Title: Re: Adi Shamir's paper on bitcoin Post by: Benatar on October 17, 2012, 11:01:02 PM The hoarders are the true heroes of bitcoin who will save btc from the horrors of deflation once the 21million coin limit is reached by slowly adding their hoarded coins into the economy. That or people who will break it even more by taking advantage of the horrors of deflation.
Title: Re: Adi Shamir's paper on bitcoin Post by: Phinnaeus Gage on October 17, 2012, 11:56:24 PM Quote Department of Computer Science and Applied Mathematics, The Weizmann Institute of Science, Israel {dorit.ron,adi.shamir}@weizmann.ac.il Nary a word: http://www.weizmann.ac.il/pages/searching/weizmann_web?search=bitcoin#bitcoin FYI: Dorit Ron is a woman. ~Bruno K~ Title: Re: Adi Shamir's paper on bitcoin Post by: mcdett on October 18, 2012, 12:20:00 AM mcdett's assertion was that 30% of people controlling 70% of wealth is somehow unheard of. In the US alone, 20% of people control 80% - 90% of the wealth (95% if you exclude home ownership and calculate only financial wealth). My assertion (assumption) embodied a lot of unlikely (but not out of the realm of belief/dreams of this community). When we reach 21mm btc they will own about 30% <-- that's where 30% comes from. Today they own 70% Don't put words in my mouth or twist my statements. The future assumptions also envisioned mass adoption (market caps over 1 trillion). If that sort of adoption occurs then the scales of economic distortions shift even more radically. I'm not talking about some socialist scheme to level the playing field, I'm talking about a small group that can control virtually everything about btc, and we don't know who they are or what they want. Title: Re: Adi Shamir's paper on bitcoin Post by: DoomDumas on October 18, 2012, 02:07:12 AM 21MM BTC is in 2140 ! Im I wrong ?
My guess, 10 to 20 % of all mined BTC to date are deleted, no more exist. That leaves 50% hoarding.. IMO, 50% hoarded coin is high estimate.. I dont like this study, from CITI, by someone notarious.. It seems the begining of an operation to discredit/debunk/denigrate BTC in the eyes of the mass.. They could use this study to pretend a lot of false fact to the mass, pretend it's only a tool for criminal activity, money laudering, terr0r1st financing... then vote BTC illicit, take aggressive illigitimate action.. justifiyed and accepted by the mass who listen to the news from TVs... this could lead to destroying any chance for the BTC to become widely used by the mass ! This puke to me ! Still an interesting analysis of the data ! I dont trust CITI, I'm worried of what they meant to do with this in the future ! Title: Re: Adi Shamir's paper on bitcoin Post by: kjj on October 18, 2012, 04:34:22 AM Why on earth would you think that a Bitcoin economy would be any different than a conventional economy in terms of wealth disparity? Show me 1 (just one) modern, free economy in which .001% [1] of the people own 70% [2] of the wealth. Just one. Otherwise you're not thinking this through. [1] assume cabal is 10 people and this number should reflect the percentage of those people against the number of people using btc today, so I may not have this number right, and someone can correct me [2] 10MM btc in circualtion today 7MM is 70% of that Money is not wealth. Money is what you use to buy wealth. (For simplicity, I'm including bitcoin as a subtype of money.) Title: Re: Adi Shamir's paper on bitcoin Post by: squid on October 18, 2012, 04:38:26 AM I will be keeping an eye on this thread ^^
Title: Re: Adi Shamir's paper on bitcoin Post by: sunnankar on October 18, 2012, 05:02:39 AM I'm talking about a small group that can control virtually everything about btc, and we don't know who they are or what they want. Are you presuming that such totalitarian dystopia does not already exist? If you look at the philosophy of liberty (http://www.youtube.com/watch?v=muHg86Mys7I) there are three time phases of past, present and future then there are three distinct classes for protecting that liberty, property, present liberty and life. This is why theft, slavery and murder are generally considered morally wrong; they infringe or eliminate freedom in one of these three time phases. If anything BTC democratizes wealth because it is sound by being both defined and limited in amount. This stands as a protector of property rights by preventing confiscation through inflation which is a form of taxation without representation. Given that the nation state can (1) infringe property rights easily with confiscation through inflation (http://www.usagold.com/gildedopinion/greenspan.html), (2) indefinite detention under the NDAA (http://www.youtube.com/watch?v=m5-3q7MjuM0) and (3) assassinate innocent children (http://www.guardian.co.uk/commentisfree/cifamerica/2011/nov/07/cia-unaccountable-drone-war) without even charging them with a crime therefore it seems like the dytopian situation you described already exists and is funded with the current monetary system. Title: Re: Adi Shamir's paper on bitcoin Post by: Boussac on October 18, 2012, 07:01:27 AM I'm talking about a small group that can control virtually everything about btc, and we don't know who they are or what they want. As pointed out by Davout, the paper assumes shared wallets like mt gox are ONE owner of a lot of addresses. This logic is flawed. Also, I do not understand how they sorted out change versus payout in the transactions. Therefore the conclusions are at best dubious, unsurprisingly for a bank-sponsored study (City, the largest bank in the world, is the sponsor through the Citi foundation). The more obvious, unquestionnable reality is in the difficulty chart: in the first two years, only a small group of miners mined the first 2.5 million coins. After that, the difficuty has skyrocketed in a way that can only be explained by a lot of miners joining the fray (not simply early adopters adding GPUs). Some of the early coins were lost but its fair to say that probably 2 million were in the hands of early adopters. In the end, it's a one time advantage over about 10% of the money supply, gradually vanishing with each sell out, nothing to worry about. Title: Re: Adi Shamir's paper on bitcoin Post by: julz on October 18, 2012, 07:11:59 AM As pointed out by Davout, the paper assumes shared wallets like mt gox are ONE owner of a lot of addresses. This logic is flawed. Also - it seems a bit strange to count the 2Million+ sub 0.01 balance wallets as the poor end of some sort of wealth pyramid. Many of these are surely people who just tried it out, e.g by getting some from a freebie site. They may or may not even have kept that wallet, let alone become engaged as an active Bitcoin user. Title: Re: Adi Shamir's paper on bitcoin Post by: jgarzik on October 18, 2012, 07:38:58 AM As pointed out by Davout, the paper assumes shared wallets like mt gox are ONE owner of a lot of addresses. This logic is flawed. Also - it seems a bit strange to count the 2Million+ sub 0.01 balance wallets as the poor end of some sort of wealth pyramid. Many of these are surely people who just tried it out, e.g by getting some from a freebie site. They may or may not even have kept that wallet, let alone become engaged as an active Bitcoin user. Some of those might be miners, collecting a lot of little bits of change. Title: Re: Adi Shamir's paper on bitcoin Post by: davout on October 18, 2012, 07:59:24 AM Emailed them, got a nice response :
Quote Subject: A couple comments on "Quantitative Analysis of the Full Bitcoin Transaction Graph" Dear sirs, I've read your paper "Quantitative Analysis of the Full Bitcoin Transaction Graph" with great interest. I am however quite surprised about the assumptions you make in order to analyze the collected Bitcoin network data and the conclusions that you draw from there. Transactions can be trivially constructed from different senders, without sharing private keys. This makes your assumption of transaction construction legality wrong. Secondly you completely discard the impact of shared wallets on the way ownership can be followed through the blockchain. Even though you might, at the macroscopic level, follow some large chunks of coins, you do not account for the fact that shared wallets completely break the chain of ownership by sending out different coins than the ones that came in. I have access to the production database of Instawallet so I took on myself to check some of your conclusions in page 10. At the date of your extraction, Instawallet received Bitcoins on 103,513 different addresses (your paper mentions approximately 23,000). You may also be interested in this document put online by Gregory Maxwell : https://en.bitcoin.it/wiki/Real_peer_review#Linking_transactions_to_identify_ownership I think I can speak for the whole Bitcoin community when I thank you for your work. Don't hesitate to contact me if you wish to further discuss this, you may also want to connect to the #bitcoin-dev IRC channel on Freenode. Best regards, David FRANCOIS And their response : Quote Dear David, We would like to thank you for your comments. The main point you raised is that one cannot claim that different addresses participating as senders in the same transactions belong to the same owner. Our response consists of several observations: 1. We quoted from an official policy statement that this should be the case when transactions have multiple sending addresses. 2. We noted that knowledge of multiple private keys is required in this case, and while it is always possible that different owners will share their private keys, this is not likely to happen very often. 3. All the previous papers on issues of privacy in the bitcoin system which we quote in the bibliography make the same assumption, so this is not something that we invented. 4. The fact that some C++ code do not enforce this requirement is not a proof that this is not true in the vast majority of cases. 5. Most of our results are statistical in nature, and are not affected by a small number of exceptions. We are much more likely to underestimate the number of addresses which should be merged together (because we never saw those addresses in the same transactions) than to overestimate them because a few transactions had multiple owners as senders. You just demonstrated that our analysis indeed underestimated the number of addresses in which Instawallet received Bitcoins. We simply saw no evidence in the data suggesting that we should link the 103,513 different addresses you mentioned, so we gave the number of about 23,000 as a lower bound, not the real number which we had no way of knowing. 6. In particular, it is not clear why the issue of dormant coins would be affected by this issue. For example, we are counting how many old coins were sent to an owner who did not initiate any outgoing transactions for three months. If we mistakenly add more addresses to that owner, we make it harder (and not easier) to satisfy this constraint, so we are underestimating the number of dormant coins. 7. Similarly, we do not understand why it would matter to mistakenly combine addresses in all our graphs. It's effect would be to make the graph look more reasonable, since it is easier to explain why someone would send bitcoinshamir to itself rather than send bitcoinshamir to many unrelated addresses only in order to receive them back at the end. 8. Finally, while one can be over cautious and never try to combine any addresses under any circumstances, this will give a greatly distorted picture about how many coins are kept and spent by owners. We believe that our methodology, which is clearly explained in the paper, gives a much better statistical picture even if a tiny number of decisions to unify addresses turn out to be incorrect. We hope that this answer will clarify the situation. Yours, Adi Shamir and Dorit Ron Title: Re: Adi Shamir's paper on bitcoin Post by: marcus_of_augustus on October 18, 2012, 09:04:33 AM Can't wait until they do the follow-up study on the Namecoin blockchain. Things must be real slow out there ....
Title: Re: Adi Shamir's paper on bitcoin Post by: greyhawk on October 18, 2012, 10:17:57 AM Quote [...]it is easier to explain why someone would send bitcoinshamir to itself rather than send bitcoinshamir to many unrelated addresses [...] What the hell? Title: Re: Adi Shamir's paper on bitcoin Post by: Bitinvestor on October 18, 2012, 11:44:26 AM Quote [...]it is easier to explain why someone would send bitcoinshamir to itself rather than send bitcoinshamir to many unrelated addresses [...] What the hell? Relax, it's probably just another autocorrect failure. http://www.autocorrectfail.org/ Title: Re: Adi Shamir's paper on bitcoin Post by: greyhawk on October 18, 2012, 12:00:37 PM Quote [...]it is easier to explain why someone would send bitcoinshamir to itself rather than send bitcoinshamir to many unrelated addresses [...] What the hell? Relax, it's probably just another autocorrect failure. http://www.autocorrectfail.org/ Hmmmmm, so we have his username. Now to find his password. ITT: Trying to crack the user account of the father of cryptography. Muahahahaha! Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 18, 2012, 01:00:46 PM Quote [...]it is easier to explain why someone would send bitcoinshamir to itself rather than send bitcoinshamir to many unrelated addresses [...] What the hell? Relax, it's probably just another autocorrect failure. http://www.autocorrectfail.org/ Hmmmmm, so we have his username. Now to find his password. ITT: Trying to crack the user account of the father of cryptography. Muahahahaha! lol! Probably "RSA123" Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 18, 2012, 01:31:45 PM Quote [...]it is easier to explain why someone would send bitcoinshamir to itself rather than send bitcoinshamir to many unrelated addresses [...] http://www.autocorrectfail.org/ ITT: Trying to crack the user account of the father of cryptography. Muahahahaha! Title: Re: Adi Shamir's paper on bitcoin Post by: Raoul Duke on October 18, 2012, 02:08:00 PM The biggest flaw on the paper is the webscraping of blockchain data.
Right there they destroyed any assurance they could have of working with validated data. How do they know they were fed the correct data by blockchain.info or blockexplorer.com? The only way to be sure you have the correct blockchain data is to let your bitcoin client download it from the network and verify it. You may also download a blockchain snapshot, but you still need to let the client verify it to be sure what you have is real data and not some decoy. Title: Re: Adi Shamir's paper on bitcoin Post by: Steve on October 18, 2012, 03:43:32 PM But I wonder how they managed to determine the exact number of unique address owners: Read the gist link (above). Their paper includes assumptions about addresses that are obviously wrong: Quote A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses, as it is demanded by the Bitcoin system that "Whoever sent this transaction owns all of these addresses". This legal requirement is also technically ensured by the fact that each received amount must have a cryptographic digital signature that unlocks it from the prior transaction. Nonetheless, clients that have an automatic mixing that is enabled by default would be very desirable. If the vast majority of clients operate in the standard way, the small amount that don't is negligible for the purpose of reverse engineering someone's economic activity. It would be hard to imagine a company finding it acceptable that their competitors can get a fairly good picture of their activity so easily. Title: Re: Adi Shamir's paper on bitcoin Post by: Raoul Duke on October 18, 2012, 03:53:19 PM But I wonder how they managed to determine the exact number of unique address owners: Read the gist link (above). Their paper includes assumptions about addresses that are obviously wrong: Quote A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses, as it is demanded by the Bitcoin system that "Whoever sent this transaction owns all of these addresses". This legal requirement is also technically ensured by the fact that each received amount must have a cryptographic digital signature that unlocks it from the prior transaction. Nonetheless, clients that have an automatic mixing that is enabled by default would be very desirable. If the vast majority of clients operate in the standard way, the small amount that don't is negligible for the purpose of reverse engineering someone's economic activity. It would be hard to imagine a company finding it acceptable that their competitors can get a fairly good picture of their activity so easily. You mean, like when their payment processor sends out a press-release and makes countless forum posts saying how much money was processed for a given merchant? It didn't seem to be a problem when Bitpay did it. lol Title: Re: Adi Shamir's paper on bitcoin Post by: hathmill on October 18, 2012, 05:11:03 PM When those 7 million BTC are spent, they will just as likely be spent on goods and services, as on USD exchanges. Theres no reason to believe these coins will be sold for fiat and "crash the market". There's no proof that they'll be used for goods and services. When one person (small cabal of people) owns 30% of the worlds wealth, it is more powerful to yield that wealth in modifying society for your whims then it is to use it on goods and services. If you look at the major finical players (soros, buffett, gross, etc (they combined control less then 1% of the economy)) they operate on another level. They are found influencing government to enhance they're financial power (look at soros's hand in the eu). They don't make stock bets, they make phone calls to presidents and talk policy. They don't spend their wealth on goods and services (that won't grow their power/influence) they use their wealth to modify political structures which change society in making themselves largess. When you own 30% you are THE political structure. My simple fear is that I spend all of this time helping build btc out (on the bet my btc will be worth more), and it ends up being that the holders of the 30% are some quasi napoleonic dictators who think the world is best when they sit on top of it.... dictating it. People would say, "why the f weren't you concerned about this lopsided wealth holding on something you were betting on, it was so obvious." Nicely put, I agree with everything you wrote. Also, when thinking about the owners of those botnets you read about, the thieves and the ponzi stuff that goes own, it makes me wonder what kinf of persons our new world masters will be. Title: Re: Adi Shamir's paper on bitcoin Post by: stochastic on October 18, 2012, 05:11:17 PM What journal was this paper published?
Title: Re: Adi Shamir's paper on bitcoin Post by: greyhawk on October 18, 2012, 06:18:50 PM What journal was this paper published? No journal per se. It's an IACR eprint as of now. So no peer-review yet. Title: Re: Adi Shamir's paper on bitcoin Post by: evoorhees on October 18, 2012, 06:35:20 PM Been following this paper and the press resulting from it with interest...
And yet, am I incorrect in thinking the central thrust of the study is incorrect for the simple fact that most change goes to new addresses which are, by definition, unspent? This means that at any time, most coins will sit in "unspent" accounts, thereby appearing as though they are savings, when in reality they are just sitting there until they are spent normally. Am I missing something or is this an absurd fatal flaw in their reasoning? Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 18, 2012, 06:49:07 PM Been following this paper and the press resulting from it with interest... I believe you are correct, but I don't think it matters much. They say 60% of coins haven't moved in 3 months; those can safely be considered some kind of savings. So the actual amount of savings would be somewhere between 60% and 78%.And yet, am I incorrect in thinking the central thrust of the study is incorrect for the simple fact that most change goes to new addresses which are, by definition, unspent? This means that at any time, most coins will sit in "unspent" accounts, thereby appearing as though they are savings, when in reality they are just sitting there until they are spent normally. Am I missing something or is this an absurd fatal flaw in their reasoning? FWIW, I contacted them saying this (trimming opening and closing words): Quote 1. The paper does not mention the concept of "change" (https://en.bitcoin.it/wiki/Change), and some of the comments imply the authors do not recognize its role in the transaction graph. When outputs are spent in a transaction they must be spent entirely; if there is more value in the output than the amount one wishes to send, if he wants to keep the rest he must send it to an address of his, known as a change address. The widely used clients use a newly generated address for change as an anonymity feature; but for the typical user it is not a deliberate attempt to do anything, it is just what happens by default. This clearly explains the "long chains" behavior. 2. The paper seems to conflate the blockchain, a database replicated on every node on the network by broadcasting blocks to peers on the network, and individual efforts to make the data easily accessible, such as blockexplorer.com and blockchain.info. The blockchain itself does not of course have HTML pages or what can be considered "hyperlinks". It may be the case that scraping those public service sites is easier than parsing the arcane database format of the blockchain, but this needs to be specified explicitly, otherwise the focus on HTML looks bizarre. 3. It is generally accepted that currency amounts in Bitcoin aren't capitalized, just like "dollar" isn't. The creator of Bitcoin is Satoshi, but the smallest Bitcoin denomination is a satoshi; I can have bitcoins or send 3.7 bitcoins, and the value of a bitcoin is $12; this happens in the Bitcoin system following the Bitcoin protocol with Bitcoin software, and Bitcoin is invaluable. This mistake occurs several times in the paper. 4. You state that 7M bitcoins are in savings account, but it is not completely clear what you characterize as such. It looks like an address which has never sent coins is considered savings; that is a poor characterization, for if everyone follows the guideline of not reusing addresses, 100% of coins at all times will be in address which have never sent, regardless of how widely bitcoins are circulated. A better candidate would be an address which has never sent and has received some coins as early as, say, 2 months ago. 5. The infamous statement that "A very important feature of the Bitcoin network is that a transaction involving multiple sending addresses can only be carried out by the common owner of all those addresses". a. You mention quoting an official policy to that effect. I would like to ask for a reference, as I know of no such policy and cannot imagine one. b. Technically, for an input to be valid its script needs to be satisfied, usually by providing a signature for the transaction which matches the public key referenced by the input. Regardless of any current implementation details, the signatures can be independent, there is no need for the owners to be one or to share their keys. c. The Bitcoin protocol supports more than just "moving coins from point A to point B" transactions. A glimpse of some of the potential applications can be seen at https://en.bitcoin.it/wiki/Contracts. Some of them crucially rely on this ability to have multiple owners constructing a transaction together. In this sense, it actually is a very important feature of the Bitcoin network that multiple inputs do not need to share an owner. d. In fact, one such application is p2p mixing, of the kind I discussed at https://bitcointalk.org/index.php?topic=54266.0. These intentionally make it harder to use the transaction graph to deanonymize users. e. In practice, most transactions on the network are simple transactions where multiple outputs of the same owner are merged, and advanced applications are not in wide use (if at all). Deducing that co-used addresses have a mutual owner is a reasonable assumption to make; but it is an assumption, it needs to be specified explicitly, and references to it being necessitated should be removed. Furthermore, this assumption - and any analysis dependent on it - will become increasingly less reasonable as advanced application find wider use. Title: Re: Adi Shamir's paper on bitcoin Post by: jbreher on October 18, 2012, 06:52:30 PM Emailed them, got a nice response : Quote 1. We quoted from an official policy statement that this should be the case when transactions have multiple sending addresses. Adi Shamir and Dorit Ron Official policy statement? Whose statement, of what policy, and what makes it official? Title: Re: Adi Shamir's paper on bitcoin Post by: Raoul Duke on October 18, 2012, 06:55:37 PM Emailed them, got a nice response : Quote 1. We quoted from an official policy statement that this should be the case when transactions have multiple sending addresses. Adi Shamir and Dorit Ron Official policy statement? Whose statement, of what policy, and what makes it official? The Bitcoin Foundation? ;D Title: Re: Adi Shamir's paper on bitcoin Post by: Steve on October 18, 2012, 06:56:45 PM Been following this paper and the press resulting from it with interest... I believe you are correct, but I don't think it matters much. They say 60% of coins haven't moved in 3 months; those can safely be considered some kind of savings. So the actual amount of savings would be somewhere between 60% and 78%.And yet, am I incorrect in thinking the central thrust of the study is incorrect for the simple fact that most change goes to new addresses which are, by definition, unspent? This means that at any time, most coins will sit in "unspent" accounts, thereby appearing as though they are savings, when in reality they are just sitting there until they are spent normally. Am I missing something or is this an absurd fatal flaw in their reasoning? Title: Re: Adi Shamir's paper on bitcoin Post by: evoorhees on October 18, 2012, 07:02:16 PM Since when did "not spending all of one's income" change from the noble and encouraged act of "saving" into the ignoble and condemned act of "hoarding"? It seems thrift is not only absent in modern society, but actively frowned upon. ??? Title: Re: Adi Shamir's paper on bitcoin Post by: jgarzik on October 18, 2012, 07:09:38 PM Been following this paper and the press resulting from it with interest... I believe you are correct, but I don't think it matters much. They say 60% of coins haven't moved in 3 months; those can safely be considered some kind of savings. So the actual amount of savings would be somewhere between 60% and 78%.And yet, am I incorrect in thinking the central thrust of the study is incorrect for the simple fact that most change goes to new addresses which are, by definition, unspent? This means that at any time, most coins will sit in "unspent" accounts, thereby appearing as though they are savings, when in reality they are just sitting there until they are spent normally. Am I missing something or is this an absurd fatal flaw in their reasoning? FWIW, I contacted them saying this (trimming opening and closing words): Nice letter! I think the issue of change and the issue of shared coin pools (web wallets) impact their fundamental analysis. The rest of the stuff they got wrong is laughable but probably statistically insignificant. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 18, 2012, 07:11:49 PM FWIW, I contacted them saying this (trimming opening and closing words): Meni, thanks for pointing the authors to the problems with the paper in such a friendly and concise manner. I hope (and it seems this might be true) they are open to this kind of criticism. Please keep us informed about any replies you might receive if possible. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 18, 2012, 07:13:15 PM Since when did "not spending all of one's income" change from the noble and encouraged act of "saving" into the ignoble and condemned act of "hoarding"? It seems thrift is not only absent in modern society, but actively frowned upon. ??? I've been having the same thought. I think usually "saving" implies the capital is being made available for investment, while "hoarding" doesn't? Title: Re: Adi Shamir's paper on bitcoin Post by: Benatar on October 19, 2012, 07:11:03 AM Since when did "not spending all of one's income" change from the noble and encouraged act of "saving" into the ignoble and condemned act of "hoarding"? It seems thrift is not only absent in modern society, but actively frowned upon. ??? I've been having the same thought. I think usually "saving" implies the capital is being made available for investment, while "hoarding" doesn't? Yeah, it's this. Saving the money with banks that make loans to businesses/other people or investing directly with businesses keeps the money in circulation, with every time it exchanges hands generally being an instance of goods created or services rendered. Title: Re: Adi Shamir's paper on bitcoin Post by: niko on October 19, 2012, 08:39:07 AM Quote It has just been discovered that research causes cancer in rats. Title: Re: Adi Shamir's paper on bitcoin Post by: pyra-proxy on October 19, 2012, 09:10:37 AM Since when did "not spending all of one's income" change from the noble and encouraged act of "saving" into the ignoble and condemned act of "hoarding"? It seems thrift is not only absent in modern society, but actively frowned upon. ??? I've been having the same thought. I think usually "saving" implies the capital is being made available for investment, while "hoarding" doesn't? Yeah, it's this. Saving the money with banks that make loans to businesses/other people or investing directly with businesses keeps the money in circulation, with every time it exchanges hands generally being an instance of goods created or services rendered. Personal opinion, I think others share is that: Hoarding is the act of storing something merely for the purposes that it will be increasing in value by just sitting there idle, and typically in absurdly large quantities. Saving is the act of storing something for the expected use when you need it, not due to the expectation it will be more valuable necessarily when the savings are used, and typically are in quantities reasonable for planned future activities/needs. i.e. "I am going to hoard all of my bitcoins now because in 20 years they'll be worth $20 million each" vs. "I am going to save X bitcoins so that I can pay my rent for 6 months in case I loose my job" It's all in attitude and purpose I believe. Title: Re: Adi Shamir's paper on bitcoin Post by: davout on October 19, 2012, 10:02:00 AM Dorit Ron and Adi Shamir have already answered.
See previous posts. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 19, 2012, 12:23:36 PM Dorit Ron and Adi Shamir have already answered. See previous posts. yes, I know, here your post for reference: https://bitcointalk.org/index.php?topic=118797.msg1280496#msg1280496 Menis email contains some questions/angles not contained in yours, though, and frankly, I didn't find their answers to yours quite satisfying. I have to agree that "statistically", the assumption that all inputs of a transaction have the same owner, is probably mostly true in the wild, but Menis objection that it should be made clear (or quantified in some way) in the paper that this is not a fact but an assumption. Simply citing "an official policy statement" with no reference and then use it as a fact does not suit such a paper well. Title: Re: Adi Shamir's paper on bitcoin Post by: gmaxwell on October 19, 2012, 01:30:44 PM Simply citing "an official policy statement" with no reference and then use it as a fact does not suit such a paper well. They don't cite anything in the paper for that, what they did is repeat the hover-over description text for the address column on blockexplorer word for word without providing any attribution, citations, or even indicating that it was a quotation— they repeated it as though it were their own words. By the bizarre academic standards this is plagiarism, though not especially severe. Whats worse is that it's wrong and that most people would instantly recognize that pop up help is not likely to be the most thoroughly complete information but since they've manage to obscure the source it's now going to be repeated as fact. Their belief that the help text on block explorer was official policy is consistent with the general confusion they seemed to exhibit that webpages people have created about bitcoin _were_ bitcoin.And sure, multi-controler transactions are probably not very common, but mistake on that fact alone makes the paper a poor citation for future reference— and it combined with the myriad more obvious though less harmful obvious-to-all-of-us embarrassing mistakes shows that they were generally clueless about the subject and that the peer review system is _not_ working. In terms of the actual results the apparent misunderstandings about address generation, coin selection, and change (that when bitcoin is use correctly as described in the original paper _all_ bitcoin are going into 'savings accounts' at all times) and the confusion relative to control and ownership (That million BTC volume on MTGOX in the last month would mostly be 'unused'/'horded' coin) are probably bigger issues, but they're harder to reason about because the data for the real answers people want don't actually exist. Perhaps 3/4 of the coins are actually horded. It's not the the paper's conclusions are wrong on that point as they are wrong on the operation of the system— its that no one, including the authors, knows— as the methods used don't actually show what they claim they do. Title: Re: Adi Shamir's paper on bitcoin Post by: Benatar on October 19, 2012, 08:24:41 PM Since when did "not spending all of one's income" change from the noble and encouraged act of "saving" into the ignoble and condemned act of "hoarding"? It seems thrift is not only absent in modern society, but actively frowned upon. ??? I've been having the same thought. I think usually "saving" implies the capital is being made available for investment, while "hoarding" doesn't? Yeah, it's this. Saving the money with banks that make loans to businesses/other people or investing directly with businesses keeps the money in circulation, with every time it exchanges hands generally being an instance of goods created or services rendered. Personal opinion, I think others share is that: Hoarding is the act of storing something merely for the purposes that it will be increasing in value by just sitting there idle, and typically in absurdly large quantities. Saving is the act of storing something for the expected use when you need it, not due to the expectation it will be more valuable necessarily when the savings are used, and typically are in quantities reasonable for planned future activities/needs. i.e. "I am going to hoard all of my bitcoins now because in 20 years they'll be worth $20 million each" vs. "I am going to save X bitcoins so that I can pay my rent for 6 months in case I loose my job" It's all in attitude and purpose I believe. Yeah, you're right too, especially when it comes to smaller things like personal savings and rainy days funds and stuff. I was talking on like a larger scale where that money is a non-insignifcant chunk of the total created currency like in the case Shamir is talking about, where investing in a way that keeps the money circulating keeps the economy as a whole healthier than removing vast chunks from circulation. Title: Re: Adi Shamir's paper on bitcoin Post by: niko on October 20, 2012, 12:22:06 AM Each coin is divisible into 100 million units, for the total of 2.1x10^15 units. You can hoard 90% of coins, and I will still be able to use Bitcoin system without any problems. There's plenty of room for everyone. The non-hoarded, circulating coins can represent value just fine.
Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 20, 2012, 05:07:00 PM Here is Adi's response to my message:
Quote from: Adi Shamir Dear Meni, The tl;dr version:First of all, I would like to thank you and several other members of the bitcoin community for your public comments and private emails, which provided us with a lot of authoritative information about someof the intricacies of the scheme. We will be happy to add more discussion and clarifications to a revised version of our paper, which will hopefully clarify our methodology and add more relevant materialabout the quantitative aspects of the transaction graph. I would like to address two issues which created the most heated discussion over the last few days: 1. While the notions of a bitcoin and of an address are completely clear, the notion of an owner is quite fuzzy since it can not be derived in a precise way from the available data (this may be a feature ofthe scheme, rather than a bug!). There are several ways how to deal with this issue: 1.1 Ignore it completely, and derive from the graph only statistical information about the behavior of addresses. However, we believe that this will completely distort many types of statistical informationwe try to extract from the graph, e.g., what is the distribution of the number of bitcoins that users keep, how many bitcoins they receive and spend, how big are their typical transactions, etc. Since thescheme enables (and even encourages) users to keep multiple addresses and to constantly shuffle bitcoins internally among their accounts, we believe that it is essential to find a way to distinguish between"internal" and "external" transactions, and thus to determine in some way what is the common ownership of different addresses. 1.2 Use our methodology, which is to assume that in most of the transactions, sending bitcoins from multiple addresses indicates that all these accounts are owned by a single entity. This classification istechnically easy to apply, but it creates two types of errors: We underestimate the common ownership of accounts just because we never saw it in the given transactions, and we overestimate it sinceoccasionally there may be multiple owners who send bitcoins in a single transaction. All the anecdotal evidence we saw so far indicates that overall we tend to underestimate the number of addresseswhich are associated with a single entity (as was demonstrated in the case of Instawallet, in which we found only about 1/3 ot the actual addresses associated with it), and that the errors in the otherdirection, while they exist, are not likely to distort our statistical conclusions in a major way. 1.3 Use a different methodology, which will be closer to the ground truth, and which can be derived either from the available data, or from reliable alternative sources. Here we need your help insuggesting such a methodology, which will be discussed by and accepted by most of the bitcoin community as better representing the issue of common ownership. It is always easier to complain about theshortcomings of one methodology than to suggest a better one! 2. The question of how many bitcoins are dormant. Even though this was only one of our many findings, it was the one statistic that caught the attention of most commentators and web journalists. Webelieve that measuring this aspect is extremely important, since it implies some fundamental truths about whether the bitcoin scheme is used mostly to trade in goods or to speculate, and how thescheme will behave if its current users will change their current pattern of behavior. Once again , we have several possible approaches, and I would like to recruit your help in initiating a frank discussionin your community about how to measure this fundamental statistics in the most accurate way. We have spent a lot of time and effort in collecting all the data, but once we have it, it will be easy for us toadapt our measuring methodology based on your suggestions as a service to your community and as a contribution to the scientific study of the bitcoin scheme. However, there is one thing I would like toclarify: I do not want to have a target-shopping experiment, in which once you will see the results you will decide whether you like it or would prefer to change the methodology again in order to geta politically more appealing result. We thus propose to wait until some consensus emerges, and only then run the selected methodology on the data and announce the results. 2.1 In order to start this discussion, I would like to make an initial suggestion: Fortunately, the issue of dormant bitcoins can be made independent of the issue of common ownership of addresses(even though several comments we received argues the politically convenient point that since our decisions about the later point did not absolutely match the ground truth, our results about dormantbitcoins were completely invalid). Let us thus work entirely at the level of addresses, paying no attention to our attempt to find such common ownerships. We propose to compile the followingstatistics: For every amount of time x (e.g., in units of full months), we will measure how many bitcoins were deposited into addresses in transactions that took place more than x months before ourcutoff date (May 13-th 2012), and were not followed by any later transaction in which the address was one of the sending addresses. 2.2 Notice that if someone keeps moving his bitcoins every few days from one address to the next (which seems to be a relatively common behavior), we will not count these bitcoins at all as dormant(and in this sense we will underestimate the number of dormant coins) unless that user stopped doing this sometime before the relevant point in time (x months before the cutoff date), and in this casewe will only count these bitcoins once, in the last transfer which he executed (since all the previous transactions had a later outgoing transaction). 2.3. To deal with the issue of coins which were minted at the earliest period, when they had little value and could have been abandoned by early experimenters, we can also consider only transactionthat took place after a certain date. 2.4. To be fair, we will have to take into account that if we consider a large value of x, there were fewer coins at that time, so when we compute percentages, we will have to use in the denominatorthe number of coins that had been minted up to x months before the cutoff date. I would appreciate it if you can bring this proposal to the attention of the bitcoind community, in order to initiate some discussion (and hopefully some kind of consensus). Once you tell us how we shouldmeasure the number of dormant coins in a way that will be accepted to the community, and assuming that this proposal is scientifically sound and technically doable), we will be happy to run theexperiment and report our findings. Finally, I would like to explain a point that seemed to raise the level of paranoia in your community, and this is the involvement of the Citi Foundation in the project. I can assure you that it was ourdecision to use some of the money that the Weizmann Institute got as a gift from this foundation in order to fund some research on alternative payment systems, that the Citi Foundation had zeroinfluence on the choice of topic, that they did not get any information about our findings while the research was going on, and that they did not see our scientific report before we published it. Our research wasthus motivated by scientific curiosity about the bitcoin scheme, and we had no hidden motives to support or discredit it when we embarked on this project. Best personal wishes, Adi. 1. They would like the help of the Bitcoin community for devising an optimal scheme to determine common ownership of coins. 2. They would like the help of the Bitcoin community for devising an optimal scheme to determine dormant coins. 3. There is nothing nefarious about the usage of Citi Foundation funding. Please see: How to determine common ownership of addresses? (Inspired by Shamir's paper) (https://bitcointalk.org/index.php?topic=119462) How to determine dormant coins? (Inspired by Shamir's paper) (https://bitcointalk.org/index.php?topic=119465) Title: Re: Adi Shamir's paper on bitcoin Post by: Benatar on October 20, 2012, 05:35:56 PM Each coin is divisible into 100 million units, for the total of 2.1x10^15 units. You can hoard 90% of coins, and I will still be able to use Bitcoin system without any problems. There's plenty of room for everyone. The non-hoarded, circulating coins can represent value just fine. Which would lead further into a deflationary spiral unless protocol is changed to get rid of the cap of units, except with the risk of someone trying to cash out those hoarded coins and crashing the economy as significant chunks enter the economy overnight. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 20, 2012, 05:51:27 PM Meni, thanks for posting. Shamir: thanks for in-depth reply.
Quote from: Adi Shamir 2.1 In order to start this discussion, I would like to make an initial suggestion: Fortunately, the issue of dormant bitcoins can be made independent of the issue of common ownership of addresses (even though several comments we received argues the politically convenient point that since our decisions about the later point did not absolutely match the ground truth, our results about dormant bitcoins were completely invalid). Let us thus work entirely at the level of addresses, paying no attention to our attempt to find such common ownerships. We propose to compile the following statistics: For every amount of time x (e.g., in units of full months), we will measure how many bitcoins were deposited into addresses in transactions that took place more than x months before our cutoff date (May 13-th 2012), and were not followed by any later transaction in which the address was one of the sending addresses. back in the days I made a bitcoin-abe query that does pretty much just that ("determine amount of coins not moved since") https://i.imgur.com/kVNsB.png I think this is the query I used: Quote select year(from_unixtime(block.block_nTime)) as year, week(from_unixtime(block.block_nTime)) as week, count(distinct block.block_id), sum(txout_value)*1E-8 from block_tx inner join block on block.block_id = block_tx.block_id inner join tx on block_tx.tx_id = tx.tx_id inner join txout on txout.tx_id = tx.tx_id left join txin txin2 on txin2.txout_id = txout.txout_id where txin2.txout_id is null group by year, week; there's also an interactive version (that lets you select the "cutoff-date" using the mouse) here: http://statistics.ecdsa.org/ Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 20, 2012, 05:56:23 PM Quote from: Shamir Once you tell us how we shouldmeasure the number of dormant coins in a way that will be accepted to the community, and assuming that this proposal is scientifically sound and technically doable), I think it will not be easy to reach a consensus here, because, quite frankly: it can't be done. To even attempt this, we would first need a definition of "dormant coins". sidenote: It would be great (to say the least) if Shamir popped up in the forums and joined the discussion without having to proxy messages through Meni/davout/... Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 20, 2012, 06:00:07 PM Each coin is divisible into 100 million units, for the total of 2.1x10^15 units. You can hoard 90% of coins, and I will still be able to use Bitcoin system without any problems. There's plenty of room for everyone. The non-hoarded, circulating coins can represent value just fine. Which would lead further into a deflationary spiral unless protocol is changed to get rid of the cap of units, except with the risk of someone trying to cash out those hoarded coins and crashing the economy as significant chunks enter the economy overnight. One could argue that "hoarded coins" are not part of the money supply. This would mean bitcoins supply was elastic after all. The hoarders would act as a sort of central banks, injecting/removing bitcoins from the supply (inflating/deflating Bitcoin money supply) based on some policies (probably mostly driven by self-interest, just like with the fed). Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 20, 2012, 06:14:28 PM Quote from: Meni Rosenfeld 1. They would like the help of the Bitcoin community for devising an optimal scheme to determine common ownership of coins. While I don't think it can be done well enough, this is the best I have come up with so far (this makes the same flawed assumption about all transaction inputs having to belong to one "owner"):
This is only marginally better than Shamirs approach and makes the same underestimation/overestimation errors. It removes the "huge rich owner"-problem introduced by "shared wallets" at the (very high) cost of having to compile a list of well-known wallets by hand. I would like to ask you guys at this point how high you guess the current percentage (by volume?) of transactions in the wild that have inputs from different owners. Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 20, 2012, 06:51:24 PM @molecular - I've now linked to dedicated threads for discussing the two problems, specific discussion of them should continue in those threads.
Title: Re: Adi Shamir's paper on bitcoin Post by: Syke on October 21, 2012, 12:04:33 AM One could argue that "hoarded coins" are not part of the money supply. This would mean bitcoins supply was elastic after all. The hoarders would act as a sort of central banks, injecting/removing bitcoins from the supply (inflating/deflating Bitcoin money supply) based on some policies (probably mostly driven by self-interest, just like with the fed). This description sounds pretty good. Title: Re: Adi Shamir's paper on bitcoin Post by: n8rwJeTt8TrrLKPa55eU on October 21, 2012, 12:07:31 AM Regardless of any flaws in the methodologies and assumptions used to write the paper, I always view as positive any research which shows that a large percentage of Bitcoins are "hoarded" (or as Erik correctly points out, "saved").
"Hoarding" is a direct measure of a currency's strength, and people's faith in that currency's future. No one hoards Zimbabwean dollars or Iranian rials. Why? Gold is hoarded to a 99.999% level; almost none of it circulates or is used in transactions. It is fantastic to see Bitcoin in the same league as Gold, USD, and Swiss Francs, as one of the most hoarded currencies on the planet. Also, to those who have misgivings about initial concentration of coins in the hands of relatively few people, I'd say two things: 1. Allocation over time will become maximally efficient anyway (http://en.wikipedia.org/wiki/Coase_theorem) 2. if we must have concentration, I'd rather it be in the hands of Satoshi and others who think like him in terms of monetary freedom and privacy, than the current system which concentrates money into the hands of central banks, governments, and their crony friends. Title: Re: Adi Shamir's paper on bitcoin Post by: Syke on October 21, 2012, 12:13:15 AM While I don't think it can be done well enough, this is the best I have come up with so far (this makes the same flawed assumption about all transaction inputs having to belong to one "owner"):
This is only marginally better than Shamirs approach and makes the same underestimation/overestimation errors. It removes the "huge rich owner"-problem introduced by "shared wallets" at the (very high) cost of having to compile a list of well-known wallets by hand. Bitcoin, by design, makes it impossible to accurately determine which addresses belong to any given wallet. Therefore, this "analysis" of hoarded coins, etc. will always be significantly flawed. Title: Re: Adi Shamir's paper on bitcoin Post by: freequant on October 21, 2012, 05:27:04 AM hmm, either Shamir has gotten "old and ignorant" (like Stallman?) or someone else did this "study" and he just put the name. Perhaps it isn't a good idea to show too much understanding of Bitcoin when there are legions trying to out Satoshi, and you are a reknown cryptographer in the list of top-10 suspects. Endorsing a poorly researched whitepaper pretty much disqualifies Dr Shamir as a potential Satoshi in the public eye. What better way to divert attention? I can't think of any other rational reason why a high-flying cryptographer as A. Shamir would associate his name with such an unchallenging and unscientific study. I am not telling that A. Shamir is Satoshi. Only that this looks like an attempt, for understandable reasons, to dissociate himself from Satoshi. That somehow reminds of Paco Ahlgren's strange (but again totally understandable) badly acted denial (http://www.pacoahlgren.com/bottomviolation/2011/08/22/the-future-of-bitcoin-and-digital-currencies/) when he went under scrutiny after writing a (perhaps a bit too much) enthusiastic article about Bitcoin (http://www.pacoahlgren.com/bottomviolation/2011/07/25/bitcoin-cannot-fail). Title: Re: Adi Shamir's paper on bitcoin Post by: niko on October 21, 2012, 05:38:33 AM hmm, either Shamir has gotten "old and ignorant" (like Stallman?) or someone else did this "study" and he just put the name. Perhaps it isn't a good idea to show too much understanding of Bitcoin when there are legions trying to out Satoshi, and you are a reknown cryptographer in the list of top-10 suspects. Endorsing a poorly researched whitepaper pretty much disqualifies Dr Shamir as a potential Satoshi in the public eye. What better way to divert attention? I can't think of any other rational reason why a high-flying cryptographer as A. Shamir would associate his name with such an unchallenging and unscientific study. I am not telling that A. Shamir is Satoshi. Only that this looks like an attempt, for understandable reasons, to dissociate himself from Satoshi. That somehow reminds of Paco Ahlgren's strange (but again totally understandable) badly acted denial (http://www.pacoahlgren.com/bottomviolation/2011/08/22/the-future-of-bitcoin-and-digital-currencies/) when he went under scrutiny after writing a (perhaps a bit too much) enthusiastic article about Bitcoin (http://www.pacoahlgren.com/bottomviolation/2011/07/25/bitcoin-cannot-fail). You think too highly of scientific publications... :D What fraction of today's papers showcase reliable, in-depth, non-biased, honest results anyway? Title: Re: Adi Shamir's paper on bitcoin Post by: freequant on October 21, 2012, 07:25:28 AM The biggest flaw on the paper is the webscraping of blockchain data. Right there they destroyed any assurance they could have of working with validated data. How do they know they were fed the correct data by blockchain.info or blockexplorer.com? The only way to be sure you have the correct blockchain data is to let your bitcoin client download it from the network and verify it. You may also download a blockchain snapshot, but you still need to let the client verify it to be sure what you have is real data and not some decoy. The paper shall be renamed "Quantitative Analysis of a Full Blockexplorer.com Screen Scraping" Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 21, 2012, 09:24:49 AM hmm, either Shamir has gotten "old and ignorant" (like Stallman?) or someone else did this "study" and he just put the name. Perhaps it isn't a good idea to show too much understanding of Bitcoin when there are legions trying to out Satoshi, and you are a reknown cryptographer in the list of top-10 suspects. Endorsing a poorly researched whitepaper pretty much disqualifies Dr Shamir as a potential Satoshi in the public eye. What better way to divert attention? I can't think of any other rational reason why a high-flying cryptographer as A. Shamir would associate his name with such an unchallenging and unscientific study. I am not telling that A. Shamir is Satoshi. Only that this looks like an attempt, for understandable reasons, to dissociate himself from Satoshi. That somehow reminds of Paco Ahlgren's strange (but again totally understandable) badly acted denial (http://www.pacoahlgren.com/bottomviolation/2011/08/22/the-future-of-bitcoin-and-digital-currencies/) when he went under scrutiny after writing a (perhaps a bit too much) enthusiastic article about Bitcoin (http://www.pacoahlgren.com/bottomviolation/2011/07/25/bitcoin-cannot-fail). Interview with Adi Shamir: Interviewer: "Mr. Shamir, please explain to our viewers, what is the bitcoin blockchain" Adi Shamir: "The bitcoin blockchain is a list of html pages *twitch* that are connected by hyperlinks *flinch* -- *eyes widen* AAAAAH FUCK IT, I CAN'T DO THIS ANY LONGER!!! THERE, I'LL ADMIT IT TO END THIS CRUEL TORTURE: I A M S A T O S H I ! And the blockchain is this BIEST that listens to us and will eat the creature from jekyll island for breakfast quite soon! Muahahahaaaaaahaaaaaaaaa!" Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 26, 2012, 08:30:07 AM Some changes have been made to the paper based on the community's feedback. The revised version is available at the same URL, http://eprint.iacr.org/2012/584.pdf.
Title: Re: Adi Shamir's paper on bitcoin Post by: greyhawk on October 26, 2012, 10:32:21 AM Now this is peer review as it should be. :)
Title: Re: Adi Shamir's paper on bitcoin Post by: niko on October 26, 2012, 01:50:48 PM Now this is peer review as it should be. :) p2p :DTitle: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 26, 2012, 09:31:56 PM can someone post a diff or have the old version? I'd like to see what got changed.
Title: Re: Adi Shamir's paper on bitcoin Post by: Peter Todd on October 27, 2012, 05:22:07 AM can someone post a diff or have the old version? I'd like to see what got changed. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 27, 2012, 08:28:18 AM can someone post a diff or have the old version? I'd like to see what got changed. https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf (https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf) Thanks, retep, for the link. I made a diff of the textual changes. Changes marked in bold: ------------------------------------------------------------------------------- In many places: Quote from: previous revision bitcoin Quote from: current revision Bitcoin Page 3: Quote from: previous revision Payments are made inAnd in the Acknowledgements: bitcoins (BTC's), which are digital coins issued and transferred by the bitcoin network. Nodes broadcast transactions to this network, which records them in publicly available web pages, called block chains, after validating them with a proof-of-work system. Quote from: current revision Payments are made in bitcoins (BTC's), which are digital coins issued and transferred by the Bitcoin network. The data of all these transactions, after being validated with a proof-of-work system, is collected into what is called the block chain. Page 12: Quote from: previous revision A common prominent practice of bitcoin users is to create chains of consecutive transactions as can be seen in Fig. 7: An initial amount of 50,000 BTC's is rapidly transferred from one address to another leaving out some small amounts. In this example 350 such transactions are carried out within the first two days during which the initial amount of 50,000 BTC's is reduced to 34,000 BTC's. In the next three weeks an additional 100 transactions follow and the amount is further reduced to merely 15,000 BTC's. A similar chain of length 120, with initial amount of 500,000 BTC's which decreases to 340,000 BTC's at the end of the chain, is shown in Fig. 1. Note that some of the transactions in this chain are carried out by Mt.Gox. Additional such chains can be found in Fig. 2, Fig. 3, Fig. 4 and Fig. 5, with lengths of 3, 15, 23, 26, 80 and 88 transactions. Quote from: current revision A common prominent practice of Bitcoin users is to create chains of consecutive transactions. Some of these chains can be explained by the change mechanism in which small payments are accompanied by the creation of a new address, into which the user transfers the dierence. Such chains can be found in Fig. 2, Fig. 4, Fig. 5 and Fig. 7, with lengths of 3, 15, 26, 80, 88 and 350 transactions. However, the behavior seen in Fig. 3 deviates significantly from this pattern, since the same amount of 5,000 bitcoins is repeatedly split off the main sum and put into accounts which have no additional transactions associated with them. And in the Acknowledgements: Quote from: previous revision Finally, we would like to thank all the members of the bitcoin community who sent us excellent comments criticisms and suggestions. Quote from: current revision Finally, we would like to thank all the members of the Bitcoin community, and in particular Meni Rosenfeld and Stefan Richter, who sent us excellent comments, criticisms and suggestions. Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 27, 2012, 04:02:42 PM can someone post a diff or have the old version? I'd like to see what got changed. https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf (https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf) Update: Adi has informed me that all revisions are available at http://eprint.iacr.org/cgi-bin/versions.pl?entry=2012/584. In particular the first version is at http://eprint.iacr.org/cgi-bin/getfile.pl?entry=2012/584&version=20121016:132906&file=584.pdf. Note that the intermediate one retep uploaded isn't there, it was mailed to some of the people who communicated with the authors. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 27, 2012, 05:25:27 PM can someone post a diff or have the old version? I'd like to see what got changed. https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf (https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf) damnit! I figures as much when I arrived at the Acknowledgements. Finished regardless. Offering to do it again. Title: Re: Adi Shamir's paper on bitcoin Post by: Peter Todd on October 27, 2012, 06:06:24 PM can someone post a diff or have the old version? I'd like to see what got changed. https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf (https://s3.amazonaws.com/retep/2012BitcoinFinalNonAnonymous.pdf) Thanks, I'd appreciate a copy for my archives as well. There's probably going to be at least one more additional revision, if only because Adi offered to acknowledge me by name as well. I also pointed out in my last email that the definition for inactive addresses, which appears to be on a per-address rather than per-transaction basis, has the problem where the people who seem to be sending dust spam to random addresses can incorrectly cause both older, pre-Mt.Gox addresses to be appear to be active after that date and then subsequently inactive and considered to be savings. You know, it'd be worth it for someone to try to replicate the whole paper with our own toolchain, such as znort's blockchain parser, and publish our own findings. If I had the free time I'd look into doing so myself. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 27, 2012, 06:14:43 PM You know, it'd be worth it for someone to try to replicate the whole paper with our own toolchain, such as znort's blockchain parser, and publish our own findings. If I had the free time I'd look into doing so myself. If there was an expectation of getting meaningful results I guess the incentive to do this might be higher. Just "showing Adi how it's done right" is not worth the effort in my mind. I don't think the way he did it invalidates the results. Still: if you find the time: go for it! Maybe you can find even more interesting results. If I'd do something like this, I'd use bitcoin-abe and sql-queries. Title: Re: Adi Shamir's paper on bitcoin Post by: Peter Todd on October 27, 2012, 07:18:39 PM You know, it'd be worth it for someone to try to replicate the whole paper with our own toolchain, such as znort's blockchain parser, and publish our own findings. If I had the free time I'd look into doing so myself. If there was an expectation of getting meaningful results I guess the incentive to do this might be higher. Just "showing Adi how it's done right" is not worth the effort in my mind. I don't think the way he did it invalidates the results. Still: if you find the time: go for it! Maybe you can find even more interesting results. If I'd do something like this, I'd use bitcoin-abe and sql-queries. I'm thinking do this first of all just to check that their(1) statistics were correct in the first place. For all we know some problems exist at the core of these results, and it'd also be useful to get more details on, for example, the claim of that 70,000BTC "laundering" transaction. It's one of the things that bothers me about the paper actually: they should have published what transactions they were talking about in many of the examples. (modulo privacy considerations where they have identified someone) Once you can reproduce those results, then you can work on more exciting concepts. Maybe those exciting measurements will only happen after time has been spent struggling? Don't forget that another perfectly valid result is that people in the Bitcoin community who really understand the system have spent a lot of time thinking about the problem, and can't find any way to get statistics out of the system. I agree that incentive is a problem. Myself I already have school, work, and a timestamping project to juggle. More generally replication papers in science are never sexy. (1) Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 27, 2012, 07:23:49 PM Why doesn't Dorit Ron pop in here and suck all knowledge from us and use our resources? Is there some formal reason like having to write the thesis on her own?
Title: Re: Adi Shamir's paper on bitcoin Post by: marcus_of_augustus on October 27, 2012, 07:24:43 PM It seems to me that best incentive for doing this kind of work is to figure out how much information is currently available from the block-chain, so that better privacy enhancing techniques can be developed to thwart further analysis. Rinse and repeat, so to speak.
Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 27, 2012, 07:37:16 PM In case someone missed it, I posted a link to the old version in the previous post.
(1) We shouldn't forget it's not really Adi Shamir's paper, but his grad student Dorit Ron's paper, who according to her linked-in page is working on a masters degree. Link? According to http://www.wisdom.weizmann.ac.il/~dron/ she's been writing papers for 28 years (and in case there is another Dorit Ron at WIS, the emails match).She would have done essentially all the work with Adi only supervising. Even if that was true, "supervising" doesn't mean not having a clue what the research is about.Quite possibly prior to publishing the paper Adi didn't actually know much about Bitcoin. I don't know if he knew much about Bitcoin, but he's interested in cryptocurrencies and has said "of course I've heard about Bitcoin" as early as a year ago.Why doesn't Dorit Ron pop in here and suck all knowledge from us and use our resources? Is there some formal reason like having to write the thesis on her own? Probably due to low signal to noise ratio on this forum. I agree that they should have consulted with local and global Bitcoin experts at a much earlier point. (Speaking of which we're talking about me coming to visit for a meeting of faculty interested in Bitcoin and/or the paper).By the way Adi and probably also Dorit are reading these threads. Title: Re: Adi Shamir's paper on bitcoin Post by: Peter Todd on October 27, 2012, 08:02:33 PM In case someone missed it, I posted a link to the old version in the previous post. (1) We shouldn't forget it's not really Adi Shamir's paper, but his grad student Dorit Ron's paper, who according to her linked-in page is working on a masters degree. Link? According to http://www.wisdom.weizmann.ac.il/~dron/ she's been writing papers for 28 years (and in case there is another Dorit Ron at WIS, the emails match).Ah, look like I'm wrong then. The linked-in page was found by someone I know who has a pro-account, so they might have found the wrong person. I edited my post to make this clear. Why doesn't Dorit Ron pop in here and suck all knowledge from us and use our resources? Is there some formal reason like having to write the thesis on her own? Probably due to low signal to noise ratio on this forum. I agree that they should have consulted with local and global Bitcoin experts at a much earlier point. (Speaking of which we're talking about me coming to visit for a meeting of faculty interested in Bitcoin and/or the paper).That's great news! Finding info on the forums is definitely difficult, and in addition Dorit seems to be a mathematician rather than a programmer, which would explain why she used what to us is a convoluted way of generating the results. Note how she acknowledged help from someone else in parsing the block chain itself. Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on October 27, 2012, 09:17:35 PM As pointed out by Davout, the paper assumes shared wallets like mt gox are ONE owner of a lot of addresses. This logic is flawed. Also - it seems a bit strange to count the 2Million+ sub 0.01 balance wallets as the poor end of some sort of wealth pyramid. Many of these are surely people who just tried it out, e.g by getting some from a freebie site. They may or may not even have kept that wallet, let alone become engaged as an active Bitcoin user. Some of those might be miners, collecting a lot of little bits of change. or service operators collecting fees from transactions Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 31, 2012, 07:03:11 PM In case someone missed it, I posted a link to the old version in the previous post. thanks. I tried to make another diff, but I'm having a hard time (line breaks have to be removed, my pdf reader's copy to clipboard function screws up on many chars, hyphenation marks need to be removed, etc). It'd be awesome to have the sources (tex or whatever they are). Right now it's too much effort for me unless someone has a great idea on how to get clean(er) text from the pdfs. Why doesn't Dorit Ron pop in here and suck all knowledge from us and use our resources? Is there some formal reason like having to write the thesis on her own? Probably due to low signal to noise ratio on this forum. I agree that they should have consulted with local and global Bitcoin experts at a much earlier point. (Speaking of which we're talking about me coming to visit for a meeting of faculty interested in Bitcoin and/or the paper).Cool! By the way Adi and probably also Dorit are reading these threads. Hello! *waves* Title: Re: Adi Shamir's paper on bitcoin Post by: cypherdoc on October 31, 2012, 07:09:55 PM In case someone missed it, I posted a link to the old version in the previous post. thanks. I tried to make another diff, but I'm having a hard time (line breaks have to be removed, my pdf reader's copy to clipboard function screws up on many chars, hyphenation marks need to be removed, etc). It'd be awesome to have the sources (tex or whatever they are). Right now it's too much effort for me unless someone has a great idea on how to get clean(er) text from the pdfs. Why doesn't Dorit Ron pop in here and suck all knowledge from us and use our resources? Is there some formal reason like having to write the thesis on her own? Probably due to low signal to noise ratio on this forum. I agree that they should have consulted with local and global Bitcoin experts at a much earlier point. (Speaking of which we're talking about me coming to visit for a meeting of faculty interested in Bitcoin and/or the paper).Cool! By the way Adi and probably also Dorit are reading these threads. Hello! *waves* thx for trying. it would indeed be helpful at some pt to see the changes they have acknowledged. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 31, 2012, 07:21:51 PM thx for trying. it would indeed be helpful at some pt to see the changes they have acknowledged. yeah, would like to see them, too. I got stuck at trying to figure out wether it'd be more work/cost to do it manually, hack up a script, search for existing tools or put up a bounty in the newbie subforum ;) Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on October 31, 2012, 07:57:24 PM thx for trying. it would indeed be helpful at some pt to see the changes they have acknowledged. do you think they will update the paper once more? molecular already posted first diff few days ago.yeah, would like to see them, too. I got stuck at trying to figure out wether it'd be more work/cost to do it manually, hack up a script, search for existing tools or put up a bounty in the newbie subforum ;) not sure how computer readable the sources are and how frequently they change but I'm sure ms word can compare two files (I'm thinking about copy-paste the versions into separate files and use standard office tool, not as elegant as diff but works as well) but will not fight in newbie section for the bounty. have thought colleagues at previous job how to use this. I even saw a manual how to do it. One must love public administration. Quote By the way Adi and probably also Dorit are reading these threads. In this case I apologize for the noise and the disturbing noise that can be found here. Why don't they include a bitcoin address in the update? For R&D purposes ; ) read donations Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on October 31, 2012, 09:50:04 PM It'd be awesome to have the sources (tex or whatever they are). I'll try to see if they're up to sharing the TeX source.thx for trying. it would indeed be helpful at some pt to see the changes they have acknowledged. do you think they will update the paper once more? molecular already posted first diff few days ago.molecular, you may want to clarify this in your post. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 31, 2012, 09:59:14 PM thx for trying. it would indeed be helpful at some pt to see the changes they have acknowledged. do you think they will update the paper once more? molecular already posted first diff few days ago.unfortunately that diff was accidentally from some intermediate version to the newest, not as you rightfully assumed and as was intended from first to newest at the time ;| yeah, would like to see them, too. I got stuck at trying to figure out wether it'd be more work/cost to do it manually, hack up a script, search for existing tools or put up a bounty in the newbie subforum ;) not sure how computer readable the sources are and how frequently they change but I'm sure ms word can compare two files (I'm thinking about copy-paste the versions into separate files and use standard office tool, not as elegant as diff but works as well) but will not fight in newbie section for the bounty. have thought colleagues at previous job how to use this. I even saw a manual how to do it. One must love public administration. Thanks for your suggestion. I did pretty much exactly that: copy-paste from pdf-reader to text-files and diffed them. Diff (of kdiff which I used) doesn't work well because of line breaks and hyphenation that is "baked" into the pdf. This will likely also make your approach (using word as diff tool) fail in the same or a similar way. btw: Cryptology ePrint Archive has different versions of the paper that can be selected here: http://eprint.iacr.org/cgi-bin/versions.pl?entry=2012/584. Unfortunately the only available download format is pdf. Why don't they include a bitcoin address in the update? For R&D purposes ; ) read donations We wouldn't want the press saying: "That paper was sponsored by the bitcoin crowd, so it's biased". Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on October 31, 2012, 10:02:09 PM just used this new-fangled internet-thingy called "google": there are many pdf diff tools, trying this one: http://www.qtrac.eu/diffpdf.html ("Program that textually or visually compares two PDF files")
EDIT: that didn't work. found an online text extractor: http://www.extractpdf.com/. Using that looked promising at first, but it seems to skip parts of text ;( I'm done for tonight ;| Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on October 31, 2012, 11:58:57 PM I looked through the whole thread, seems nobody posted a link to previous versions of the paper.
Can you please PM me a URL where I can grab a copy? edit: the later version replaced the original 1.0 and I have nothing to compare. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on November 03, 2012, 02:29:31 PM I looked through the whole thread, seems nobody posted a link to previous versions of the paper. Can you please PM me a URL where I can grab a copy? edit: the later version replaced the original 1.0 and I have nothing to compare. meni posted a link earlier in this thread and here's a link to a page that lets you download any version of the paper (posted this earlier): http://eprint.iacr.org/cgi-bin/versions.pl?entry=2012/584 Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on November 03, 2012, 03:11:10 PM meni posted a link earlier in this thread and here's a link to a page that lets you download any version of the paper (posted this earlier): http://eprint.iacr.org/cgi-bin/versions.pl?entry=2012/584 I was looking precisely for this ^^ thanks. I'm on it (diff) Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on November 03, 2012, 03:22:54 PM meni posted a link earlier in this thread and here's a link to a page that lets you download any version of the paper (posted this earlier): http://eprint.iacr.org/cgi-bin/versions.pl?entry=2012/584 I was looking precisely for this ^^ thanks. I'm on it (diff) awesome! Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on November 21, 2012, 08:01:22 PM I paid a visit to WIS today to meet the group of 8 people involved in Citi-funded research (which includes Adi, Dorit, my M.Sc advisor, and some other people I've known from my time there, which AFAIK was before this project started). Adi explained that this funding was given for doing banking-related research, and that each member of the group dedicates a small portion of his time to such research. He wished to emphasize again that other than this broad directive, the researchers are free to choose their agenda, and that no input was received from the Citi Foundation regarding the choice of topic, let alone the conclusions of the research.
Through most of the meeting I answered general questions about Bitcoin; we also spent some time brainstorming ideas for improving the paper. I will soon put up for discussion here some of the issues that were raised. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on November 21, 2012, 08:23:01 PM I paid a visit to WIS today to meet the group of 8 people involved in Citi-funded research (which includes Adi, Dorit, my M.Sc advisor, and some other people I've known from my time there, which AFAIK was before this project started). Adi explained that this funding was given for doing banking-related research, and that each member of the group dedicates a small portion of his time to such research. He wished to emphasize again that other than this broad directive, the researchers are free to choose their agenda, and that no input was received from the Citi Foundation regarding the choice of topic, let alone the conclusions of the research. Through most of the meeting I answered general questions about Bitcoin; we also spent some time brainstorming ideas for improving the paper. I will soon put up for discussion here some of the issues that were raised. cool! Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on November 26, 2012, 08:48:20 AM awesome! bitcoin -> Bitcoin - cause initial difficulty when comparing versions, sea of red : ) p #2 added that statistics is based on one of two main sources of block information but that they are sure that they are the same and with no impact on stats (footnote) p #4 altered system description, deleted mentions of drugs, Silk road and investigations. instead more detailed description how payments can be combined from multiple chunks p #5 chapter 3 new 5 lines at the end, more details how they evaluated entities' btc ballances. changed Owner to Entity p #7 in the middle „One can also argue...“ added thought about 'lost' coins in experiments by early adopters (look for 1,657,480 bitcoins) ... taking this into account they think 73% btc is associated with addresses that only accept bitcoins and never sent any. 70% out of those 73% are addresses not changed in last 3 months before the cut-off date of the research. p #8 it tabs 2, 3, 4, 5, 6 added number of addresses and a title Number of owners changed to num of entities. p #12 para Long Chains: changed description why some small txs are chained the way they are and also they drop MtGox note p #13 Acknowledgments added last sentence: Finally, we would like to thank all the members of the Bitcoin community, and in particular Meni Rosenfeld and Stefan Richter, who sent us excellent comments, criticisms and suggestions. We revised the original version of the paper in order to respond to their input. Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on November 26, 2012, 09:01:35 AM @Binford 6100 - can you post the actual before and after texts?
bitcoin -> Bitcoin - cause initial difficulty when comparing versions, sea of red : ) If you haven't already, you should pre-process by unifying the capitalization in both versions.Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on November 26, 2012, 12:41:35 PM @Meni I had it 'outsourced' this time after I failed few weeks ago. This is a summary I translated into English from the report I received. I did not specify that it should be in English nor that I want to have it formatted in any special way. You're interested in what, seeing paragraphs next to each other from v1.0 and 1.1 so you can see the changes for yourself? Now that I know what changed this could be easy.
Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on November 26, 2012, 12:56:18 PM @Meni I had it 'outsourced' this time after I failed few weeks ago. This is a summary I translated into English from the report I received. I did not specify that it should be in English nor that I want to have it formatted in any special way. You're interested in what, seeing paragraphs next to each other from v1.0 and 1.1 so you can see the changes for yourself? Now that I know what changed this could be easy. Yes, skipping large blocks of text that remained the same. Something like molecular's diff (https://bitcointalk.org/index.php?topic=118797.msg1301043#msg1301043). PS myself I know what changed, but other people may be interested in clearly seeing the improvements.Title: Re: Adi Shamir's paper on bitcoin Post by: Binford 6100 on November 26, 2012, 07:26:10 PM @Meni even with pre-processed texts there are problems, like layout issues. p.ex. when the same text shifts by one word so every line looks different. adding new line breaks to list of tolerated exceptions would do the trick but not with my tool.
etc. Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on November 26, 2012, 10:50:52 PM @Meni even with pre-processed texts there are problems, like layout issues. p.ex. when the same text shifts by one word so every line looks different. adding new line breaks to list of tolerated exceptions would do the trick but not with my tool. etc. back when I tried I found some online service like this: http://www.fileformat.info/convert/doc/pdf2txt.htm to pre-process that helped with the linebreaks but had some other problems I don't remember. Might be worth a try. Title: Re: Adi Shamir's paper on bitcoin Post by: Meni Rosenfeld on November 27, 2012, 08:06:10 AM @Meni even with pre-processed texts there are problems, like layout issues. p.ex. when the same text shifts by one word so every line looks different. adding new line breaks to list of tolerated exceptions would do the trick but not with my tool. I imagine that new paragraphs would have two line breaks. So what about replacing double line breaks with a temporary character, removing all line breaks, and replacing the temporary character with a line break? Then every paragraph would be in a single line.etc. Would it help to obtain the original TeX? Title: Re: Adi Shamir's paper on bitcoin Post by: molecular on November 27, 2012, 09:04:59 AM @Meni even with pre-processed texts there are problems, like layout issues. p.ex. when the same text shifts by one word so every line looks different. adding new line breaks to list of tolerated exceptions would do the trick but not with my tool. I imagine that new paragraphs would have two line breaks. So what about replacing double line breaks with a temporary character, removing all line breaks, and replacing the temporary character with a line break? Then every paragraph would be in a single line.etc. Would it help to obtain the original TeX? As I said earlier, having access to the original tex or whatever the sources are would certainly make things easier. |