Bitcoin Forum
November 07, 2024, 01:14:23 PM *
News: Latest Bitcoin Core release: 28.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1] 2 »  All
  Print  
Author Topic: How large an Amazon EC2 instance for Bitcoin?  (Read 3673 times)
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 10, 2013, 07:23:30 PM
 #1

I'm running a bitcoin service on amazon Ec2, and I need to run a full version of bitcoin- block chain included. How much disk space will I need to keep on hand to keep bitcoind from crashing? (my current problem).

more or less retired.
2112
Legendary
*
Offline Offline

Activity: 2128
Merit: 1073



View Profile
March 10, 2013, 10:10:52 PM
 #2

I'm running a bitcoin service on amazon Ec2, and I need to run a full version of bitcoin- block chain included. How much disk space will I need to keep on hand to keep bitcoind from crashing? (my current problem).
The smallest has 160GB of the local storage. That is more than enough for couple of years. I/O to the local storage is free of charge. Just don't pull a bitomat.pl and don't store the backup copy of the wallet on the same ephemeral storage as the working blockchain.

Please comment, critique, criticize or ridicule BIP 2112: https://bitcointalk.org/index.php?topic=54382.0
Long-term mining prognosis: https://bitcointalk.org/index.php?topic=91101.0
Sukrim
Legendary
*
Offline Offline

Activity: 2618
Merit: 1007


View Profile
March 11, 2013, 12:33:30 AM
 #3

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

https://www.coinlend.org <-- automated lending at various exchanges.
https://www.bitfinex.com <-- Trade BTC for other currencies and vice versa.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 07:49:39 PM
 #4

I'm running a bitcoin service on amazon Ec2, and I need to run a full version of bitcoin- block chain included. How much disk space will I need to keep on hand to keep bitcoind from crashing? (my current problem).
The smallest has 160GB of the local storage. That is more than enough for couple of years. I/O to the local storage is free of charge. Just don't pull a bitomat.pl and don't store the backup copy of the wallet on the same ephemeral storage as the working blockchain.

Could you give me a little bit more info on what happened?

more or less retired.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 07:50:19 PM
 #5

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

more or less retired.
SgtSpike
Legendary
*
Offline Offline

Activity: 1400
Merit: 1005



View Profile
March 11, 2013, 07:59:35 PM
 #6

I'm running a bitcoin service on amazon Ec2, and I need to run a full version of bitcoin- block chain included. How much disk space will I need to keep on hand to keep bitcoind from crashing? (my current problem).
The smallest has 160GB of the local storage. That is more than enough for couple of years. I/O to the local storage is free of charge. Just don't pull a bitomat.pl and don't store the backup copy of the wallet on the same ephemeral storage as the working blockchain.

Could you give me a little bit more info on what happened?
They stored the backup on the same storage as the normal.  Amazon pulled their storage for whatever reason.  They lost 25,000 BTC because they didn't have the wallet backed up to anything else, and Amazon wiped it when their storage was pulled.
2112
Legendary
*
Offline Offline

Activity: 2128
Merit: 1073



View Profile
March 11, 2013, 08:12:30 PM
 #7

Could you give me a little bit more info on what happened?
Basically bitomat.pl administrator didn't read the AWS documentation. He tried to upgrade his instance which triggered erasing of the ephemeral storage and EBS volumes not marked persistent. Only his trading database files that were on a separately attached volume survived. He even purchased the Platinum-level support from Amazon, because he didn't believe that Amazon really throws away the encryption keys to the customer's data when the contract is closed. Mt.Gox acquired bitomat.pl and made customers good on BTC deposits, PLNs weren't affected. Mt.Gox still uses Polish bank relationships established by Bitomat to operate in the SEPA zone.

Recent EC2-related thread in the Newbie zone:

https://bitcointalk.org/index.php?topic=151640.0

Please comment, critique, criticize or ridicule BIP 2112: https://bitcointalk.org/index.php?topic=54382.0
Long-term mining prognosis: https://bitcointalk.org/index.php?topic=91101.0
SgtSpike
Legendary
*
Offline Offline

Activity: 1400
Merit: 1005



View Profile
March 11, 2013, 08:19:42 PM
 #8

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

Building an online wallet, on Amazon EC2 is a horrible idea, this will end in disaster. Also I hope your not using TF for this would be way over his level. He won't know how to encryption the and deliver them in javascript so only the user can use the private keys. I am warning you this will end in disaster.
Why would he use TF?  TF is designing websites, not programming them.
SgtSpike
Legendary
*
Offline Offline

Activity: 1400
Merit: 1005



View Profile
March 11, 2013, 08:29:28 PM
 #9

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

Building an online wallet, on Amazon EC2 is a horrible idea, this will end in disaster. Also I hope your not using TF for this would be way over his level. He won't know how to encryption the and deliver them in javascript so only the user can use the private keys. I am warning you this will end in disaster.
Why would he use TF?  TF is designing websites, not programming them.

He created his last wallet, Terracoin wallet.
Ew, remind me not to use it.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 08:53:15 PM
 #10

I'm running a bitcoin service on amazon Ec2, and I need to run a full version of bitcoin- block chain included. How much disk space will I need to keep on hand to keep bitcoind from crashing? (my current problem).
The smallest has 160GB of the local storage. That is more than enough for couple of years. I/O to the local storage is free of charge. Just don't pull a bitomat.pl and don't store the backup copy of the wallet on the same ephemeral storage as the working blockchain.

Could you give me a little bit more info on what happened?
They stored the backup on the same storage as the normal.  Amazon pulled their storage for whatever reason.  They lost 25,000 BTC because they didn't have the wallet backed up to anything else, and Amazon wiped it when their storage was pulled.

Well that's plain silly.

more or less retired.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 08:54:29 PM
 #11

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

Building an online wallet, on Amazon EC2 is a horrible idea, this will end in disaster. Also I hope your not using TF for this would be way over his level. He won't know how to encryption the and deliver them in javascript so only the user can use the private keys. I am warning you this will end in disaster.
Why would he use TF?  TF is designing websites, not programming them.

TF thus far has proved quite adept at programming, I've been happy so far. If someone has a good reason (and proof) as to why he shouldn't be used I would take a look at it.

more or less retired.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 08:56:58 PM
 #12

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

Building an online wallet, on Amazon EC2 is a horrible idea, this will end in disaster. Also I hope your not using TF for this would be way over his level. He won't know how to encryption the and deliver them in javascript so only the user can use the private keys. I am warning you this will end in disaster.

Relax- I'm interested in hearing why something like this can't be done on EC2. And besides- for the moment it's Terracoin, so relax. :-)

more or less retired.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 10:28:35 PM
 #13

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

Building an online wallet, on Amazon EC2 is a horrible idea, this will end in disaster. Also I hope your not using TF for this would be way over his level. He won't know how to encryption the and deliver them in javascript so only the user can use the private keys. I am warning you this will end in disaster.

Relax- I'm interested in hearing why something like this can't be done on EC2. And besides- for the moment it's Terracoin, so relax. :-)

To many variables not controlled by you, if you want to do this right get a dedicated box.

But EC2 is a dedicated box- although I have to trust Amazon I suppose, and they have sophisticated levels of user permissions. Seems safer to use then a dedicated box, especially where redundancy is concerned.

more or less retired.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 10:29:28 PM
 #14

Protipp: Use a BIP32 deterministic wallet to create addresses on the fly on the server but keep the private keys offline in your wallet.

I'm building a online wallet- I would need the private keys on the server, no?

Building an online wallet, on Amazon EC2 is a horrible idea, this will end in disaster. Also I hope your not using TF for this would be way over his level. He won't know how to encryption the and deliver them in javascript so only the user can use the private keys. I am warning you this will end in disaster.
Why would he use TF?  TF is designing websites, not programming them.

TF thus far has proved quite adept at programming, I've been happy so far. If someone has a good reason (and proof) as to why he shouldn't be used I would take a look at it.

Go look at the money packer dude's website release the code, it was a mess. I almost threw up, he is using php to construct html LIKE SERIOUSLY, and there were some flaws in the code, which I still looking at.

You wouldn't use PHP to construct HTML? I thought that was pretty standard, unless I'm behind the times.

more or less retired.
speeder
Hero Member
*****
Offline Offline

Activity: 994
Merit: 501


PredX - AI-Powered Prediction Market


View Profile
March 11, 2013, 10:36:01 PM
 #15

Amazon EC2 purpose is handle highly scalable services.

NOT critical services.

It was made to handle netflix, where there are no damage if the thing go down (Beside angry people).

It is not supposed to handle... bitomat.

crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 10:42:44 PM
 #16

Amazon EC2 purpose is handle highly scalable services.

NOT critical services.

It was made to handle netflix, where there are no damage if the thing go down (Beside angry people).

It is not supposed to handle... bitomat.

But it seems like the same thing no? Its a server. Bitcoin needs highly scalable (look at gox!) and I think the Netflix people would think an enormous amount of damage would be done if it went down. Netflix is worth more then all of bitcoin combined.

I am sincerely interested in your opinion, but could you offer any facts to support it? Something I could read up on?

more or less retired.
SgtSpike
Legendary
*
Offline Offline

Activity: 1400
Merit: 1005



View Profile
March 11, 2013, 10:47:21 PM
 #17

Amazon EC2 purpose is handle highly scalable services.

NOT critical services.

It was made to handle netflix, where there are no damage if the thing go down (Beside angry people).

It is not supposed to handle... bitomat.

But it seems like the same thing no? Its a server. Bitcoin needs highly scalable (look at gox!) and I think the Netflix people would think an enormous amount of damage would be done if it went down. Netflix is worth more then all of bitcoin combined.

I am sincerely interested in your opinion, but could you offer any facts to support it? Something I could read up on?
Again, Amazon permanently lost 25k BTC because of Huh.  It doesn't matter - bottom line is, data storage there should not be considered reliable or long-term.  Everything stored there should also be backed up (constantly) to another source, or the risk exists of a similar thing happening to you.  I don't think it's a bad route to go, just make sure everything is backed up, and double-check those backups quite often.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 11, 2013, 11:06:50 PM
 #18

Amazon EC2 purpose is handle highly scalable services.

NOT critical services.

It was made to handle netflix, where there are no damage if the thing go down (Beside angry people).

It is not supposed to handle... bitomat.

But it seems like the same thing no? Its a server. Bitcoin needs highly scalable (look at gox!) and I think the Netflix people would think an enormous amount of damage would be done if it went down. Netflix is worth more then all of bitcoin combined.

I am sincerely interested in your opinion, but could you offer any facts to support it? Something I could read up on?
Again, Amazon permanently lost 25k BTC because of Huh.  It doesn't matter - bottom line is, data storage there should not be considered reliable or long-term.  Everything stored there should also be backed up (constantly) to another source, or the risk exists of a similar thing happening to you.  I don't think it's a bad route to go, just make sure everything is backed up, and double-check those backups quite often.

Always a good idea. I think what that site did, (if it didn't steal them) was just terminate their instance, which it informs you clearly wil result in them terminating your data. :-/

more or less retired.
gweedo
Legendary
*
Offline Offline

Activity: 1498
Merit: 1000


View Profile
March 12, 2013, 01:15:15 AM
 #19

Amazon EC2 purpose is handle highly scalable services.

NOT critical services.

It was made to handle netflix, where there are no damage if the thing go down (Beside angry people).

It is not supposed to handle... bitomat.

But it seems like the same thing no? Its a server. Bitcoin needs highly scalable (look at gox!) and I think the Netflix people would think an enormous amount of damage would be done if it went down. Netflix is worth more then all of bitcoin combined.

I am sincerely interested in your opinion, but could you offer any facts to support it? Something I could read up on?

If GOX was using EC2, they be incredibly dumb, they would have to play by amazon's rules and could lose control of the information really quickly. Lets be honest here, for the benefits of EC2 you would not get them. EC2 is great scalability horizontally.
crazy_rabbit (OP)
Legendary
*
Offline Offline

Activity: 1204
Merit: 1002


RUM AND CARROTS: A PIRATE LIFE FOR ME


View Profile
March 12, 2013, 07:54:30 AM
 #20

Amazon EC2 purpose is handle highly scalable services.

NOT critical services.

It was made to handle netflix, where there are no damage if the thing go down (Beside angry people).

It is not supposed to handle... bitomat.

But it seems like the same thing no? Its a server. Bitcoin needs highly scalable (look at gox!) and I think the Netflix people would think an enormous amount of damage would be done if it went down. Netflix is worth more then all of bitcoin combined.

I am sincerely interested in your opinion, but could you offer any facts to support it? Something I could read up on?

If GOX was using EC2, they be incredibly dumb, they would have to play by amazon's rules and could lose control of the information really quickly. Lets be honest here, for the benefits of EC2 you would not get them. EC2 is great scalability horizontally.

Thanks, but your still not saying why you think this. No examples? Nothing specific? Do you work for Linode?

more or less retired.
Pages: [1] 2 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!