Bitcoin Forum
December 05, 2016, 10:53:56 AM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 [4]  All
  Print  
Author Topic: Yes, the Bitcoin.org Site and Forum were Down  (Read 8010 times)
sirius
Bitcoiner
Staff
Sr. Member
****
Offline Offline

Activity: 429



View Profile
December 20, 2010, 03:16:00 PM
 #61

An attacker could mess up the original file that is pulled by the backup servers, but I'm not too worried about that happening. Old backups can be stored for at least a week or two.

The server now makes daily backups automatically, but doesn't rsync them yet. Bzipped size about 50 MB.

Identifi - Decentralized address book with trust ratings
I'm not a forum admin - please contact theymos instead.
1480935236
Hero Member
*
Offline Offline

Posts: 1480935236

View Profile Personal Message (Offline)

Ignore
1480935236
Reply with quote  #2

1480935236
Report to moderator
1480935236
Hero Member
*
Offline Offline

Posts: 1480935236

View Profile Personal Message (Offline)

Ignore
1480935236
Reply with quote  #2

1480935236
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
kiba
Legendary
*
Offline Offline

Activity: 980


View Profile
December 20, 2010, 03:20:29 PM
 #62

How long will this process take?

sirius
Bitcoiner
Staff
Sr. Member
****
Offline Offline

Activity: 429



View Profile
December 20, 2010, 03:50:31 PM
 #63

How long will this process take?

Don't worry, not long Smiley

Identifi - Decentralized address book with trust ratings
I'm not a forum admin - please contact theymos instead.
ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470


Bringing Legendary Har® to you since 1952


View Profile
December 20, 2010, 07:00:36 PM
 #64

An attacker could mess up the original file that is pulled by the backup servers, but I'm not too worried about that happening. Old backups can be stored for at least a week or two.

Yes, but it is also easy to do automatic MD5/SHA1/SHA256 signing of every file. So this is a non-issue really.
Just add 5 more lines to backup script.

The server now makes daily backups automatically, but doesn't rsync them yet. Bzipped size about 50 MB.

Awesome. I can create a backup site myself easily.

--------
Also, here is the examplary RSYNC command to backup a folder of one server to another:
Code:
# rsync -rltgoDvzx root@server.1:/remote/backup/folder/path /path/to/local/backup/folder --inplace

If you want to check what will the command do, without actually executing it, add "-n" parameter, which will do a so-called DRY RUN:
Code:
# rsync -rltgoDvzx -n root@server.1:/remote/backup/folder/path /path/to/local/backup/folder --inplace

If the remote sever is on a different port than standard 22, then use this:
Code:
# rsync -rltgoDvzx -n root@server.1:/remote/backup/folder/path /path/to/local/backup/folder --inplace -e 'ssh -ax -c blowfish -p 40022'

This is also a dry run, no files will be transferred. 40022 is naturally the port number and blowfish is type of encryption used for connection (it's the fastest one for transferring files).

The "-rltgoDvzx" parameters will make rsync transfer entire directory recursively with all possible subdirectories, without files/dirs from other mounted volumes in the path.
Try # man rsync to see what all the options mean.

sirius
Bitcoiner
Staff
Sr. Member
****
Offline Offline

Activity: 429



View Profile
December 21, 2010, 04:35:32 PM
 #65

It's now making daily backups to remote servers. Thanks for help ShadowOfHarbringer.

Identifi - Decentralized address book with trust ratings
I'm not a forum admin - please contact theymos instead.
kiba
Legendary
*
Offline Offline

Activity: 980


View Profile
December 21, 2010, 05:20:17 PM
 #66

Thanks for resolving this issue!

That mean that the senior develooper can redeploy to a different server with the backups, if neccesary. Right?

How many servers are serving as backup/mirror?

ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470


Bringing Legendary Har® to you since 1952


View Profile
December 21, 2010, 06:11:39 PM
 #67

It's now making daily backups to remote servers. Thanks for help ShadowOfHarbringer.

No problem.
Are you planning to make some public site from which other people (such as myself) could download backups ?

I can setup a backup server too (and act as a mirror backup), as i rent a few servers in datacenters here and there.

You could probably setup a dedicated RSYNC server with bandwidth per user limit. There is even no need to give people SSH access actually.

sirius
Bitcoiner
Staff
Sr. Member
****
Offline Offline

Activity: 429



View Profile
December 21, 2010, 07:42:31 PM
 #68

Are you planning to make some public site from which other people (such as myself) could download backups ?

The database backups contain private stuff like password hashes (=passwords), PM's and email addresses, so we can't give them out. Only bitcoin.org admins (Satoshi, Gavin, me) have the access.

That mean that the senior develooper can redeploy to a different server with the backups, if neccesary. Right?

Yes. We'll make sure there are always backups available.

Identifi - Decentralized address book with trust ratings
I'm not a forum admin - please contact theymos instead.
ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470


Bringing Legendary Har® to you since 1952


View Profile
December 21, 2010, 08:10:05 PM
 #69

Are you planning to make some public site from which other people (such as myself) could download backups ?

The database backups contain private stuff like password hashes (=passwords), PM's and email addresses, so we can't give them out. Only bitcoin.org admins (Satoshi, Gavin, me) have the access.

Ah sure, forgot about that.
Well, there is always a possibility of cutting out all sensitive data from the database to make a public read-only forum backup (nobody will be able to login to it since it would contain no hashes, so just read-only).

But i guess that would be probably too much work.

ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470


Bringing Legendary Har® to you since 1952


View Profile
December 21, 2010, 09:23:59 PM
 #70

Sirius, would you care to create a no-sensitive-data version of backups so everyone can backup it like wikileaks ?

kiba
Legendary
*
Offline Offline

Activity: 980


View Profile
December 30, 2010, 03:36:27 AM
 #71

So, how mirrors are backing up the forum db?

Is there a way to do a db dump of non-sensitives information?

ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470


Bringing Legendary Har® to you since 1952


View Profile
December 30, 2010, 09:04:43 PM
 #72

So, how mirrors are backing up the forum db?

Is there a way to do a db dump of non-sensitives information?

There is a way, the question is if sirius has time or will to do it.

kiba
Legendary
*
Offline Offline

Activity: 980


View Profile
December 30, 2010, 11:34:17 PM
 #73

Er, how many mirrors are backing up the database?

Gavin Andresen
Legendary
*
Offline Offline

Activity: 1652


Chief Scientist


View Profile WWW
December 30, 2010, 11:47:30 PM
 #74

Er, how many mirrors are backing up the database?

The forum database is now being automatically compress, encrypted, and backed up to another of sirius' servers and to Amazon S3 every day (one per day, I don't delete the old backups, yet).

How often do you get the chance to work on a potentially world-changing project?
Bruce Wagner
Sr. Member
****
Offline Offline

Activity: 336


View Profile
January 10, 2011, 10:08:46 PM
 #75

Perhaps we should build a Forum-Backup capability into the standard bitcoin block chain..... so that a current backup of the entire forum database is embedded into the block chain.   Wink
fabianhjr
Sr. Member
****
Offline Offline

Activity: 322


Do The Evolution


View Profile
January 10, 2011, 10:33:46 PM
 #76

And have my password hash included? No way!
EDIT: You can use google cache if it ever goes down btw. Smiley

sirius
Bitcoiner
Staff
Sr. Member
****
Offline Offline

Activity: 429



View Profile
January 10, 2011, 11:55:13 PM
 #77

Sirius, would you care to create a no-sensitive-data version of backups so everyone can backup it like wikileaks ?

Could be done, but not very high priority. We don't need Wikileaks-grade security measures yet.

Identifi - Decentralized address book with trust ratings
I'm not a forum admin - please contact theymos instead.
ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470


Bringing Legendary Har® to you since 1952


View Profile
January 11, 2011, 04:45:02 AM
 #78

Sirius, would you care to create a no-sensitive-data version of backups so everyone can backup it like wikileaks ?

Could be done, but not very high priority. We don't need Wikileaks-grade security measures yet.

Hey, nobody is in a hurry here.
I was just asking if You can do it at all.

Pages: « 1 2 3 [4]  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!