Bitcoin Forum
November 08, 2024, 05:01:18 AM *
News: Latest Bitcoin Core release: 28.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 2 3 [4]  All
  Print  
Author Topic: Yes, the Bitcoin.org Site and Forum were Down  (Read 8966 times)
sirius
Bitcoiner
Sr. Member
****
Offline Offline

Activity: 429
Merit: 1002



View Profile
December 20, 2010, 03:16:00 PM
 #61

An attacker could mess up the original file that is pulled by the backup servers, but I'm not too worried about that happening. Old backups can be stored for at least a week or two.

The server now makes daily backups automatically, but doesn't rsync them yet. Bzipped size about 50 MB.

Iris — for better social networks
I'm not a forum admin - please contact theymos instead.
kiba
Legendary
*
Offline Offline

Activity: 980
Merit: 1020


View Profile
December 20, 2010, 03:20:29 PM
 #62

How long will this process take?

sirius
Bitcoiner
Sr. Member
****
Offline Offline

Activity: 429
Merit: 1002



View Profile
December 20, 2010, 03:50:31 PM
 #63

How long will this process take?

Don't worry, not long Smiley

Iris — for better social networks
I'm not a forum admin - please contact theymos instead.
ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470
Merit: 1006


Bringing Legendary Har® to you since 1952


View Profile
December 20, 2010, 07:00:36 PM
Last edit: December 20, 2010, 07:21:07 PM by ShadowOfHarbringer
 #64

An attacker could mess up the original file that is pulled by the backup servers, but I'm not too worried about that happening. Old backups can be stored for at least a week or two.

Yes, but it is also easy to do automatic MD5/SHA1/SHA256 signing of every file. So this is a non-issue really.
Just add 5 more lines to backup script.

The server now makes daily backups automatically, but doesn't rsync them yet. Bzipped size about 50 MB.

Awesome. I can create a backup site myself easily.

--------
Also, here is the examplary RSYNC command to backup a folder of one server to another:
Code:
# rsync -rltgoDvzx root@server.1:/remote/backup/folder/path /path/to/local/backup/folder --inplace

If you want to check what will the command do, without actually executing it, add "-n" parameter, which will do a so-called DRY RUN:
Code:
# rsync -rltgoDvzx -n root@server.1:/remote/backup/folder/path /path/to/local/backup/folder --inplace

If the remote sever is on a different port than standard 22, then use this:
Code:
# rsync -rltgoDvzx -n root@server.1:/remote/backup/folder/path /path/to/local/backup/folder --inplace -e 'ssh -ax -c blowfish -p 40022'

This is also a dry run, no files will be transferred. 40022 is naturally the port number and blowfish is type of encryption used for connection (it's the fastest one for transferring files).

The "-rltgoDvzx" parameters will make rsync transfer entire directory recursively with all possible subdirectories, without files/dirs from other mounted volumes in the path.
Try # man rsync to see what all the options mean.

sirius
Bitcoiner
Sr. Member
****
Offline Offline

Activity: 429
Merit: 1002



View Profile
December 21, 2010, 04:35:32 PM
 #65

It's now making daily backups to remote servers. Thanks for help ShadowOfHarbringer.

Iris — for better social networks
I'm not a forum admin - please contact theymos instead.
kiba
Legendary
*
Offline Offline

Activity: 980
Merit: 1020


View Profile
December 21, 2010, 05:20:17 PM
 #66

Thanks for resolving this issue!

That mean that the senior develooper can redeploy to a different server with the backups, if neccesary. Right?

How many servers are serving as backup/mirror?

ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470
Merit: 1006


Bringing Legendary Har® to you since 1952


View Profile
December 21, 2010, 06:11:39 PM
 #67

It's now making daily backups to remote servers. Thanks for help ShadowOfHarbringer.

No problem.
Are you planning to make some public site from which other people (such as myself) could download backups ?

I can setup a backup server too (and act as a mirror backup), as i rent a few servers in datacenters here and there.

You could probably setup a dedicated RSYNC server with bandwidth per user limit. There is even no need to give people SSH access actually.

sirius
Bitcoiner
Sr. Member
****
Offline Offline

Activity: 429
Merit: 1002



View Profile
December 21, 2010, 07:42:31 PM
Last edit: December 21, 2010, 07:57:19 PM by sirius-m
 #68

Are you planning to make some public site from which other people (such as myself) could download backups ?

The database backups contain private stuff like password hashes (=passwords), PM's and email addresses, so we can't give them out. Only bitcoin.org admins (Satoshi, Gavin, me) have the access.

That mean that the senior develooper can redeploy to a different server with the backups, if neccesary. Right?

Yes. We'll make sure there are always backups available.

Iris — for better social networks
I'm not a forum admin - please contact theymos instead.
ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470
Merit: 1006


Bringing Legendary Har® to you since 1952


View Profile
December 21, 2010, 08:10:05 PM
 #69

Are you planning to make some public site from which other people (such as myself) could download backups ?

The database backups contain private stuff like password hashes (=passwords), PM's and email addresses, so we can't give them out. Only bitcoin.org admins (Satoshi, Gavin, me) have the access.

Ah sure, forgot about that.
Well, there is always a possibility of cutting out all sensitive data from the database to make a public read-only forum backup (nobody will be able to login to it since it would contain no hashes, so just read-only).

But i guess that would be probably too much work.

ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470
Merit: 1006


Bringing Legendary Har® to you since 1952


View Profile
December 21, 2010, 09:23:59 PM
 #70

Sirius, would you care to create a no-sensitive-data version of backups so everyone can backup it like wikileaks ?

kiba
Legendary
*
Offline Offline

Activity: 980
Merit: 1020


View Profile
December 30, 2010, 03:36:27 AM
 #71

So, how mirrors are backing up the forum db?

Is there a way to do a db dump of non-sensitives information?

ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470
Merit: 1006


Bringing Legendary Har® to you since 1952


View Profile
December 30, 2010, 09:04:43 PM
 #72

So, how mirrors are backing up the forum db?

Is there a way to do a db dump of non-sensitives information?

There is a way, the question is if sirius has time or will to do it.

kiba
Legendary
*
Offline Offline

Activity: 980
Merit: 1020


View Profile
December 30, 2010, 11:34:17 PM
 #73

Er, how many mirrors are backing up the database?

Gavin Andresen
Legendary
*
Offline Offline

Activity: 1652
Merit: 2301


Chief Scientist


View Profile WWW
December 30, 2010, 11:47:30 PM
 #74

Er, how many mirrors are backing up the database?

The forum database is now being automatically compress, encrypted, and backed up to another of sirius' servers and to Amazon S3 every day (one per day, I don't delete the old backups, yet).

How often do you get the chance to work on a potentially world-changing project?
Bruce Wagner (OP)
Sr. Member
****
Offline Offline

Activity: 336
Merit: 252


View Profile
January 10, 2011, 10:08:46 PM
 #75

Perhaps we should build a Forum-Backup capability into the standard bitcoin block chain..... so that a current backup of the entire forum database is embedded into the block chain.   Wink
fabianhjr
Sr. Member
****
Offline Offline

Activity: 322
Merit: 250


Do The Evolution


View Profile
January 10, 2011, 10:33:46 PM
Last edit: January 11, 2011, 12:48:25 AM by fabianhjr
 #76

And have my password hash included? No way!
EDIT: You can use google cache if it ever goes down btw. Smiley

sirius
Bitcoiner
Sr. Member
****
Offline Offline

Activity: 429
Merit: 1002



View Profile
January 10, 2011, 11:55:13 PM
 #77

Sirius, would you care to create a no-sensitive-data version of backups so everyone can backup it like wikileaks ?

Could be done, but not very high priority. We don't need Wikileaks-grade security measures yet.

Iris — for better social networks
I'm not a forum admin - please contact theymos instead.
ShadowOfHarbringer
Legendary
*
Offline Offline

Activity: 1470
Merit: 1006


Bringing Legendary Har® to you since 1952


View Profile
January 11, 2011, 04:45:02 AM
 #78

Sirius, would you care to create a no-sensitive-data version of backups so everyone can backup it like wikileaks ?

Could be done, but not very high priority. We don't need Wikileaks-grade security measures yet.

Hey, nobody is in a hurry here.
I was just asking if You can do it at all.

Pages: « 1 2 3 [4]  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!