Linux Format forums Forum Index Linux Format forums
Help, discussion, magazine feedback and more
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Server Backup
Goto page 1, 2  Next
 
Post new topic   Reply to topic    Linux Format forums Forum Index -> Discussion
View previous topic :: View next topic  
Author Message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Tue Aug 30, 2011 12:36 pm    Post subject: Server Backup Reply with quote

Anyone have any experience with bacula / amanda / bash scripts /anything else for backups?

I have a couple of servers that backup at the moment to their own internal / external hdds, and I want to make the backups a bit more central. I have a freenas server with 4tb of raidZ that I would like to backup to and I am getting a new (intel atom) server to do some network monitoring so I was thinking I could use that as the 'manager / director'

So any "preferences / how long it takes to learn / how easy it is to restore when I'm in canada and the people left are windows people... / what happens when the director dies/ avoid this like the plague / etc" dies comments would be great, thanks

(and yes I have googled)
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
Dutch_Master
LXF regular


Joined: Tue Mar 27, 2007 2:49 am
Posts: 2435

PostPosted: Tue Aug 30, 2011 1:42 pm    Post subject: Reply with quote

1) Determine what needs backing up and how much space you need for it.
2) Put in some cronjobs:
2-1) once a week: scp the entire data-set to location X
2-2) daily: rsync changed data to location Y
3) make sure the backup locations are not accessible by normal users

When a restore needs to be done, scp the latest known correct backup from location X, then rsync from location Y manually. When you put in the cron jobs, make sure different times are specified for each copy action, to avoid clashes and network congestion and make sure enough time is given to complete the job. Also, put in place a system for removal of older backups, discuss the retention period with the 'powers-that-be', making sure they understand more retention means more costs and overhead...
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8464
Location: Warrington, UK

PostPosted: Tue Aug 30, 2011 10:19 pm    Post subject: Reply with quote

After trying various systems, I am now more than happy with BackupPC. It is space-efficient when backing up multiple computers as hard links are used for duplicate files, and as it is all controlled from the server, no software or configuration is needed on the machines to be backed up beyond ensuring that SSH is running.
_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
sledgehammer



Joined: Fri Jul 28, 2006 3:03 pm
Posts: 47

PostPosted: Sat Sep 03, 2011 8:53 am    Post subject: Reply with quote

I'm an Amanda man myself!?

Amanda is command line stuff unless you go commercial with Zmanda. I found Amanda tricky to configure but eventually when you get your head around some strange concepts and configure it correctly it just works and does the right thing. I have found it entirely reliable over the last five years or so. I do suggest that you use Genes helper scripts to backup the indexes as this is an Amanda weak point.

Restoring is easy but a bare metal restore is not, so you would need to practice that. If its for Windows admins then I'm afraid I think you are on a loser with this one unless you go Zmanda which has a web based gui.

Although I mention all the negatives above the big positive is that it has practically required no maintenance over the years I have been using it.
Back to top
View user's profile Send private message
wyliecoyoteuk
LXF regular


Joined: Sun Apr 10, 2005 11:41 pm
Posts: 3452
Location: Birmingham, UK

PostPosted: Sat Sep 03, 2011 9:43 am    Post subject: Reply with quote

+1 for BackupPC.
We back up all of our servers (Windows and Linux) to a Ubuntu server with a 2TB mirror running BackupPC, which has the off-site backup disk archive attached as well.
_________________
The sig between the asterisks is so cool that only REALLY COOL people can even see it!

*************** ************
Back to top
View user's profile Send private message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Sun Sep 04, 2011 2:03 pm    Post subject: Reply with quote

thanks for the replies, i guess I should get reading about backupPC!
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8464
Location: Warrington, UK

PostPosted: Sun Sep 04, 2011 11:00 pm    Post subject: Reply with quote

You could start with LXF125.
_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Mon Sep 05, 2011 11:01 am    Post subject: Reply with quote

ooooh true dat. Now where is that pescky subs number...
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Tue Sep 20, 2011 10:03 am    Post subject: Reply with quote

Ok let me see if I have got this right...

I have installed backuppc onto my new ubuntu server. Now I mount the 4tb freenas share (via nfs) to /var/lib/BackupPC

Then all the backups will go there.

What happens if I want to backup the freenas server to another freenas server (I did want to use zfs replication but I can't get it to fully work Sad )?
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8464
Location: Warrington, UK

PostPosted: Tue Sep 20, 2011 11:06 am    Post subject: Reply with quote

rsync
_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Tue Sep 20, 2011 11:12 am    Post subject: Reply with quote

first backup of webserver running! Bit of a mission to get there, including vs " and permissions with the keys....

hooray!

now to work out how to get rsync to pull...
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8464
Location: Warrington, UK

PostPosted: Tue Sep 20, 2011 11:54 am    Post subject: Reply with quote

rsync doesn't care whether the remote or local end of the connection is the source or destination. As long as you have the appriate SSH public keys on the other box, you only need

Code:
ssh -aH user@otherbox:/var/lib/BackupPC/ /BackupPCbackup/

_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Tue Sep 20, 2011 12:15 pm    Post subject: Reply with quote

I was going to create a cron job on the backup backup freenas server (the one that isn't mounted) to rsync. Takes some of the effort of the backuppc server Very Happy
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8464
Location: Warrington, UK

PostPosted: Tue Sep 20, 2011 2:24 pm    Post subject: Reply with quote

That's exactly what the command I posted does Smile
_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
bobthebob1234
LXF regular


Joined: Thu Jan 03, 2008 9:38 pm
Posts: 1369
Location: A hole in a field

PostPosted: Tue Sep 20, 2011 3:16 pm    Post subject: Reply with quote

wouldn't work, no reference to BackupPC does not exist on either freenas server Cool

would be
/mnt/poolA/linuxBackup -> /mnt/poolC/linuxBackup


also did you mean
Code:

rsync -aH


rather than
Code:

ssh -aH

cos
Code:

ssh: illegal option -- H


or do you and your army for free electrons have some super duper ssh that we mere mortals could not possible comprehend ?

But thanks for the advice
_________________
For certain you have to be lost to find the places that can't be found. Elseways, everyone would know where it was
Back to top
View user's profile Send private message
View previous topic :: View next topic  
Display posts from previous:   
Post new topic   Reply to topic    Linux Format forums Forum Index -> Discussion All times are GMT
Goto page 1, 2  Next
Page 1 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Linux Format forums topic RSS feed 


Powered by phpBB © 2001, 2005 phpBB Group


Copyright 2011 Future Publishing, all rights reserved.


Web hosting by UKFast