3
2

I am looking to find a strategy for backing up data. I have an Ubuntu 10.04 box that I have essentially acting as a server. I work on multiple UNIX systems and I daily backup critical databases, directories, files, etc., via a combination of tar, bzip2, sshfs, and scp. Because of this, I have daily "snapshots" and this will begin to take it's toll on my storage space although I'm okay with snapshots but I was hoping to find out if there is a better way.

Any ideas or pointers are greatly appreciated. One item I am not familiar with and haven't studied is the idea of using tar, etc., to "sync" to an existing tar file. Maybe that's a better way so if anyone can point me in the right direction on that as well.

asked 28 May '10, 15:00

Andy's gravatar image

Andy
2972920
accept rate: 14%

I don't have an 'answer' as such but rsync could be very useful to you. For example the below would only copy files (or bits of files) if they differ, thus not transferring anything un-required.

rsync -e ssh -au /var/www/. root@server2:/var/www/.

(28 May '10, 15:38) gregularexpr...



I've used two strategies depending upon my need. For both I have an online RAID6 array containing a directory for each machine I'm backing up. Currently I'm using a Thecus N5200 which has been reliable for a few years:

1) Rsync is FAST and will help your snapshot problem a bit. It overwrites files having the same name with the newer version. It does NOT delete files removed on the original machine which may be a plus or minus depending upon your need to archive vs. restore.

2) For snapshots using an efficient DIFF scheme to minimize duplication, I use rdiff-backup. It's much slower than Rsync but has allowed me to restore working machines when they've been totally clobbered. It also has a feature allowing you to delete old snapshots. Read all about it (after you install it from synaptic or Applications/Ubuntu Software Center) at:

man (1) rdiff-backup

Good Luck.

link

answered 28 May '10, 15:39

DBA's gravatar image

DBA
2264
accept rate: 23%

rsync is a good option, also I find simple-backup and also luckybackup to also be useful in their own ways. Obviously if you JUST want to backup folders and files, that is different than say backing up entire systems, which you would use a different toolset to do, like Clonezilla.

https://help.ubuntu.com/community/BackupYourSystem/SimpleBackupSuite

link

answered 28 May '10, 22:24

Ron's gravatar image

Ron ♦
9361618
accept rate: 13%

edited 28 May '10, 22:42

rsnapshot will give you the benefits of daily snapshots without taking much more space than a single snapshot (at least for normal usage patterns. If you have a ton of data changing on a daily basis, you'll want to explore other options).

rnspashot - http://www.linuxquestions.org/linux/articles/Jeremys_Magazine_Articles/Backups_with_rsnapshot

--jeremy

link

answered 11 Jun '10, 02:16

jeremy's gravatar image

jeremy ♦♦
1.0k1516
accept rate: 37%

Unison File Synchronizer works wonderful in this direction. http://www.cis.upenn.edu/~bcpierce/unison/

link

answered 18 Jun '10, 09:11

ananth.p's gravatar image

ananth.p
1313
accept rate: 0%

Tar is not meant for incremental backups, unless you're using tape. Rsync is the best solution I've found. I have a script that has worked well for me for years, which you can download from

http://www.unc.edu/~adamsonj/files/jbackup-0.1.tar.gz

It's licensed under the GPL.

Keep in mind that experts (i.e. paranoids) recommend you having backups on multiple media, and in multiple locations, e.g. in case your house burns down or some kind of catastrophe destroys your whole system (including the external hard drive you are mirroring to).

Enjoy! Joel

link

answered 19 Jun '10, 19:49

trashbird1240's gravatar image

trashbird1240
11
accept rate: 0%

rdiff-backup used with http://smxi.org/site/about.htm#rbxi

link

answered 12 Aug '10, 01:47

craigevil's gravatar image

craigevil
1162
accept rate: 6%

Well,

If you are a Perl oriented person then http://search.cpan.org/~lbrocard/Dackup-0.44/lib/Dackup.pm is your friend. i use it for everything and anything. just make a backup aplication (20 lines of code) and set it under crone and all problems solved. (for me at least)

link

answered 17 Aug '10, 07:53

Robert%20Bakaric's gravatar image

Robert Bakaric
1
accept rate: 0%

Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "Title")
  • image?![alt text](/path/img.jpg "Title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×10

Asked: 28 May '10, 15:00

Seen: 2,904 times

Last updated: 17 Aug '10, 07:53

powered by OSQA