Ask Slashdot: Heterogeneous Network Backups w/Linux? 124
drix asks:
"Like many I'm running a Linux gateway between my
home network and cable internet connection. Naturally, I'd
like it if my Linux server, 4 Win 98 boxes, and
iMac could do a nightly backup. The problem is I only have
one tape drive, which is, of course, situated in the
server. So my question is what software exists that, a)
runs on Linux, b) exists in a client server form, where
the server runs a "backup daemon" that each client
connects to to backup its respective hard disk each night,
and c) has clients available for Windows and optionally
Mac? I guess the analogous NT ware would be Seagate
Backup Exec, which runs on an NT server and polls NT
workstations nightly for any changed files, and then uses
delta file compression to zip those changes to the server's
tape drive. I don't need anything that complicated, but I
must have the basic ability to move the files."
Re:CD-RW? (Score:1)
Re:backup programs for Linux (Score:1)
Security no-no (Score:1)
Re:Interesting.. (Score:2)
backup programs for Linux (Score:3)
Backups
http://www.amnda.org/ - Amanda
ftp://ftp.zn-gmbh.com/pub/linux/ - afbackup
http://www.cs.wisc.edu/~jmelski/burt/ - Burt
http://www.estinc.com/features.html - BRU
http://www.estinc.com/qsdr.html - Quickstart
http://www.unitrends.com/bp.html - Backup Professional
http://www.unitrends.com/ctar.html - CTAR
http://www.unitrends.com/ctarnet.html - CTAR:NET
http://www.unitrends.com/pcpara.html - PC ParaChute
Commercial:
http://www.arkeia.com/ - Arkeia
http://www.legato.com/Products/html/legato_netw
http://feral.com/networker.html - Legato Networker server
Now not all handle multiple OS's, etc. But of the freeones it was afbackup or amanda (or both) that did.
good luck.
http://www.seifried.org/lasg/
Hmmm (Score:1)
One think you should remember is that you may not want to do full backups on the machines that don't have the compatable tape drive -- you won't be able to load the data off of the server to the client without getting the OS installed even after a disk crash!
What I'd do is use netatalk and samba to have the same (home, maybe) mounted on all the machines... that way you have a centralized point that has all your important data. Additional data could be left only on the server.
Rumor Mill (Score:1)
Re:CD-RW? (Score:1)
Well for one thing, 9 GB of data can fit on a $14 12/24 gig DDS-3 tape.
These tapes were made to be rewritten over 1,000 times, aren't prone to scratching, doesn't require swapping for only 9 gigs of data, and are very small.
Not to mention tape is slightly faster writing than CD-RW's. While CD-RW's write at 300-600 KB/s, tapes can write at about 10-20x that.
You pay a little more for a tape drive, $700-$900 for an drive depending on make/model and internal or external.
--
Re:Here's an idea (for the Mac) (Score:1)
I have never used Appletalk, and I don't really know what it's about, but I assume that it is yet another file sharing system. Linux kernels have support for AppleTalk. Perhaps you could copy files from your Mac via the AppleTalk daemon.
Good luck to you!
Re:Backup for the Mac simple.. maybe Windows too.. (Score:1)
I heartily second the motion for Retrospect.
I got a freebie copy with a DAT drive. It rules!
Put the tape drive on your Mac, mount everything
to be backed up on it, and Just Do It. It is Really Easy, and it works Very Well.
Your boss should kick your ass anyway, then. (Score:1)
According to our backup server (and the number of tapes we go through), since version 6.5, Backup Exec has backed up with incremental backups. I have no experience with prior versions, so I can't comment on them.
If you can't get it to work, that's not Backup Exec's fault.
One way... (Score:1)
Re:BOFH (Score:1)
anything you want to keep is to be kept on the server.
I fully reserve the right to come in on the weekend and change your workstation around (bigger/faster/whatever). Anything on the local drive is temporary. Only two have learned the hard way. The rest all do as I say and keep important stuff on the server.
If that makes me a BOFH, then I accept. But I'll be god damned if I'm gonna worry about each and every workstation we have and recuing some program or data that I have repeatedly told them to keep on the server if it was important!
Simple approach (Score:1)
Re:Backing up your Mac (Score:1)
In any case, most Mac-friendy apps do use aliases for many reasons, both for locating resources like libraries, the preferences folder, other applications, etc. They dont store a number per se (least not any more than any other binary data is really a number) but rather an alias object, easily created with the current path/reference of the target object (aliases are for more than just files).
Just so you know... and if Macs really operated that way I wouldn't think it was too nifty. In fact I love the way I can move installed apps between volumes or machines and NOT have to reinstall (at worst, on a different machine, you normally have to move only a single pref file or folder, except MS products which feature dozens of libraries and folders).
Also, I dont know what you think is funky about Mac pathnames, it simply uses ":" as a delimiter instead of "/"... the leftmost item is the volume name, just like most other OSes, and the rest is the path, again like other OSes. All thats different is the delim.
Just so we don't have any misunderstandings...
Bb.
Re:Try Arkeia (Score:1)
i don't know if you know this or not, but Seagate Backup Exec is now Veritas Backup Exec and last i heard, a new linux client is included w/ the latest binaries. of course, you're still stuck w/ NT as your manager but maybe that will change if ppl comment to Veritas enough.
#define cascade, linking multiple drives into one pool that make the pool look like one giant tape drive.
-l
VERITAS Backup Exec UNIX Client (Score:1)
http://support.veritas.com/menu _ddProduct_BEWNT.htm [veritas.com]
legato networker. (Score:1)
Re:Arkeia - by Knox Software (Score:1)
You don't know the half of it. Arkeia was written in France and then translated for the US market. I found one place in their PDF manuals where one of the tables is still in French. Elsewhere in the docs, there are awkward bits of phrasing and grammar errors.
Still, the package does work well, and it's cheap. For home use it's free, but you're limited to 2 clients. But for about $150, you can get a 5-client license which works nicely.
We use this package at work every day. It's not perfect, but it beats the hell out of installing a tape drive in every box.
Re:Yeah, you can do it. (Score:1)
Sorry, that won't work except for the simplest setups. (I.e. where you don't want complete backups, but rather just a selected subtree or two.)
The problem is in file locking. Many files (the registry and paging files are a prime example) are locked all the time. Typical backup programs like tar will just sit there patiently, forever waiting for the files to be unlocked when they come across them.
This is, of course, a result of Windows sucking, but bitching about it won't change the fact that sometimes you've just gotta back up a Windows box.
Elsewhere people have suggested Arkeia. I second this, as it not only handles true network backups, it does incrementals, keeps an off-tape log of files backed up so it's very easy to restore things, and it handles the registry on a Windows box appropriately.
It has other nice features, too: mutltiflows, so it's backing up more than one machine at once, for efficiency; separate GUI and backup processes, so you can start it and then shut down the GUI; a Java GUI that will run anywhere; and it's cheap.
Re:How do you back up the registry? (Score:1)
You don't. This is one of many reasons why specialized network backup programs exist: they know to handle the registry and pagefiles a special cases.
Re:Try Arkeia (Score:1)
Re:Rumor Mill (partially confirmed) (Score:1)
Interesting.. (Score:1)
Unfortunately for the Mac there is no free UNIX-like shell, like CygWin on the PC, so you miss some scripting tools.
Have you set up Netatalk and the piece that lets Linux talk back to the Mac? You might be able to use Retrospect on the Mac, then AppleScript midnight copies to the "Appleshare" running on Linux.
I odn't have a solution, but maybe some of this helps. Cheers,
Re:backup programs for Linux (Score:2)
Freeware
http://www.amanda.org/ [amanda.org] - Amanda
ftp://ftp.zn-gmbh.com/pub/linux/ [zn-gmbh.com] - afbackup
http://www.cs.wisc.edu/~jmelski/burt/ [wisc.edu] - Burt
http://www.estinc.com/features.html [estinc.com] - BRU
http://www.estinc.com/qsdr.html [estinc.com] - Quickstart
Commercial
http://www.unitrends.com/bp.html [unitrends.com] - Backup Professional
http://www.unitrends.com/ctar.html [unitrends.com] - CTAR
http://www.unitrends.com/ctarnet.html [unitrends.com] - CTAR:NET
http://www.unitrends.com/pcpara.html [unitrends.com] - PC ParaChute
http://www.arkeia.com/ [arkeia.com] - Arkeia
http://www.legato.com/Pro ducts/html/legato_networker.html [legato.com] - Legato Networker Linux client
http://feral.com/networker.html [feral.com] - Legato Networker server
Backup for the Mac simple.. maybe Windows too... (Score:1)
And it will backup to an FTP server too.. so just create a MacBackup directory on the Linux box, and have the iMac do it's backups to that directory, then just back those files up to tape from the Linux box locally.
I'm pretty sure it will do the same for Windows, and it's pretty cheap (Cheaper than BackUp Exec.)
Re:Amanda (Score:1)
Oh yeah, we use a 12-cartridge 4mm stacker, a single 4mm drive, and an old Conner "floppy tape" on 3 different backup servers...
Richard.
Re:CD-RW? (Score:1)
Thanks.
Re:Image the Disks? (Score:1)
CD-RW? (Score:2)
Linux seems sadly lacking in the area of backups - it's all based around backup-to-tape
--
Networker (Score:1)
BOFH (Score:1)
My policy on it irritates people, hence the title of my post. With the number of workstations I have to manage, I consider workstations expendable. If the Win9x/Winnt4 station eats itself, oh well... reinstall and get on with it. I tell everyone to keep anything they care about ON THE SERVER. Some dont listen, and they lose stuff when Windows blows up completely.
okay, so I suck (Score:1)
My setup is this: On my dedicated backup server I have NFS mounts to the main Linux servers. I run BRU on a crontab that does a incremental backup daily and a full backup weekly. I used a rather ugly hack on the MTX driver for the DLT library control, but it works very well. I chose BRU because of it's verify pass on backups. Makes me feel better about the amazing amount of data I've been asked to manage. For the database, I just dump the contents of what it backed up into different
My point is that if you keep everything on servers, locating, backing up, and restoring is easier.
However, if you must keep stuff on the Windows machines, smbmount should work fine allowing you to keep everything mounted in one place. Someone already said this, but for the Mac, use one of the utils that lets you use SMB and "share" the directories.
One last note, if you are doing this over the internet, I would hope you're using a vpn of some sort
Re:Maybe all you Admins should do your job... (Score:1)
2)I dont back up my workstation. I keep my stuff on the server.
3)I have drop in replacements sitting in the back. The customizing for the individual user takes maybe an hour. Restoring from tape takes FOREVER. Besides, the user can shift over to another workstation while I'm setting up Outlook and the other stuff. Big deal.
4)Backing up all the workstations would make my already enormous backup even bigger. This costs more money in tapes, takes longer, and is harder to sift through when there is a problem.
5)I dont know if you noticed, but I have not been using the term "we". Guess why! Because I'm the only one who does internal support. With it being only me, I _need_ everything centralized.
How about FTP? (Score:1)
It's probably not the fastest way to do backups, but it's simple, fast to implement, and easy to extend.
Re:CD-RW? (Score:1)
I perused MANY HOWTO's/Sites/dejanews posts before I finally got mine working (and I've been using Linux/compiling kernels since 1994!) I've had similar problems getting my Hauppage TV card, printer, and Diamond Stealth II G460 video card going under 2.2.x. I'm currently roughing out a series of webpages under a working title of "It Doesn't Have to be This Hard" that will, hopefully collect all the info I needed to get these "odd duck" pieces of hardware going into one place. A lot of it was painfully obvious one I figured it out.
I'm starting with the CD-RW... email me if you think I can help. (Am I gonna need a new ISP tomorrow?)
davewalker@zebra.net
Money for backups? (Score:1)
Here's an idea (Score:2)
/mnt/smb/win01/c
/mnt/smb/win02/c
...
get mounted to
I don't know about the Mac - but if you can find a way to mount a Mac volume from Linux your set.
If autofs cannot handle SMB mounts - just write a perl script that will parse a text file with this information and have your backup tool/cron run this script first.
Re:Image the Disks? (Score:1)
Store important files on the linux box (Score:2)
It's better to use the linux box as a real server, then configure the other machines to store *important* files on the server. Don't back up the clients, just the server. Since you have to re-install windoze every 10 minutes, this is nice too becuase you can trash the windows box, re-install everything and still have all your important files accessible. Restoring backups on windoze is a nightmare (without something like arcada (even then, I bet it's a mini-nightmare)) because of their brain-dead long filenames.
-=Julian=-
Re:Or rcp or rsh? (Score:1)
-earl
yep - a couple of options (Score:1)
Alternately you could use BRU and do the same thing (via scripts and shares...)
HTH
Re:Rumor Mill (partially confirmed) (Score:1)
Backup Exec isn't going anywhere for awhile either.
Netbackup is a cool product.. yes spendy, but it does everything under the sun.
(yes, I work for veritas, so I may be biased)
Re:Money for backups? (Score:1)
Backup clients DO help, and make work easier.
Besides, why? Because, it exists for other unix platforms.
Re:backup programs for Linux (Score:1)
Re:Try Arkeia (Score:1)
Very cool, and it supports the nifty tape library we just purchased too.
Re:How do you back up the registry? (Score:1)
Re:Backup for the Mac simple.. maybe Windows too.. (Score:1)
Retrospect is excellent, only problem is that the server only runs on Mac (a beta of the NT exist but is not usable yet.). We use it to back up about 100 macs and some pcs. We have done backups to tapes and to CD's. No problems.
On my machines (some 10 unix machines) we only use some scripts that search for files that has changed since tha last backup, and then afio these files to the tape. Main problem is that we create to many files and the tape station is not reliable enough. We will change to CD or DVD soon (when someone has time to change the script)
Re:Seagate Backup Exec already supports all that (Score:1)
don't blame me... I didn't pick NT
AS/400 support in any of these packages? (Score:1)
Re:Seagate Backup Exec already supports all that (Score:1)
The moral? Check the support documentation for supported OS versions.
Graduate of the Mad Max school of defensive driving.
Re:backup programs for Linux (Score:1)
Re:Rumor Mill (partially confirmed) (Score:1)
Re:Rumor Mill (partially confirmed) (Score:2)
To do this I hadx to buy the 7.3 version of Backup Exec for NT... (I upgraded from 7.0... it was like $400 for the upgrade). On the CD is a Linux "agent". It installs pretty nicely if you have Red Hat 5.2... otherwise gives you a warning about "unsupported UNIX platform" but worked OK on RH 5.0 and RH 6.0 (we don't have any other distributions, call me a follower... my guess is that it wont be pleasant to get it to work under another distro) It so far is also a real pig... Linux clients get backed up to the NT BE server at about 4.8MB/min (what is that? 500kbps?). In any case, 4.8MB/min across an Ethernet during a backup is not good. By way of comparison, our Windows clients get backed up at about 170MB/min.
Additionall problems: the agent requires a password for access by the backup server... you specify the password during the install of the agent on the Linux machines.
The password is:
1. shown in the clear as you type it in (the install is just a batch script, guess they didn't know how to change the tty settings during the password entry).
2. stored in the clear in a config file
3. exposed to all users, as the directory the agent install creates and the agent config file is permitted rx for other. (i changed it, of course, to be unreadable by anyone but root)
three things that tip you off that the guys in this division of Veritas dont write much UNIX software:
1. the speed
2. the default security problems i mentioned
3. the agents come in a tar file that, when untarred,expands files into the current directory instead of creating a directory from your current one (not a big deal, but its a tipoff that they're used to PKZIP).
4. the post-agent-install tip that you can start the daemon by "restarting your workstation". so funny. not just "/etc/rc.d/init.d/agent.init start", but "restart your workstation". it's classic.
In any case, I'm glad the agent exists even with its faults because it makes my life much easier.. rather than having to administer 2 backup systems (one for NT, one for *NIX), I can do it all from one console... Of course, I don't know if it actually completely *works* yet, as the backup is running as we speak, but hopefully the verify results work out...
Bottom line observation: Commercial software running on Linux is sort of scary. None of the niceties of community-produced stuff. I dont think I'd *want* to see the code...
Re:Seagate Backup Exec already supports all that (Score:1)
Try it...
Re:Your boss should kick your ass anyway, then. (Score:1)
I've been all over it up and down.
It will do either a "NORMAL" (full) or a "DAILY" which is only files changed in the current day, meaning between the start time and midnight the previous day. All the other "backup types" depend on the windows archive bit and so will always perform fulls. Try it...
don't forget macdump (Score:1)
Not that this is necessarily the best solution out there, but I mention it for completeness.
Here's what I do.... (Score:1)
I bought the personal edition of Retrospect for the Mac, and backup via FTP to the Linux server. Hard disks are cheap enough for this to be the easiest solution for me (I use an old slow one for the backup).
For the Windows machines, the Linux box mounts their disks with smbmount.
Then I can run BRU Personal Edition (came with RedHat) on the Linux machine to back all this up.
When I got a second Linux box (firewall) I NFSed that up to the main server, and bought the normal version of BRU which will do NFS drives.
There are probably better ways to do all this, but this method works well enough for me, and I'd rather spend my time messing with other things
Simon
Re:Rumor Mill (OmniBack) (Score:1)
Redefine the problem (Score:3)
Instead of asking how your Linux server can back up Windows and Mac clients, why not ask how much you can move from your Windows and Mac systems to the Linux server?!
After my Windows system crashed yet again, I reinstalled the system (which, thanks to Toshiba, formats the disk so I lose any files which survived the crash) I set it up to use a network login - my "profile" and personal files are stored on my Linux system in an ext2 partition... and are backed up nightly. Likewise, I reinstalled all of my applications to a SAMBA "network" drive. I then changed the permissions so most of the files were read-only - no more Word viruses.
This isn't perfect, but I'm a lot more comfortable with my Window system mounting network drives from my Linux box than my Linux box trying to SMBMOUNT the Windows system for backups.
P.S., I use Amanda.
Maybe all you Admins should do your job... (Score:1)
PS: I'm probably a better network admin than an employee, although my employee-bias probably makes me appear otherwise.
Or rcp or rsh? (Score:1)
tar cf - yourDir | rsh remoteHost cd
or tar it to
As for desktop OSs: Servers get backed up. Desktops don't. Clients pull files. Servers serve them. Therefore clients keep files on servers or risk being LARTed hard.
--jpg
Real-world example (Score:1)
We also have samba and netatalk installed on this machine so both Macs and PCs can mount the shared volume as a network volume. We then use platform-specific back-up tools (Retrospect from Dantz in this case for both machine types, but you can mix and match)on each machine to write back-up archives to the shared Linux volume.
The cron task fires up tar at 4 AM and streams the whole pile of archives off to tape. First person in in the morning swaps tapes.
One advantage of using Retrospect is that it can perform Mac and PC back-ups via FTP, without the need to mount a shared volume.
C.
Another vote for Amanda (Score:1)
backing up cross platform (Score:1)
alternatively there are NFS classes form sun, so you could get your mac and wins to nfs mount via java and move the files that way.
Re:CD-RW? (Score:1)
Cycles.
Tapes (even cheap DDS-tapes) can take several tens of thousands of read-write cycles (DLT tapes have the most: >1 million cycles)
AFAIK, CD-RW have much less cycles.
Oh, and another word:
Lifetime.
CD-R's become a pile of dirt after a few years in bad conditions (non-constant heat and humidity) and need constant climate and darkness to last decades.
i dont konw the numbers for CD-RW (since im not interrested in them), but i would guess they last even less than CDR's.
Tapes last for decades.
my 2 cents (euro)
--
Jor
--
Keep your data on the server, image the win98's (Score:1)
I like my setup:
All my data is on my Server. I a workstation goes down I don't care - I have not lost anything. I backup my server.
I do fiddle around a lot with my PC's. I like to try out different OS's, different Apps.
I create base OS installs with all updates and current drivers, then I use Ghost or DriveImage Pro to create images of these base OS installs on my server. That way I can restore them whenever I want. With compression, even an NT installation takes under 150Meg on mt server.
Another trick for rapid restores: My primary workstation runs NT (don't flame me - I am already in a world of pain!!!!). I have a 1 Gig boot/system partition, and a 7 Gig partition. I frequently backup the 1 Gig partition that holds the OS by Ghosting it to my server. I install apps to the D: drive. If my system crashes, I restore the C: drive, and I am OK - that restores the OS, registry, and most system files. A nice rapid restore (not %100 fool proof, but very convenient.)
Good luck.
BTW: There is a free imaging app available at:
http://cuiwww.unige.ch/info/pc/remote-boot/howt
It is part of their great and imaging remote boot solution!
Re:Image the Disks? (Score:1)
http://cuiwww.unige.ch/info/pc/remote-boot/howt
Last time I checked it is free for non-commercial use. I have tested it with Win9X clients. The image creation process is slow, but the restore speed was fine.
The link has a terrific solution!
Hope it helps!
Arkeia (Score:1)
It has clients for most everything, server is similar.
We run it on Linux.
Don't remember a Mac client, however, use netatalk, and have the Mac copy itself to a volume on the Linux Box...then back up that volume.
I'm using smbtar to backup Win NT (Score:1)
smbtar comes with samba.
I'm also running netatalk to share files on the linux box with a Macintosh, but I don't have a clue how to back up the Mac.
I've done it with Java/samba combo. CVS planned (Score:1)
Ah!! I have another question, is possible to use CVS as a backup server? I think it could be amazing. Someone tried this?
Amanda (Score:1)
Re:Interesting.. (Score:1)
network with a product called "Dave Client". It
is a Netbios client program for the Mac and lets
you network it like a Windows PC.
see http://www.thursby.com/ for details. We use
smbtar (SAMBA tool for backups) on our Linux box
to back up both the Windows PCs and Macintoshes
that way.
A Spendy Solution, but a good one... (Score:1)
Re:Simple approach (Score:1)
Jason