How To Move Your Linux Systems To ext4 304
LinucksGirl writes "Ext4 is the latest in a long line of Linux file systems, and it's likely to be as important and popular as its predecessors. As a Linux system administrator, you should be aware of the advantages, disadvantages, and basic steps for migrating to ext4. This article explains when to adopt ext4, how to adapt traditional file system maintenance tool usage to ext4, and how to get the most out of the file system."
But does it run... (Score:2, Funny)
Re:But does it run... (Score:4, Funny)
Comment removed (Score:5, Funny)
Re:But does it run... (Score:5, Funny)
Re: (Score:3, Funny)
Well, you open up your computer to find that the hard drive has been removed ..
And the rest of the PC interior has been carefully cleaned.
Re: (Score:3, Funny)
Re:But does it run... (Score:5, Funny)
Re:But does it run... (Score:5, Funny)
Re:But does it run... (Score:4, Funny)
Even if you found a platter under the front seat.
Mere Mortals? (Score:2)
Re: (Score:3, Funny)
Re: (Score:2)
Nice trick.
Not for the casual user (Score:5, Informative)
Re:Not for the casual user (Score:5, Funny)
Re:Not for the casual user (Score:5, Informative)
It is unlikely the common desktop (or even, for that matter, the common server) will see appreciable performance increase with it.
Disk sizes are going up. In a few years you'll see a terabyte on a single drive. I'd also say that features like undelete, and online de-frag are important to anyone.
So while you may not see any real performance increases, that's really beside the point.
Re:Not for the casual user (Score:5, Funny)
Re:Not for the casual user (Score:5, Funny)
Re:Not for the casual user (Score:5, Informative)
Re:Not for the casual user (Score:4, Funny)
Re:Not for the casual user (Score:4, Insightful)
Now when we have ten TB drives....
Good grief people Yea just keep a few thousand TV shows on your desktop.
Re:Not for the casual user (Score:5, Funny)
Re: (Score:3, Interesting)
Re: (Score:3, Interesting)
As for your other points, it's largely a packrat mentality. There
Re: (Score:3, Interesting)
It is just more productive to grab the DVD.
Re: (Score:3, Informative)
1) People wanting a lossless copy of the original media. i.e. purists.
2) Bonus content.
3) HD video.
4) Kids - they will want to watch different movies, over and over and over, at different ages.
5) Watching a movie with friends.
6) Keeping it all out of sight, out of mind.
7) Wanting to keep the NAS within a small power threshold, i.e. more easily done with higher storage density/fewer HDD. Better for the environment too wi
Re: (Score:3, Insightful)
There's nothing better than to sit down with the wife one evening and use the remote and flip through the DVD collection on the TV and start the movie without having to get up and figure out what to watch.
It also means we're more likely to watch something we both enjoy rather than whatever happens to be on the TV at that time.
Re: (Score:3, Interesting)
Re:Not for the casual user (Score:5, Funny)
Re:Not for the casual user (Score:5, Funny)
I'm just happy when it's done for me, and I don't have to handle it manually. When fscking fails at the beginning, it can ruin your whole day if you're not an expert.
Re:Not for the casual user (Score:5, Funny)
Usually my problem is that my fsck gets a "fsck-completed-normally", when the media is really only half fscked.
But don't worry -- fscking takes practice. If you got a quality media, you can half-fsck it many times before the media fails completely.
May I also suggest fscking aids? There are many tools on the market that can help when your fscking routinely fails doesn't complete. They're usually lightweight and easy to use, and can help to save your media from getting fscked elsewhere.
As you said, when all else fails, sometimes you really do just need to handle it manually.
Re: (Score:3, Interesting)
1 TB
500 GB
300 GB
When they decide to fsck at the same time, it can take 1/2 hour or longer to get to the login screen.
Re: (Score:3, Informative)
man fsck
"filesystems on different drives will be checked at the same time to utilize parallelism available in the hardware."
If / is small it will be quicker. If / is a large partition then it hinders any parallelism.
The sixth field, (fs_passno), is used by the fsck(8) program to deter-
mine the order in which filesystem checks are done at reboot time. The
Re:Not for the casual user (Score:5, Interesting)
Re:Not for the casual user (Score:5, Funny)
Re:Not for the casual user (Score:5, Funny)
I can tell you're a slashdotter. When most people fsck they want it to last as long as possible.
Re:Not for the casual user (Score:5, Funny)
Re: (Score:3, Interesting)
I transcode my Myth stuff on an ext3 partition, and occasionally get complaints about the larg
Re: (Score:3, Informative)
And if you care about that data make a backup and even better run a raid.
Remember EVERY HARD DRIVE IS GOING TO FAIL SOMEDAY.
Re: (Score:3, Interesting)
Re: (Score:2)
Really? My (comparatively) cheap laptop has 640gig of storage, and when you start getting into video, 640g is NOT enough!
You can buy 2 x 500gig desktop hds for the grand total of $150.
At that price, a terrabyte will be the "new pink" within a couple of years. Just like 2
Re:Not for the casual user (Score:5, Interesting)
That said, ext4 is unstable. It can easily eat your data. Just say NO to moving your filesystem to ext4 - for now.
Re:Not for the casual user (Score:4, Informative)
XFS has both extents and delayed allocation. I really don't know why we need Ext4. XFS has been a very solid fs for quite some time now, it's sad that more attention hasn't been payed to it from kernel hackers. The whole idea behind Ext4 seems to be more of a NIH syndrome than anything else. I could understand if it was radically different but it isn't.
Re:Not for the casual user (Score:5, Insightful)
One of many reasons right here [brillig.org]
I messed around with Ext4 for a little while on my machine (Like a couple days, just toying with it and seeing how its performance compares to Ext3 and Reiser4) a while back, like maybe a little bit before it was merged as experimental in the mainstream kernel. It is fast, backwards-compatible and extremely featureful. XFS is not a bad filesystem, but it has some problems, in my eyes. Metadata-only journaling, aggressive caching that makes it a potentially dangerous choice if you don't have a UPS, very slow metadata and deletion operations.
That's great that XFS has a lot of features Ext4 is bringing to the playing field, and has had them for a long time. To pretend, however, that the developers of Ext4 simply have a NIH syndrome is just silly and disregards the fact that there is a lot that Ext4 already provides that XFS doesn't, and even more that it will soon. You might not see what the big deal is, but really, I can assure you that it won't be very long before the new ideas Ext4 employs are in widespread use.
Here's an interesting article [byteandswitch.com] that really caught my eye with this: "Storage snapshot: The financial firm has more than 14 Petabytes of active storage and plans to add "several more Pbytes" within the next 12 months."
Re: (Score:3, Insightful)
Well yeah, but Slashdot seems like a pretty good place to find people who administer multi-TB systems, no?
A terabyte isn't what it used to be (hell, 1TB SATA disks are pretty common) and ext3 sucks pretty hard even on a measly TB.
Does the sub-TB desktop crowd even care about filesystems? I mean, they all pretty much work and these days the popular ones have pretty similar performance (on a single s
Wikipedia entry (Score:5, Informative)
Re: (Score:3, Funny)
Re:Wikipedia entry (Score:4, Funny)
Now now, don't give us too much credit
It's like ext2 times two, stupid.
Re:Wikipedia entry (Score:5, Funny)
Re: (Score:3, Funny)
No, wrong. it's the next stable release of ext. remember people, odd numbers are development, even numbers are stable!
okay, mod me down, I should really come up with new jokes [slashdot.org].
Re: (Score:2)
Thank you, GP, for saving me the seconds of typing with a convenient link. And shame on you for wanting to put out a candle that might be used to light the darkness.
Preempting the prefix war (Score:4, Insightful)
Of course, in this case you have to balance the confusion stemming from the Tera in IT context meaning 1024 in some cases. To be honest, people insisting on the new naming, they should have come up with a sensible sounding name and promoted that. You have to remember that language, even technical language is for the people. There are lots of ways to craft a beautiful, logical, symmetrical language that no sane person would use because it just doesn't sound convenient.
Maybe a linguist can pitch in to explain why tebibyte sounds so awful?
Re:Preempting the prefix war (Score:5, Funny)
Hey hey hey!
Re: (Score:2)
Tebibyte: Ubit's bubad bubecubause ubit mubakes yubou subound lubike Mubushmubouth.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I just hate the mindset that comes up with all of this stuff, it reeks of the sort of person who alphabetises everything and writes into newspapers to complain that they misused the apostrophe one time on one page. I mean for god's sake, take
Re: (Score:2)
Re: (Score:3, Funny)
I'd say that i fyou define that 1KB is 1 billion bytes, then you've got bigger problems than the marketing departments of drive manufacturers.
Indulging the prefix war (Score:5, Insightful)
Personally, I think the whole thing is a mess, and computer professionals should be working harder to enforce a consistent scheme. Unfortunately, only a minority of computer professionals seem interested in changing the status quo confusion.
I think the real problem is that people, inherently, are loathe to change. They are more apt to come up with rationalizations and justifications for doing things "the old way" rather than put in the work to learn (and code!) a new system. Sorry if this sounds harsh, but I find the people who say the binary prefixes "sound dumb" or say that "the current (inconsistent)* system works fine" are just coming up with excuses to avoid doing the work to use a properly consistent standard/notation.
Maybe you're right, and that if the new prefixes had sounded "cooler", then adoption would have been faster... but I'm not so sure. Even if true, it doesn't absolve any of us for allowing the confusion to persist: cool or not, we (geeks especially!) should have the discipline to use proper standards.
* The current system can be roughly described as: SI prefixes are powers of 10 everywhere except in computer science, when they become powers of 2. But only when referring to memory, and some data structure sizes, but not when referring to transmission rates or disk space (unless it's a flash drive, sometimes), and other kinds of data structures.
Re: (Score:2)
Hard drives have the MiB-MB problem because manufacturers wanted to be able to say 60GB instead of 54GB. When you buy a monitor, you have look for viewable size in much smaller print. Then there is the dithering you hear about on modern LCDs. I've also heard that early monitors were measured by their horizonta
This is going to sound crazy but... (Score:2)
Re: (Score:3, Interesting)
In any spoken language, different sounds are loosely associated with different ideas. As a simple example, voiceless sounds, like p, k, t, f, and s, are well suited for pointed use, as in pejoratives; and r, especially the alveolar trill variety, is associated with intimidation or primality. These associations are made either because it sounds like something else ("rrrr" sounds like an animal's growl or roar -- notice the Rs in "growl" and "roar"?)
Re: (Score:2)
Wait, what? (Score:2)
Nanoseconds.
We're dealing with a process whose maximum useful precision is "has the green light gone off yet", and we've got nanosecond timestamps.
Re: (Score:2)
Re: (Score:2)
And the timestamp isn't in
Re:Wait, what? (Score:5, Informative)
IIRC, today's PCs have high-resolution timers available that surpass the old 14.318MHz clock chip. If you can't get accurate nanoseconds out of the timers yet, they'll just round the numbers off. No big deal.
BTW, NTFS uses 100ns timestamp granularity, and it was designed when systems were almost 100X slower than today. So it had a similar amount of overkill, but that certainly doesn't seem to have had any negative impact on the acceptance of NTFS.
Re: (Score:2)
Not now, and not in the near future, sure. However, who's to say that it won't happen, possibly sooner than we think? The developers had the room to store times that accurate, so they probably just put it in to allow for future developments.
Re: (Score:2)
Actually, on my system, it's a yellow one, just under the green power light.
To all ext3 users... (Score:5, Informative)
On a related sidenode: I'm very happy with SGI's xfs right now. ext\d isn't the only player in the field, so please, go out and boldly evaluate available alternatives. You won't be disappointed, I promise.
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2, Troll)
Re: (Score:2)
Re: (Score:3, Interesting)
XFS kills ext in terms of not losing data. I have recovered lots of data from failed drives that were XFS formatted. Not so with ext3 which tends to flake out and destroy itself when it gets bad data.
And don't even mention ReiserFS, that has always sucked. I have lost more data to Reiser than any other filesystem (ext is a close second though). Sometimes it would co
Re:To all ext3 users... (Score:5, Interesting)
ext3 is both so slow and so bottlenecked that mythtv had to implement a special "slow delete" mode which gradually truncates files instead of just unlinking them. Without the "slow deletes" mode, you get hiccups in any shows that are being recorded while old shows are deleted.
On my system, deleting a 20GB file can take a minute on ext3 (and the filesystem is completely locked - all other processes are blocked), but on ntfs it is almost instantaneous.
Re:To all ext3 users... (Score:4, Insightful)
I seem to be plugging XFS in every fs thread recently, so I'll second that - I'm really surprised it's not more popular.
ext3 may have, more or less, caught up to XFS in IO speed recently, but file operations on large filesystems are still a disaster - just try deleting a 2TB tree with a couple million files in ext3, I dare you.
Step 1 (Score:3, Informative)
OK, all done!
undelete (Score:5, Informative)
But does it undelete... (Score:2, Interesting)
Re:But does it undelete... (Score:4, Informative)
POSIX was not and should not be designed in such a way that "undelete" is reliably possible. That's like saying can I unlight that match. Can I unbreak that egg?
An unreliable system that may, on the odd chance that the file structure has not changed too much, recover files from a disk that have not been over-written yet is no replacement for NOT being an idiot and being careful when you delete something.
Re: (Score:2)
Re:But does it undelete... (Score:4, Insightful)
The greatest feature of modern software is "Undo." Everything I can screw up on the computer should have an Undo-- that's what the Recycle Bin (or Trash Can for Mac users) is there for, although it's a bit more awkward than pressing control-Z.
Call it stupidity if you want, but my system files (you know, the ones that file permissions actually protect from malware) are worth approximately zero, and my personal files (the ones that malware can delete no question asked) are worth hundreds of man-hours, if not thousands, and ten times that in dollar value.
Windows Shadow Copy has an exact template on how to implement it, now go implement it.
(And yes, I keep backups, as should everybody. But there's no excuse not to use spare disk space as another layer of defense.)
Re: (Score:2)
So if you want some sort of soft delete, don't use rm or del. Use a tool that 'soft deletes' a file by moving it into a trash bin, which you can 'hard delete' when you need more space. This is how Windows and KDE both work.
Personally, I think file systems aren't aggressive enough when it comes to deleting files. When I delete something I want it
Re: (Score:2)
It's not unreasonable to expect to be able to undo that action when I immediately press cancel it and make sure the drive is not written to anymore. Ext2 can do this easily. Ext3 goes out of its way to make this impossible. XFS/ZFS/ReiserFS etc.. all m
Re: (Score:2)
That's essentially what any shell does. Personally, I find it annoying and do all my deleting from the command line.
Re: (Score:3, Informative)
Fifth, if you delete two files in different directories with the same name, both can't exist in the
Re: (Score:3, Informative)
Sorry, but no way I'm gonna have a script that contains "sudo rm -rf" on my system...
Wrong arguments (Score:2)
Re: (Score:2)
Re: (Score:3, Funny)
Re: (Score:2)
Frankly, the whole command is poorly designed. I don't want to confirm each and every directory, I want an overview of what is getting deleted, and then I want it to ask me "are you sure?". It doesn't even offer an option "yes to all" when using interactive mode when you finally tire of pressing "y" 50.000 times.
I've even went looking for replacements that did just that, but that turned up nothing.
ext3 tops out at 16GB files? (Score:2, Interesting)
Is this really the case? I created a 100GB file on ext3 earlier this week. It contains a virtual machine image that I am currently running under Xen. I haven't yet had a problem. I would guess that >16GB files are pretty commonly used in the world of Xen.
Re: (Score:2)
Why bother? (Score:4, Informative)
What ever they do XFS and JFS will have way more testing and use than ext4 will ever have. I just don't get the point of ext4. It would be far more useful to fix the one remaining issue with XFS, the inability to shrink the filesystem none destructively, than to flog the dead horse which is ext2/3 even more with ext4, which is not one disk compatible anyway.
Re: (Score:3, Insightful)
Remember how reiserfs was the first filesystem to have journaling in Linux, and how some people were ready to state that there is no need to do an ext3 any more?
What about comparison to other filesystems? (Score:5, Informative)
Those features may be new to ext3, but not to the real competitors. I see nothing that might grant an edge over JFS or XFS. The real justifications will come from performance tests.
This reminds me of the recent NTFS article here, which actually suggested that since Hans Reiser is in jail and reiser4 is dead, we should consider NTFS. WTF? The ludicrousness of using NTFS as the primary filesystem is further justified in this article by its similar performance to ZFS, but both run in user-space (and are thus horrible in performance), so neither is really an option. What the heck is wrong with JFS and XFS?
Here are some real comparisons: First, Wikipedia's Comparison of file systems [wikipedia.org] gets you started with a nice mapping of features. Second, a benchmarking of filesystems from 2006 [linuxgazette.net] which is still quite applicable (though it doesn't yet cover ext4). What we need is a comparison of EXT4 to XFS and JFS (et al), with EXT2/3 in there for reference.
Recall that the biggest reason for using ext3 is that it is supported best of all the filesystems. If all hell breaks loose, even Tomsrtbt [toms.net] (an ancient rescue floppy pre-dating knoppix) can fix it. Ext4 breaks this backwards-compatibility to ext2. Therefore, I see no reason to use it. One might as well use something more stable and proven, especially while we lack numbers suggesting it performs as well or better.
Re:What about comparison to other filesystems? (Score:4, Informative)
Aside from the fact that no non-obsolete machine I've seen in the last few years has a disk drive, 'backwards compatibility with ext2' is a pretty lousy minimum requirement for a filesystem.
Heck, I can do recovery on Ext2/3, ReiserFS, JFS, XFS, and more using only a few-dozen-meg Debian netinstall image. I don't even want to know what an Ubuntu or Knoppix LiveCD could recover from.
Re: (Score:3, Informative)
Here's an Ext4/XFS/ZFS benchmark [brillig.org]
I would like to see a more recent benchmark that did include JFS/Reiser/etc, though.
Re: (Score:2, Insightful)