Paragon Is Working To Get Its nfs3 Filesystem Into the Linux Kernel (arstechnica.com) 73
Jim Salter writes via Ars Technica: In March of last year, proprietary filesystem vendor Paragon Software unleashed a stream of anti-open source FUD about a Samsung-derived exFAT implementation headed into the Linux kernel. Several months later, Paragon seemed to have seen the error of its ways and began the arduous process of getting its own implementation of Microsoft's NTFS (the default filesystem for all Windows machines) into the kernel as well. Although Paragon is still clearly struggling to get its processes and practices aligned to open source-friendly ones, Linux kernel BDFL Linus Torvalds seems to have taken a personal interest in the process. After nearly a year of effort by Paragon, Torvalds continues to gently nudge both it and skeptical Linux devs in order to keep the project moving forward.
To those familiar with daily Linux use, the utility of Paragon's version of NTFS might not be immediately obvious. The Linux kernel already has one implementation of NTFS, and most distributions make it incredibly easy to install and use another FUSE-based implementation (ntfs-3g) beyond that. Both existing implementations have problems, however. The in-kernel implementation of NTFS is extremely old, poorly maintained, and should only be used read-only. As a result, most people who actually need to mount NTFS filesystems on Linux use the ntfs-3g driver instead. Ntfs-3g is in reasonably good shape -- it's much newer than the in-kernel ntfs implementation, and as Linux filesystem guru Ted Ts'o points out, it actually passes more automated filesystem tests than Paragon's own ntfs3 does.
Unfortunately, due to operating in userspace rather than in-kernel, ntfs-3g's performance is abysmal. In Ts'o's testing, Paragon's ntfs3 completed automated testing in 8,106 seconds -- but the FUSE-based ntfs-3g required a whopping 34,783 seconds. Bugs and performance aside, ongoing maintenance is a key aspect to Paragon's ntfs3 making it in-kernel. Torvalds opined that "Paragon should just make a pull request for [ntfs3]" -- but he did so after noting that the code should get OKs from current maintainers and that Paragon itself should maintain the code going forward. (Paragon developer Konstantin Komarov quickly replied that the company intended to continue maintaining the code, once accepted.) [...] For his own part, Torvalds seems determined to find a performant, modern, maintainable replacement for the ancient (2001-era) and seldom-used ntfs implementation in the kernel now. As long as Paragon remains willing to keep playing, it seems likely to get there eventually -- perhaps even in time for the 5.15 kernel.
To those familiar with daily Linux use, the utility of Paragon's version of NTFS might not be immediately obvious. The Linux kernel already has one implementation of NTFS, and most distributions make it incredibly easy to install and use another FUSE-based implementation (ntfs-3g) beyond that. Both existing implementations have problems, however. The in-kernel implementation of NTFS is extremely old, poorly maintained, and should only be used read-only. As a result, most people who actually need to mount NTFS filesystems on Linux use the ntfs-3g driver instead. Ntfs-3g is in reasonably good shape -- it's much newer than the in-kernel ntfs implementation, and as Linux filesystem guru Ted Ts'o points out, it actually passes more automated filesystem tests than Paragon's own ntfs3 does.
Unfortunately, due to operating in userspace rather than in-kernel, ntfs-3g's performance is abysmal. In Ts'o's testing, Paragon's ntfs3 completed automated testing in 8,106 seconds -- but the FUSE-based ntfs-3g required a whopping 34,783 seconds. Bugs and performance aside, ongoing maintenance is a key aspect to Paragon's ntfs3 making it in-kernel. Torvalds opined that "Paragon should just make a pull request for [ntfs3]" -- but he did so after noting that the code should get OKs from current maintainers and that Paragon itself should maintain the code going forward. (Paragon developer Konstantin Komarov quickly replied that the company intended to continue maintaining the code, once accepted.) [...] For his own part, Torvalds seems determined to find a performant, modern, maintainable replacement for the ancient (2001-era) and seldom-used ntfs implementation in the kernel now. As long as Paragon remains willing to keep playing, it seems likely to get there eventually -- perhaps even in time for the 5.15 kernel.
ntfs not nfs3 (Score:5, Informative)
Incorrect title. This is about Paragon's ntfs driver, not nfs3.
Re: (Score:2)
Incorrect title. This is about Paragon's ntfs driver, not nfs3.
that's exactly what I was about to post ;-)
Re: (Score:2)
Still not fixed. BeauHD are you actually an editor?
Re: (Score:2)
Both are incorrect, Paragon refers to their ntfs fillesystem as ntfs3.
Re: (Score:2)
Are you saying you actually expected the Slashdot editors to edit correctly? Sacrilege!
Re: (Score:2)
They're idiots. I've yet to see them ever correct an error. I have no idea why it is so difficult for them, or why they don't seem to care.
Re: ntfs not nfs3 (Score:2)
Maybe for the same reason that we can't edit our posts to fix basic eras.
Re: (Score:2)
For some reason slashdot editors are incapable of editing their posts for typos
Re: (Score:1)
Or checking them before posting.
They must be so proud of their work.
Re: (Score:2)
Hey, look at that, BeauHD still hasn't edited the title. It makes you wonder what they do all day. It clearly isn't editing.
Re: (Score:2)
Thank you for this. Now I'm not as interested because I don't see ntfs-3g performance to be as bad as alleged in the article.
Re: (Score:2)
ReiserFS (Score:4, Funny)
Does anyone remember ReiserFS? That was a killer file system, just don't get it mad.
Re: ReiserFS (Score:2)
Re: (Score:2)
Indeed I do! It basically died with the murder charges but some features have inspired and have been implemented in other FS. The name Reiser became heavily blacklisted although and rather quickly IIRC.
Cheers!
Re: (Score:1)
Last patches are apparently still maintained by DARPA in 2021!
https://en.wikipedia.org/wiki/... [wikipedia.org]
If you look at the feature set, zfs meets several IMHO. Then if zfs isn't really needed feature set wise, I would probably use btrfs, then ext4 I guess, maybe even ext2 depending on the use case.
Anyway, ReiserFS was really refreshing back then.
Re: (Score:3)
If needing features in that type of filesystem, I am leaning towards btrfs. ZFS is excellent, but I've had issues where I/O threads will hard-lock under Linux and require a reboot to un-hang, and have had issues like this on multiple platforms. Hopefully that gets stomped out, because it is the best filesystem to ensure that bit rot is found and repaired.
If one uses btrfs similar to how Synology implements it, where md-raid is doing the heavy lifting among multiple drives, and then btrfs on top of it, it
Re: (Score:2)
Here's a screen shot of the Wikipedia entry from back then.
Reiser file system [baltimoremick.com]
Re: (Score:1)
I know some people would jump at that file system if it could do that.
Re: (Score:2, Informative)
ol' Hans had parole denied in 2020 but will be up for hearing again in March 2023. Just imagine, we have legal system where guy can strangle his wife and hide the body, yet possibly be free in 15 years. Amazing bleeding heart system we have...
Re: (Score:1)
Re: (Score:2)
Even when Hans showed exactly where wife buried, we have some real simps and buttlicks here of personality cult types.
Re:ReiserFS (Score:4, Insightful)
Re: (Score:3)
Qualified immunity is a hell of a drug.
Re: (Score:2, Interesting)
No, we should have a harsher legal system where when you are convicted of brutally murdering someone by a jury of your peers you should never be let out. Instead there are cases seemingly every day where some asshole with 4-5 violent convictions finally kills someone (or kills someone _fucking again_).
We are too hard on nonviolent crime/drug offenses and way too lenient with the subhuman monsters who prey on actual people.
Re: (Score:2)
Instead there are cases seemingly every day
We shouldn't rely on feelings and impressions.
Re: (Score:2)
Re: (Score:3)
The goal should be to reform prisoners, not punish them forever or try to make them some kind of deterrent example. Punishment does very little to help anyone, and often just makes it harder for people to go straight. Deterrent simply doesn't work.
What does it say about us if we can't take the worst in our society and fix them? We seem to have given up, the problem is too hard, so lock them up forever.
Re: (Score:2)
Get back to me when you can you guarantee anyone won't kill someone?
Re: (Score:2)
I can nearly(*) guarantee you that someone who has already demonstrated they will murder won't murder again if you keep them in prison.
* - other prisoners or guards exempted.
Re: (Score:1)
I cannot guarantee that anyone won't kill someone. ... quite high and morally unacceptable.
But the price of saving lives by jailing everyone is
The price of saving lives by jailing murderers for life, meaning life, is much, much, lower and totally morally acceptable.
Re: (Score:2)
Because he's angry at what Reiser did, he wants there to be no possibility of parole for other people in other circumstances.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
last I checked the choker was convicted.
As for that career criminal with gun in his lap in car, of course the cop shot him when he went for the gun, righteous shooting. Or are you siding with the "expert" the family brought in that claimed the criminal actually was going scratch his crotch? Who knew there were crotch scratching experts. So why the hell are siding with illegally armed criminal going for his gun when cop approaches?
Re: (Score:2)
The police are the ones who hired the "expert" to conclude, as he has done many times, that police are right to carry out extra-judicial executions at the slightest moment of panic by the officers.
The man was sleeping. People move when they sleep. You have no evidence he was reaching for his gun, other than the police who murdered him saying say so. The video evidence is not conclusive at all.
As for that career criminal with gun in his lap in car
That's how you think the legal system should work, hey? If a person was a cri
Re: (Score:2)
You're confused, you link story that says expert Blake, hired by city, says shooting justified.
"âoethe 55 rounds fired by 6 officers in approx. 3.5 seconds is reasonable based upon my training and experience as a range instructor as well as through applied human factors psychologyâ."
So to summarize, McCoy, kidnapper and human trafficker, who had a bunch of stolen firearms seized from his house prior, and who was carrying a stolen firearm, went for that stolen gun and was shot dead.
One less piece o
Re: (Score:2)
Re: (Score:3)
Just imagine, we have legal system where guy can strangle his wife and hide the body, yet possibly be free in 15 years.
He only killed one person. 15 years is a good enough sentence. If he killed hundreds of thousands we should elect him president instead.
Re: (Score:2)
Yeah, it doesn't much more clear cut than Reiser's crime. His subsequent antics in prison (e.g. his clownish civil suits) do not suggest a man accepting the gravity of what he has done.
Re:ReiserFS (Score:4, Funny)
Re: (Score:2)
Putting aside the developer, the filesystem was also unstable. It had very good performance, but not such a good record of data integrity.
Re: (Score:2)
killer file system
You win today's Slashdot "Line of the Day" award! Congrats.
Why not move ntfs-3g into the kernel? (Score:2)
Re: (Score:2)
I'm pretty sure it's a legal rather than a technological roadblock.
Re: (Score:3)
Because it's based on FUSE, which is about putting filesystems in userland. It's typically used for filesystems that are somewhat unusual or being used in a not-normal-filesystem situation like Docker containers.
How does being in kernel benefit Paragon? (Score:5, Interesting)
Will Paragon be able to sell more support if the software is in kernel? I gather they weren't making a lot of profit by selling drivers on Linux, but why are they going to the trouble to make it easily available to everyone? Prestige? It sounds like a pain in the ass if they've been working on it for so long.
Re: (Score:2)
Yes, I'm curious too. I actually own a couple of licenses and it seems to work fine. Didn't cost a whole lot of money, but I can't see how they're winning by making it open source. But I'm all for it, seems to work well, more open source, yippee.
Re:How does being in kernel benefit Paragon? (Score:5, Insightful)
How does being in kernel benefit Paragon?
1: people can just plug and play without worrying about if a distro built the module.
2: any internal changes to the kernel are done by working concurrently with the authors of the changes for seamless release / build transitions without relying on mailing lists and or getting surprised by the change.
3: tighter integration with in kernel calls than through the module interface. Could shave off measurable divisions of seconds by being in kernel rather than going through the module interface.
4: easier collaboration with the other kernel FS guys, who might also know some tricks they can do to get latency down even more. They don't even have to convince them to grab a separate GIT project like if it was a module to be built.
5: good will of the community and kernel developers. Kernel devs won't be as likely to make changes that may affect performance / building / ETC, and shrug and say "Well, should be in kernel and we might care more.".
6: they sell other crap for Linux / Mac too, and having your name known with something that works can move product. Due to NTFS-3G they probably didn't sell much of their NTFS driver to Linux users anyways so aren't losing any money on making it free. They may actually MAKE some money if people use it, it works faster / better than NTFS-3G, and people then buy their virtualization stuff or any of their other products.
Re: (Score:2)
Proprietary software does not belong in the Kernel.
Correct, but where is Microsoft ? With M/S "going Linux" they should re-license all their file systems to a GPL compatible license. Then no need for this Paragon mess.
Until that happens, I will never trust Microsoft and all this proves is M/S has some form of an agenda against Linux.
Re: (Score:1)
Re: (Score:3)
Re:Embrace and Extend... (Score:4, Interesting)
MS has licensed exFAT, which has been a very useful thing, because exFAT is one of the few filesystems that Macs, Windows, and Linux machines can all read and write to.
I wish MS would GPL NTFS as a native Linux filesystem, and one that could be used for a root filesystem.
Call me crazy, but NTFS has been around a long time, has been through many torture tests, and is battle tested, where it usually isn't the reason why a Windows box is hosed after a hard shutdown. It would be a very useful Linux filesystem, especially because it supports a lot of extensions, such as compression, deduplication, snapshots, journals, redirected writes, ACLs, extended attributes, and so on. Having that as an option would be quite useful.
Re: (Score:2)
I use exFAT on some of my NAS external drives. It regularly bitches to me that the power went out. That doesn't happen with the FUSE implementation of NTFS-3G.
Linus Torvalds BDFL? (Score:1)
Sure, he is DFL, but does he really deserve the 'B'?