Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
×
Linux

New Linux Petabyte-Scale Distributed File System 132

An anonymous reader writes "A recent addition to Linux's impressive selection of file systems is Ceph, a distributed file system that incorporates replication and fault tolerance while maintaining POSIX compatibility. Explore the architecture of Ceph and learn how it provides fault tolerance and simplifies the management of massive amounts of data."
This discussion has been archived. No new comments can be posted.

New Linux Petabyte-Scale Distributed File System

Comments Filter:
  • by AdmiralXyz ( 1378985 ) on Wednesday May 05, 2010 @08:31PM (#32106568)
    "It took a lot of work, but this latest Linux patch enables support for multi-petabyte file organization and storage!"
    "Do you have support for smooth, full-screen Flash video yet?"
    "No, but who uses that?"
  • "Do you have support for smooth, full-screen Flash video yet?"

    Frankly, that's Adobe's fault, not ours.

  • by Cryacin ( 657549 ) on Wednesday May 05, 2010 @08:45PM (#32106692)
    I think the big issue in the programming community as a whole is the current lack of understanding of the differences between eventual and atomic consistency.

    Distributed file systems work quite well when you have a single source of truth, but when you have multiple data stores, you can have multiple sources of truth. It essentially adds a temporal dimension to your data. As in, John Smith is a debtor of XYZ corp on Monday morning, but due to the server being down, we haven't realised on Tuesday morning that he paid his bill on Monday afternoon. Add late fee penalties.

    It adds another layer of complexity to an application that delayed gestures roll back transitive actions between actors in an Ecosystem. In the example, it would be to send out another letter stating that the late fee penalties have been removed, and if already paid, a refund is to be issued.
  • by jdhutchins ( 559010 ) on Wednesday May 05, 2010 @09:19PM (#32106888)

    While google may be able to go ahead and re-index websites if it loses that data, "regenerating" gmail and google docs stuff isn't quite so easy, and even small amounts of data loss would kill those applications (especially among paid users).

  • Nothing. They can always go back and regenerate that data. It's just a matter of time.

    You just contradicted yourself. You're right; it's just a matter of time. Only, thing is, this is the Internet. How long to recreate that data? Weeks? Months? Years? 6 months is an eternity on the Net.

    If all the accounts and stories were lost on Slashdot due to a massive database failure, how many people would come back, creating a new account and so forth? How many long would it take before there was enough content and accounts to make it interesting again? Now realize that Slashdot is a drop in the bucket compared to Google.

  • by Ethanol-fueled ( 1125189 ) * on Wednesday May 05, 2010 @09:27PM (#32106930) Homepage Journal
    It was noble of you to try to wrest control of a troll thread, but your comment loses a lot of credibility for being titled "Re: Do niggers use linux?"

    Would it hurt to at least change the title while you strive for visibility and relevance? When I saw the title of your post, I half-expected to see a poorly-written diatribe against Jamal Jackson for playing basketball and chasing caucasian women.

    Thank you, kind sir, for listening. We all must do our part to prevent trolling!
  • Re:History (Score:2, Insightful)

    by volcan0 ( 1775818 ) on Wednesday May 05, 2010 @09:36PM (#32106978)
    I always liked dreamhost (not for their uptime....), this just confirms it. It is good to see a compagny using open source software contributing back like this.
  • by Hurricane78 ( 562437 ) <deleted&slashdot,org> on Wednesday May 05, 2010 @10:18PM (#32107254)

    Yes it is ours. If “ours” means: Us idiots who made Flash dominant in the first place, by using it in any way.
    It always takes two. The ass doing it, and the idiot letting him do it. That guy with the narrow mustache from the 40s would agree to that: “What luck for rulers that men do not think.” ^^

  • Linux® (Score:3, Insightful)

    by The Yuckinator ( 898499 ) on Wednesday May 05, 2010 @10:41PM (#32107378)

    The first word in the article summary is "Linux®"

    Does that look weird to anyone else? I realize it's technically correct for the registered trademark symbol to be there, but somehow it just doesn't seem right.

  • by glwtta ( 532858 ) on Wednesday May 05, 2010 @11:26PM (#32107648) Homepage
    this copying of the node happens after the node goes down?

    One of the remaining replicas of each block on the failed node is copied so the total replication count does not go down. The original was perhaps poorly phrased, no need to be a dick about it, though.
  • by jedidiah ( 1196 ) on Wednesday May 05, 2010 @11:30PM (#32107684) Homepage

    > Having a rats nest of audio and video apis doesn't help the situation. You freetards should be happy what you get for your piece of shit OS.

    The ffmpeg developers can manage yet the "professionals" at Adobe cant?

    "freetardry" is the only reason h264 acceleration is supported under Linux.

    If we waited for the nickel-and-dime-you approach to come to the rescue we would still be waiting.

    At least with MacOS, Adobe had a real excuse.

  • by SanityInAnarchy ( 655584 ) <ninja@slaphack.com> on Wednesday May 05, 2010 @11:48PM (#32107814) Journal

    So then you freetards need to stop whining when 99% of the world choices not to use or support your shitty OS.

    99% of the world does use our OS. You're likely doing it right now. Or did you think Slashdot runs on IIS?

    And not that it'd make much difference to an obvious troll, but I use proprietary software when appropriate, and I am in favor of open source, not necessarily "free software." Not every Linux user is RMS. (And if they were, they probably wouldn't be Linux users.)

  • by fatalwall ( 873645 ) on Thursday May 06, 2010 @01:09AM (#32108204)

    I don't read XKCD...

  • by nappingcracker ( 700750 ) on Thursday May 06, 2010 @01:16AM (#32108248)

    Frankly, that's Adobe's fault, not ours.

    It could be our fault if you wanted it to be:
    http://www.gnu.org/software/gnash/ [gnu.org]
    http://swfdec.freedesktop.org/wiki/ [freedesktop.org]

  • by evilviper ( 135110 ) on Thursday May 06, 2010 @01:26AM (#32108298) Journal

    "Do you have support for smooth, full-screen Flash video yet?"

    A) Yes, I do. MPlayer will play any Flash videos, with a bare minimum of resources, and fully supports multiple video output methods, like xv and gl.

    The PROBLEM is that Flash videos aren't directly available anywhere... You have to parse through a SWF video player object to even determine where to FIND the URL of the actual FLV or MP4 file. And add to that extremely aggressive plugin detection scripts on many sites, which will refuse to even embed the SWF if you happen to have an unknown VERSION of the flash player. Unfortunately, I've mentioned this before, and got several interested replies, but nobody has thus far written a browser plug-in that will masquerade as Flash 10, and understand just enough SWF to find the URLs, and either present them to the users, or automatically pass them to MPlayer. A sad, sad failing, to be sure, since

    B) I (and many, many others) care VASTLY more about Linux's support for massive storage arrays than we do for it's support of Flash, and other user-level fluff. My servers never need to visit YouTube... But booting from a hard drive more than 2 terabytes??? Don't expect Windows to let you do that, without very specialized hardware (EFI firmware). Linux, however, can do it out of the box with many common distros.

I have hardly ever known a mathematician who was capable of reasoning. -- Plato

Working...