Linux Chosen for IBM's New Supercomputer 343
Uhh_Duh writes "news.com is reporting that Linux will be the main OS in the Blue Gene - IBM's $100m supercomputer project. The Blue Gene will contain 65,000 processors and 16 trillion bytes of memory." Wow. That's a lot of nuclear weapons simulations.
The end of AIX (Score:2, Insightful)
IBM is pooling all its resources into Linux now.
I suppose that's both a good and a bad thing.
Re:The end of AIX (Score:5, Insightful)
Second, the AIX roadmap goes out to at least 2007 (five year planning window). So don't be throwing away your SMIT knowledge quite yet. I'd be very surprised if there wasn't significant AIX work being done as far out as 2010.
IBM has at least us$20B in AIX and as a result it is very mature. They're putting nearly us$1B a year into Linux (JFS being just one wonderful thing ported). It will still be a while before they can bet the company on Linux. Do also keep in mind that AIX has at least a 15 year head start on Linux.
-- Multics
Re:The end of AIX (Score:5, Insightful)
IBM have spent a fortune on raising the public profile of linux. Now, perhaps you're a software geek, but those positive articles about linux in the mainstream press don't come cheap. And those IBM Consultants selling linux to conservative financial data centres need a LOT of backing.
IBM are fighting a propaganda war with Microsoft. That eats millions very fast.
Re:The end of AIX (Score:2, Funny)
One more crippling
bombshell hit the already beleaguered AIX community when IDC confirmed that AIX
market share has dropped yet again, now down to less than a fraction of 1 percent of
all servers. Coming on the heels of a recent Netcraft survey which plainly states
that AIX has lost more market share, this news serves to reinforce what we've
known all along. AIX is collapsing in complete disarray, as fittingly exemplified by
failing dead last [samag.com]
in the recent Sys Admin comprehensive networking test.
You don't need to
be a Kreskin [amazingkreskin.com] to predict AIX's
future. The hand writing is on the wall: AIX faces a bleak future. In fact there won't
be any future at all for AIX because AIX is dying. Things are looking very
bad for AIX. As many of us are already aware, AIX continues to lose market share. Red
ink flows like a river of blood.
AIX 5L is the most endangered of them all, having
lost 93% of its core developers. The sudden and unpleasant departures of long time
AIX 5L developers Jordan Hubbard and Mike Smith only serve to underscore the point
more clearly. There can no longer be any doubt: AIX 5L is dying.
Let's
keep to the facts and look at the numbers.
AIX Version 4.3.3 leader Theo states that there
are 7000 users of AIX Version 4.3.3. How many users of AIX Version 4.0 are there? Let's see. The number of
AIX Version 4.3.3 versus AIX Version 4.0 posts on Usenet is roughly in ratio of 5 to 1. Therefore there are
about 7000/5 = 1400 AIX Version 4.0 users. AIX posts on Usenet are about half of the volume
of AIX Version 4.0 posts. Therefore there are about 700 users of AIX. A recent article put
AIX Version 4.3.3 at about 80 percent of the AIX market. Therefore there are (7000+1400+700)*4 =
36400 AIX Version 4.3.3 users. This is consistent with the number of AIX Version 4.3.3 Usenet posts.
Due to the troubles of Walnut Creek, abysmal sales and so on, AIX went out
of business and was taken over by IBM who sell another troubled OS. Now IBM is also dead, its corpse turned over to yet another charnel house.
All major
surveys show that AIX has steadily declined in market share. AIX is very sick and
its long term survival prospects are very dim. If AIX is to survive at all it will
be among OS dilettante dabblers. AIX continues to decay. Nothing short of a miracle
could save it at this point in time. For all practical purposes, AIX is dead.
Fact: AIX is dying
Re:The end of AIX (Score:5, Interesting)
In 5 years, there will be only Linux, BSD and Solaris - with BSD and Solaris being binary and source compatible to Linux.
Linux has reunited Unix, this is a good thing because it didn't happen by monopilzation from one company. There is lot of diversity within Linux (lots of different vendors and supporters) but it's all compatible.
Re:The end of AIX (Score:3, Insightful)
Linux will be the non-proprietary and completely open foundataion for the next generation of software. The UNIX philosophy is the common thread, where Solaris, Linux, and BSD will be differently-targeted implementations. Microsoft will be playing catch-up in this new era.
I also hope that the portability of Linux will keep fueling the intense competition among hardware vendors. For one, I don't want the RISC architectures, such as SPARC, PowerPC, and MIPS, to go away. SPARC, for example, is a completely open standard with only a $99 license fee for new implementations. If there is any safe-haven from Intel, AMD, and Palladium, SPARC might be it. These architectures need to be commoditized further to head off any complete domination by x86. They simply cannot be marginalized out of existence by Intel.
The End of SPARC? (Score:3, Interesting)
In the meantime, successor projects (to UltraSPARC) have spent too much time redesigning and precious little time getting a competitive product out the door.
The performance of the software running on my server farm's fastest Intel/AMD machines is far superior to the performance of the same products running on the fastest SPARC boxes. On the other hand, every SPARC box we've ever purchased is still running in some capacity. I can't say that for the PC-platform servers.
I'd like to see Sun get its in-house design process straightened away and become competitive again. But somebody high up is going to have to take ownership of that process and make some major changes if it's going to happen, IMO. And since things have languished this long, it's hard to figure how somebody's going to wake up at this late date and put full effort into fixing what's gone wrong. I sure hope it happens, for some of the same reasons you shared!
That's a lot of Tuxes... (Score:3, Funny)
Re:That's a lot of Tuxes... (Score:2, Funny)
weird....
Re:That's a lot of Tuxes... (Score:5, Funny)
Re:That's a lot of Tuxes... (Score:3, Insightful)
Factoring in processor speed, that makes each bot at least 2 times more clever than the machine that recently gained a draw in chess against kramnik.
Wow
What distribution? (Score:2)
Re:What distribution? (Score:5, Funny)
Re:What distribution? (Score:5, Informative)
Hopefully the fruits of this will feed through into the mainline kernel and so to other systems.
Re:What distribution? (Score:2)
Re:What distribution? (Score:4, Insightful)
Programmers on this level face entirely different challenges, such as optimizing a 65 thousand thread program so that CPUs aren't idle 90% of the time waiting for others. This is going to output some high quality specialized kernel code that about 10 or 20 computers around the world would find helpful performance-wise. Any desktop or server for mere mortals won't see much improvement.
Re:What distribution? (Score:2)
Re:What distribution? (Score:3, Funny)
From: bob@ibm.com
Subject: kernel-smp patch, 65000 cpu's
Dear Linus,
Please accept this patch to accommodate thousands of processors in a single machine.
[attached: patch]
To: bob@ibm.com
From: Linus Torvalds
Subject: Re: kernel-smp patch, 65000 cpu's
No problem, Bob. Just go ahead and send me one of those machines for "testing" and then I'll merge the patch in...
Linus
he real question is (Score:2, Funny)
Gzzzzap (Score:4, Funny)
Try to /. this baby! (Score:2, Funny)
Why Linux? (Score:5, Funny)
To quote someone else: "16 trillion bytes should be enough for everyone."
Not nukes (Score:4, Insightful)
RTFA. That's a lot of protein fold simulations.
Re:Not nukes (Score:2, Informative)
Re:Not nukes (Score:3, Insightful)
Re:Not nukes (Score:4, Informative)
I read the f'ing article and it says...
Unless nuclear weapons simulations is secret code for protien fold simulations, then I don't get it.
Re:Not nukes (Score:4, Funny)
Re:Not nukes (Score:2)
What ever that's one big system, and represents a huge investment in Linux. Fanstastic stuff! I'm not sure how I feel about the use though, good we don't need to blow things up, but seems a shame that such a wonderful computer is only used to research ways of killing people rather than helping them. I just think it would be a little more romantic to think of this beast trying to figure out a cure for cancer or something.
Re:Not nukes (Score:2)
Why after Gene Amdahl of course, the genius
designer of the IBM/360 mainframe line!
Or maybe because they want to play on words
"bluejeans" ~ "BlueGene"?
Re:Not nukes (Score:3, Informative)
Re:Not nukes (Score:3, Insightful)
Re:Not nukes (Score:3, Informative)
Once the national labs got wind of the idea they decided to build a smaller "test" version called Blue Gene/L that will be used by the labs for their own purposes.
I've been reading up on this as there is work at Caltech on BG/L.
Re:Not nukes (Score:2)
Imagine a Beowulf cluster of these! (Score:4, Funny)
Re:Imagine a Beowulf cluster of these! (Score:2)
It'll be very interesting to see if the Japanese supercomputer manufacturers will try to match this....
Weather simulations? (Score:3, Insightful)
About nuclear testing, isnt the capability to destroy the whole earth enough? Kinda makes me less worried about Saddam and more worried about the cowboy in charge.
Re:Weather simulations? (Score:2, Informative)
That will only address the problem of inaccurate models. It will not decrease the problem of sensitivity to noise in the input data (the butterfly effect), which fundamentally limits the prediction to a week or so. To reduce the noise problem, we need more sensors all over the earth and the oceans.
Re:Weather simulations? (Score:2)
No; we'd also like to make sure that we don't do so accidentally; hence, testing.
Re:Weather simulations? (Score:2)
Re:Weather simulations? (Score:2)
No, when Saddam test nuclears its because he wants to blow us all up. He has never had a weapon that he has not employed, often times even on his own people. There is a marked diference between a modern, dempcratic nation keeping an arsenal for self defense and a madman keeping an arsenal for world domination.
Re:Weather simulations? (Score:2)
Nuclear testing (Score:2, Informative)
In other news... (Score:4, Funny)
Deep Thought? (Score:5, Funny)
Building a computer, to tell you how to build another, larger, more complex computer. Hrmmm..
Re:Deep Thought? (Score:4, Informative)
Uh, that's how it works in general. Or did you think modern CPUs were laid out by hand?
Re:Deep Thought? (Score:5, Funny)
Uh, that's how it works in general. Or did you think modern CPUs were laid out by hand?
Naturally I laid out my own CPU by hand. I run Gentoo [gentoo.org] on it too. We all do. What are you, some kind of Mandrake wussy?
Re:Deep Thought? (Score:5, Interesting)
Uh, that's how it works in general. Or did you think modern CPUs were laid out by hand?
Continuing on that theme, it's written (at least next to the Apple 1 and Cray machines at the Science Museum in London) that Seymour Cray used an Apple to design his super computers while Apple used a Cray to simulate one of their designs.
We are slaves of computers (Score:3, Insightful)
Lots more info (Score:5, Informative)
Re:Lots more info (Score:3, Informative)
Sounds impressive (Score:5, Funny)
But what they don't tell you it that it is 65,000 old 386DXs
Re:Sounds impressive (Score:2)
Current plans are for embedded Power 4 CPUs at around 1GHz. (Think grown up G4s)
-- Multics
Re:Sounds impressive (Score:3, Funny)
Picture 65,000 AMD's at 2+ GHz, what a fire hazard that would be :*)
Coming soon: your own 32-way computer on a chip (Score:4, Informative)
I still hope they get decent coolers 'cuz we're now talking about 32 processors per chip ! Still, what an awesome design to increase the density & number of processors. I was wondering how they'd do it for 65,000. Now I know :)
Interesting question unfolding : will we ever get those chips on the desktop ? Imagine your own 32-way PC at home. Heh, who needs Beowulf clusters now !
Re:Coming soon: your own 32-way computer on a chip (Score:4, Interesting)
32*64*8*64 = 1048576.
Re:Coming soon: your own 32-way computer on a chip (Score:4, Interesting)
Re:Coming soon: your own 32-way computer on a chip (Score:4, Interesting)
The unedited copy/paste from the article goes like this:
The chip itself will extend an IBM design philosophy that will emerge in coming years with IBM's Power4 processor. That processor will package four CPUs on a single chip, IBM has said.
Blue Gene will use 32 CPUs in a single chip, Goyal said.
So, is that a one-million processors machine they're really building, a 32768 chips machine or what ? ZDnet reporters are on crack today :)
I wish someone found an article from IBM's PR site with more details and less confusion.
Open source IBM (Score:5, Interesting)
The decision to adopt Linux came, in part, as a result of the growing size and strength of the open-source community. Thousands of developers around the world are participating in the evolution of Linux. Creating a new OS inside of IBM would require a massive engineering effort.
followed by
We chose Linux because it's open and....saw considerable advantage in using an operating system supported by the open-source community, so that we can get their input and feedback."
So, basically, IBM doesn't want to design their own proprietary system (smart) and plans to use the resources currently available. (also smart)
They want open-source to get them rich, right? Less initial cost by the company, etc etc. What are the odds they'll profit-share with people they're getting rich off of? (well, ok, attempting)
Re:Open source IBM (Score:3, Insightful)
At least the decission that IBM has take will give a good campaign about the use of Open Source Software. It's better than any other big company decission who doesn't support the Open Source Software.
I think, the Open Source Software will not get any improvement if the people behind them always always get big suspiciousness over the other.
Re:Open source IBM (Score:3, Insightful)
Remember that symbiosis is really mutual parasitism. From the entire system, both gain. IBM is *not* an "open-source" company, but they recognize the value and have dumped money into Linux. Oddly enough, IBM seems to be the main one actually profiting from Linux, and I can't imagine that was the original intention. IBM can dump money into Linux, never see a red cent direct result, and come out smelling like a rose.
64,000 processors and $100 million do give a pretty strong indication that Linux is enterprise-ready.
I wouldn't worry about the big suspiciousness. They're the ones "watching the watchers". They're also why I would tend to trust Open Source even if it were of inferior quality.
Re:Open source IBM (Score:5, Informative)
Re:Open source IBM (Score:3, Funny)
Hey, you're giving free content to Slashdot by posting here! OSDN are getting rich off you, and they're not profit-sharing! You'd better stop posting to Slashdot!!
Re:Open source IBM (Score:3, Insightful)
Um. Isn't this one of the tenets of free software--it's not just free as in speech, it's also free as in beer.
The OSS movement (if such a 'herding cats' endeavour can truly be said to exist) should be welcoming this. One of the world's premier supercomputing projects is adopting Linux. Now you can say to CEOs, "Remember how nobody ever went wrong buying IBM? Well, now IBM is sinking $100 million into a Linux supercomputer. So yeah, we can build your corporate network. By the way, we don't have to charge you for software, either."
IBM has already been pushing Linux for enterprise solutions. It occurs to me that (just maybe) they might already be making significant contributions to Linux, both in terms of code improvements and indirect public relations benefits.
What more do you want them to do in terms of profit sharing? Mail a dollar bill to everyone that's written code for a Linux distro?
Re:Open source IBM (Score:5, Funny)
Dude, why are you bitching? I am sure they will make the source available so you can install it on your own 65,000 processor machine.
Re:Open source IBM (Score:2)
Re:Open source IBM (Score:2)
Uhuh. So, five years down the line when asked why you didn't invest in the most popular operating system going, you would reply, "Because Sacarino posted something on Slashdot!"
Guess why you're not a big business CEO...
Re:Open source IBM (Score:3, Informative)
This IS NOT SMP!!!! This is Super Parallel Beowulf processing. Beowulf Linux already runs on LOTS of Super Computers. It will be a trivial thing for IBM to get this working on that many processors because it's more like a 65,000 node super computer.
Face it. (Score:3, Insightful)
Face it. If they could make more money selling NT, they would. If the BSDs had the media appeal that Linux has, they would have run a "Peace, Love and BSD" campaign.
Re:Face it. (Score:5, Funny)
You mean IBM, a large multinational company, isn't just out to do good? They actually use the best tools out there to make a profit without considering their moral obligation to stubbornly pick an OS and stick with it in religious conviction? Oh the horror! Won't someone please think of the children!
-1, Sarcastic asshole, I know I know...
Re:Face it. (Score:5, Insightful)
Linux is free. Linux will remain free. Forever.
And "free" as in "freedom" is important. It guarantees a save investment and makes sure you are not trapped in vendor lock-in. It also guarantees the abcense of stuff like WPA or MSFT's new EULA.
Stuff like that is more important than what "sucks" and what has "media appeal". IBM has learned this first-hand with OS/2.
No, OS/2 did not fail because of crappy marketing. It failed because computer-makers refused to preinstall a OS from a competitor. No matter how cheap it might have been, no matter how great it was. - It would have been a stupid decision for computer makers to chain themselves to a competitor.
While some people still don't get it, EVERY major IT-company already understood that Linux is the only way to go long-term. Every major IT-company which is not trapped in Microsoft-contracts is supporting, using and/or offering Linux solutions. IBM, Intel, AMD, Sun, Oracle.. you name it.
Re:Face it. (Score:3, Interesting)
Re:Face it. (Score:4, Interesting)
The Blue Gin?!? (Score:2)
Oh, wait...
second most powerful computer... (Score:2, Funny)
i speak of none but the computer which will become after this one...
65k? That more linux CPUs than on all desktops (Score:2, Funny)
mice (Score:3, Funny)
Variations on the same story (Score:5, Informative)
IBM Chooses Linux for 'Blue Gene' Supercomputer
IBM has chosen the open source Linux operating system to run on one of its largest, most powerful supercomputing projects, dubbed "Blue Gene."
The petaflop computer, which can calculate 1 quadrillion operations per second, is 100 times more powerful than the fastest computers available, according to IBM.
ZDNet UK [zdnet.co.uk]
Linux will power IBM supercomputer project
The upcoming family of 'Blue Gene' supercomputers will run on an extended form of Linux, a major endorsement for the open source operating system
Linux will be the main operating system for IBM's upcoming family of "Blue Gene" supercomputers -- a major endorsement for the operating system and the open-source computing model it represents.
OS Opinion [osopinion.com]
IBM Chooses Linux for 'Blue Gene' Supercomputer
Another supercomputer in the same family, Blue Gene/L, is also set to run Linux. IBM has said Blue Gene/L will be at least 15 times faster than today's fastest supercomputers.
See Complete Story
The Blue Gene project, first announced in late 1999, was designed to model the folding of human proteins, allowing researchers to better understand diseases and their cures. At the time, IBM said Blue Gene would be 1,000 times more powerful than "Deep Blue," the computer that beat chess champion Garry Kasparov in 1997.
Would you like to play a game? (Score:3, Funny)
Unreal 2002 (Score:4, Funny)
Re:Unreal 2002 (Score:2, Informative)
Good for linux (Score:2, Insightful)
Pretty soon we'll have that power on our desktops (Score:2, Interesting)
Look at these previous Cray systems [cray.com], and compare that to what we have now. Sure, 2GB of RAM was "Super-computer" territory in 1985, but today you can walk in and buy it for $200 at Best Buy.
so hard to put it in appropriate units? (Score:2, Insightful)
Old times... (Score:5, Funny)
That's a LOT of processors.
It's nice to see that some companies have kept the tradition of computers that fill a room or five. Maybe they can throw some vacuum tubes on for old time's sake.
I bet... (Score:2, Funny)
With something that powerful (Score:4, Funny)
16 TB memory (Score:3, Interesting)
Eliminate war! (Score:2, Funny)
supercomputer crippled by small memory (Score:5, Informative)
Re:contributions to OSS? (Score:2, Informative)
Re:contributions to OSS? (Score:5, Insightful)
Porting or developing their own projects -- JFS is an often pointed to as an example
Sponsoring developers of Open Source projects -- I know at least one KDE developer that was paid to write a series of tutorials on KParts that were published on IBM's web site . I recently saw something by the founder of Gentoo Linux as well.
Public Relations -- This is the big one. IBM lends Open Source and Linux more credability than any other company. They throw more resources into promoting Linu x than any other company. At a time where most major tech companies are at the most passively supporting Linux, IBM is very actively promoting it, and it's the reason that a lot of other major players are paying attention to Linux
Again, you can't underestimate the effects that having IBM backing Linux has in a corporate environment. Intel and AMD are paying attention because of IBM, and I'd be that a lot of a big part of why MS has taken note of Linux lately is that competing with Linux means competing with IBM.
So yes, they're contributing back, but the most significant ways are not the conventional methods. They're in fact contributing something to Linux that no number of hackers can -- credibility.
Confirming the PR portion (Score:2)
Re:contributions to OSS? (Score:3)
- the kernel
- Most of the Apache projects, Xerces and Xalan are almost entirely maintain by IBM employees
- KDE usability
And that's just places where I've seen IBM email addresses. They do a lot, especially in Apache, it's just very easy to forget as they don't trumpet it like some other companies do.
Re:contributions to OSS? (Score:2)
That is a great service to offer.
Re:contributions to OSS? (Score:3)
Re:contributions to OSS? (Score:4, Informative)
Re:contributions to OSS? (Score:3, Insightful)
Re:Cool (Score:2, Funny)
Re:bad news for Linux? (Score:2, Interesting)
The fact that it also has that "Free" appeal to it, not just Free as in $ but Free as in open and for the benefit of the users and no one else, isnt going to change just because IBM is making its own branch for its megacomputers and whatnot. Even if they come out with a desktop version that gains popularity, it wouldnt be mutally exclusive with Slackware and the rest of the gang. Those companies who liked linux for its robust working environment could now have that with the comfy blanket of legitimate IBM support, and those of us who dont want to pay for it, or dont want to give money to a supercorporation, could continue to use Slackware, etc. And if you really believe in the open source movement, you will trust the fact that software written For People will always be a better product than software written For Profit.
Re:bad news for Linux? (Score:2, Insightful)