IBM's Blue Gene powered by Linux 290
bigjnsa500 writes "Linux will be the main operating system for IBM's upcoming family of 'Blue Gene' supercomputers--a major endorsement for the operating system and the open-source computing model it represents. Blue Gene/L, the first member of the family, will contain 65,000 processors and 16 trillion bytes of memory. Due in 2004 or 2005, the system will be able to perform 200 trillion calculations per second. Lawrence Livermore National Laboratory will use the system for performing nuclear weapons simulations." Blue Gene has been announced for some time, but it's cool to see how it's shaping up.
SCO Linux (Score:5, Funny)
Re:SCO Linux (Score:2)
to quote the article: (Score:3, Insightful)
The truth is that AIX isn't entirely IBM's property, and Linux is not Unix. I guess SCO has an operative inside of zdnet.
Funny how Apple makes supercomputers with IBM's chips while IBM makes supercomputers with AMD's chips. Sun is starting to us x86 and Sparc64 chips despite its own UltraSparc line. HP dropped the Saturn chip for ARM. Can anyone afford their own chips these days?
Re:to quote the article: (Score:3, Informative)
Where? BuleGene uses a varient of PPC970 chips from IBM.
ASCI Red Storm runs SuSE Linux (Score:4, Informative)
ASCI Red Storm google search [google.com]
Re:ASCI Red Storm runs SuSE Linux (Score:2)
**The nodes themselves will run custom Sandia-developed light-weight OS code-named Catamount. The service and storage nodes will run SuSE Linux.**
so.. it doesn't really 'run suse linux' as a whole, even though it's in the mix.
Re:ASCI Red Storm runs SuSE Linux (Score:2)
Supercomputing is all about maximizing throughput, therefore you want to cache everything you can, and sacrifice worst-case performance to get improved average-case performance. eg, if you could increase the cache speed & latency in exchange for sacrificing main memory latency, then that would be a good tradeoff (as long as there is enough memory bandwidth). Very long time-slices is another technique.
For a real-time syst
in other news (Score:5, Funny)
And in related News... (Score:5, Funny)
Zowie (Score:2, Informative)
It should be noted (Score:2, Informative)
How many apples is that? (Score:4, Interesting)
kidding aside, are these based on the novel IBM design for having small clusters of wimpy processors sharing sections of memory. The concept being to have each processor running slowly, almost stalled waiting on a memory fetch. (while seeming stupid at first glance, its really diabolically clever since now you can junk all the long pipelines and branch prediction stuff: every single byte that comes from memory will be used by some CPU requesting it, thus you minimize the memmory buss buttle neck that is, ultimately, the limit on most processing).
if this is that design then that 65,000 processors indeed may not be quite as much computing horespower as it sounds. it might indeed be comparable to a smaller handful of G5s.
or maybe i'm full of crap.
Re:How many apples is that? (Score:5, Insightful)
Re:How many apples is that? (Score:2)
By building the machine out of the CPUs they used, IBM demonstrates that as a company they prefer not to use the G5 at this moment. But they might turn around and use the G5 later.
Remember the IBM PS/2 line? The rest of the PC industry stuck with ISA architecture for a long time, nearly killing IBM.
No one knows everything.
Re:How many apples is that? (Score:2)
The first step on the path to enlightenment is accurate self-reflection.
Re:How many apples is that? (Score:5, Insightful)
You say:
What was the claim? The only bogus claims I heard regarding the Terascale (G5 cluster) were:
Then a New York Times report using old data reported 7.1 teraflops Rmax--enough to put it at #3 on the old list and #4 on the new--NYT forgot to mention that there have since been three new clusters that made the top 10, one of which slightly edged out the Terascale.
Of course, by the time that was reported, the figure was revised to 8.3 Tflops and now, officially reported (both on the current Top500 and by the head of Terascale) as 9.555 Tflops (60% efficiency) with the stipulation they could probably get 10% more. A pretty umapproachable #3 spot in the Fall500 and the first sub-$100 million dollar system to break the 10 teraflop mark.
Go look at the current benchmarks [macrumors.com], where are the Pentium clusters that are above it? Where are the Itanium clusters above it? Where are the Athlon clusters above it? Oh, I'm sure there will be some (probably in the Spring2004 500), but where are they all right now? How much do the current ones on the list cost (answer: no less than $30 million). Sounds to me the wishful-thinking, poor-reporting Wired and the Mac zealots were closer to the truth than FUD-meisters and the anti-Mac zealots.
The most efficient top 10 supercomputer right now is also the most powerful: The NEC EarthSimulator at about 80%. I'd imagine we should expect a 60-80% efficiency from the big budget Blue Gene/L. And in my book there is nothing wrong with the current 60% efficency of Terascale--anyway it probably says a lot more about how good Infiniband is than it does about how good the Mac is.
But the writing is on the wall. There is nothing special about the the 970 (G5), Virginia Tech could have done the same thing with an Opteron or Itanium2--it would have taken more processors and cost twice as much: ~$10 million best offer for the systems as opposed to $5.7 million list price paid for the Macs (subtracting $1.5 million for the Infiniband cards, routers, and cabling).
The take home point is not that they did it with Macs or Mac OS X instead of (your favorite CPU) and Linux. The take home point is: these guys built a top 10 supercomputer in a fraction of the time (months as opposed to years) at a fraction of the cost (<$10 million as opposed to >$100 million).
Yes, like the Crays of the old days (and today) there will always be those who need something like Blue Gene/L and IBM is happy to supply them. But a whole new generation of supercomputers will be built on-demand and out of commodity PC hardware and a good set of software running on an OS that doesn't charge for all the CALs. Right now the 970 is easily the best performer for LinPak. So much so, they can pay educational list price which included such worthless features as an Apple-tooled case, overpriced RAM, gigabit cards, and Radeon graphics cards, firewire, usb2.0, digital audio, iTunes and other iApps, and a OpenGL based desktop. Since the 970 is made by IBM, I'd hazard a guess that IBM would be happy to supply these people too. Whether they choose to run Linux, MacOS X, or something else.
Nuclear Weapons (Score:5, Interesting)
Re: (Score:2, Insightful)
Alfred Nobel -- great example! (Score:2)
Actually, this is a fine example ... because, though Nobel did not initially conceive of dynamite as a product for military use, it quickly became used for such ... and, in fact, Nobel himself became closely involved with the military munitions industry and the questions and problems surrounding it.
Particularly germane to the subject of nuclear weapons, Nobel felt that the
Re:Nuclear Weapons (Score:2)
Re:Nuclear Weapons (Score:5, Insightful)
Re: (Score:2)
Re:Nuclear Weapons (Score:3, Insightful)
Somewhere else, there's an open source developer who's just realized that his work is being used to power machines for Doctors without Borders, the Red Cross, a number of innercity churches and rec centers, and hospitals.
Yet somewhere else, there are soldiers testing out new
Re:Nuclear Weapons (Score:2)
Re:Nuclear Weapons (Score:2)
Well that is one of many reasons why some people prefer a more restrictive license for their work. When you restrict your product and exchange it for Money, then the money is the universal medium of exchange, not the software. In the Open Source world, money buys beer, pizza
Re:Nuclear Weapons (Score:2)
Re:Nuclear Weapons (Score:2)
Wake me up when Linux is turned to the task of creating the next superplague.
This is the price of freedom of knowledge (Score:3, Insightful)
The problem with this is that you cannot simultaneously restrict and promote knowledge. As another poster has commented, everything we do as a society is interlinked
Re:Nuclear Weapons (Score:2)
Somewhere else ... (Score:2)
Oh, the horror, the horror!
Non Sequiter Re:Nuclear Weapons (Score:3, Informative)
Blue Gene != ASCI White [Re:Nuclear Weapons] (Score:3, Interesting)
Nuke simulations? (Score:4, Insightful)
Are they trying to pack more megatons of destructive force into each warhead? Don't the major world governments have enough quantity to preclude the need for more powerful units?
Or are the tests run to design "safer" and/or more localized implementations? (Awww, looks like Big Brother has a soft spot after all...)
Re: (Score:3, Informative)
Re:Nuke simulations? (Score:2, Insightful)
Re:Nuke simulations? (Score:3, Insightful)
Re:Nuke simulations? (Score:5, Informative)
Historically, the modern reason for computer simulation of nukes is to put a stopper in the nuclear proliferation genie. The logic is convoluted but sensible. The idea is that first you get a test ban treaty. Second, You offer economic and power production aid to all countries that dont develop nuke engineering or let you control their plutonium bearing nuke waste.
this creates a situation where nuke weapon engineering has to be done either in secret (since there no civial reactor technology to produce plutonium) or if done overtly, they still cant test their weapons. Neither can we.
this leaves everyone in a delightful position of 1) not being perfectly certain their nukes will work when delivered. thus they are not good offensive weapons. (imagine what would happen if pakistan launched on india and it were a dud).
2) yet they still make good defensive weapons since even though its not tested it doesn;t mean it wont work.
which is sort of nice. it discourages both developement and first use. world is MAD but better off.
Unfortunately the US would never go for this if they did not have a way of testing their own weapons. So they do it in silico rather than in nevada. This allows us the political will to go through with this. a better world results. THe clock is ticking. we know the weapons will work now but they are aging.. will they work in say ten years. THis is where computer simulations come in. within ten years we should be able to model nukes and nuke aging on one of these machines at a level that gaurentees our readiness. or maybe if this test ban thing works we can just scrap them all in ten years.
that was the plan. But now with about 30 countries with potential nuke development capability this plan maybe about to break down. thus we go to plan B.
plan B is we use these big computers to design new reactors that dont produce plutonium. We sell these to the countries. now they can have nuke power without creating weapons grade plutonium. Again every body happy.
except of course N. Korea.
Re:Nuke simulations? (Score:3, Interesting)
This is the best latin quote I have ever seen.
Re:Nuke simulations? (Score:3, Interesting)
I guess if you're going to maintain a nuclear
Re:Nuke simulations? (Score:2)
I understand the military likes to have plans for everything. But this is part of the Whitehouse's official policy. The first time it had been changed like this in years. If you're an American, you shouldn't dismiss these thing
Re:Nuke simulations? (Score:3, Funny)
Nope, they're trying to create a massive War-Sim in which nation-heads could raise war for a real deal.
"I'll nuke your a$$ unless you inflat your yuan."
"I don't fear your but I don't want to mess up the houses and railroads I spent three months on. You can get 6 yuan for 1 and you must neutralize a warhead in reallife as part of the deal."
"too late butthead, it has been launched already.Frankly, I just want to see how it e
Re:Nuke simulations? (Score:2)
Simulating the explosive force and shape of an aging stockpile, as well as the manner in which the warheads are stored requires some serious computing.
the next great video game (Score:2)
Just wait until Quake XXXIV is released: global thermonuclear destruction!
Re:Nuke simulations? (Score:2)
No, they are making sure 50 year old bombs still work.
-Eyston
Um, maybe IBM should concentrate on making money. (Score:2, Insightful)
Of course I realize that I'm probably wrong in some way but this is just how it seems to me.
Re:Um, maybe IBM should concentrate on making mone (Score:5, Funny)
Ahhh, you are forgetting the army of overpriced IBM consultants that you'll have to hire to install the thing.
Re:Um, maybe IBM should concentrate on making mone (Score:2, Insightful)
My Aunt and Uncle have been working for IBM since the "glory days" of computing, and through that I realized that IBM has a solid foot in the door. They provide servers/computers for hundreds of companies around the world, with the biggest being probably half or more of the current blue-chip corporations.
We're not in the dot-com era anymore, bud.
Re:Um, maybe IBM should concentrate on making mone (Score:2, Funny)
Re:Um, maybe IBM should concentrate on making mone (Score:2, Interesting)
It will be the exact same thing here. Do you really think IBM isnt paid huge amounts of money for this work? They are doing resea
Wait a sec.. (Score:5, Funny)
So then why don't have we have the simulation of Blue Gene run a simulation of Blue Gene two, and that run a simulation of a quantum computer, and that run a simulation of Deep Thought? Then that can run a simulation of the rest of the universe.
Then the two will bicker and argue about who's real, whom created whom, and millions of Matrix freaks will yell "I told you!!!" to those who have ridiculed them so many, many years.
Re:Wait a sec.. (Score:2)
Ciryon
Is this news? (Score:4, Informative)
Anyhow, going to the Blue Gene [ibm.com] web page, there is a document dated Nov 2002, an overview of BlueGene/L. An excerpt:
The approach we have adopted is to split the operating system functionality between compute and I/O nodes...
The compute node operating system, also called the BlueGene/L compute node kernel, is a simple, lightweight, single-user operating system that supports execution of a single dual-threaded application compute process...
I/O nodes are expected to run the Linux operating system, supporting the execution of multiple processes. Only system software executes on the I/O nodes, no application code.
Beating plowshares into swords (Score:3, Insightful)
-B
Re:Beating plowshares into swords (Score:2)
Or Los Angeles Lakers.
Re:Beating plowshares into swords (Score:2)
Computer! Make me another Star Trek series! (Score:2)
What video card to use with this bad boy? (Score:4, Funny)
Good frame rate for Quake 3??
AA on or off?
VSynch on or off?
all well and good... (Score:4, Funny)
Re:all well and good... (Score:2)
You mean 65,535 monitors. 65,536 would require 17 bits to render...
(remember, 0 is a number to us programmer types!)
Re:all well and good... (Score:3, Insightful)
Who taught you to program?
So, where's the 0th monitor fit in here? Or, did you start at 1?
It's a blithe assumption by people that we start counting at 1. Ever wonder why it takes two digits to render just the first 10 counting in base 10, but only one digit to max out when counting in base binary?
If you count in base 2, you start at 0, as in
0, 1
not
1, 10.
It should then
Re:all well and good... (Score:4, Insightful)
Here's a nice calculation for you.
What is 2 to the power of 16? 2^16. Try all kinds of calculators.
How many times would you multiply 2 with itself to end up with an odd number (which 65,535 is)? It is fairly difficult to end up with an odd number when doing 2^y where y is an integer > 0.
Now, 2^15 + 2^14 + 2^13
I'm guessing the guy who taught the parent poster to count actually knew what he was doing
Actually the spec says... (Score:2)
SCO's Bill.... (Score:3, Funny)
Don't you just know Daryl's about to go apoplectic over all that money IBM is "stealing". Let's face it, he has to really believe in his private universe.
May he pop a blood vessel.
Re:SCO's Bill.... (Score:2)
I think you have just discovered IBM's new strategy
Re:SCO's Bill.... (Score:2)
Don't you just know Daryl's about to go apoplectic over all that money IBM is "stealing".
SCO is currently suing IBM for $5,000,000,000 dollars. Your number above represents 0.9% of that figure.
Even in the SCO world, I doubt they're losing any sleep over this...
I think I know what IBM is thinking. . . . (Score:3, Funny)
Terrorists! (Score:2)
See, Microsoft's allies were right all the long.... Linux/Open Source is the choice for Terrorists!
Those wacky propellorheads at Livermore!! (Score:2, Funny)
That oughta give 'em the firepower to prototype the nuclear WMD that can surgically remove the state of Utah without bothering the neighbors.
about that nuke research- (Score:4, Informative)
For those of you wondering why it takes 1 pflop to do such a simulation consider how much computing power it would take to follow each gas molecule in the explosion as it expands. They won't be able to get even remotely close to that precise, obviously. (6x10^23 molecules in 22 liters at room temp, so figure about 10^25 molecules to follow around)
Also, keep in mind that 70% of academic research dollars are defense related. (whether you like that or not, sadly)
What *I* Can't Wait For... (Score:5, Insightful)
I'm dreaming. I know.
Re:What *I* Can't Wait For... (Score:4, Insightful)
Lots of wrothwhile stuff gets done on those machines, believe it or not. Just like lots of worthwhile stuff gets done at Lawrence Livermore Lab. They're famous for their weapons, but the amount of other research done there is staggering.
Re:What *I* Can't Wait For... (Score:2)
Its too sad... (Score:2)
And now its about to be build, they use it for nuclear weapon research
Re:Its too sad... (Score:2)
Re:What *I* Can't Wait For... (Score:2)
Echoes of earlier lawsuits ... (Score:2)
OOOH! (Score:2)
(hold on).
Oh, never mind.
Cool name... (Score:3, Funny)
Yeah, 9th grade was like some sort of nightmare for me which seems to just live on and on...
Bug report (Score:5, Funny)
the kernel is becoming slightly unstable with more than 10 trillion bytes and 65000 CPUs, please try to reproduce the situation. See the attached memory dump file.
More corporate welfare... (Score:3, Interesting)
I commented on a similar previous corporate welfare handout where IBM was producing some software to mimic the human brain or some crap like that...to the tune of around half a billion dollars.
This is yet another such example...Lawrence Livermore National Laboratory is "operated by the University of California for the U.S. Department of Energy" This is yet another example of the public subsidizing hech tech industries, specifically IBM but it happens for others as well.
When are enough people going to stand up and put a stop to this bullshit so that we can use our money for much better use? Or better yet, when is the public going to be involved in deciding for themselves which projects get priority and how they are to be run?
And our government has the nerve to lecture others on how to run a democracy!
Finally! (Score:2, Funny)
How long to crack 128 bit encryption? (Score:3, Insightful)
Just a thought...
Big Deal (Score:2)
"Blue Gene/L, the first member of the family, will contain 65,000 processors and 16 trillion bytes of memory."
But does it support SATA RAID5?
"16 trillion bytes of data"... Duhhhh. (Score:3, Interesting)
I just love it when someone writes an article, and doesn't know hot to put it into words people can understand.. So they come up with this jackass "it's a million billion!" shit.
16 trillion bytes of data = Approx 15 terabytes.
What the hell is so hard about saying "15TB" ?
WTF? Nuclear weapons research? (Score:3, Insightful)
Why not research into harnessing different kinds of energy. Or search for a cure for cancer. Or look for fucking aliens.
But please. Not more fucking weapons. There are enough.
Scratches Head (Score:2)
16 terabytes (Score:2)
Let's do the math ... (Score:2)
I'll take two!
Why Linux? (Score:3, Funny)
Re:yeah but... (Score:2, Funny)
Maybe not - but given IBM's history, it might be great at playing chess.
Or Tic-Tac-Toe, given the nuclear weapons simulation angle.
Re:yeah but... (Score:3, Funny)
Re:yeah but... (Score:2)
Really shouldn't we have gotten past the point of trying to build technologies that wipe out all life on Earth?
Re:yeah but... (Score:2)
Re:yeah but... (Score:2)
scripsit Magila:
<pedantic>Um, more importantly I don't think whatever architecture it uses will be binary-compatible with ia32...</pedantic>
Re:yeah but... (Score:2)
Re:Total operating system cost (Score:2)
$1499/CPU * 65000 CPU = $97,435,000
(Remember, the end of october signals the increase in the per-CPU price)
Re:Math makes my head hurt. (Score:2)
Re:Math makes my head hurt. (Score:2, Informative)
In something like fluid dynamics, these programs are actuall
Re:hehe this reminds me... (Score:2)
Hmmm. As much as I love and support Linux, I'd be interested to see a linux running on a CPU whose power supply have died.
Re:Sweet cluster (Score:2, Interesting)