Linux Clusters Finally Break the TeraFLOP barrier 223
cworley submitted - several times - this well-linked submission about a slightly boring topic - fast computers. "Top500.org
has just released its latest
list of the world's fastest supercomputers (updated twice yearly). For
the first time, Linux Beowulf clusters
have joined the teraFLOP club, with six new clusters breaking the teraFLOP
barrier. Two Linux clusters now rank in the Top 10: Lawrence Livermore's "MCR" (built by Linux NetworX ) ranks #5 achieving 5.694 teraFLOP/s, and Forecast Systems Laboratory's "Jet" (built by HPTi) ranks #8 reaching
3.337 TeraFLOP/s. Other Linux clusters surpassing the teraFLOP/s barrier
include:
LSU's "SuperMike" at #17 (from Atipa
), the University at Buffalo
at #22 and Sandia National Lab at
#32 (both from Dell ), an Itanium cluster
for British Petroleum Houston at #42 (from HP
), and Argonne National Labs at
#46 (from Linux NetworX ) reached just
over the one teraFLOP/s mark with 361 processors. In the previous Top500 list compiled last June, the fastest Intel based Netfinity 1024 processor clusters from IBM were sub-teraFLOP/s and the University of Heidelberg's AMD based "HELICS" cluster (built by
Megware
) held the top tux rank at #35 with 825 GFLOP/s."
Enough Links? (Score:5, Funny)
Re:Enough Links? (Score:1, Funny)
Re:Enough Links? (Score:1)
Re:Enough Links? (Score:5, Funny)
Just act like the average Slashdot member. Never click any links to read the articles and just post your thoughts regarding the subject.
Everything get so much easier that way!
Re:Enough Links? (Score:2)
I hope you don't ever read the quickies [slashdot.org]...
Re:Enough Links? (Score:4, Funny)
It would probably end up linking to the greatest pr0n site of all time...
Re:Enough Links? (Score:1)
Re:Enough Links? (Score:5, Funny)
Re:Enough Links? (Score:2, Funny)
Re:Enough Links? (Score:1)
Re:Enough Links? (Score:1)
Scenario 1: He's got two accounts. One devoted to karma whoring, one devoted to FP's. You've guessed it. All consciensous
Scenario 2: Revenge is a dish best served hot. What better way to get back at his enemies, than to slashdot their machines to melting point?
Question? (Score:4, Funny)
Re:Question? (Score:1)
Re:Question? (Score:5, Funny)
Good luck. Last I checked, that one falls under Heisenberg's Uncertainty Theorem.
Re:Question? (Score:1, Insightful)
Re:Question? (Score:1)
We don't know were they are when the network's working at it's "usual high speed"?
Or is it that when the network is not working at it's "usual high speed", you find them waiting for you in your office?
Re:Question? (Score:5, Funny)
That shouldn't be too hard... I bet that my Palm Pilot has enough power to predict exactly, what my boss is going to say in the next meeting tomorrow.
If it's about schedules, he'll say:
Work...
If it's about project goals, he'll ask me to:
Make...
If it's about specifications, he'll say: "I have no idea. You find out yourself." And for anything else it would be just blank. All blank.
On the other hand... if a manager actually has any real thoughts... Well, that would be as easy as to predict patterns from a pure chaos.
Re:Question? (Score:3, Funny)
If it dies, you're fired.
FLOPs (Score:1, Offtopic)
Re:FLOPs (Score:1, Informative)
FLOPS=Floating Point Operations per Second
Re:FLOPs (Score:2)
Re:FLOPs (Score:2)
Why don't they write it: FLOP/s?
Re:FLOPs (Score:1)
I lile FLOPS better.
Re:FLOPs (Score:1)
per
Second
FLOP/s, not FLO/s. Just an FYI
Re:FLOPs (Score:3, Insightful)
Because FLOPS means FLoating point Operations Per Second
'/' means 'per'.
FLOP/s would mean FLoating point Operations Per Per Second
FLO/s doesn't seem like a very good idea, except for cleaning your teeth.
Re:FLOPs (Score:5, Interesting)
Re:FLOPs (Score:1)
Russ
Ah ha! (Score:2, Offtopic)
So, is THAT how you get something accepted? Really I don't know if posting that story with that attached to the front of it was such a great idea.....
Now everyone who submits a story that they think is good, should it get rejected, they will simply submit like twenty copies of it....
What a pain for the poor editors.... Really I question the wisdom of telling us this works....
Re:Ah ha! (Score:1, Offtopic)
Re:Ah ha! (Score:3)
can you imagine... (Score:5, Funny)
(hey what else can I say, it's already a cluster)
Re:can you imagine... (Score:1)
Have another coffee while it Boots (Score:4, Interesting)
Re:Have another coffee while it Boots (Score:4, Funny)
Perhaps the boot speed is limited by the ramp-up speed of the local power plant.
Re:Have another coffee while it Boots (Score:2, Funny)
Turning off the extended mem-check reduced this to 25 mins.
I once had a SCSI cable go bad, and I had to boot that darn thing up about a dozen times, swapping out cables, to find the bad cable. What a bad night that was! Swap cable, take 25-min break, watch SCSI errors from kernel. lather, rinse, repeat. 3 hours to find one bent pin on a scsi cable. yuck.
Re:Have another coffee while it Boots (Score:3, Informative)
LinuxBIOS (Score:5, Interesting)
Wow! (Score:4, Interesting)
2 Hewlett-Packard 7727.00 Los Alamos
The distance from the first to the second is pretty impressive. What on earth did NEC really do over there?
EARTH-SIMULATOR (Score:3, Funny)
It's gonna take some CPU power to simulate earth, don't you think??
Re:EARTH-SIMULATOR (Score:5, Funny)
{
sleep(years_to_ms(30000));
}
dunno what they need the computing power for..'
oh yeah, to generate the program to call that.
Re:EARTH-SIMULATOR (Score:3, Interesting)
Re:Wow! (Score:2, Funny)
Re:Wow! (Score:1)
Re:Wow! (Score:3, Informative)
a 64 GFlop Nec SX-6 supercomputer. (5,120 CPUs total).
It has its own dedicated, custom-built power station. 'nuff said.
Google is your friend, but for starters:
http://www.sw.nec.co.jp/hpc/sx-e/sx6/index.html
http://www.nec.co.jp/press/en/0203/0801.html
Re:Wow! (Score:2, Informative)
Re:Wow! (Score:3, Informative)
One big item to note is that many of the supercomputers built in the US are for weapons research; as opposed to the NEC supercomputer, which deals with, obviously, changes of the earth.
More links:
Press release for the Earth Simulator [nec.co.jp], dated March 8, 2002
General system information on the cluster [nec.co.jp]
Re:Wow! (Score:2)
Im not against it, its just a joke. I am one of those that believes that humor is the only thing that keeps mankind from collectively commit suicide. In my point of view humor cant ever be wrong.
Im sorry if you are offended but i wont change because it offends you. I have to live with people saying things that i dont like all day. Thats part of life outside a totalitarian state.
Re:Wow! (Score:2)
That said i am sorry if i may have offended you. It was ment to be a joke about the types that always complain about spelling. I get your drift but i dont think anything is to holy to make fun of.
Re:Wow! (Score:2)
How many FLOPS (Score:2, Interesting)
Re:How many FLOPS (Score:3, Funny)
$ grep bogomips
bogomips : 2962.22
Re:How many FLOPS (Score:2)
Bogomips are not a mesure of performance by any stretch of the imagination. bogus+mips = bogomips.
Of course I'm stating the obvious.
Re:How many FLOPS (Score:2)
Whats the matter jericho? 2962.22 to racy for you?
(yes that is a joke
Re:How many FLOPS (Score:2, Insightful)
Actually, neither are FLOPS. It wildly depends on what you do in your program, and no benchmark is representative.
As an instructor for the course 'Optimizing for the CRAY J932' told my class: the 'Theoretical Peak Performance' is the performance the manufacturer guarantees you won't exceed.
Funny (Score:1)
I'm not trying to start a war or anything. It's just an amusing observation.
Re: (Score:2, Interesting)
Re:It seems like the Apple Mac..... (Score:3, Insightful)
I know that they arn't as scalable
I think you answered your own question there.
Re: (Score:1)
Re:It seems like the Apple Mac..... (Score:1)
Re:It seems like the Apple Mac..... (Score:1)
It may still be ahead in gflops... I'm not into cpu's enough to answer that but i do doubt that. In any case mac's are for graphics people so that should be a real blow.
But I'll bet dual 2.4 ghz xeons will kick the 1.25 ghz system's ass in terms of gflops. Plus there only like $650 each so the mobo + processors won't cost more then $1400.
Re:It seems like the Apple Mac..... (Score:5, Insightful)
Hell, the Sony Playstation 2 was subject to export restrictions because it was 'too powerful', which was driven by/followed with the requisite marketing drivel, but you don't see and PS2 clusters in the 'Worlds fastest supercomputer' list either.
It has been a long time since Apple PPC was competitive in terms of price/performance with x86s. Of course thats not the only reason to buy a computer, i don't want to get the apple-zealots panties in a bunch.
It's just that Intel/AMD didn't make a song and dance about breaking the GFLOP barrier, since that happened way back with the P3/Athlon 600-800, hardly cutting edge chips.
Hell, a 600Mhz Alpha had GFLOP performance years before either the G4 or the x86s.
The PPC has a nice vector processing unit (Altivec), which could make it a good choice in some situations, but given the premium you pay for Beowulf nodes (Xserves?) from Apple, you will, in general, get a lot more bang for the buck from x86.
Re:It seems like the Apple Mac..... (Score:3, Informative)
Not really (Score:2)
The top500 list is based on double-precision linpack scores. This cluster would not score anywhere near that level on the top500 test because Altivec doesn't do double precision, so you use the regular scalar FPU. Furthermore, you need a fairly fast interconnect to get a good fraction of theoretical peak on linpack, so I would estimate that this cluster wouldn't get more than 40 gflops or so in the top500 test.
P4s can do a double precision vector, and as a result, they get much better linpack scores in a similarly equipped cluster, and for far less money. This is why you don't see big clusters being built out of macs.
Re:It seems like the Apple Mac..... (Score:2, Funny)
I don't know 'bout AMD, but Intel has these funny BunnyPeople to promote anything from breaking speed limits to new processors as shown here [intel.com]. So contrary to what you believe, yes Intel does make a song and dance(plus commercial) about [insert_marketing_gibberish_here]!
Re:It seems like the Apple Mac..... (Score:2)
Re:It seems like the Apple Mac..... (Score:2)
Beowulf clusters aren't so tricky... (Score:5, Interesting)
Step 1: Install the lam packages on all the nodes
Step 2: Create an account on all nodes, and use a passphrase-less ssh key to avoid prompting.
Step 3: Compile your code with mpicc (rather than gcc)
Step 4: Copy to all nodes.
Step 5: mpirun C
Admittedly it was only a 4 node cluster, but hey
Please, someone break it to me gently if this wasn't actually a Beowulf cluster
Re:Beowulf clusters aren't so tricky... (Score:3, Interesting)
The main comment that struck me was how easy it was to set up. The Engineer IT department is mostly Unix (they're all in retraining becuase they are dumping Sun Stations for Intel based systems running XP beleive it or not- becuase Intel chips are so much faster and machines running XP are much cheaper than Sun Sparcs (plus the software they want runs on XP)) so it was of course easy to set up for them.
Next they'll be setting up another LINUX cluster with maxed out dual or quad processor machines with more RAM. They're really excited.
Re:Beowulf clusters aren't so tricky... (Score:5, Interesting)
I agree with you, in principle, it *is* easy to do but the problems increase with the number of nodes. IMHO, the main problems are:
-Administration effort per node has to be almost zero. Beyond a number of nodes you definitely need things like fully automatic instalation, automatic power control, automatic diagnostic tools, a batch system, etc. All these tools already exist but you need some know-how to put all them together.
-You need a large enough room with a cooling system that gives at least 100 W per node, 7kW in our case. Room temperature has to be about 20oC.
-Low cost PC hardware is not allways reliable enough for this application. If you have codes that run 24x7 for months in a large number of processors, the probability to have a hardware problem is very high.
We have found that our hardware suppliers do not carry out extensive tests on the systems they sell. This is because "normal" users run low quality OSs and they assume that it is normal that the computers just hang from time to time. Therefore, they do not allways detect failures in critical components such as RAM.
-Of course, your application has to be suitable for parallel computing, specially if your cluster uses a low cost 100Mb/s network. In this case, compared to a "conventional" parallel computer (eg Cray T3E), the processors are roughly equivalent but the network is about 10 times slower and is easily the bottleneck of the system.
Having said that, despite all the problems, I love Beowulfs. They have totally changed high performance computing, and they are definitely here to stay.
All this has been possible thanks to free software, so thanks Mr. Stallman/Torvalds and many others...
Whoa that's cool (Score:1)
I love those giant black racks, even if it's not the fastest cluster in the world the Space Odyssey nostalgia is still there.
"My God, it's full of stars!"
-Matt
TCO's? (Score:1)
Impressive numbers (Score:3, Informative)
----
Re:Impressive numbers (Score:4, Insightful)
Meh, it's got pretty impressive image recognition, but can't do math for shit - all in all, I'm not amazed.
Re:Impressive numbers (Score:2, Funny)
Sorry, couldn't resist.
Re:Impressive numbers (Score:2)
It's kinda like a harddrive - one headcrash and you'd really like a replacement. Trust me on that one
[OT: Number of links] (Score:2)
While most people seem to be complaining about the number of links in the story, if history is any indicator, 90% of people won't click on one of those links, let alone all of them.
seriously.. (Score:1)
Well, duh. (Score:1, Offtopic)
He probably went all crazy because Linux stories tend to get ignored here at Slashdot.
Article /.ed (Score:3, Funny)
Flops is not everything (Score:5, Informative)
A real supercomputer supports much faster I/O, higher interconnection bandwidth and lower interconnection latency.
And btw. the new Cray X1 [cray.com] delivers the performance of a all but the largest linux-clusters in a single cabinet (820 GFlops peak that is..). In terms of computing efficiency it makes even the Earth Simulator look pale. I am really looking forward to the next iteration of the TOP500, when the first X1 machines are included.
Re:Flops is not everything (Score:4, Insightful)
Some applications scale on these kinds of clusters and some don't. But to say that "MFlops does not mean a lot" is just as silly a blanket statement as pretending that the Linpack benchmark is "the speed" of the computer.
That Cray does look pretty awesome, btw.
Flat5
All Shook Up (Score:4, Funny)
As when other barriers are broken, a bit of a shock wave was created.
Windows machines for miles around were rattled.
So how many old 386's that were left around (Score:1)
And the big question was did they top it all of with a 15" monitor they had lying around?
CNN and MS Bias (Score:2, Interesting)
As a side note, I find it rather funny that aside from technical issues, one can not legaly cluster Macrohard systems because EULAs gets in the way!
Just wondering.... (Score:2, Funny)
Does Microsoft compete in this space? (Score:4, Funny)
(This is a serious question, I have no idea if they do or do not.)
Check out... (Score:3, Informative)
OMFG! (Score:1)
Submission failed to mention... (Score:2)
M@
"Slightly Boring" (Score:3, Insightful)
Latley though, I feel the things I'm waiting for my computer are not a function of how fast the CPU can run, but how poorly the software is written. Can someone can tell me why my windoze machines sometimes block for up to a min when I try to click the "Location" box on the top of the file browser common dialog control? Or the oft-complained about boot time for most everything? Or the time it takes almost any program to load up the first time you load it?
Anyone else think it's time to start over, and not just assume the fater and faster machines can deal with the laziness we program into the systems we build?
M@
Imagine.... (Score:5, Funny)
e = 42; // always 42.
</humor>
it's been done with NetBSD before (Score:2)
It's just a question of proper application software, and OS doesn't really matter - I can't understand all this fuzz about Linux. *shrug*
Super Computer Prefer ANYTHING But Windows 499to1 (Score:2)
Looking at the list, we can see that Super Computers Prefer ANYTHING BUT Microsoft, 499 to 1. I tried to find out more about the "1", but it has been encrypted by Seoul National University using a character set "charset=euc-kr". If anyone has more info on it, please post it in english.
I wonder when Steve Jobs will get a MAC cluster on this list
SETI@Home is still ahead (Score:2)
Re:in anticipation of the barrage of beowulf clich (Score:2)
Re:in anticipation of the barrage of beowulf clich (Score:1)
Re:in anticipation of the barrage of beowulf clich (Score:1)
Re:Just asking for it... (Score:1, Offtopic)
But will there be more beowulf cluster jokes then links in the stories?
Re:Links (Score:3, Funny)
Will we be able to slashdot every one of them though? PErhaps someone should post some mirrors
Re:Links (Score:1)