Slashdot is powered by your submissions, so send in your scoop

 



Forgot your password?
typodupeerror
DEAL: For $25 - Add A Second Phone Number To Your Smartphone for life! Use promo code SLASHDOT25. Also, Slashdot's Facebook page has a chat bot now. Message it for stories and more. Check out the new SourceForge HTML5 Internet speed test! ×
Supercomputing

Submission + - Apache Hadoop Wins Terabyte Sort Benchmark (yahoo.com)

owenomalley writes: "One of Yahoo's Hadoop clusters sorted 1 terabyte of data in 209 seconds, which beat the previous record of 297 seconds in the annual general purpose (daytona) terabyte sort benchmark. Apache Hadoop is an open source Java framework for writing data-intensive distributed programs, and includes both a distributed file system and a map/reduce implementation. The sort benchmark, which was created in 1998 by Jim Gray, specifies the input data (10 billion 100 byte records), which must be completely sorted and written to disk. This is the first time that either a Java or an open source program has won. Yahoo is both the largest user of Hadoop with 13,000+ nodes running hundreds of thousands of jobs a month and the largest contributor, although non-Yahoo usage and contributions are increasing rapidly."
This discussion was created for logged-in users only, but now has been archived. No new comments can be posted.

Apache Hadoop Wins Terabyte Sort Benchmark

Comments Filter:

A list is only as strong as its weakest link. -- Don Knuth

Working...