Phoronix Releases Linux Benchmarking Distribution 31
Bitnit writes "Phoronix has released a major update to their automated Linux benchmarking software, the Phoronix Test Suite, and more interestingly they have released their own distribution that's designed for hardware testing and benchmarking on Linux. With PTS Desktop Live they provide this Linux distribution that's to run only from a live environment off a DVD / USB key and then allows their benchmarking software to run — and only that — on this standardized software stack, which makes hardware comparisons a lot easier."
Wrong benchmarks (Score:2, Interesting)
While the suite is good for benchmarking regressions between kernel versions (across distros for example), it's not a very good distribution comparing tool in my opinion.
I'd like to see benchmarks such as:
* Time from bootloader to login window/desktop
* Time from desktop to webbrowser fully loaded Google or something
* Time it takes to open an Excel sheet with OpenOffice
* Amount of swap space used under normal desktop cirmumstances (some ~15 FF tabs, few sheets, docs, mail reader, etc)
It doesn't matter if it differs +-2 fps in some game, or a MB/s on storage throughput. It's the whole integration and system together that determines what the distribution is etc.