Slashdot Log In
Debian Cluster Replaces Supercomputer For Weather Forecasting
Posted by
Soulskill
on Friday March 14, @02:04AM
from the when-it-rains-it-pours dept.
from the when-it-rains-it-pours dept.
wazza brings us a story about the Philippine government's weather service (PAGASA), which has recently used an eight-PC Debian cluster to replace an SGI supercomputer. The system processes data from local sources and the Global Telecommunication System, and it has reduced monthly operational costs by a factor of 20. Quoting:
"'We tried several Linux flavours, including Red Hat, Mandrake, Fedora etc,' said Alan Pineda, head of ICT and flood forecasting at PAGASA. 'It doesn't make a dent in our budget; it's very negligible.' Pineda said PAGASA also wanted to implement a system which is very scalable. All of the equipment used for PICWIN's data gathering comes off-the-shelf, including laptops and mobile phones to transmit weather data such as temperature, humidity, rainfall, cloud formation and atmospheric pressure from field stations via SMS into PAGASA's central database."
Related Stories
Firehose:Debian cluster beats supercomputer in forecasting by Anonymous Coward
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading ... Please wait.

One thing always missing from such stories... (Score:5, Interesting)
What was the age and the specs of the SGI being replaced?
Going by Moore's law, a factor of 20 performance improvement takes about 6 to 8 years. If the SGI was at least that old, this isn't news -- it's just the state of the art these days. In other words, small clusters capable of weather forcasting are relatively run-of-the-mill.
Of course, props to linux for being the enabler in this case.
Re:One thing always missing from such stories... (Score:4, Funny)
6 to 8 years, you say? Well, then, they'll be ready to upgrade about the time the next version of Debian is released.
Re:One thing always missing from such stories... (Score:5, Informative)
> Debian "unstable" Sid is upgraded every day, or at least several times per week.
True.
> Debian "testing" is upgraded several times a month.
Wrong. Debian testing is updated automatically from packages in Debian unstable. The difference is simply that a package has to sit in Debian unstable for a few days, and no significant bugs can be introduced by the new package, before it is updated. Since the process is automatic, Debian testing is updated just slightly less continuously as unstable (it depends on the robot to check the package dependencies and bug reports rather than the maintainer to upload a new version).
The only time when the update rate is seen as low as less than that is when testing is in deep freeze, i.e., a new stable is about to be created.
> Debian "stable" is upgraded every one or two years.
It usually takes slightly longer than two years.
> The only one I have avoided is "Debian experimental"...
You cannot have a pure "Debian experimental" system. Debian experimental are subsystems that could have profound effect on the rest of the system, and so is provided for trial in isolation. E.g., back in the Gnome 1 to Gnome 2 transition days, or XFree 3 to XFree 4 days, these subsystems are tested in experimental before moving to unstable. These packages are supposed to be used on top of or to replace some unstable packages. Since they affects one particular subsystem, experienced testers can try one particular one based on their needs.
This isn't anything new... (Score:5, Interesting)
Where is... (Score:5, Funny)
apt-get -f -y install gweather
But it failed with something about "ldconfig:
Is libearthquake in unstable?
Re:Where is... (Score:5, Funny)
more weather - For when you need a new update.
less weather - Got too much weather? Reduce it!
vi weather - When you want to change the weather.
emacs weather - When you want to change the weather on 15 separate planets at once.
cat weather - It's raining... oh, never mind.
Re:hmm (Score:5, Funny)
Re:hmm (Score:5, Funny)
Re:Debian? (Score:4, Insightful)
-- from a debian user... who actually started quite late with potato....
Re:Debian? (Score:4, Interesting)
Stability is a major thing with Debian, and my experience has been that this is quite true.
Re:Debian? (Score:4, Funny)
Re:Debian? (Score:5, Informative)
Wow - how many performance clusters do you run again?
Not that I run a "performance cluster" as such - but I do run a bunch of machines that are very busy, all on Debian.
You know what? We compile the couple of programs where CPU is the bottleneck from source. We also compile Cyrus IMAP from source because we apply a pile of patches, but if someone else was packaging up all those patches in upstream, I'd be happy for them to be compiled there. Disk IO is the issue with Cyrus, and a custom compile won't help with that.
Yeah, we build our own kernels as well - that's another point that's worth the effort to customise.
Re:Debian? (Score:5, Insightful)
The things I (and my co-workers) put a lot of optimization effort into is the kernel and our apps. You're exactly right.. 99.9% of our CPU cycles go into getting work done, and that 0.1% used by
Re:Debian? (Score:5, Funny)
Re:Debian? (Score:5, Informative)
I hated Debian at first because it wasn't friendly, but I looked into it more and realized it was the best choice I could make for my production servers. I can set them up and check once a week or so and they're still chugging along without need of intervention.
I wouldn't use Debian on my desktop (I use Kubuntu), but it can't be beat for servers.
It's NOT a desktop distro. Especially compared to Mandr* or Ubuntu or many others out there.
Re:Debian? (Score:5, Informative)
Re:Debian? (Score:4, Insightful)
I doubt they have X installed on these machines.
Re:Debian? (Score:4, Insightful)
Re:Debian? (Score:5, Insightful)
Not sure why you call Debian a desktop distro, it's much more useful as a server.
Re:Debian? (Score:5, Insightful)
Re:Debian? (Score:5, Interesting)
Debian isn't - and never has been - a desktop distro. If you want a desktop distro built on Debian architecture, you get Ubuntu, or Knoppix, or one of a dozen others. Debian's unique selling proposition is a combination of stability, which is very important to production servers, and a rigorous commitment to free software. Packages don't make it into Debian Stable until they have been thoroughly tested. Debian also has the best package management system in the industry.
Frankly, I wouldn't run a server with anything else.
Re:dent in the budget (Score:4, Informative)
Re:I don't understand the difference (Score:5, Informative)
Also the core os ( most minimal installation ) has many different tools and libs.
Also at time of release they can pick from many different versions of a single package.
That in combination with what version of GCC and compile flags can and does make a huge differance.
And at least with Debian you really do know how the systems was build, with RedHat I still wonder...
Marcel
Re:I don't understand the difference (Score:4, Informative)
Re:I don't understand the difference (Score:5, Informative)
Once you got it configured the way you want it, there's little intervention involved to maintaining it. It'll just keep chugging along. The keyword there is "correctly". Follow the readmes, howtos, and best practices, and you're golden.
It's also one of the oldest distributions which always kept to the spirit of GNU/Linux in general: community development and enrichment. Debian developers pride themselves on that spirit. To make the best software for humans. (At least that's what I gather from hanging out with Debian folk) These people are not only passionate in the software that they write, they do it without wanting anything in return, being humble in the way they do it, and wanting no reward for doing it. To them, their reward is in other people using their software and loving it! In my opinion they're not recognized enough.
But what do I know? I just use the software.