Slashdot is powered by your submissions, so send in your scoop

 



Forgot your password?
typodupeerror
×
Linux Software

Feature:Linux and X-Ray Astronomy 39

Kevin Remhof has submitted us a piece on an area of Linux that a lot of you might not be familiar with, but may wish to be: Linux and X-Ray Astronomy. Talks about some of the things you can do, as well as common applications to do them with. Check it out.
The following was written by Slashdot Reader Kevin

Linux and X-Ray Astronomy

by Kevin Remhof


On July 23, 1999, NASA deployed the Chandra X-Ray observatory from the Space Shuttle Columbia. This telescope is a major leap forward in X-Ray astronomy. It will enable scientists to study dark matter, black holes, and other objects with great detail. I was checking out the information on the Chandra website and started to wonder about the software behind this telescope. So, I did a little searching on NASA'as website and found some interesting information. What I found is that X-Ray Astronomy is depending more and more on Linux for analyzing the data.

Background

X-Ray astronomy has been around since the early days of the space program. X-Ray telescopes work much the same as a regular telescope, but rely on X-Rays to view objects. The earth?s atmosphere absorbs most radiation from space. So, in order to use these telescopes, they have to be lifted out of earth?s atmosphere. The first X-Ray telescope sent into space took pictures of the Sun. Since the Sun is so close to earth, it was not hard to focus this crude telescope. Modern X-Ray telescopes are much more refined. The Chandra telescope could read the letters on a stop sign from 12 miles away.

X-Ray telescope data needs to be decoded before it is useful. This is similar to the concepts behind the SETI@Home project. Astronomers are allocated time to use the telescope. Chandra has about a 55 minute viewing time during each or bit around the earth. The telescope first gathers data without interpreting it. That data is then transferred to earth. Scientists then pick up chunks of that data for analysis. It is then that the power of X-Ray telescopes can be seen. X-Ray pictures are a little strange. Although attractive pieces of art, they are not easily understood by the general public.

The Linux Connection

Astronomers have used UNIX as their standard platform for years. Sun, HP, DE C/OSF were all commonplace. That is until Linux came along. Linux is becoming more and more popular and is threatening to take over as the platform of choice. Linux is now the darling of NASA. It is easy to powerful, easy to use, and porting applications from UNIX is not too difficult. NASA even uses Beowulf clusters for various projects which need large amounts of computing power.

Linux is a great choice for X-Ray astronomy because of the wide available of the OS and the software for it. Two popular programs are XANADU and FTOOLS. Both of them began as UNIX programs and have now been ported to Linux.

One astronomer, Ken Ebisawa has even written a HOWTO on "Linux for X-Ray Astronomers ". He details how to get Linux up and running and some of the various tools useful in X-Ray astronomy. According to the Goddard Space Center?s website, & quot;Ebisawa hopes to resolve the mystery of the Milky Way's so-called diffuse X-ray emission, a ubiquitous cloud of X-rays that blankets our galactic plane and whose origin is unknown. To do so, Dr. Ebisawa will look at a region of space where this cloud varies in X-ray brightness but where there seems to be no distinct energy sources to produce it." Ebisawa will use his Dell Inspiron laptop to analyze his data.

Open Source Software

The latest development in X-Ray astronomy is Open Source. Another program for analyzing X-Ray data is called SAOimage. Currently, it is being redesigned and updated using Open Source practices. Open Source is a natural for this because users often want to extend the software by combining it with other systems to come up with a research environment. It also helps to reduce some of the costs associated with development of such complex systems. Using the bazaar model of software development allows multiple developers to maintain and upgrade this complex code. It also allows the shared development of key pieces of code and functionality while satisfying individual needs of users.

Conclusion

Linux is rapidly becoming the OS of choice for X-Ray astronomers. This is yet another credit to the flexibility and power of Linux. More information on the Chandra scientists can be found here.

This discussion has been archived. No new comments can be posted.

Feature:Linux and X-Ray Astronomy

Comments Filter:
  • This really isn't anything new. Linux has been supplanting old unix workstations in astronomy for years. In my research group, we started making the switch about 3 years ago, and today we're almost completely a linux shop (we still have an old sparc that I'm keeping around just for grins).

    In reponse to the question of what can the community do, I would give two suggestions:

    1. Help out the saoimage development project, the latest beta release is finally starting to have features that it should've had 3 years ago (eg. true color support). Btw, saoimage isn't just useful for x-ray astronomers, us folks working in the optical and infrared use it too.

    2. If you're perl minded, check out the perl data language project [aao.gov.au]. In order to keep future astronomy analysis software free and open source, the PDL project needs to succeed (as well as improving perl's bindings to gtk). The reason I say this, is that a certain segment of the astronomy community is moving towards IDL, a proprietary scripting and data analysis package from RSI. IDL has some nice plusses, but it's non-free, and in the long run I think perl could be a much more powerful environment. Iraf, may be free and it gets the job done, but IMHO it's a real mess, and too poorly documented to be able to last much longer.

    Ciao

  • I too am forced to use IDL on a regular basis and absolutely loathe it. The remote sesning frontend, ENVI, is better though. At least RSI release IDL and ENVI for linux (binary, x86 only of course.)

    One of the chaps here is evaluating PDL and is very impressed, I'll take a look at it myself sometime.

    For another use of linux at NASA check out AirMSIR [nasa.gov]. Although it's not mentioned on the page, the instrument is controlled using linux with RT extensions. Still didn't stop it from missing the target on the fieldwork I was doing in Kansas last month though...:-(

    Nick

  • Aug 97. But don't they use a BSD-derivative on the primary systems?
  • for you perl-headed number crunchers out there, check out the PDL package from CPAN or from http://grimbergen.astro.rug.nl/~tim/PDL/ if you want rpms. it's not yet a full-on replacement for IDL, but it does plots well, is reasonably fast, and is a helluva a lot more fun to program. it has some slick opengl plotting capabilities, too. for general purpose data manipulation and plotting PDL is pretty powerful and i wouldn't dream of moving from it to IDL. i'm forced to use IDL for one of my projects and i _really_ dislike it.

    for python users, there's the NumPy package that's roughly analogous to PDL as well as a python interface to the pgplot graphics library. i don't have much personal experience with python, though.

    IDL is kind of the exception since most major software packages used in astronomy are free if not open source. heck, aips is even GPL'ed.

    tim
  • yeah, sitting down and rewriting IDL from scratch would be a huge effort and not bloody likely, but some free things like perl/PDL are coming close to providing near equivalent functionality for data manipulation and plotting.

    i think it's rather elitist for big, money-rich centers like ESA or NASA to choose to standardize on expensive solutions like IDL. the $1500 or so per license is a very big chunk of the computing budget for many small departments.

    tim
  • ...are nothing like one another, except at the most basic, functional level. (ie they have a hole in one end, some sort of focussing device and some way of recording what's going on). They both frequently contain big cylindrical bits. That's about it, though.
  • then use the term: "Roentgen-Rays"

    named after the man who discoverd the X-Rays.
    (he himself named the rays X-Rays because of
    his understatement)

    scnr. ;-)
  • Thank you for that wonderful piece of flamebait. This is a flame that I'm sure you won't read, given the level of maturity you've already expressed.

    Rather than trying to express your pitiful self in such an annoying way, here are a couple other ideas for you.

    1. Learn to use it. Linux is great, but not for the ignorant (which this sort of behavior proves you are).

    2. How about surfing elsewhere? If you have used linux, and don't like it, use something else. Freedom of choice is a wonderful thing. And since so much stuff here is about linux, and you don't like linux, you have no reason to be here. Attracting flames in this way serves absolutely no purpose, other than possibly inflating your poor misguided ego. (Oh look! I can click on "Reply" and add to the stuff people read! I'm "3>Tr3/\/\3lY 3le3T" now for finding this "Reply" button! I think I'll be ANNOYING and send a message that does absolutely nothing but prove my own trollness and get sentient life-forms to yell at me! Yeah cool!)
    --
    Paranoid
  • For those of you that care, I just thought I'd let you know that all of the Chandra data analysis software is being developed on Sun/Solaris machines and ported to redhat and slackware. I've tested (and demo'd) the linux ports, and they're coming along nicely. It's definitely a step in the right direction to have this software available for linux boxes. All of this software is in the public domain, and covered with a license similar to the GPL, with the expected NASA spin on it.

    It's been amazing to watch the transition in the past few years at AAS (American Astronomical Society) and other professional meetings - now everyone has laptops running linux and loaded with their favorite analysis software.

    I was shocked to see so many Chandra-related folks posting on /. Obviously y'all don't work in calibration or data systems, huh? :)

    BTW, if any of you folks can show me how to get IRAF to build properly on LinuxPPC, reply to this!

    -zeno
  • As an X-ray astrophysicist working on Chandra as well as XMM and Astro-E (two other X-ray observatories to be launched within a year), I'd say one of the greatest free software needs in X-ray astronomy is a free equivalent to IDL. It plots data well, and can manipulate data pretty well too, but it's not free in either sense (freedom or price). As far as I know the source code is unavailable and unmodifiable, and on top of that, extremely expensive.

    How does IDL compare with PAW and HBOOK? I know both of them are free and the source is available at the CERN site. Also both of them are used fairly widely within the HEP community.

    The only problem with PAW is that its pretty cryptic and odd at times. Basically its 4 or 5 packages that have been glued together. Also its pretty fortran oriented and supports vms type abbreviations(e.g. v/cr can be used instead of vector/create) in the macros so reading other people's source can be difficult.

  • Hmm, this is an interesting article. Having given up on SETI after all the hoohaw about repeated packets and the overload of users, I thought this might provide some pointers for getting into some *real science*. However, it only really seems to be useful for those who already know what they are doing.

    The HOWTO in particular caught my attention, but it is more of a "HOW TO set up a Linux system" than "HOW TO get involved in X-Ray astronomy".

    I guess that if one doesn't have the appropriate background, this isn't a suitable subject for beginners to get involved in.

    Maybe I'll stick to my home gene-splicing experiments :-)

  • It's cool that NASA is supporting Linux. But it is certainly true that the field of astronomy has been very Unix oriented for a long time (that is, for those who have given up their VAX systems already. :) )

    Anotheuinr interesting thing about astronomy is the emphasis on open source software. Two of the most popular astronomical data analysis packages in the USA have been open source from the start.

    The IRAF project [noao.edu] (supported by the NSF) has been open source since it started in the early-mid 80's. It's primarily used for optical and infrared imaging and spectroscopy for ground-based and space-based observation, but it is also used for X-ray astronomy. Nearly all of the Hubble data is processed in IRAF.

    Radio astronomers use the AIPS software [nrao.edu], which is also open source and has been since its origin in 1978.

    Both have supported Linux since about the time RedHat first appeared on the scene. Neither of these packages are recommended for non-specialists, but they are examples of free software which dominate a discipline.
  • First comment? ;)

    LL
  • by JJ ( 29711 )
    X-ray astronomy specifically and astronomy in general is a perfect place for LINUX (and UNIX previously) to grow. First, it's pretty much a skill training sourcing field. That is, the number of job opportunities is such that there are a lot of good people who just can't work in the field after they reach qualification and find work elsewhere, like in the computer industry. Second, astronomy is not a luxuriously supported discipline (double the funding and thats still true.) hence, astronomers learn to do things on the cheap (like not buying an MS setup, getting an open source one.) Third, it's a moderate sized field, small enough to have lots of personal contacts, large enough to make technology specialization at least plausible. Fourth, the amount of computing power needed in certain disciplines , particularly X-ray, is pretty much . . . well, astronomical. Hence, the people in the discipline become pretty handy with computers and analysis. All in all, astronomical research provides one of the best returns on the federal dollar invested in academic research. Of course, don't tell the government this.
  • As an X-ray astronomer myself I'd like to add that one of the main reasons for Linux being popular in our field is CHEAPNESS. I'm originally from the UK - where the computer systems are governed by a central organisation called Starlink (http://star-www.rl.ac.uk). They've been the subject of many budget cut backs that means that the previously supported platforms Solaris and Digital Unix are fast becoming too expensive to maintain.

    So Linux came along - cheap hardware - free OS - easy portability and it's Unix enough that for users of DU or Solaris it can be picked up quickly.

    Now most of the work I'm doing is on Linux - alot of the software developement for XMM (ESA's companion to Chandra) is being done on Linux (including work I am doing myself).

    So no - as someone else pointed out - Linux in astronomy is nothing new - I'm betting on Linux being the number one operating system used in Astronomy - simply because that area is populated by hackers and the computer savvy, exactly the kind of people who made Linux what it is today.
  • > you suddenly OWN that magical ROOT password

    Hmm... just because it's Linux doesn't stop it being administered. I admit that I have the root passwords in my current X-ray astronomy job (for Solaris as well as Linux) - but in my last job the root passwords to the Linux boxes were just as secret as those for the Solaris and Digital Unix boxes.
  • This little factoid has been known to me, and my Astronomy Associates in Tucson AZ for some time now.
    For those of you who do not know, Tucson AZ is perhaps the Astronomy Captital of the World, with Kitt Peak National Observatory in our back-yard and perhaps the highest per capita population of Astronomers (especially Ph.D.s) in the World.

    I'm mostly Familiar with Steward Observatory [arizona.edu] and the University of Arizona [arizona.edu] Department of Astronomy [arizona.edu]. There, we primarily use Sun Workstation and the IRAF project, while most of the software applications revolve around FORTRAN Language, due to the industry standard in the Astronomy Community.
    I know from personal experience, that Linux Platforms like Red Hat and Caldera are often "passed" around from office to office and home to home so that the PC fleet can network to the Unix severs and scientists can do a majority of their Data reduction at the comfort of their home or Office PC and not some slow terminal connection.

    Also on the horizon, the Astronomy community is eager to network everything together (with security and what-knot, so that some hacker kid can't get access to the HST) so that the Astronomer doing research can sit in his lab/office and do his research over a computer connection, rather then spend his precious time in an observatory maneuvering the Telescope and doing menial tasks of adaptive optics and taking dark images to adapt for errors in the telescope, that could easily be done remotely. All the while, while porting Unix software like qphot, emacs, super mongo, and IRAF to their Linux PC and working with their data instantly.

    That ends this report from the field, this is BaronCarlos.
    *Carlos: Exit Stage Right*

    "Geeks, Where would you be without them?"

  • Interesting, I must say... Hence, the people in the discipline become pretty handy with computers and analysis. All in all, astronomical research provides one of the best returns on the federal dollar invested in academic research. Of course, don't tell the government this. Of course, I'll add my $0.01 worth: I think it's great that such innovative, ingeniutive, inventive, etc. people exist. Now, if only the government'd start cutting budgets in other areas, maybe some of those slackers would be forced to actually start thinking a bit.

    Then again, I realize that many of you may find that extremist, in which case I'd advise you, and the rest of the "population at large" to ignore me.

    I'm finished now. Thank you for your time.
  • This is slightly off topic, but...

    Not too long ago, I found a book in a used bookstore called "How to Build a Radio Telescope" - it was published in the late 50's-early 60's (IIRC), and a the schematics seem to be based on tube technology. However, it seems pretty in depth on everything else.

    Are there any geeks out there that would be interested in such a book? I picked it up because of the title - I mean, how often do you find such a book - anywhere?

    I am not saying I am going to sell it - but I might give thought to converting it to HTML or something if enough people are interested...
  • by Wubby ( 56755 )
    Linux is currenty being used for some operations at the Operational Control Center for Chandra. It is being used to process some data. It was an obvious choice, from what I'm told. The majority of the system runs on SGI's, though. Throw in a couple Suns for good measure and a couple NT's to screw things up (trust me they do!). Personnally, I'd like to switch to Linux exclusively, but these are decision that take YEARS to be made. Chandra has only a 5 years expectancy.
  • Stupid Dweeb.... use your time for something more productive than wastying a few mor bytes of space on /.'s Hard drives.

    You probably just read here cause you still cant figure out what this whole 'Linux" thing is. :-0

  • So how long until Linux gets used on a shuttle mission? It'll be the first Open Source operating system in orbit.

    (I wonder how a penguin would react to zero-g)

It's been a business doing pleasure with you.

Working...