Spitzer Space Telescope Data Processing and Algorithmic Complexity

Automated reduction of a very large body of data from the Spitzer Space Telescope requires an intricate and very flexible software system to support more than 50 different pipelines executing on a large distributed computing cluster. Additionally, in order to correct many instrumental signatures and calibration features, a variety of complex algorithms need to be utilized to process and distribute calibrated images and spectra from nearly 5 million instrument frames that are collected by the observatory every year. A sample of the complexities that needed to be accommodated both in system architecture and design as well as signatures encountered and associated algorithms will be described

Caltrans Keeps the Spitzer Pipelines Moving

The computer pipelines used to process digital infrared astronomical images from NASA's Spitzer Space Telescope require various input calibration-data files for characterizing the attributes and behaviors of the onboard focal-plane-arrays and their detector pixels, such as operability, darkcurrent offset, linearity, non-uniformity, muxbleed, droop, and point-response functions. The telescope has three very different science instruments, each with three or four spectral-band-pass channels, depending on the instrument. Moreover, each instrument has various operating modes (e.g., full array or sub-array in one case) and parameters (e.g., integration time). Calibration data that depend on these considerations are needed by pipelines for generating both science products (production pipelines) and higher-level calibration products (calibration pipelines). The calibration files are created in various formats either "off- line" or by the aforementioned calibration pipelines, depending on the above configuration details. Also, the calibration files are generally applicable to a certain time period and therefore must be selected accordingly for a given raw input image to be correctly processed. All of this complexity in selecting and retrieving calibration files for pipeline processing is handled by a procedural software program called "caltrans". This software, which is implemented in C and interacts with an Informix database, was developed at the Spitzer Science Center (SSC) and is now deployed in SSC daily operations. The software is rule-based, very flexible, and, for efficiency, capable of retrieving multiple calibration files with a single software-execution command

Refinement of the Spitzer Space Telescope Pointing History Based on Image Registration Corrections from Multiple Data Channels

Position reconstruction for images acquired by the Infrared Array Camera (IRAC), one of the science instruments onboard the Spitzer Space Telescope, is a multistep procedure that is part of the routine processing done at the Spitzer Science Center (SSC). The IRAC instrument simultaneously images two different sky footprints, each with two independent infrared passbands (channels). The accuracy of the initial Spitzer pointing reconstruction is typically slightly better than 1". The well‐known technique of position matching imaged point sources to even more accurate star catalogs to refine the pointing further is implemented for SSC processing of IRAC data as well. Beyond that, the optimal processing of redundant pointing information from multiple instrument channels to yield an even better solution is also performed at the SSC. Our multichannel data processing approach is particularly beneficial when the star‐catalog matches are sparse in one channel but copious in others. A thorough review of the algorithm as implemented for the Spitzer mission reveals that the mathematical formalism can be fairly easily generalized for application to other astronomy missions. The computation of pointing uncertainties, the interpolation of pointing corrections and their uncertainties between measurements, and the estimation of random‐walk deviations from linearity are special areas of importance when implementing the method. After performing the operations described in this paper on the initial Spitzer pointing, the uncertainty in the observatory pointing history file is reduced 10–15 fold

Processing of 24 Micron Image Data at Spitzer Science Center

The 24μm array on board the Spitzer Space Telescope is one of three arrays in the Multi-band Imaging Photometer for Spitzer (MIPS) instrument. It provides 5′.3 × 5′.3 images at a scale of ≈ 2″.5 per pixel corresponding to sampling of the point spread function which is slightly better than critical (≈ 0.4λ / D). A scan-mirror allows dithering of images on the array without the overhead of moving and stabilizing the spacecraft. It also enables efficient mapping of large areas of sky without significant compromise in sensitivity. We present an overview of the pipeline flow and reduction steps involved in the processing of image data acquired with the 24μm array. Residual instrumental signatures not yet removed in automated processing and strategies for hands-on mitigation thereof are also given

The ISO-IRAS Faint Galaxy Survey

The ISO-IRAS Faint Galaxy Survey will obtain comprehensive space- and ground-based observations of the most distant and luminous galaxies in the IRAS Faint Source Survey. ISO observations are obtained by filling short gaps in the ISO observing schedule with pairs of 11.5μm ISOCAM and 90μm ISOPHOT observations. As of the October 1997 date of this Conference, over 500 sources have been observed by ISO with an ISOCAM detection rate exceeding 803. Ground-based spectrophotometry confirms that the IIFGS efficiently detects moderateredshift, strong emission line Luminous Infrared Galaxies. Spectrophotometry is currently available for 67 galaxies with 0.07 < z < 0. 7 and L_(fir) > 10^(11) L_☉. The galaxies are comparable to nearby LIGs, showing HII/Liner excitation; about 10% exhibit strong AGN characteristics. As a part of this survey we will cover over 1.25 square degrees of sky to an 11.5μm limit of approximately l.0mJy, allowing a sensitive estimate of the 11.5μm logN-logS Relationship. Preliminary ll.5μm source counts suggest substantial evolution in the mid-infrared galaxy population

First Results from the ISO‐IRAS Faint Galaxy Survey

We present the first results from the ISO-IRAS Faint Galaxy Survey (IIFGS), a program designed to obtain ISO observations of the most distant and luminous galaxies in the IRAS Faint Source Survey by filling short gaps in the ISO observing schedule with pairs of 12 μm ISOCAM and 90 μm ISOPHOT observations. As of 1997 October, over 500 sources have been observed, with an ISOCAM detection rate over 80%, covering over 1.25 deg^2 of sky to an 11.5 μm point-source completeness limit of approximately 1.0 mJy (corresponding to a ~10 σ detection sensitivity). Observations are presented for nine sources detected by ISOPHOT and ISOCAM early in the survey for which we have ground-based G- and I-band images and optical spectroscopy. The ground-based data confirm that the IIFGS strategy efficiently detects moderate-redshift (z = 0.11-0.38 for this small sample) strong emission line galaxies with L_(60 μm) ≳ 10^(11) L_☉; one of our sample has L_(60 μm) > 10^(12) L_☉ (H_0 = 75 km s^(-1) Mpc^(-1), Ω = 1). The infrared-optical spectral energy distributions are comparable to those of nearby luminous infrared galaxies, which span the range from pure starburst (e.g., Arp 220) to infrared QSO (Mrk 231). Two of the systems show signs of strong interaction, and four show active galactic nucleus (AGN)-like excitation; one of the AGNs, F15390+6038, which shows a high excitation Seyfert 2 spectrum, has an unusually warm far- to mid-infrared color and may be an obscured QSO. The IIFGS sample is one of the largest and deepest samples of infrared-luminous galaxies available, promising to be a rich sample for studying infrared-luminous galaxies up to z ~ 1 and for understanding the evolution of infrared galaxies and the star formation rate in the universe

First Results from the ISO‐IRAS Faint Galaxy Survey

We present the first results from the ISO-IRAS Faint Galaxy Survey (IIFGS), a program designed to obtain ISO observations of the most distant and luminous galaxies in the IRAS Faint Source Survey by filling short gaps in the ISO observing schedule with pairs of 12 μm ISOCAM and 90 μm ISOPHOT observations. As of 1997 October, over 500 sources have been observed, with an ISOCAM detection rate over 80%, covering over 1.25 deg^2 of sky to an 11.5 μm point-source completeness limit of approximately 1.0 mJy (corresponding to a ~10 σ detection sensitivity). Observations are presented for nine sources detected by ISOPHOT and ISOCAM early in the survey for which we have ground-based G- and I-band images and optical spectroscopy. The ground-based data confirm that the IIFGS strategy efficiently detects moderate-redshift (z = 0.11-0.38 for this small sample) strong emission line galaxies with L_(60 μm) ≳ 10^(11) L_☉; one of our sample has L_(60 μm) > 10^(12) L_☉ (H_0 = 75 km s^(-1) Mpc^(-1), Ω = 1). The infrared-optical spectral energy distributions are comparable to those of nearby luminous infrared galaxies, which span the range from pure starburst (e.g., Arp 220) to infrared QSO (Mrk 231). Two of the systems show signs of strong interaction, and four show active galactic nucleus (AGN)-like excitation; one of the AGNs, F15390+6038, which shows a high excitation Seyfert 2 spectrum, has an unusually warm far- to mid-infrared color and may be an obscured QSO. The IIFGS sample is one of the largest and deepest samples of infrared-luminous galaxies available, promising to be a rich sample for studying infrared-luminous galaxies up to z ~ 1 and for understanding the evolution of infrared galaxies and the star formation rate in the universe

Caltrans Keeps the Spitzer Pipelines Moving

The computer pipelines used to process digital infrared astronomical images from NASA's Spitzer Space Telescope require various input calibration-data files for characterizing the attributes and behaviors of the onboard focal-plane-arrays and their detector pixels, such as operability, dark-current offset, linearity, non- uniformity, muxbleed, droop, and point-response functions. The telescope has three very different science instruments, each with three or four spectral-band-pass channels, depending on the instrument. Moreover, each instrument has various operating modes (e-g., full array or sub-array in one case) and parameters (e.g., integration time). Calibration data that depend on these considerations are needed by pipelines for generating both science products (production pipelines) and higher-level calibration products (calibration pipelines). The calibration files are created in various formats either 'off-line' or by the aforementioned calibration pipelines, depending on the above configuration details. Also, the calibration files are generally applicable to a certain time period and therefore must be selected accordingly for a given raw input image to be correctly processed. All of this complexity in selecting and retrieving calibration files for pipeline processing is handled by a procedural software-program called 'caltrans' . This software, which is implemented in C and interacts with an Informix database, was developed at the Spitzer Science Center (SSC) and is now deployed in SSC daily operations. The software is rule-based, very flexible, and, for efficiency, capable of retrieving multiple calibration files with a single software-execution command