41 research outputs found
Designing a Multi-Petabyte Database for LSST
The 3.2 giga-pixel LSST camera will produce approximately half a petabyte of archive images every month. These data need to be reduced in under a minute to produce real-time transient alerts, and then added to the cumulative catalog for further analysis. The catalog is expected to grow about three hundred terabytes per year. The data volume, the real-time transient alerting requirements of the LSST, and its spatio-temporal aspects require innovative techniques to build an efficient data access system at reasonable cost. As currently envisioned, the system will rely on a database for catalogs and metadata. Several database systems are being evaluated to understand how they perform at these data rates, data volumes, and access patterns. This paper describes the LSST requirements, the challenges they impose, the data access philosophy, results to date from evaluating available database technologies against LSST requirements, and the proposed database architecture to meet the data challenges
IVOA Recommendation: IVOA Astronomical Data Query Language Version 2.00
This document describes the Astronomical Data Query Language (ADQL). ADQL has
been developed based on SQL92. This document describes the subset of the SQL
grammar supported by ADQL. Special restrictions and extensions to SQL92 have
been defined in order to support generic and astronomy specific operations
The Fifth Data Release of the Sloan Digital Sky Survey
This paper describes the Fifth Data Release (DR5) of the Sloan Digital Sky
Survey (SDSS). DR5 includes all survey quality data taken through June 2005 and
represents the completion of the SDSS-I project (whose successor, SDSS-II will
continue through mid-2008). It includes five-band photometric data for 217
million objects selected over 8000 square degrees, and 1,048,960 spectra of
galaxies, quasars, and stars selected from 5713 square degrees of that imaging
data. These numbers represent a roughly 20% increment over those of the Fourth
Data Release; all the data from previous data releases are included in the
present release. In addition to "standard" SDSS observations, DR5 includes
repeat scans of the southern equatorial stripe, imaging scans across M31 and
the core of the Perseus cluster of galaxies, and the first spectroscopic data
from SEGUE, a survey to explore the kinematics and chemical evolution of the
Galaxy. The catalog database incorporates several new features, including
photometric redshifts of galaxies, tables of matched objects in overlap regions
of the imaging survey, and tools that allow precise computations of survey
geometry for statistical investigations.Comment: ApJ Supp, in press, October 2007. This paper describes DR5. The SDSS
Sixth Data Release (DR6) is now public, available from http://www.sdss.or
The Seventh Data Release of the Sloan Digital Sky Survey
This paper describes the Seventh Data Release of the Sloan Digital Sky Survey
(SDSS), marking the completion of the original goals of the SDSS and the end of
the phase known as SDSS-II. It includes 11663 deg^2 of imaging data, with most
of the roughly 2000 deg^2 increment over the previous data release lying in
regions of low Galactic latitude. The catalog contains five-band photometry for
357 million distinct objects. The survey also includes repeat photometry over
250 deg^2 along the Celestial Equator in the Southern Galactic Cap. A
coaddition of these data goes roughly two magnitudes fainter than the main
survey. The spectroscopy is now complete over a contiguous area of 7500 deg^2
in the Northern Galactic Cap, closing the gap that was present in previous data
releases. There are over 1.6 million spectra in total, including 930,000
galaxies, 120,000 quasars, and 460,000 stars. The data release includes
improved stellar photometry at low Galactic latitude. The astrometry has all
been recalibrated with the second version of the USNO CCD Astrograph Catalog
(UCAC-2), reducing the rms statistical errors at the bright end to 45
milli-arcseconds per coordinate. A systematic error in bright galaxy photometr
is less severe than previously reported for the majority of galaxies. Finally,
we describe a series of improvements to the spectroscopic reductions, including
better flat-fielding and improved wavelength calibration at the blue end,
better processing of objects with extremely strong narrow emission lines, and
an improved determination of stellar metallicities. (Abridged)Comment: 20 pages, 10 embedded figures. Accepted to ApJS after minor
correction
The Second Data Release of the Sloan Digital Sky Survey
The Sloan Digital Sky Survey (SDSS) has validated and made publicly available its Second Data Release. This data release consists of 3324 deg2 of five-band (ugriz) imaging data with photometry for over 88 million unique objects, 367,360 spectra of galaxies, quasars, stars, and calibrating blank sky patches selected over 2627 deg2 of this area, and tables of measured parameters from these data. The imaging data reach a depth of r ≈ 22.2 (95% completeness limit for point sources) and are photometrically and astrometrically calibrated to 2% rms and 100 mas rms per coordinate, respectively. The imaging data have all been processed through a new version of the SDSS imaging pipeline, in which the most important improvement since the last data release is fixing an error in the model fits to each object. The result is that model magnitudes are now a good proxy for point-spread function magnitudes for point sources, and Petrosian magnitudes for extended sources. The spectroscopy extends from 3800 to 9200 Å at a resolution of 2000. The spectroscopic software now repairs a systematic error in the radial velocities of certain types of stars and has substantially improved spectrophotometry. All data included in the SDSS Early Data Release and First Data Release are reprocessed with the improved pipelines and included in the Second Data Release. Further characteristics of the data are described, as are the data products themselves and the tools for accessing them
The Third Data Release of the Sloan Digital Sky Survey
This paper describes the Third Data Release of the Sloan Digital Sky Survey
(SDSS). This release, containing data taken up through June 2003, includes
imaging data in five bands over 5282 deg^2, photometric and astrometric
catalogs of the 141 million objects detected in these imaging data, and spectra
of 528,640 objects selected over 4188 deg^2. The pipelines analyzing both
images and spectroscopy are unchanged from those used in our Second Data
Release.Comment: 14 pages, including 2 postscript figures. Submitted to AJ. Data
available at http://www.sdss.org/dr