A framework to measure the properties of intergalactic metal systems with two-point flux statistics

The abundance, temperature, and clustering of metals in the intergalactic medium are important parameters for understanding their cosmic evolution and quantifying their impact on cosmological analysis with the Ly $\alpha$ forest. The properties of these systems are typically measured from individual quasar spectra redward of the quasar's Ly $\alpha$ emission line, yet that approach may provide biased results due to selection effects. We present an alternative approach to measure these properties in an unbiased manner with the two-point statistics commonly employed to quantify large-scale structure. Our model treats the observed flux of a large sample of quasar spectra as a continuous field and describes the one-dimensional, two-point statistics of this field with three parameters per ion: the abundance (column density distribution), temperature (Doppler parameter) and clustering (cloud-cloud correlation function). We demonstrate this approach on multiple ions (e.g., C IV, Si IV, Mg II) with early data from the Dark Energy Spectroscopic Instrument (DESI) and high-resolution spectra from the literature. Our initial results show some evidence that the C IV abundance is higher than previous measurements and evidence for abundance evolution over time. The first full year of DESI observations will have over an order of magnitude more quasar spectra than this study. In a future paper we will use those data to measure the growth of clustering and its impact on the Ly $\alpha$ forest, as well as test other DESI analysis infrastructure such as the pipeline noise estimates and the resolution matrix.Comment: 15 pages, 14 figure

Mock data sets for the Eboss and DESI Lyman-α\alpha forest surveys

{We present a publicly-available code to generate mock Lyman-$\alpha$ (\lya) forest data sets. The code is based on the Fluctuating Gunn-Peterson Approximation (FGPA) applied to Gaussian random fields and on the use of fast Fourier transforms (FFT). The output includes spectra of lya transmitted flux fraction, $F$, a quasar catalog, and a catalog of high-column-density systems. While these three elements have realistic correlations, additional code is then used to generate realistic quasar spectra, to add absorption by high-column-density systems and metals, and to simulate instrumental effects. Redshift space distortions (RSD) are implemented by including the large-scale velocity-gradient field in the FGPA resulting in a correlation function of $F$ that can be accurately predicted. One hundred realizations have been produced over the 14,000 deg$^2$ Dark Energy Spectroscopy Instrument (DESI) survey footprint with 100 quasars per deg$^{2}$, and they are being used for the Extended Baryon Oscillation Survey (eBOSS) and DESI surveys. The analysis of these realizations shows that the correlation of $F$ follows the prediction within the accuracy of eBOSS survey. The most time-consuming part of the production occurs before application of the FGPA, and the existing pre-FGPA forests can be used to easily produce new mock sets with modified redshift-dependent bias parameters or observational conditions.Comment: to be submitted ot JCA

Performance of the Quasar Spectral Templates for the Dark Energy Spectroscopic Instrument

Millions of quasar spectra will be collected by the Dark Energy Spectroscopic Instrument (DESI), leading to a fourfold increase in the number of known quasars. High-accuracy quasar classification is essential to tighten constraints on cosmological parameters measured at the highest redshifts DESI observes (z > 2.0). We present spectral templates for identification and redshift estimation of quasars in the DESI Year 1 data release. The quasar templates are comprised of two quasar eigenspectra sets, trained on spectra from the Sloan Digital Sky Survey. The sets are specialized to reconstruct quasar spectral variation observed over separate yet overlapping redshift ranges and, together, are capable of identifying DESI quasars from 0.05 < z < 7.0. The new quasar templates show significant improvement over the previous DESI quasar templates regarding catastrophic failure rates, redshift precision and accuracy, quasar completeness, and the contamination fraction in the final quasar sample

Target Selection and Validation of DESI Quasars

The Dark Energy Spectroscopic Instrument (DESI) survey will measure large-scale structures using quasars as direct tracers of dark matter in the redshift range 0.9 2.1. We present several methods to select candidate quasars for DESI, using input photometric imaging in three optical bands (g, r, z) from the DESI Legacy Imaging Surveys and two infrared bands (W1, W2) from the Wide-field Infrared Survey Explorer. These methods were extensively tested during the Survey Validation of DESI. In this paper, we report on the results obtained with the different methods and present the selection we optimized for the DESI main survey. The final quasar target selection is based on a random forest algorithm and selects quasars in the magnitude range of 16.5 2.1), exceeding the project requirements by 20%. The redshift distribution of the selected quasars is in excellent agreement with quasar luminosity function predictions

The Dark Energy Spectroscopic Instrument: one-dimensional power spectrum from first Ly α forest samples with Fast Fourier Transform

We present the one-dimensional Ly α forest power spectrum measurement using the first data provided by the Dark Energy Spectroscopic Instrument (DESI). The data sample comprises 26 330 quasar spectra, at redshift z > 2.1, contained in the DESI Early Data Release and the first 2 months of the main survey. We employ a Fast Fourier Transform (FFT) estimator and compare the resulting power spectrum to an alternative likelihood-based method in a companion paper. We investigate methodological and instrumental contaminants associated with the new DESI instrument, applying techniques similar to previous Sloan Digital Sky Survey (SDSS) measurements. We use synthetic data based on lognormal approximation to validate and correct our measurement. We compare our resulting power spectrum with previous SDSS and high-resolution measurements. With relatively small number statistics, we successfully perform the FFT measurement, which is already competitive in terms of the scale range. At the end of the DESI survey, we expect a five times larger Ly α forest sample than SDSS, providing an unprecedented precise one-dimensional power spectrum measurement

The Spectroscopic Data Processing Pipeline for the Dark Energy Spectroscopic Instrument

We describe the spectroscopic data processing pipeline of the Dark Energy Spectroscopic Instrument (DESI), which is conducting a redshift survey of about 40 million galaxies and quasars using a purpose-built instrument on the 4-m Mayall Telescope at Kitt Peak National Observatory. The main goal of DESI is to measure with unprecedented precision the expansion history of the Universe with the Baryon Acoustic Oscillation technique and the growth rate of structure with Redshift Space Distortions. Ten spectrographs with three cameras each disperse the light from 5000 fibers onto 30 CCDs, covering the near UV to near infrared (3600 to 9800 Angstrom) with a spectral resolution ranging from 2000 to 5000. The DESI data pipeline generates wavelength- and flux-calibrated spectra of all the targets, along with spectroscopic classifications and redshift measurements. Fully processed data from each night are typically available to the DESI collaboration the following morning. We give details about the pipeline's algorithms, and provide performance results on the stability of the optics, the quality of the sky background subtraction, and the precision and accuracy of the instrumental calibration. This pipeline has been used to process the DESI Survey Validation data set, and has exceeded the project's requirements for redshift performance, with high efficiency and a purity greater than 99 percent for all target classes.Comment: AJ, revised version, 55 pages, 55 figures, 4 table

3D Correlations in the Lyman-α\alpha Forest from Early DESI Data

We present the first measurements of Lyman-$\alpha$ (Ly$\alpha$) forest correlations using early data from the Dark Energy Spectroscopic Instrument (DESI). We measure the auto-correlation of Ly$\alpha$ absorption using 88,509 quasars at $z>2$, and its cross-correlation with quasars using a further 147,899 tracer quasars at $z\gtrsim1.77$. Then, we fit these correlations using a 13-parameter model based on linear perturbation theory and find that it provides a good description of the data across a broad range of scales. We detect the BAO peak with a signal-to-noise ratio of $3.8\sigma$, and show that our measurements of the auto- and cross-correlations are fully-consistent with previous measurements by the Extended Baryon Oscillation Spectroscopic Survey (eBOSS). Even though we only use here a small fraction of the final DESI dataset, our uncertainties are only a factor of 1.7 larger than those from the final eBOSS measurement. We validate the existing analysis methods of Ly$\alpha$ correlations in preparation for making a robust measurement of the BAO scale with the first year of DESI data

The Lyman-α\alpha forest catalog from the Dark Energy Spectroscopic Instrument Early Data Release

We present and validate the catalog of Lyman-$\alpha$ forest fluctuations for 3D analyses using the Early Data Release (EDR) from the Dark Energy Spectroscopic Instrument (DESI) survey. We used 96,317 quasars collected from DESI Survey Validation (SV) data and the first two months of the main survey (M2). We present several improvements to the method used to extract the Lyman-$\alpha$ absorption fluctuations performed in previous analyses from the Sloan Digital Sky Survey (SDSS). In particular, we modify the weighting scheme and show that it can improve the precision of the correlation function measurement by more than 20%. This catalog can be downloaded from https://data.desi.lbl.gov/public/edr/vac/edr/lya/fuji/v0.3 and it will be used in the near future for the first DESI measurements of the 3D correlations in the Lyman-$\alpha$ forest

Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological implications from two decades of spectroscopic surveys at the Apache Point Observatory

We present the cosmological implications from final measurements of clustering using galaxies, quasars, and Ly α forests from the completed Sloan Digital Sky Survey (SDSS) lineage of experiments in large-scale structure. These experiments, composed of data from SDSS, SDSS-II, BOSS, and eBOSS, offer independent measurements of baryon acoustic oscillation (BAO) measurements of angular-diameter distances and Hubble distances relative to the sound horizon, r_{d}, from eight different samples and six measurements of the growth rate parameter, fσ_{8}, from redshift-space distortions (RSD). This composite sample is the most constraining of its kind and allows us to perform a comprehensive assessment of the cosmological model after two decades of dedicated spectroscopic observation. We show that the BAO data alone are able to rule out dark-energy-free models at more than eight standard deviations in an extension to the flat, Λ CDM model that allows for curvature. When combined with Planck Cosmic Microwave Background (CMB) measurements of temperature and polarization, under the same model, the BAO data provide nearly an order of magnitude improvement on curvature constraints relative to primary CMB constraints alone. Independent of distance measurements, the SDSS RSD data complement weak lensing measurements from the Dark Energy Survey (DES) in demonstrating a preference for a flat Λ CDM cosmological model when combined with Planck measurements. The combined BAO and RSD measurements indicate σ_{8} = 0.85 ± 0.03, implying a growth rate that is consistent with predictions from Planck temperature and polarization data and with General Relativity. When combining the results of SDSS BAO and RSD, Planck, Pantheon Type Ia supernovae (SNe Ia), and DES weak lensing and clustering measurements, all multiple-parameter extensions remain consistent with a Λ CDM model. Regardless of cosmological model, the precision on each of the three parameters, Ω_{Λ}, H_{0}, and σ_{8}, remains at roughly 1%, showing changes of less than 0.6% in the central values between models. In a model that allows for free curvature and a time-evolving equation of state for dark energy, the combined samples produce a constraint Ω_{k} = −0.0022 ± 0.0022. The dark energy constraints lead to w_{0} = −0.909 ± 0.081 and w_{a} = −0.49^{+0.35}_{-0.30}, corresponding to an equation of state of w_{p} = 1.018 ± 0.032 at a pivot redshift z_{p} = 0.29 and a Dark Energy Task Force Figure of Merit of 94. The inverse distance ladder measurement under this model yields H_{0} = 68.18 ± 0.79 km s^{-1} Mpc^{-1}, remaining in tension with several direct determination methods; the BAO data allow Hubble constant estimates that are robust against the assumption of the cosmological model. In addition, the BAO data allow estimates of H_{0} that are independent of the CMB data, with similar central values and precision under a Λ CDM model. Our most constraining combination of data gives the upper limit on the sum of neutrino masses at ∑m_{v} < 0.115 eV (95% confidence). Finally, we consider the improvements in cosmology constraints over the last decade by comparing our results to a sample representative of the period 2000–2010. We compute the relative gain across the five dimensions spanned by w, Ω_{k}, ∑m_{v}, H_{0}, H_{0}, and σ_{8} and find that the SDSS BAO and RSD data reduce the total posterior volume by a factor of 40 relative to the previous generation. Adding again the Planck, DES, and Pantheon SN Ia samples leads to an overall contraction in the five-dimensional posterior volume of 3 orders of magnitude

Overview of the instrumentation for the Dark Energy Spectroscopic Instrument

The Dark Energy Spectroscopic Instrument (DESI) embarked on an ambitious 5 yr survey in 2021 May to explore the nature of dark energy with spectroscopic measurements of 40 million galaxies and quasars. DESI will determine precise redshifts and employ the baryon acoustic oscillation method to measure distances from the nearby universe to beyond redshift z > 3.5, and employ redshift space distortions to measure the growth of structure and probe potential modifications to general relativity. We describe the significant instrumentation we developed to conduct the DESI survey. This includes: a wide-field, 3.°2 diameter prime-focus corrector; a focal plane system with 5020 fiber positioners on the 0.812 m diameter, aspheric focal surface; 10 continuous, high-efficiency fiber cable bundles that connect the focal plane to the spectrographs; and 10 identical spectrographs. Each spectrograph employs a pair of dichroics to split the light into three channels that together record the light from 360–980 nm with a spectral resolution that ranges from 2000–5000. We describe the science requirements, their connection to the technical requirements, the management of the project, and interfaces between subsystems. DESI was installed at the 4 m Mayall Telescope at Kitt Peak National Observatory and has achieved all of its performance goals. Some performance highlights include an rms positioner accuracy of better than 0.″1 and a median signal-to-noise ratio of 7 of the [O ii] doublet at 8 × 10−17 erg s−1 cm−2 in 1000 s for galaxies at z = 1.4–1.6. We conclude with additional highlights from the on-sky validation and commissioning, key successes, and lessons learned