Validation of semi-analytical, semi-empirical covariance matrices for two-point correlation function for early DESI data

We present an extended validation of semi-analytical, semi-empirical covariance matrices for the two-point correlation function (2PCF) on simulated catalogs representative of luminous red galaxies (LRGs) data collected during the initial 2 months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). We run the pipeline on multiple effective Zel'dovich (EZ) mock galaxy catalogs with the corresponding cuts applied and compare the results with the mock sample covariance to assess the accuracy and its fluctuations. We propose an extension of the previously developed formalism for catalogs processed with standard reconstruction algorithms. We consider methods for comparing covariance matrices in detail, highlighting their interpretation and statistical properties caused by sample variance, in particular, non-trivial expectation values of certain metrics even when the external covariance estimate is perfect. With improved mocks and validation techniques, we confirm a good agreement between our predictions and sample covariance. This allows one to generate covariance matrices for comparable data sets without the need to create numerous mock galaxy catalogs with matching clustering, only requiring 2PCF measurements from the data itself. The code used in this paper is publicly available at https://github.com/oliverphilcox/RascalC

Validating the Galaxy and Quasar Catalog-Level Blinding Scheme for the DESI 2024 analysis

In the era of precision cosmology, ensuring the integrity of data analysis through blinding techniques is paramount -- a challenge particularly relevant for the Dark Energy Spectroscopic Instrument (DESI). DESI represents a monumental effort to map the cosmic web, with the goal to measure the redshifts of tens of millions of galaxies and quasars. Given the data volume and the impact of the findings, the potential for confirmation bias poses a significant challenge. To address this, we implement and validate a comprehensive blind analysis strategy for DESI Data Release 1 (DR1), tailored to the specific observables DESI is most sensitive to: Baryonic Acoustic Oscillations (BAO), Redshift-Space Distortion (RSD) and primordial non-Gaussianities (PNG). We carry out the blinding at the catalog level, implementing shifts in the redshifts of the observed galaxies to blind for BAO and RSD signals and weights to blind for PNG through a scale-dependent bias. We validate the blinding technique on mocks, as well as on data by applying a second blinding layer to perform a battery of sanity checks. We find that the blinding strategy alters the data vector in a controlled way such that the BAO and RSD analysis choices do not need any modification before and after unblinding. The successful validation of the blinding strategy paves the way for the unblinded DESI DR1 analysis, alongside future blind analyses with DESI and other surveys.Comment: Supporting publication of "DESI 2024 II: Sample definitions, characteristics, and two-point clustering statistics", "DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars", and "DESI 2024 V: Analysis of the full shape of two-point clustering statistics from galaxies and quasars". (v2 - update DESI references

ELG spectroscopic systematics analysis of the DESI Data Release 1

Dark Energy Spectroscopic Instrument (DESI) uses more than 2.4 million Emission Line Galaxies (ELGs) for 3D large-scale structure (LSS) analyses in its Data Release 1 (DR1). Such large statistics enable thorough research on systematic uncertainties. In this study, we focus on spectroscopic systematics of ELGs. The redshift success rate (f goodz) is the relative fraction of secure redshifts among all measurements. It depends on observing conditions, thus introduces non-cosmological variations to the LSS. We, therefore, develop the redshift failure weight (w zfail) and a per-fibre correction (η zfail) to mitigate these dependences. They have minor influences on the galaxy clustering. For ELGs with a secure redshift, there are two subtypes of systematics: 1) catastrophics (large) that only occur in a few samples; 2) redshift uncertainty (small) that exists for all samples. The catastrophics represent 0.26% of the total DR1 ELGs, composed of the confusion between [O ii] and sky residuals, double objects, total catastrophics and others. We simulate the realistic 0.26% catastrophics of DR1 ELGs, the hypothetical 1% catastrophics, and the truncation of the contaminated 1.31 < z < 1.33 in the AbacusSummit ELG mocks. Their Pℓ show non-negligible bias from the uncontaminated mocks. But their influences on the redshift space distortions (RSD) parameters are smaller than 0.2σ. The redshift uncertainty of DR1 ELGs is 8.5km s-1 with a Lorentzian profile. The code for implementing the catastrophics and redshift uncertainty on mocks can be found in https://github.com/Jiaxi-Yu/modelling_spectro_sys

Fiducial-Cosmology-dependent systematics for the DESI 2024 BAO Analysis

When measuring the Baryon Acoustic Oscillations (BAO) scale from galaxy surveys, one typically assumes a fiducial cosmology when converting redshift measurements into comoving distances and also when defining input parameters for the reconstruction algorithm. A parameterised template for the model to be fitted is also created based on a (possibly different) fiducial cosmology. This model reliance can be considered a form of data compression, and the data is then analysed allowing that the true answer is different from the fiducial cosmology assumed. In this study, we evaluate the impact of the fiducial cosmology assumed in the BAO analysis of the Dark Energy Spectroscopic Instrument (DESI) survey Data Release 1 (DR1) on the final measurements in DESI 2024 III. We utilise a suite of mock galaxy catalogues with survey realism that mirrors the DESI DR1 tracers: the bright galaxy sample (BGS), the luminous red galaxies (LRG), the emission line galaxies (ELG) and the quasars (QSO), spanning a redshift range from 0.1 to 2.1. We compare the four secondary AbacusSummit cosmologies against DESI's fiducial cosmology (Planck 2018). The secondary cosmologies explored include a lower cold dark matter density, a thawing dark energy universe, a higher number of effective species, and a lower amplitude of matter clustering. The mocks are processed through the BAO pipeline by consistently iterating the grid, template, and reconstruction reference cosmologies. We determine a conservative systematic contribution to the error of $0.1\%$ for both the isotropic and anisotropic dilation parameters $\alpha_{\rm iso}$ and $\alpha_{\rm AP}$. We then directly test the impact of the fiducial cosmology on DESI DR1 data.Comment: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasar

Optimal Reconstruction of Baryon Acoustic Oscillations for DESI 2024

Baryon acoustic oscillations (BAO) provide a robust standard ruler to measure the expansion history of the Universe through galaxy clustering. Density-field reconstruction is now a widely adopted procedure for increasing the precision and accuracy of the BAO detection. With the goal of finding the optimal reconstruction settings to be used in the DESI 2024 galaxy BAO analysis, we assess the sensitivity of the post-reconstruction BAO constraints to different choices in our analysis configuration, performing tests on blinded data from the first year of DESI observations (DR1), as well as on mocks that mimic the expected clustering and selection properties of the DESI DR1 target samples. Overall, we find that BAO constraints remain robust against multiple aspects in the reconstruction process, including the choice of smoothing scale, treatment of redshift-space distortions, fiber assignment incompleteness, and parameterizations of the BAO model. We also present a series of tests that DESI followed in order to assess the maturity of the end-to-end galaxy BAO pipeline before the unblinding of the large-scale structure catalogs.Comment: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasar

Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data

We present an optimized way of producing the fast semi-analytical covariance matrices for the Legendre moments of the two-point correlation function, taking into account survey geometry and mimicking the non-Gaussian effects. We validate the approach on simulated (mock) catalogs for different galaxy types, representative of the Dark Energy Spectroscopic Instrument (DESI) Data Release 1, used in 2024 analyses. We find only a few percent differences between the mock sample covariance matrix and our results, which can be expected given the approximate nature of the mocks, although we do identify discrepancies between the shot-noise properties of the DESI fiber assignment algorithm and the faster approximation used in the mocks. Importantly, we find a close agreement (<~ 5% relative differences) in the projected errorbars for distance scale parameters for the baryon acoustic oscillation measurements. This confirms our method as an attractive alternative to simulation-based covariance matrices, especially for non-standard models or galaxy sample selections, in particular, relevant to the broad current and future analyses of DESI data.Comment: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars (arXiv:2404.03000). 29 pages, 4 figures. Prepared for submission to JCAP. Code available at https://github.com/oliverphilcox/RascalC and https://github.com/misharash/RascalC-scripts/tree/DESI2024. Data points from the plots available at https://zenodo.org/doi/10.5281/zenodo.1089516

HOD-Dependent Systematics for Luminous Red Galaxies in the DESI 2024 BAO Analysis

In this paper, we present the estimation of systematics related to the halo occupation distribution (HOD) modeling in the baryon acoustic oscillations (BAO) distance measurement of the Dark Energy Spectroscopic Instrument (DESI) 2024 analysis. This paper focuses on the study of HOD systematics for luminous red galaxies (LRG). We consider three different HOD models for LRGs, including the base 5-parameter vanilla model and two extensions to it, that we refer to as baseline and extended models. The baseline model is described by the 5 vanilla HOD parameters, an incompleteness factor and a velocity bias parameter, whereas the extended one also includes a galaxy assembly bias and a satellite profile parameter. We utilize the 25 dark matter simulations available in the AbacusSummit simulation suite at $z=$ 0.8 and generate mock catalogs for our different HOD models. To test the impact of the HOD modeling in the position of the BAO peak, we run BAO fits for all these sets of simulations and compare the best-fit BAO-scaling parameters $\alpha_{\rm iso}$ and $\alpha_{\rm AP}$ between every pair of HOD models. We do this for both Fourier and configuration spaces independently, using post-reconstruction measurements. We find a 3.3$\sigma$ detection of HOD systematic for $\alpha_{\rm AP}$ in configuration space with an amplitude of 0.19%. For the other cases, we did not find a 3$\sigma$ detection, and we decided to compute a conservative estimation of the systematic using the ensemble of shifts between all pairs of HOD models. By doing this, we quote a systematic with an amplitude of 0.07% in $\alpha_{\rm iso}$ for both Fourier and configuration spaces; and of 0.09% in $\alpha_{\rm AP}$ for Fourier space.Comment: 36 pages, 9 figures. Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasar

HOD-Dependent Systematics in Emission Line Galaxies for the DESI 2024 BAO analysis

The Dark Energy Spectroscopic Instrument (DESI) will provide precise measurements of Baryon Acoustic Oscillations (BAO) to constrain the expansion history of the Universe and set stringent constraints on dark energy. Therefore, precise control of the global error budget due to various systematic effects is required for the DESI 2024 BAO analysis. In this work, we focus on the robustness of the BAO analysis against the Halo Occupation Distribution (HOD) modeling for the Emission Line Galaxy (ELG) tracer. Based on a common dark matter simulation, our analysis relies on HOD mocks tuned to early DESI data, namely the One-Percent survey data. To build the mocks, we use several HOD models for the ELG tracer as well as extensions to the baseline HOD models. Among these extensions, we consider distinct recipes for galactic conformity and assembly bias. We perform two independent analyses in the Fourier space and in the configuration space. We recover the BAO signal from two-point measurements after performing reconstruction on our mocks. Additionally, we also apply the control variates technique to reduce sample variance noise. Our BAO analysis can recover the isotropic BAO parameter $\alpha_\text{iso}$ within 0.1\% and the Alcock Paczynski parameter $\alpha_\text{AP}$ within 0.3\%. Overall, we find that our systematic error due to the HOD dependence is below 0.17\%, with the Fourier space analysis being more robust against the HOD systematics. We conclude that our analysis pipeline is robust enough against the HOD systematics for the ELG tracer in the DESI 2024 BAO analysis.Comment: Supporting publication of DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasar

Validation of the Scientific Program for the Dark Energy Spectroscopic Instrument

The Dark Energy Spectroscopic Instrument (DESI) was designed to conduct a survey covering 14,000 deg$^2$ over five years to constrain the cosmic expansion history through precise measurements of Baryon Acoustic Oscillations (BAO). The scientific program for DESI was evaluated during a five month Survey Validation (SV) campaign before beginning full operations. This program produced deep spectra of tens of thousands of objects from each of the stellar (MWS), bright galaxy (BGS), luminous red galaxy (LRG), emission line galaxy (ELG), and quasar target classes. These SV spectra were used to optimize redshift distributions, characterize exposure times, determine calibration procedures, and assess observational overheads for the five-year program. In this paper, we present the final target selection algorithms, redshift distributions, and projected cosmology constraints resulting from those studies. We also present a `One-Percent survey' conducted at the conclusion of Survey Validation covering 140 deg$^2$ using the final target selection algorithms with exposures of a depth typical of the main survey. The Survey Validation indicates that DESI will be able to complete the full 14,000 deg$^2$ program with spectroscopically-confirmed targets from the MWS, BGS, LRG, ELG, and quasar programs with total sample sizes of 7.2, 13.8, 7.46, 15.7, and 2.87 million, respectively. These samples will allow exploration of the Milky Way halo, clustering on all scales, and BAO measurements with a statistical precision of 0.28% over the redshift interval $z<1.1$, 0.39% over the redshift interval $1.1<z<1.9$, and 0.46% over the redshift interval $1.9<z<3.5$.Comment: 42 pages, 18 figures, accepted by A