Measurements of one-point statistics in 21 cm intensity maps via foreground avoidance strategy

Measurements of the one-point probability distribution function and higher-order moments (variance, skewness, and kurtosis) of the high-redshift 21 cm fluctuations are among the most direct statistical probes of the non-Gaussian nature of structure formation and evolution during reionization. However, contamination from astrophysical foregrounds and instrument systematics pose significant challenges in measuring these statistics in real observations. In this work, we use forward modelling to investigate the feasibility of measuring 21 cm one-point statistics through a foreground avoidance strategy. Leveraging the well-known characteristic of foreground contamination in which it occupies a wedge-shape region in k-space, we apply a foreground wedge-cut filter that removes the contaminated modes from a mock data set based on the Hydrogen Epoch of Reionization Array (HERA) instrument, and measure the one-point statistics from the image-space representation of the remaining non-contaminated modes. We experiment with wedge-cutting over different frequency bandwidths and varying degrees of removal that correspond to different assumptions on the extent of the foreground sources on the sky and leakage from the Fourier Transform window function. We find that the centre of the band is the least biased from wedge-cutting while the edges of the band are unusable due to being highly down-weighted by the window function. Based on this finding, we introduce a rolling filter method that allows reconstruction of an optimal wedge-cut 21~cm intensity map over the full bandwidth using outputs from wedge-cutting over multiple sub-bands. We perform Monte Carlo simulations to show that HERA should be able to measure the rise in skewness and kurtosis near the end of reionization with the rolling wedge-cut method if foreground leakage from the Fourier transform window function can be controlled.Comment: 12 pages, 8 figures, submitted to MNRA

Comparing Redundant and Sky-model-based Interferometric Calibration: A First Look with Phase II of the MWA

© 2018. The American Astronomical Society. All rights reserved.. Interferometric arrays seeking to measure the 21 cm signal from the epoch of reionization (EOR) must contend with overwhelmingly bright emission from foreground sources. Accurate recovery of the 21 cm signal will require precise calibration of the array, and several new avenues for calibration have been pursued in recent years, including methods using redundancy in the antenna configuration. The newly upgraded Phase II of Murchison Widefield Array (MWA) is the first interferometer that has large numbers of redundant baselines while retaining good instantaneous UV coverage. This array therefore provides a unique opportunity to compare redundant calibration with sky-model-based algorithms. In this paper, we present the first results from comparing both calibration approaches with MWA Phase II observations. For redundant calibration, we use the package OMNICAL and produce sky-based calibration solutions with the analysis package Fast Holographic Deconvolution (FHD). There are three principal results: (1) We report the success of OMNICAL on observations of ORBComm satellites, showing substantial agreement between redundant visibility measurements after calibration. (2) We directly compare OMNICAL calibration solutions with those from FHD and demonstrate that these two different calibration schemes give extremely similar results. (3) We explore improved calibration by combining OMNICAL and FHD. We evaluate these combined methods using power spectrum techniques developed for EOR analysis and find evidence for marginal improvements mitigating artifacts in the power spectrum. These results are likely limited by the signal-to-noise ratio in the 6 hr of data used, but they suggest future directions for combining these two calibration schemes

A Roadmap for Astrophysics and Cosmology with High-Redshift 21 cm Intensity Mapping

In this white paper, we lay out a US roadmap for high-redshift 21 cm cosmology (30 < z < 6) in the 2020s. Beginning with the currently-funded HERA and MWA Phase II projects and advancing through the decade with a coordinated program of small-scale instrumentation, software, and analysis projects targeting technology development, this roadmap incorporates our current best understanding of the systematics confronting 21 cm cosmology into a plan for overcoming them, enabling next-generation, mid-scale 21 cm arrays to be proposed late in the decade. Submitted for consideration by the Astro2020 Decadal Survey Program Panel for Radio, Millimeter, and Submillimeter Observations from the Ground as a Medium-Sized Project.Comment: 10 pages (plus a cover page and references), 6 figures. Submitted as a APC White Paper for Astro202

Measuring HERA's Primary Beam in Situ: Methodology and First Results

The central challenge in 21 cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes, such as the Hydrogen Epoch of Reionization Array (HERA), that do not move, primary beam characterization is particularly challenging because standard beam-calibration routines do not apply (Cornwell et al.) and current techniques require accurate source catalogs at the telescope resolution. We present an extension of the method from Pober et al. where they use beam symmetries to create a network of overlapping source tracks that break the degeneracy between source flux density and beam response and allow their simultaneous estimation. We fit the beam response of our instrument using early HERA observations and find that our results agree well with electromagnetic simulations down to a -20 dB level in power relative to peak gain for sources with high signal-to-noise ratio. In addition, we construct a source catalog with 90 sources down to a flux density of 1.4 Jy at 151 MHz.The central challenge in 21 cm cosmology is isolating the cosmological signal from bright foregrounds. Many separation techniques rely on the accurate knowledge of the sky and the instrumental response, including the antenna primary beam. For drift-scan telescopes, such as the Hydrogen Epoch of Reionization Array (HERA), that do not move, primary beam characterization is particularly challenging because standard beam-calibration routines do not apply (Cornwell et al.) and current techniques require accurate source catalogs at the telescope resolution. We present an extension of the method from Pober et al. where they use beam symmetries to create a network of overlapping source tracks that break the degeneracy between source flux density and beam response and allow their simultaneous estimation. We fit the beam response of our instrument using early HERA observations and find that our results agree well with electromagnetic simulations down to a -20 dB level in power relative to peak gain for sources with high signal-to-noise ratio. In addition, we construct a source catalog with 90 sources down to a flux density of 1.4 Jy at 151 MHz

Optimizing sparse RFI prediction using deep learning

Radio frequency interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array (HERA) grow larger in number of receivers. To address this, we present a deep fully convolutional neural network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known \u2018ground truth\u2019 data set for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6 7 105 HERA time-ordered 1024 channelled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time\u2013frequency context which increases discrimination between RFI and non-RFI. The inclusion of phase when predicting achieves a recall of 0.81, precision of 0.58, and F2 score of 0.75 as applied to our HERA-67 observations

Methods of Error Estimation for Delay Power Spectra in 21 cm Cosmology

Precise measurements of the 21 cm power spectrum are crucial for understanding the physical processes of hydrogen reionization. Currently, this probe is being pursued by low-frequency radio interferometer arrays. As these experiments come closer to making a first detection of the signal, error estimation will play an increasingly important role in setting robust measurements. Using the delay power spectrum approach, we have produced a critical examination of different ways that one can estimate error bars on the power spectrum. We do this through a synthesis of analytic work, simulations of toy models, and tests on small amounts of real data. We find that, although computed independently, the different error bar methodologies are in good agreement with each other in the noise-dominated regime of the power spectrum. For our preferred methodology, the predicted probability distribution function is consistent with the empirical noise power distributions from both simulated and real data. This diagnosis is mainly in support of the forthcoming HERA upper limit and also is expected to be more generally applicable

Parametrizing Epoch of Reionization foregrounds: A deep survey of low-frequency point-source spectra with the Murchison Widefield Array

© 2016 The Authors. Experiments that pursue detection of signals from the Epoch of Reionization (EoR) are relying on spectral smoothness of source spectra at low frequencies. This article empirically explores the effect of foreground spectra on EoR experiments by measuring high-resolution full-polarization spectra for the 586 brightest unresolved sources in one of the Murchison Widefield Array (MWA) EoR fields using 45 h of observation. A novel peeling scheme is used to subtract 2500 sources from the visibilities with ionospheric and beam corrections, resulting in the deepest, confusion-limited MWA image so far. The resulting spectra are found to be affected by instrumental effects, which limit the constraints that can be set on source-intrinsic spectral structure. The sensitivity and power-spectrum of the spectra are analysed, and it is found that the spectra of residuals are dominated by point spread function sidelobes from nearby undeconvolved sources. We release a catalogue describing the spectral parameters for each measured source

A Real Time Processing system for big data in astronomy: Applications to HERA

As current- and next-generation astronomical instruments come online, they will generate an unprecedented deluge of data. Analyzing these data in real time presents unique conceptual and computational challenges, and their long-term storage and archiving is scientifically essential for generating reliable, reproducible results. We present here the real-time processing (RTP) system for the Hydrogen Epoch of Reionization Array (HERA), a radio interferometer endeavoring to provide the first detection of the highly redshifted 21 cm signal from Cosmic Dawn and the Epoch of Reionization by an interferometer. The RTP system consists of analysis routines run on raw data shortly after they are acquired, such as calibration and detection of radio-frequency interference (RFI) events. RTP works closely with the Librarian, the HERA data storage and transfer manager which automatically ingests data and transfers copies to other clusters for post-processing analysis. Both the RTP system and the Librarian are public and open source software, which allows for them to be modified for use in other scientific collaborations. When fully constructed, HERA is projected to generate over 50 terabytes (TB) of data each night, and the RTP system enables the successful scientific analysis of these data