Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions

Recent advances in attention-free sequence models rely on convolutions as alternatives to the attention operator at the core of Transformers. In particular, long convolution sequence models have achieved state-of-the-art performance in many domains, but incur a significant cost during auto-regressive inference workloads -- naively requiring a full pass (or caching of activations) over the input sequence for each generated token -- similarly to attention-based models. In this paper, we seek to enable $\mathcal O(1)$ compute and memory cost per token in any pre-trained long convolution architecture to reduce memory footprint and increase throughput during generation. Concretely, our methods consist in extracting low-dimensional linear state-space models from each convolution layer, building upon rational interpolation and model-order reduction techniques. We further introduce architectural improvements to convolution-based layers such as Hyena: by weight-tying the filters across channels into heads, we achieve higher pre-training quality and reduce the number of filters to be distilled. The resulting model achieves 10x higher throughput than Transformers and 1.5x higher than Hyena at 1.3B parameters, without any loss in quality after distillation

Identification of Radiopure Titanium for the LZ Dark Matter Experiment and Future Rare Event Searches

The LUX-ZEPLIN (LZ) experiment will search for dark matter particle interactions with a detector containing a total of 10 tonnes of liquid xenon within a double-vessel cryostat. The large mass and proximity of the cryostat to the active detector volume demand the use of material with extremely low intrinsic radioactivity. We report on the radioassay campaign conducted to identify suitable metals, the determination of factors limiting radiopure production, and the selection of titanium for construction of the LZ cryostat and other detector components. This titanium has been measured with activities of $^{238}$U$_{e}$~$<$1.6~mBq/kg, $^{238}$U$_{l}$~$<$0.09~mBq/kg, $^{232}$Th$_{e}$~$=0.28\pm 0.03$~mBq/kg, $^{232}$Th$_{l}$~$=0.25\pm 0.02$~mBq/kg, $^{40}$K~$<$0.54~mBq/kg, and $^{60}$Co~$<$0.02~mBq/kg (68\% CL). Such low intrinsic activities, which are some of the lowest ever reported for titanium, enable its use for future dark matter and other rare event searches. Monte Carlo simulations have been performed to assess the expected background contribution from the LZ cryostat with this radioactivity. In 1,000 days of WIMP search exposure of a 5.6-tonne fiducial mass, the cryostat will contribute only a mean background of $0.160\pm0.001$(stat)$\pm0.030$(sys) counts.Comment: 13 pages, 3 figures, accepted for publication in Astroparticle Physic

Background Determination for the LUX-ZEPLIN (LZ) Dark Matter Experiment

The LUX-ZEPLIN experiment recently reported limits on WIMP-nucleus interactions from its initial science run, down to $9.2\times10^{-48}$ cm$^2$ for the spin-independent interaction of a 36 GeV/c$^2$ WIMP at 90% confidence level. In this paper, we present a comprehensive analysis of the backgrounds important for this result and for other upcoming physics analyses, including neutrinoless double-beta decay searches and effective field theory interpretations of LUX-ZEPLIN data. We confirm that the in-situ determinations of bulk and fixed radioactive backgrounds are consistent with expectations from the ex-situ assays. The observed background rate after WIMP search criteria were applied was $(6.3\pm0.5)\times10^{-5}$ events/keV$_{ee}$/kg/day in the low-energy region, approximately 60 times lower than the equivalent rate reported by the LUX experiment.Comment: 25 pages, 15 figure

Projected sensitivities of the LUX-ZEPLIN experiment to new physics via low-energy electron recoils

LUX-ZEPLIN is a dark matter detector expected to obtain world-leading sensitivity to weakly-interacting massive particles interacting via nuclear recoils with a ∼ 7 -tonne xenon target mass. This paper presents sensitivity projections to several low-energy signals of the complementary electron recoil signal type: 1) an effective neutrino magnetic moment, and 2) an effective neutrino millicharge, both for p p -chain solar neutrinos, 3) an axion flux generated by the Sun, 4) axionlike particles forming the Galactic dark matter, 5) hidden photons, 6) mirror dark matter, and 7) leptophilic dark matter. World-leading sensitivities are expected in each case, a result of the large 5.6 t 1000 d exposure and low expected rate of electron-recoil backgrounds in the < 100     keV energy regime. A consistent signal generation, background model and profile-likelihood analysis framework is used throughout

A search for new physics in low-energy electron recoils from the first LZ exposure

The LUX-ZEPLIN (LZ) experiment is a dark matter detector centered on a dual-phase xenon time projection chamber. We report searches for new physics appearing through few-keV-scale electron recoils, using the experiment's first exposure of 60 live days and a fiducial mass of 5.5t. The data are found to be consistent with a background-only hypothesis, and limits are set on models for new physics including solar axion electron coupling, solar neutrino magnetic moment and millicharge, and electron couplings to galactic axion-like particles and hidden photons. Similar limits are set on weakly interacting massive particle (WIMP) dark matter producing signals through ionized atomic states from the Migdal effect.Comment: 13 pages, 10 figures. See https://tinyurl.com/LZDataReleaseRun1ER for a data release related to this pape

Simulations of Events for the LUX-ZEPLIN (LZ) Dark Matter Experiment

The LUX-ZEPLIN dark matter search aims to achieve a sensitivity to the WIMP-nucleon spin-independent cross-section down to (1-2) $\times$ $10^{-12}$ pb at a WIMP mass of 40 GeV/$c^2$. This paper describes the simulations framework that, along with radioactivity measurements, was used to support this projection, and also to provide mock data for validating reconstruction and analysis software. Of particular note are the event generators, which allow us to model the background radiation, and the detector response physics used in the production of raw signals, which can be converted into digitized waveforms similar to data from the operational detector. Inclusion of the detector response allows us to process simulated data using the same analysis routines as developed to process the experimental data