TabRet: Pre-training Transformer-based Tabular Models for Unseen Columns

We present \emph{TabRet}, a pre-trainable Transformer-based model for tabular data. TabRet is designed to work on a downstream task that contains columns not seen in pre-training. Unlike other methods, TabRet has an extra learning step before fine-tuning called \emph{retokenizing}, which calibrates feature embeddings based on the masked autoencoding loss. In experiments, we pre-trained TabRet with a large collection of public health surveys and fine-tuned it on classification tasks in healthcare, and TabRet achieved the best AUC performance on four datasets. In addition, an ablation study shows retokenizing and random shuffle augmentation of columns during pre-training contributed to performance gains.Comment: Accepted at the Workshop on Understanding Foundation Models at ICLR 202

ミトコンドリア オヨビ マイクロサテライト DNA タケイ ニ モトヅク アバシリ エミュー シュウダン ノ イデンテキ コウゾウ

エミュー(Dromaius novaehollandiae)はオーストラリア原産の走鳥類であり,エミューオイル,食肉および卵などを生産することから,オホーツク地域の新規産業動物として期待されている。しかし,エミューの生産形質における遺伝的改良はほとんど実施されておらず,それは今後のオホーツクにおけるエミュー産業の発展に必須となることが予測される。我々はミトコンドリアDNA(mtDNA)およびマイクロサテライトDNA多型を指標として,網走におけるエミュー集団の遺伝的多様性を調査した。D-loop領域の塩基配列を決定し,23個体間において比較した結果,2ヶ所の塩基置換サイトが検出され,2種類のハプロタイプの存在が認められた(a-ハプロタイプ:15792C/16114Gおよびb-ハプロタイプ:15792T/16114A)。それらの頻度は,それぞれ0.96および0.04であり,網走集団の多くはa-ハプロタイプに占められていた。一方,4座位のマイクロサテライトDNAについて83個体のジェノタイピングを行った結果,そのすべてにおいて多型が認められ,平均アレル数は7.25,平均ヘテロ接合率は 0.52(H_O)および0.59(H_E)であった。したがって,網走におけるエミュー集団は高い遺伝的多様性を保持することが示唆された。The emu (Dromaius novaehollandiae) is a ratite native to Australia. Various products, including oils, meat, and eggs, can be obtained from the emu, making it a useful industrial animal. The genetic improvement of the emu is essential for the development of emu farming. To estimate the genetic diversity of the domestic emu population in Abashiri, we investigated mitochondrial DNA (mtDNA) and microsatellite DNA polymorphisms. The D-loop region of mtDNA was sequenced, and two haplotypes were detected: 15792C/16114G (a-haplotype) and 15792T/16114A (b-haplotype), with respective frequencies of 0.96 and 0.04. Therefore, the a-haplotype was overwhelmingly prevalent in the Abashiri population. Additionally, four microsatellite loci were genotyped, and polymorphism was detected at all markers. The average number of alleles at these markers was 7.25, and the average observed heterozygosity (H_O) was 0.52, compared to an average expected heterozygosity (H_E) of 0.59. Therefore, we speculated that high genetic diversity was maintained in the Abashiri emu population

Diving below the spin-down limit:constraints on gravitational waves from the energetic young pulsar PSR J0537-6910

We present a search for continuous gravitational-wave signals from the young, energetic X-ray pulsar PSR J0537-6910 using data from the second and third observing runs of LIGO and Virgo. The search is enabled by a contemporaneous timing ephemeris obtained using NICER data. The NICER ephemeris has also been extended through 2020 October and includes three new glitches. PSR J0537-6910 has the largest spin-down luminosity of any pulsar and is highly active with regards to glitches. Analyses of its long-term and inter-glitch braking indices provided intriguing evidence that its spin-down energy budget may include gravitational-wave emission from a time-varying mass quadrupole moment. Its 62 Hz rotation frequency also puts its possible gravitational-wave emission in the most sensitive band of LIGO/Virgo detectors. Motivated by these considerations, we search for gravitational-wave emission at both once and twice the rotation frequency. We find no signal, however, and report our upper limits. Assuming a rigidly rotating triaxial star, our constraints reach below the gravitational-wave spin-down limit for this star for the first time by more than a factor of two and limit gravitational waves from the l = m = 2 mode to account for less than 14% of the spin-down energy budget. The fiducial equatorial ellipticity is limited to less than about 3 x 10⁻⁵, which is the third best constraint for any young pulsar

The population of merging compact binaries inferred using gravitational waves through GWTC-3

We report on the population properties of 76 compact binary mergers detected with gravitational waves below a false alarm rate of 1 per year through GWTC-3. The catalog contains three classes of binary mergers: BBH, BNS, and NSBH mergers. We infer the BNS merger rate to be between 10 $\rm{Gpc^{-3} yr^{-1}}$ and 1700 $\rm{Gpc^{-3} yr^{-1}}$ and the NSBH merger rate to be between 7.8 $\rm{Gpc^{-3}\, yr^{-1}}$ and 140 $\rm{Gpc^{-3} yr^{-1}}$ , assuming a constant rate density versus comoving volume and taking the union of 90% credible intervals for methods used in this work. Accounting for the BBH merger rate to evolve with redshift, we find the BBH merger rate to be between 17.9 $\rm{Gpc^{-3}\, yr^{-1}}$ and 44 $\rm{Gpc^{-3}\, yr^{-1}}$ at a fiducial redshift (z=0.2). We obtain a broad neutron star mass distribution extending from $1.2^{+0.1}_{-0.2} M_\odot$ to $2.0^{+0.3}_{-0.3} M_\odot$. We can confidently identify a rapid decrease in merger rate versus component mass between neutron star-like masses and black-hole-like masses, but there is no evidence that the merger rate increases again before 10 $M_\odot$. We also find the BBH mass distribution has localized over- and under-densities relative to a power law distribution. While we continue to find the mass distribution of a binary's more massive component strongly decreases as a function of primary mass, we observe no evidence of a strongly suppressed merger rate above $\sim 60 M_\odot$. The rate of BBH mergers is observed to increase with redshift at a rate proportional to $(1+z)^{\kappa}$ with $\kappa = 2.9^{+1.7}_{-1.8}$ for $z\lesssim 1$. Observed black hole spins are small, with half of spin magnitudes below $\chi_i \simeq 0.25$. We observe evidence of negative aligned spins in the population, and an increase in spin magnitude for systems with more unequal mass ratio

Search for anisotropic gravitational-wave backgrounds using data from Advanced LIGO and Advanced Virgo's first three observing runs

We report results from searches for anisotropic stochastic gravitational-wave backgrounds using data from the first three observing runs of the Advanced LIGO and Advanced Virgo detectors. For the first time, we include Virgo data in our analysis and run our search with a new efficient pipeline called {\tt PyStoch} on data folded over one sidereal day. We use gravitational-wave radiometry (broadband and narrow band) to produce sky maps of stochastic gravitational-wave backgrounds and to search for gravitational waves from point sources. A spherical harmonic decomposition method is employed to look for gravitational-wave emission from spatially-extended sources. Neither technique found evidence of gravitational-wave signals. Hence we derive 95\% confidence-level upper limit sky maps on the gravitational-wave energy flux from broadband point sources, ranging from $F_{\alpha, \Theta} < {\rm (0.013 - 7.6)} \times 10^{-8} {\rm erg \, cm^{-2} \, s^{-1} \, Hz^{-1}},$ and on the (normalized) gravitational-wave energy density spectrum from extended sources, ranging from $\Omega_{\alpha, \Theta} < {\rm (0.57 - 9.3)} \times 10^{-9} \, {\rm sr^{-1}}$, depending on direction ($\Theta$) and spectral index ($\alpha$). These limits improve upon previous limits by factors of $2.9 - 3.5$. We also set 95\% confidence level upper limits on the frequency-dependent strain amplitudes of quasimonochromatic gravitational waves coming from three interesting targets, Scorpius X-1, SN 1987A and the Galactic Center, with best upper limits range from $h_0 < {\rm (1.7-2.1)} \times 10^{-25},$ a factor of $\geq 2.0$ improvement compared to previous stochastic radiometer searches.Comment: 23 Pages, 9 Figure

All-sky search for continuous gravitational waves from isolated neutron stars in the early O3 LIGO data

We report on an all-sky search for continuous gravitational waves in the frequency band 20-2000 Hz and with a frequency time derivative in the range of [-1.0,+0.1]×10-8 Hz/s. Such a signal could be produced by a nearby, spinning and slightly nonaxisymmetric isolated neutron star in our Galaxy. This search uses the LIGO data from the first six months of Advanced LIGO's and Advanced Virgo's third observational run, O3. No periodic gravitational wave signals are observed, and 95% confidence-level (C.L.) frequentist upper limits are placed on their strengths. The lowest upper limits on worst-case (linearly polarized) strain amplitude h0 are ∼1.7×10-25 near 200 Hz. For a circularly polarized source (most favorable orientation), the lowest upper limits are ∼6.3×10-26. These strict frequentist upper limits refer to all sky locations and the entire range of frequency derivative values. For a population-averaged ensemble of sky locations and stellar orientations, the lowest 95% C.L. upper limits on the strain amplitude are ∼1.4×10-25. These upper limits improve upon our previously published all-sky results, with the greatest improvement (factor of ∼2) seen at higher frequencies, in part because quantum squeezing has dramatically improved the detector noise level relative to the second observational run, O2. These limits are the most constraining to date over most of the parameter space searched

Search for Gravitational Waves Associated with Gamma-Ray Bursts Detected by Fermi and Swift during the LIGO-Virgo Run O3b

We search for gravitational-wave signals associated with gamma-ray bursts (GRBs) detected by the Fermi and Swift satellites during the second half of the third observing run of Advanced LIGO and Advanced Virgo (2019 November 1 15:00 UTC-2020 March 27 17:00 UTC). We conduct two independent searches: A generic gravitational-wave transients search to analyze 86 GRBs and an analysis to target binary mergers with at least one neutron star as short GRB progenitors for 17 events. We find no significant evidence for gravitational-wave signals associated with any of these GRBs. A weighted binomial test of the combined results finds no evidence for subthreshold gravitational-wave signals associated with this GRB ensemble either. We use several source types and signal morphologies during the searches, resulting in lower bounds on the estimated distance to each GRB. Finally, we constrain the population of low-luminosity short GRBs using results from the first to the third observing runs of Advanced LIGO and Advanced Virgo. The resulting population is in accordance with the local binary neutron star merger rate. © 2022. The Author(s). Published by the American Astronomical Society

All-sky search for long-duration gravitational-wave bursts in the third Advanced LIGO and Advanced Virgo run

After the detection of gravitational waves from compact binary coalescences, the search for transient gravitational-wave signals with less well-defined waveforms for which matched filtering is not well suited is one of the frontiers for gravitational-wave astronomy. Broadly classified into “short” ≲1  s and “long” ≳1  s duration signals, these signals are expected from a variety of astrophysical processes, including non-axisymmetric deformations in magnetars or eccentric binary black hole coalescences. In this work, we present a search for long-duration gravitational-wave transients from Advanced LIGO and Advanced Virgo’s third observing run from April 2019 to March 2020. For this search, we use minimal assumptions for the sky location, event time, waveform morphology, and duration of the source. The search covers the range of 2–500 s in duration and a frequency band of 24–2048 Hz. We find no significant triggers within this parameter space; we report sensitivity limits on the signal strength of gravitational waves characterized by the root-sum-square amplitude hrss as a function of waveform morphology. These hrss limits improve upon the results from the second observing run by an average factor of 1.8