Adaptive Optimizers with Sparse Group Lasso for Neural Networks in CTR Prediction

We develop a novel framework that adds the regularizers of the sparse group lasso to a family of adaptive optimizers in deep learning, such as Momentum, Adagrad, Adam, AMSGrad, AdaHessian, and create a new class of optimizers, which are named Group Momentum, Group Adagrad, Group Adam, Group AMSGrad and Group AdaHessian, etc., accordingly. We establish theoretically proven convergence guarantees in the stochastic convex settings, based on primal-dual methods. We evaluate the regularized effect of our new optimizers on three large-scale real-world ad click datasets with state-of-the-art deep learning models. The experimental results reveal that compared with the original optimizers with the post-processing procedure which uses the magnitude pruning method, the performance of the models can be significantly improved on the same sparsity level. Furthermore, in comparison to the cases without magnitude pruning, our methods can achieve extremely high sparsity with significantly better or highly competitive performance. The code is available at https://github.com/intelligent-machine-learning/dlrover/blob/master/tfplus.Comment: 24 pages. Published as a conference paper at ECML PKDD 2021. This version includes Appendix which was not included in the published version because of page limi

Effects of vertical advection on multimessenger signatures of black hole neutrino-dominated accretion flows in compact binary coalescences

In the coalescence events of binary neutron star (NS) or a black hole (BH) and an NS, a BH hyperaccretion disk might be eventually formed. At very high mass accretion rates, MeV neutrinos will be emitted from this disk, which is called a neutrino-dominated accretion flow (NDAF). Neutrino annihilation in the space out of the disk is energetic enough to launch ultrarelativistic jets to power gamma-ray bursts. Moreover, vertical advection might exist in NDAFs, which can generate the magnetic buoyancy bubbles to release gamma-ray photons. In this paper, we visit the effects of the vertical advection in NDAFs on the disk structure and gamma-ray and neutrino luminosities for different accretion rates. Then we study the anisotropic emission of kilonovae and the following gravitational waves (GWs) driven by the gamma-ray photons and neutrinos from NDAFs. Comparing NDAFs without vertical advection, the neutrino luminosity and GW strains slightly decrease for the case with vertical advection, and the kilonovae will be brightened by the injected gamma-ray photons. The future joint multimessenger observations might distinguish whether the vertical advection exists in NDAFs or not after compact binary coalescences.Comment: 14 pages, 7 figures, accepted for publication in Ap

Characteristic measurements of silicon dioxide aerogel plasmas generated in a Planckian radiation environment

Includes bibliographical references (pages 6-7).The temporally and spatially resolved characteristics of silicon dioxide aerogel plasmas were studied using x-ray spectroscopy. The plasma was generated in the near-Planckian radiation environment within gold hohlraum targets irradiated by laser pulses with a total energy of 2.4 kJ in 1 ns. The contributions of silicon ions at different charge states to the specific components of the measured absorption spectra were also investigated. It was found that each main feature in the absorption spectra of the measured silicon dioxide aerogel plasmas was contributed by two neighboring silicon ionic species

HCV 6a Prevalence in Guangdong Province Had the Origin from Vietnam and Recent Dissemination to Other Regions of China: Phylogeographic Analyses

Recently in China, HCV 6a infection has shown a fast increase among patients and blood donors, possibly due to IDU linked transmission.We recruited 210 drug users in Shanwei city, Guangdong province. Among them, HCV RNA was detected in 150 (71.4%), both E1 and NS5B genes were sequenced in 136, and 6a genotyped in 70. Of the 6a sequences, most were grouped into three clusters while 23% represent emerging strains. For coalescent analysis, additional 6a sequences were determined among 21 blood donors from Vietnam, 22 donors from 12 provinces of China, and 36 IDUs from Liuzhou City in Guangxi Province. Phylogeographic analyses indicated that Vietnam could be the origin of 6a in China. The Guangxi Province, which borders Vietnam, could be the first region to accept 6a for circulation. Migration from Yunnan, which also borders Vietnam, might be equally important, but it was only detected among IDUs in limited regions. From Guangxi, 6a could have further spread to Guangdong, Yunnan, Hainan, and Hubei provinces. However, evidence showed that only in Guangdong has 6a become a local epidemic, making Guangdong the second source region to disseminate 6a to the other 12 provinces. With a rate of 2.737×10⁻³ (95% CI: 1.792×10⁻³ to 3.745×10⁻³), a Bayesian Skyline Plot was portrayed. It revealed an exponential 6a growth during 1994-1998, while before and after 1994-1998 slow 6a growths were maintained. Concurrently, 1994-1998 corresponded to a period when contaminated blood transfusion was common, which caused many people being infected with HIV and HCV, until the Chinese government outlawed the use of paid blood donations in 1998.With an origin from Vietnam, 6a has become a local epidemic in Guangdong Province, where an increasing prevalence has subsequently led to 6a spread to many other regions of China

A Pan-cancer analysis reveals high-frequency genetic alterations in mediators of signaling by the tgf-β superfamily

We present an integromic analysis of gene alterations that modulate transforming growth factor β (TGF-β)-Smad-mediated signaling in 9,125 tumor samples across 33 cancer types in The Cancer Genome Atlas (TCGA). Focusing on genes that encode mediators and regulators of TGF-β signaling, we found at least one genomic alteration (mutation, homozygous deletion, or amplification) in 39% of samples, with highest frequencies in gastrointestinal cancers. We identified mutation hotspots in genes that encode TGF-β ligands (BMP5), receptors (TGFBR2, AVCR2A, and BMPR2), and Smads (SMAD2 and SMAD4). Alterations in the TGF-β superfamily correlated positively with expression of metastasis-associated genes and with decreased survival. Correlation analyses showed the contributions of mutation, amplification, deletion, DNA methylation, and miRNA expression to transcriptional activity of TGF-β signaling in each cancer type. This study provides a broad molecular perspective relevant for future functional and therapeutic studies of the diverse cancer pathways mediated by the TGF-β superfamily

Triassic sedimentation and postaccretionary crustal evolution along the Solonker suture zone in Inner Mongolia, China

Detrital zircon U-Pb dating of the Xingfuzhilu Formation in southern Inner Mongolia yields a maximum depositional age of around 220 Ma. The predominantly Permian and Triassic zircons are characterized by oscillatory zoning and euhedral shapes, with mostly positive zircon εHf(t) values (+2.0 to +16.4), indicating that they were derived from a proximal magmatic source. Early-Middle Paleozoic zircons have variable zircon εHf(t) values from −6.2 to +11.2 and are characterized by weak oscillatory zoning and subhedral-subrounded shapes, suggesting that the sources are a proximal magmatic arc, possibly mixed with components of the Ondor Sum magmatic arc and the magmatic arc at the northern margin of the North China Craton. The remnants of Precambrian blocks in the southeastern Central Asian Orogenic Belt (CAOB), and the North China Craton may also have been a minor source region for the Xingfuzhilu succession. These results, combined with regional data, indicate that a closing remnant ocean basin or narrow seaway possibly existed in the Middle Permian (Guadalupian) immediately prior to final collision of the CAOB and closure of the Paleo-Asian Ocean. Subsequent collision resulted in the crustal uplift and thickening along the Solonker suture zone, accompanied by possible slab break-off and lithospheric delamination during the Latest Permian to Middle Triassic. The resultant orogen in the Late Triassic underwent exhumation and denudation of rocks in response to the postorogenic collapse and regional extension. Vertical crustal growth in the Triassic is documented by detrital zircons from the Xingfuzhilu Formation and appears to have been widespread across entire eastern CAOB