Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation

Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic forgetting of old tasks in gradient-based optimization. However, the normalization layers provide an exception, as they are updated interdependently by the gradient and statistics of currently observed training samples, which require specialized strategies to mitigate recency bias. In this work, we focus on the most popular Batch Normalization (BN) and provide an in-depth theoretical analysis of its sub-optimality in continual learning. Our analysis demonstrates the dilemma between balance and adaptation of BN statistics for incremental tasks, which potentially affects training stability and generalization. Targeting on these particular challenges, we propose Adaptive Balance of BN (AdaB$^2$N), which incorporates appropriately a Bayesian-based strategy to adapt task-wise contributions and a modified momentum to balance BN statistics, corresponding to the training and testing stages. By implementing BN in a continual learning fashion, our approach achieves significant performance gains across a wide range of benchmarks, particularly for the challenging yet realistic online scenarios (e.g., up to 7.68%, 6.86% and 4.26% on Split CIFAR-10, Split CIFAR-100 and Split Mini-ImageNet, respectively). Our code is available at https://github.com/lvyilin/AdaB2N.Comment: Accepted by NeurIPS 202

Turning dead leaves into an active multifunctional material as evaporator, photocatalyst, and bioplastic

Large numbers of leaves fall on the earth each autumn. The current treatments of dead leaves mainly involve completely destroying the biocomponents, which causes considerable energy consumption and environmental issues. It remains a challenge to convert waste leaves into useful materials without breaking down their biocomponents. Here, we turn red maple dead leaves into an active three-component multifunctional material by exploiting the role of whewellite biomineral for binding lignin and cellulose. Owing to its intense optical absorption spanning the full solar spectrum and the heterogeneous architecture for effective charge separation, films of this material show high performance in solar water evaporation, photocatalytic hydrogen production, and photocatalytic degradation of antibiotics. Furthermore, it also acts as a bioplastic with high mechanical strength, high-temperature tolerance, and biodegradable features. These findings pave the way for the efficient utilization of waste biomass and innovations of advanced materials

Provoking topology by octahedral tilting in strained SrNbO3_3

Transition metal oxides with a wide variety of electronic and magnetic properties offer an extraordinary possibility to be a platform for developing future electronics based on unconventional quantum phenomena, for instance, the topology. The formation of topologically non-trivial states is related to crystalline symmetry, spin-orbit coupling, and magnetic ordering. Here, we demonstrate how lattice distortions and octahedral rotation in SrNbO$_3$ films induce the band topology. By employing angle-resolved photoemission spectroscopy (ARPES) and density functional theory (DFT) calculations, we verify the presence of in-phase $a^0a^0c^+$ octahedral rotation in ultra-thin SrNbO$_3$ films, which causes the formation of topologically-protected Dirac band crossings. Our study illustrates that octahedral engineering can be effectively exploited for implanting and controlling quantum topological phases in transition metal oxides.Comment: 6 pages, 4 figure

High Genetic Diversity of HIV-1 and Active Transmission Clusters among Male-to-Male Sexual Contacts (MMSCs) in Zhuhai, China

Monitoring genetic diversity and recent HIV infections (RHIs) is critical for understanding HIV epidemiology. Here, we report HIV-1 genetic diversity and RHIs in blood samples from 190 HIV-positive MMSCs in Zhuhai, China. MMSCs with newly reported HIV were enrolled from January 2020 to June 2022. A nested PCR was performed to amplify the HIV polymerase gene fragments at HXB2 positions 2604–3606. We constructed genetic transmission network at both 0.5% and 1.5% distance thresholds using the Tamura-Nei93 model. RHIs were identified using a recent infection testing algorithm (RITA) combining limiting antigen avidity enzyme immunoassay (LAg-EIA) assay with clinical data. The results revealed that 19.5% (37/190) were RHIs and 48.4% (92/190) were CRF07_BC. Two clusters were identified at a 0.5% distance threshold. Among them, one was infected with CRF07_BC for the long term, and the other was infected with CRF55_01B recently. We identified a total of 15 clusters at a 1.5% distance threshold. Among them, nine were infected with CRF07_BC subtype, and RHIs were found in 38.8% (19/49) distributed in eight genetic clusters. We identified a large active transmission cluster (n = 10) infected with a genetic variant, CRF79_0107. The multivariable logistic regression model showed that clusters were more likely to be RHIs (adjusted OR: 3.64, 95% CI: 1.51~9.01). The RHI algorithm can help to identify recent or ongoing transmission clusters where the prevention tools are mostly needed. Prompt public health measures are needed to contain the further spread of active transmission clusters

Comparison between HIV self-testing and facility-based HIV testing approach on HIV early detection among men who have sex with men: A cross-sectional study

Background To assess whether HIV self-testing (HIVST) has a better performance in identifying HIV-infected cases than the facility-based HIV testing (HIVFBT) approach. Methods A cross-sectional study was conducted among men who have sex with men (MSM) by using an online questionnaire (including information on sociodemographic, sexual biography, and HIV testing history) and blood samples (for limiting antigen avidity enzyme immunoassay, gene subtype testing, and taking confirmed HIV test). MSM who were firstly identified as HIV positive through HIVST and HIVFBT were compared. Chi-square or Fisher’s exact test was used to explore any association between both groups and their subgroups. Results In total, 124 MSM HIV cases were identified from 2017 to 2021 in Zhuhai, China, including 60 identified through HIVST and 64 through HIVFBT. Participants in the HIVST group were younger (≤30 years, 76.7% vs. 46.9%), were better educated (>high school, 61.7% vs. 39.1%), and had higher viral load (≥1,000 copies/ml, 71.7% vs. 50.0%) than MSM cases identified through HIVFBT. The proportion of early HIV infection in the HIVST group was higher than in the HIVFBT group, identified using four recent infection testing algorithms (RITAs) (RITA 1, 46.7% vs. 25.0%; RITA 2, 43.3% vs. 20.3%; RITA 3, 30.0% vs. 14.1%; RITA 4, 26.7% vs. 10.9%; all p < 0.05). Conclusions The study showed that HIVST has better HIV early detection among MSM and that recent HIV infection cases mainly occur in younger and better-educated MSM. Compared with HIVFBT, HIVST is more accessible to the most at-risk population on time and tends to identify the case early. Further implementation studies are needed to fill the knowledge gap on this medical service model among MSM and other target populations

Incidence and spontaneous clearance of gonorrhea and chlamydia infections among men who have sex with men: a prospective cohort study in Zhuhai, China

BackgroundMen who have sex with men (MSM) face significant risks of Chlamydia trachomatis (CT) and/or Neisseria gonorrhoeae (NG) infection. Nevertheless, only limited studies have looked into the site-specific infection and clearance of CT/NG. In order to prevent transmission, it is essential to understand the underlying factors that drive infection and spontaneous clearance.MethodsA 12-week cohort study examined the association between CT/NG infection, self-clearance, and sexual behaviors among MSM. The Willingness Service recruited participants who completed weekly questionnaires and provided urine, throat, and rectal swab samples.ResultsThe study involved 151 men, in which 51 (33.8%) were diagnosed with CT/NG infection during the study period. HIV (OR = 11.31), kissing (OR = 1.59), receptive oral sex (OR = 36.64), and insertive anal sex (OR = 19.73) constituted significant risk factors. 100% condom use (OR = 5.78) and antibiotic (OR = 7.53) were more likely to cause spontaneous clearance.DiscussionMSM may engage in riskier sexual behaviors due to insufficient knowledge and awareness of STI prevention, leading to increased susceptibility to NG/CT. It is crucial to concentrate on enhancing health education for MSM.ConclusionThis study found that the rectum was the most prevalent site of CT/NG and sexual behavior can influence the infection. Additionally, the appropriate use of antibiotics and consistent condom use may contribute to clear spontaneously

Clinical and electrophysiological features of SCN8A variants causing episodic or chronic ataxia

BACKGROUND: Variants in SCN8A are associated with a spectrum of epilepsies and neurodevelopmental disorders. Ataxia as a predominant symptom of SCN8A variation has not been well studied. We set out to investigate disease mechanisms and genotype-phenotype correlations of SCN8A-related ataxia. METHODS: We collected genetic and electro-clinical data of ten individuals from nine unrelated families carrying novel SCN8A variants associated with chronic progressive or episodic ataxia. Electrophysiological characterizations of these variants were performed in ND7/23 cells and cultured neurons. FINDINGS: Variants associated with chronic progressive ataxia either decreased Na + current densities and shifted activation curves towards more depolarized potentials (p.Asn995Asp, p.Lys1498Glu and p.Trp1266Cys) or resulted in a premature stop codon (p.Trp937Ter). Three variants (p.Arg847Gln and biallelic p.Arg191Trp/p.Asp1525Tyr) were associated with episodic ataxia causing loss-of-function by decreasing Na + current densities or a hyperpolarizing shift of the inactivation curve. Two additional episodic ataxia-associated variants caused mixed gain- and loss-of function effects in ND7/23 cells and were further examined in primary murine hippocampal neuronal cultures. Neuronal firing in excitatory neurons was increased by p.Arg1629His, but decreased by p.Glu1201Lys. Neuronal firing in inhibitory neurons was decreased for both variants. No functional effect was observed for p.Arg1913Trp. In four individuals, treatment with sodium channel blockers exacerbated symptoms. INTERPRETATION: We identified episodic or chronic ataxia as predominant phenotypes caused by variants in SCN8A. Genotype-phenotype correlations revealed a more pronounced loss-of-function effect for variants causing chronic ataxia. Sodium channel blockers should be avoided under these conditions. FUNDING: BMBF, DFG, the Italian Ministry of Health, University of Tuebingen

Les droits disciplinaires des fonctions publiques : « unification », « harmonisation » ou « distanciation ». A propos de la loi du 26 avril 2016 relative à la déontologie et aux droits et obligations des fonctionnaires

The production of tt‾ , W+bb‾ and W+cc‾ is studied in the forward region of proton–proton collisions collected at a centre-of-mass energy of 8 TeV by the LHCb experiment, corresponding to an integrated luminosity of 1.98±0.02 fb−1 . The W bosons are reconstructed in the decays W→ℓν , where ℓ denotes muon or electron, while the b and c quarks are reconstructed as jets. All measured cross-sections are in agreement with next-to-leading-order Standard Model predictions.The production of $t\overline{t}$, $W+b\overline{b}$ and $W+c\overline{c}$ is studied in the forward region of proton-proton collisions collected at a centre-of-mass energy of 8 TeV by the LHCb experiment, corresponding to an integrated luminosity of 1.98 $\pm$ 0.02 \mbox{fb}^{-1}. The $W$ bosons are reconstructed in the decays $W\rightarrow\ell\nu$, where $\ell$ denotes muon or electron, while the $b$ and $c$ quarks are reconstructed as jets. All measured cross-sections are in agreement with next-to-leading-order Standard Model predictions