Parameter-Efficient Tuning Makes a Good Classification Head

In recent years, pretrained models revolutionized the paradigm of natural language understanding (NLU), where we append a randomly initialized classification head after the pretrained backbone, e.g. BERT, and finetune the whole model. As the pretrained backbone makes a major contribution to the improvement, we naturally expect a good pretrained classification head can also benefit the training. However, the final-layer output of the backbone, i.e. the input of the classification head, will change greatly during finetuning, making the usual head-only pretraining (LP-FT) ineffective. In this paper, we find that parameter-efficient tuning makes a good classification head, with which we can simply replace the randomly initialized heads for a stable performance gain. Our experiments demonstrate that the classification head jointly pretrained with parameter-efficient tuning consistently improves the performance on 9 tasks in GLUE and SuperGLUE.Comment: Accepted as a long paper to EMNLP 2022 Main Conferenc

PSSA: PCA-domain superpixelwise singular spectral analysis for unsupervised hyperspectral image classification.

Although supervised classification of hyperspectral images (HSI) has achieved success in remote sensing, its applications in real scenarios are often constrained, mainly due to the insufficiently available or lack of labelled data. As a result, unsupervised HSI classification based on data clustering is highly desired, yet it generally suffers from high computational cost and low classification accuracy, especially in large datasets. To tackle these challenges, a novel unsupervised spatial-spectral HSI classification method is proposed. By combining the entropy rate superpixel segmentation (ERS), superpixel-based principal component analysis (PCA), and PCA-domain 2D singular spectral analysis (SSA), both the efficacy and efficiency of feature extraction are improved, followed by the anchor-based graph clustering (AGC) for effective classification. Experiments on three publicly available and five self-collected aerial HSI datasets have fully demonstrated the efficacy of the proposed PCA-domain superpixelwise SSA (PSSA) method, with a gain of 15–20% in terms of the overall accuracy, in comparison to a few state-of-the-art methods. In addition, as an extra outcome, the HSI dataset we acquired is provided freely online

Translithospheric magma plumbing system of intraplate volcanoes as revealed by electrical resistivity imaging

AbstractThe magma plumbing systems of volcanoes in subduction and divergent tectonic settings are relatively well known, whereas those of intraplate volcanoes remain elusive; robust geophysical information on the magma pathways and storage zones is lacking. We inverted magnetotelluric data to image the magma plumbing system of an intraplate monogenetic volcanic field located above the stagnant Pacific slab in northeast China. We identified a complex, vertically aligned, low-resistivity anomaly system extending from the asthenosphere to the surface consisting of reservoirs with finger- to lens-like geometries. We show that magma forms as CO2-rich melts in a 150-km-deep asthenospheric plume crossing the whole lithosphere as hydrated melt, inducing underplating at 50 km depth, evolving in crustal reservoirs, and erupting along dikes. Intraplate volcanoes are characterized by low degrees of melting and low magma supply rates. Their plumbing systems have a geometry not so different from that of volcanoes in subduction settings

The efficacy of mobile phone-based text message interventions (‘Happy Quit’) for smoking cessation in China

Background Considering the extreme shortage of smoking cessation services in China, and the acceptability, feasibility and efficacy of mobile phone-based text message interventions for quitting smoking in other countries, here we propose a study of “the efficacy of mobile phone-based text message interventions (‘Happy Quit’) for smoking cessation in China”. The primary objective of this proposed project is to assess whether a program of widely accessed mobile phone-based text message interventions (‘Happy Quit’) will be effective at helping people in China who smoke, to quit. Based on the efficacy of previous studies in smoking cessation, we hypothesize that ‘Happy Quit’ will be an effective, feasible and affordable smoking cessation program in China. Methods/Design In this single-blind, randomized trial, undertaken in China, about 2000 smokers willing to make a quit attempt will be randomly allocated, using an independent telephone randomization system that includes a minimization algorithm balancing for sex (male, female), age (19–34 or \u3e34 years), educational level (≤ or \u3e12 years), and Fagerstrom score for nicotine addiction (≤5, \u3e5), to ‘Happy Quit’, comprising motivational messages and behavioral-change support, or to a control group that receives text messages unrelated to quitting. Messages will be developed to be suitable for Chinese. A pilot study will be conducted before the intervention to modify the library of messages and interventions. The primary outcome will be self-reported continuous smoking abstinence. A secondary outcome will be point prevalence of abstinence. Abstinence will be assessed at six time points (4, 8, 12, 16, 20 and 24 weeks post-intervention). A third outcome will be reductions in number of cigarettes smoked per day. Discussion/Implications The results will provide valuable insights into bridging the gap between need and services received for smoking cessation interventions and tobacco use prevention in China. It will also serve as mHealth model for extending the public health significance of other interventions, such as mental health interventions

ANALYSIS ON 113 CASES OF ADVERSE REACTIONS CAUSED BY Β-LACTAM ANTIBIOTICS

The objectives of this study were to learn about the characteristics and rules of the occurrence of adverse reactions caused by lactam antibiotics and provide a reference for clinical drug use. Methods: A retrospective study was made to analyse the 113 case reports of adverse reactions caused by β-lactam antibiotics collected in our hospital between 2007 and 2009. Results: 113 cases of ADR involved 17 kinds of β-lactam antibiotics, headed by ceftriaxone sodium. The most common manifestation was skin and accessory damage; nervous system and gastrointestinal system damage were also easier to find, and the administration route was mainly intravenous infusion. Conclusion: The clinical application of β-lactam antibiotics should pay attention to adverse reaction monitoring and rational drug use to reduce the incidence of adverse reactions

Bilateral Fronto-Parietal Integrity in Young Chronic Cigarette Smokers: A Diffusion Tensor Imaging Study

Cigarette smoking continues to be the leading cause of preventable morbidity and mortality in China and other countries. Previous studies have demonstrated gray matter loss in chronic smokers. However, only a few studies assessed the changes of white matter integrity in this group. Based on those previous reports of alterations in white matter integrity in smokers, the aim of this study was to examine the alteration of white matter integrity in a large, well-matched sample of chronic smokers and non-smokers.Using in vivo diffusion tensor imaging (DTI) to measure the differences of whole-brain white matter integrity between 44 chronic smoking subjects (mean age, 28.0±5.6 years) and 44 healthy age- and sex-matched comparison non-smoking volunteers (mean age, 26.3±5.8 years). DTI was performed on a 3-Tesla Siemens scanner (Allegra; Siemens Medical System). The data revealed that smokers had higher fractional anisotropy (FA) than healthy non-smokers in almost symmetrically bilateral fronto-parietal tracts consisting of a major white matter pathway, the superior longitudinal fasciculus (SLF).We found the almost symmetrically bilateral fronto-parietal whiter matter changes in a relatively large sample of chronic smokers. These findings support the hypothesis that chronic cigarette smoking involves alterations of bilateral fronto-parietal connectivity