Segatron: Segment-Aware Transformer for Language Modeling and Understanding

Transformers are powerful for sequence modeling. Nearly all state-of-the-art language models and pre-trained language models are based on the Transformer architecture. However, it distinguishes sequential tokens only with the token position index. We hypothesize that better contextual representations can be generated from the Transformer with richer positional information. To verify this, we propose a segment-aware Transformer (Segatron), by replacing the original token position encoding with a combined position encoding of paragraph, sentence, and token. We first introduce the segment-aware mechanism to Transformer-XL, which is a popular Transformer-based language model with memory extension and relative position encoding. We find that our method can further improve the Transformer-XL base model and large model, achieving 17.1 perplexity on the WikiText-103 dataset. We further investigate the pre-training masked language modeling task with Segatron. Experimental results show that BERT pre-trained with Segatron (SegaBERT) can outperform BERT with vanilla Transformer on various NLP tasks, and outperforms RoBERTa on zero-shot sentence representation learning.Comment: Accepted by AAAI 202

RETRACTED: Correlations of β-catenin, Ki67 and Her-2/neu with gastric cancer

This article has been retracted: please see Elsevier Policy on Article Withdrawal (http://www.elsevier.com/locate/withdrawalpolicy).This article has been retracted at the request of the editor as the authors have plagiarized part of a paper that had already appeared in Acta Universitatis Medicinalis Anhui (2014, volume 49, issue 2, Pg:258–261, the link in CNKI: http://www.cnki.net/KCMS/detail/detail.aspx, the website of the Journal: http://www.aydxb.cn/publist.asp?second_id=2005). One of the conditions of submission of a paper for publication is that authors declare explicitly that their work is original and has not appeared in a publication elsewhere. Re-use of any data should be appropriately cited. As such this article represents a severe abuse of the scientific publishing system. The scientific community takes a very strong view on this matter and apologies are offered to readers of the journal that this was not detected during the submission process

Parameter Optimization of a Discrete Scattering Model by Integration of Global Sensitivity Analysis Using SMAP Active and Passive Observations

Active and passive microwave signatures respond differently to the land surface and provide complementary information on the characteristics of the observed scenes. The objective of this paper is to explore the synergy of active radar and passive radiometer observations at the same spatial scale to constrain a discrete radiative transfer model, the Tor Vergata (TVG) model, to gain insights into the microwave scattering and emission mechanisms over grasslands. The TVG model can simultaneously simulate the backscattering coefficient and emissivity with a set of input parameters. To calibrate this model, in situ soil moisture and temperature data collected from the Maqu area in the northeastern region of the Tibetan Plateau, interpolated leaf area index (LAI) data from the Moderate Resolution Imaging Spectroradiometer LAI eight-day products, and concurrent and coincident Soil Moisture Active Passive (SMAP) radar and radiometer observations are used. Because this model needs numerous input parameters to be driven, the extended Fourier amplitude sensitivity test is first applied to conduct global sensitivity analysis (GSA) to select the sensitive and insensitive parameters. Only the most sensitive parameters are defined as free variables, to separately calibrate the active-only model (TVG-A), the passive-only model (TVG-P), and the active and passive combined model (TVG-AP). The accuracy of the calibrated models is evaluated by comparing the SMAP observations and the model simulations. The results show that TVG-AP can well reproduce the backscattering coefficient and brightness temperature, with correlation coefficients of 0.87, 0.89, 0.78, and 0.43 and root-mean-square errors of 0.49 dB, 0.52 dB, 7.20 K, and 10.47 K for σ HH⁰ , σ VV⁰ , TBH, and TBV, respectively. In contrast, TVG-A and TVG-P can only accurately model the backscattering coefficient and brightness temperature, respectively. Without any modifications of the calibrated parameters, the error metrics computed from the validation data are slightly worse than those of the calibration data. These results demonstrate the feasibility of the synergistic use of SMAP active radar and passive radiometer observations under the unified framework of a physical model. In addition, the results demonstrate the necessity and effectiveness of applying GSA in model optimization. It is expected that these findings can contribute to the development of model-based soil moisture retrieval methods using active and passive microwave remote sensing data

Transiently impaired endothelial function during thyroid hormone withdrawal in differentiated thyroid cancer patients

PurposeEndothelial dysfunction, which was associated with chronic hypothyroidism, was an early event in atherosclerosis. Whether short-term hypothyroidism following thyroxine withdrawal during radioiodine (RAI) therapy was associated with endothelial dysfunction in patients with differentiated thyroid cancer (DTC) was unclear. Aim of the study was to assess whether short-term hypothyroidism could impair endothelial function and the accompanied metabolic changes in the whole process of RAI therapy.MethodsWe recruited fifty-one patients who underwent total thyroidectomy surgery and would accept RAI therapy for DTC. We analyzed thyroid function, endothelial function and serum lipids levels of the patients at three time points: the day before thyroxine withdrawal(P1), the day before 131I administration(P2) and 4-6 weeks after RAI therapy(P3). A high-resolution ultrasound named flow-mediated dilation (FMD) was used to measure endothelial function of the patients.ResultsWe analyzed the changes of FMD, thyroid function and lipids at three time points. FMD(P2) decreased significantly compared to FMD(P1) (P1vsP2, 8.05 ± 1.55vs 7.26 ± 1.50, p<0.001). There was no significant difference between FMD(P3) and FMD(P1) after restoring TSH (thyroid stimulating hormone) suppression therapy (P1 vs P3, 8.05 ± 1.55 vs 7.79 ± 1.38, p=0.146). Among all parameters, the change of low-density lipoprotein (ΔLDL) was the only factor correlated negatively with the change of FMD (ΔFMD) throughout the RAI therapy process (P1-2, r=-0.326, p=0.020; P2-3, r=-0.306, p=0.029).ConclusionEndothelial function was transiently impaired in DTC patients at short-term hypothyroidism state during the RAI therapy, and immediately returned to the initial state after restoring TSH suppression therapy

Parallel momentum distribution of the 28^{28}Si fragments from 29^{29}P

Distribution of the parallel momentum of $^{28}$Si fragments from the breakup of 30.7 MeV/nucleon $^{29}$P has been measured on C targets. The distribution has the FWHM with the value of 110.5 $\pm$ 23.5 MeV/c which is consistent quantitatively with Galuber model calculation assuming by a valence proton in $^{29}$P. The density distribution is also predicted by Skyrme-Hartree-Fock calculation. Results show that there might exist the proton-skin structure in $^{29}$P.Comment: 4 pages, 4 figure

Management of granulomatous lobular mastitis: an international multidisciplinary consensus (2021 edition)

Granulomatous lobular mastitis (GLM) is a rare and chronic benign inflammatory disease of the breast. Difficulties exist in the management of GLM for many front-line surgeons and medical specialists who care for patients with inflammatory disorders of the breast. This consensus is summarized to establish evidence-based recommendations for the management of GLM. Literature was reviewed using PubMed from January 1, 1971 to July 31, 2020. Sixty-six international experienced multidisciplinary experts from 11 countries or regions were invited to review the evidence. Levels of evidence were determined using the American College of Physicians grading system, and recommendations were discussed until consensus. Experts discussed and concluded 30 recommendations on historical definitions, etiology and predisposing factors, diagnosis criteria, treatment, clinical stages, relapse and recurrence of GLM. GLM was recommended as a widely accepted definition. In addition, this consensus introduced a new clinical stages and management algorithm for GLM to provide individual treatment strategies. In conclusion, diagnosis of GLM depends on a combination of history, clinical manifestations, imaging examinations, laboratory examinations and pathology. The approach to treatment of GLM should be applied according to the different clinical stage of GLM. This evidence-based consensus would be valuable to assist front-line surgeons and medical specialists in the optimal management of GLM.Improving the Ability of Diagnosis and Treatment of Difficult Disease

Two-photon widths of the χc0,2\chi_{c0, 2} states and helicity analysis for \chi_{c2}\ar\gamma\gamma}

Based on a data sample of 106 M $\psi^{\prime}$ events collected with the BESIII detector, the decays \psi^{\prime}\ar\gamma\chi_{c0, 2},\chi_{c0, 2}\ar\gamma\gamma are studied to determine the two-photon widths of the $\chi_{c0, 2}$ states. The two-photon decay branching fractions are determined to be {\cal B}(\chi_{c0}\ar\gamma\gamma) = (2.24\pm 0.19\pm 0.12\pm 0.08)\times 10^{-4} and {\cal B}(\chi_{c2}\ar\gamma\gamma) = (3.21\pm 0.18\pm 0.17\pm 0.13)\times 10^{-4}. From these, the two-photon widths are determined to be $\Gamma_{\gamma \gamma}(\chi_{c0}) = (2.33\pm0.20\pm0.13\pm0.17)$ keV, $\Gamma_{\gamma \gamma}(\chi_{c2}) = (0.63\pm0.04\pm0.04\pm0.04)$ keV, and $\cal R$ $=\Gamma_{\gamma \gamma}(\chi_{c2})/\Gamma_{\gamma \gamma}(\chi_{c0})=0.271\pm 0.029\pm 0.013\pm 0.027$, where the uncertainties are statistical, systematic, and those from the PDG {\cal B}(\psi^{\prime}\ar\gamma\chi_{c0,2}) and $\Gamma(\chi_{c0,2})$ errors, respectively. The ratio of the two-photon widths for helicity $\lambda=0$ and helicity $\lambda=2$ components in the decay \chi_{c2}\ar\gamma\gamma is measured for the first time to be $f_{0/2} =\Gamma^{\lambda=0}_{\gamma\gamma}(\chi_{c2})/\Gamma^{\lambda=2}_{\gamma\gamma}(\chi_{c2}) = 0.00\pm0.02\pm0.02$.Comment: 10 pages, 4 figure

Study of J/ψ→ppˉJ/\psi\to p\bar{p} and J/ψ→nnˉJ/\psi\to n\bar{n}

The decays $J/\psi\to p\bar{p}$ and $J/\psi\to n\bar{n}$ have been investigated with a sample of 225.2 million $J/\psi$ events collected with the BESIII detector at the BEPCII $e^+e^-$ collider. The branching fractions are determined to be $\mathcal{B}(J/\psi\to p\bar{p})=(2.112\pm0.004\pm0.031)\times10^{-3}$ and $\mathcal{B}(J/\psi\to n\bar{n})=(2.07\pm0.01\pm0.17)\times10^{-3}$. Distributions of the angle $\theta$ between the proton or anti-neutron and the beam direction are well described by the form $1+\alpha\cos^2\theta$, and we find $\alpha=0.595\pm0.012\pm0.015$ for $J/\psi\to p\bar{p}$ and $\alpha=0.50\pm0.04\pm0.21$ for $J/\psi\to n\bar{n}$. Our branching-fraction results suggest a large phase angle between the strong and electromagnetic amplitudes describing the $J/\psi\to N\bar{N}$ decay.Comment: 16 pages, 13 figures, the 2nd version, submitted to PR

First observation of the M1 transition ψ(3686)→γηc(2S)\psi(3686)\to \gamma\eta_c(2S)

Using a sample of 106 million \psi(3686) events collected with the BESIII detector at the BEPCII storage ring, we have made the first measurement of the M1 transition between the radially excited charmonium S-wave spin-triplet and the radially excited S-wave spin-singlet states: \psi(3686)\to\gamma\eta_c(2S). Analyses of the processes \psi(2S)\to \gamma\eta_c(2S) with \eta_c(2S)\to \K_S^0 K\pi and K^+K^-\pi^0 gave an \eta_c(2S) signal with a statistical significance of greater than 10 standard deviations under a wide range of assumptions about the signal and background properties. The data are used to obtain measurements of the \eta_c(2S) mass (M(\eta_c(2S))=3637.6\pm 2.9_\mathrm{stat}\pm 1.6_\mathrm{sys} MeV/c^2), width (\Gamma(\eta_c(2S))=16.9\pm 6.4_\mathrm{stat}\pm 4.8_\mathrm{sys} MeV), and the product branching fraction (\BR(\psi(3686)\to \gamma\eta_c(2S))\times \BR(\eta_c(2S)\to K\bar K\pi) = (1.30\pm 0.20_\mathrm{stat}\pm 0.30_\mathrm{sys})\times 10^{-5}). Combining our result with a BaBar measurement of \BR(\eta_c(2S)\to K\bar K \pi), we find the branching fraction of the M1 transition to be \BR(\psi(3686)\to\gamma\eta_c(2S)) = (6.8\pm 1.1_\mathrm{stat}\pm 4.5_\mathrm{sys})\times 10^{-4}.Comment: 7 pages, 1 figure, 1 tabl