Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture

In this paper, we propose a highly parameter-efficient approach to scaling pre-trained language models (PLMs) to a deeper model depth. Unlike prior work that shares all parameters or uses extra blocks, we design a more capable parameter-sharing architecture based on matrix product operator (MPO). MPO decomposition can reorganize and factorize the information of a parameter matrix into two parts: the major part that contains the major information (central tensor) and the supplementary part that only has a small proportion of parameters (auxiliary tensors). Based on such a decomposition, our architecture shares the central tensor across all layers for reducing the model size and meanwhile keeps layer-specific auxiliary tensors (also using adapters) for enhancing the adaptation flexibility. To improve the model training, we further propose a stable initialization algorithm tailored for the MPO-based architecture. Extensive experiments have demonstrated the effectiveness of our proposed model in reducing the model size and achieving highly competitive performance.Comment: 14 pages, 4 figures, 6 table

Meta-analysis of incidence and risk factors of immune checkpoint inhibitor-associated pneumonia in patients with lung cancer

Objective: To systematically evaluate the incidence and risk factors of immune checkpoint inhibitor-associated pneumonia (CIP) in patients with lung cancer. Methods: The literature evaluating the incidence of CIP and its influencing factors in lung cancer patients were searched, in Chinese Biomedical Literature Database (CBM), CNKI Database, WanFang Database, VIP Chinese Biomedical Journal Database, PubMed, Cochrane Library, Web of Science, EBSCOhost, Medline and CINAHL Database from the construction of the library to June 30, 2022. Stata 17.0 software was applied to perform a Meta-analysis of the incidence and risk factors of CIP. Results: A total of 19 articles were included, involving 3 101 patients with lung cancer. The results of Meta-analysis showed that the total incidence of CIP in lung cancer patients was 18% (95%CI:0.14-0.21). Subgroup analysis showed that the incidence of CIP was higher in patients with lung cancer reported in 2021 and 2022, Asian countries and case-control studies. Risk factors included prior chronic obstructive pulmonary disease, prior interstitial pulmonary disease, performance status (PS) score≥2 points and combination therapy. Conclusion: The incidence of CIP is high in lung cancer patients and the occurrence of CIP is affected by many factors. Clinical medical staff should strengthen the identification and screening of risk factors, and intervene early to avoid serious consequences

Prevalence of picky eating behaviour in Chinese school-age children and associations with anthropometric parameters and intelligence quotient. A cross-sectional study

AbstractPrevious studies have demonstrated the importance of eating behaviour regarding dietary variety and nutrient intake of children. However, the association between picky eating and growth of children is still a topic of debate. This study sought to estimate the prevalence of picky eating and to identify possible associations with the growth of school-age children in China. In this survey, 793 healthy children aged 7–12 years were recruited from nine cities and rural areas in China using a multi-stage cluster sampling method. Data collected included socio-demographic information and parents' perceptions of picky eating using a structured questionnaire, nutrient intake using 24-hour dietary recall, weight and height using body measurements, and intelligence using the Wechsler Intelligence Scale for Children. Blood samples were collected and analysed for minerals. The prevalence of picky eating reported by parents was 59.3% in children. Compared with non-picky eaters, picky eaters had a lower dietary intake of energy, protein, carbohydrates, most vitamins and minerals, and lower levels of magnesium, iron, and copper in the blood (p < 0.05), and also had a 0.184 z-score lower in height for age (95% CI: −0.332, 0.036; p = 0.015), a 0.385 z-score lower in weight for age (95% CI: −0.533, −0.237; p < 0.001), a 0.383 z-score lower in BMI for age (95% CI: −0.563, −0.203; p < 0.001), and scored 2.726 points higher on the intelligence test (95% CI: 0.809, 4.643; p = 0.006) when adjusted for children's birth weight and food allergy, mothers' education, and family income. Picky eating behaviour towards meat, eggs and vegetables showed negative associations with growth. Picky eating behaviour is prevalent in school-age children in China and may have a negative effect on growth

Clinical and radiological characteristics of pediatric COVID-19 before and after the Omicron outbreak: a multi-center study

IntroductionThe emergence of the Omicron variant has seen changes in the clinical and radiological presentations of COVID-19 in pediatric patients. We sought to compare these features between patients infected in the early phase of the pandemic and those during the Omicron outbreak.MethodsA retrospective study was conducted on 68 pediatric COVID-19 patients, of which 31 were infected with the original SARS-CoV-2 strain (original group) and 37 with the Omicron variant (Omicron group). Clinical symptoms and chest CT scans were examined to assess clinical characteristics, and the extent and severity of lung involvement.ResultsPediatric COVID-19 patients predominantly had normal or mild chest CT findings. The Omicron group demonstrated a significantly reduced CT severity score than the original group. Ground-glass opacities were the prevalent radiological findings in both sets. The Omicron group presented with fewer symptoms, had milder clinical manifestations, and recovered faster than the original group.DiscussionThe clinical and radiological characteristics of pediatric COVID-19 patients have evolved with the advent of the Omicron variant. For children displaying severe symptoms warranting CT examinations, it is crucial to weigh the implications of ionizing radiation and employ customized scanning protocols and protective measures. This research offers insights into the shifting disease spectrum, aiding in the effective diagnosis and treatment of pediatric COVID-19 patients

Structure and Photoluminescent Properties of ZnO Encapsulated in Mesoporous Silica SBA-15 Fabricated by Two-Solvent Strategy

The two-solvent method was employed to prepare ZnO encapsulated in mesoporous silica (ZnO/SBA-15). The prepared ZnO/SBA-15 samples have been studied by X-ray diffraction, transmission electron microscope, X-ray photoelectron spectroscopy, nitrogen adsorption–desorption isotherm, and photoluminescence spectroscopy. The ZnO/SBA-15 nanocomposite has the ordered hexagonal mesostructure of SBA-15. ZnO clusters of a high loading are distributed in the channels of SBA-15. Photoluminescence spectra show the UV emission band around 368 nm, the violet emission around 420 nm, and the blue emission around 457 nm. The UV emission is attributed to band-edge emission of ZnO. The violet emission results from the oxygen vacancies on the ZnO–SiO2interface traps. The blue emission is from the oxygen vacancies or interstitial zinc ions of ZnO. The UV emission and blue emission show a blue-shift phenomenon due to quantum-confinement-induced energy gap enhancement of ZnO clusters. The ZnO clusters encapsulated in SBA-15 can be used as light-emitting diodes and ultraviolet nanolasers

Structure and Luminescence Properties of Eu3+-Doped Cubic Mesoporous Silica Thin Films

Eu3+ ions-doped cubic mesoporous silica thin films with a thickness of about 205 nm were prepared on silicon and glass substrates using triblock copolymer as a structure-directing agent using sol–gel spin-coating and calcination processes. X-ray diffraction and transmission electron microscopy analysis show that the mesoporous silica thin films have a highly ordered body-centered cubic mesoporous structure. High Eu3+ ion loading and high temperature calcination do not destroy the ordered cubic mesoporous structure of the mesoporous silica thin films. Photoluminescence spectra show two characteristic emission peaks corresponding to the transitions of5D0-7F1 and 5D0-7F2 of Eu3+ ions located in low symmetry sites in mesoporous silica thin films. With the Eu/Si molar ratio increasing to 3.41%, the luminescence intensity of the Eu3+ ions-doped mesoporous silica thin films increases linearly with increasing Eu3+ concentration

Dopamine depletion and subcortical dysfunction disrupt cortical synchronization and metastability affecting cognitive function in Parkinson's disease

Parkinson's disease (PD) is primarily characterized by the loss of dopaminergic cells and atrophy in subcortical regions. However, the impact of these pathological changes on large‐scale dynamic integration and segregation of the cortex are not well understood. In this study, we investigated the effect of subcortical dysfunction on cortical dynamics and cognition in PD. Spatiotemporal dynamics of the phase interactions of resting‐state blood‐oxygen‐level‐dependent signals in 159 PD patients and 152 normal control (NC) individuals were estimated. The relationships between subcortical atrophy, subcortical–cortical fiber connectivity impairment, cortical synchronization/metastability, and cognitive performance were then assessed. We found that cortical synchronization and metastability in PD patients were significantly decreased. To examine whether this is an effect of dopamine depletion, we investigated 45 PD patients both ON and OFF dopamine replacement therapy, and found that cortical synchronization and metastability are significantly increased in the ON state. The extent of cortical synchronization and metastability in the OFF state reflected cognitive performance and mediates the difference in cognitive performance between the PD and NC groups. Furthermore, both the thalamic volume and thalamocortical fiber connectivity had positive relationships with cortical synchronization and metastability in the dopaminergic OFF state, and mediate the difference in cortical synchronization between the PD and NC groups. In addition, thalamic volume also reflected cognitive performance, and cortical synchronization/metastability mediated the relationship between thalamic volume and cognitive performance in PD patients. Together, these results highlight that subcortical dysfunction and reduced dopamine levels are responsible for decreased cortical synchronization and metastability, further affecting cognitive performance in PD. This might lead to biomarkers being identified that can predict if a patient is at risk of developing dementia

Approximate Crank–Nicolson Algorithm with Higher-Order PML Implementation for Plasma Simulation in Open Region Problems

By incorporating the higher-order concept with the perfectly matched later (PML) scheme, unconditionally stable approximate Crank–Nicolson algorithm is proposed for plasma simulation in open region problems. More precisely, the proposed implementation is based on the CN Direct-Splitting (CNDS) procedure for the finite-difference time-domain (FDTD) unmagnetized plasma simulation. The unmagnetized plasma can be regarded as frequency-dependent media which can be calculated by the piecewise linear recursive convolution (PLRC) method. The proposed implementation shows the advantages of higher-order concept, CNDS procedure, and PLRC method in terms of improved absorbing performance, enhanced computational efficiency, and outstanding calculation accuracy. Numerical examples are introduced to indicate the effectiveness and efficiency. It can be concluded from results that the proposed scheme shows considerable efficiency, accuracy, absorption, and unconditional stability