Learning Sparse Neural Networks with Identity Layers

The sparsity of Deep Neural Networks is well investigated to maximize the performance and reduce the size of overparameterized networks as possible. Existing methods focus on pruning parameters in the training process by using thresholds and metrics. Meanwhile, feature similarity between different layers has not been discussed sufficiently before, which could be rigorously proved to be highly correlated to the network sparsity in this paper. Inspired by interlayer feature similarity in overparameterized models, we investigate the intrinsic link between network sparsity and interlayer feature similarity. Specifically, we prove that reducing interlayer feature similarity based on Centered Kernel Alignment (CKA) improves the sparsity of the network by using information bottleneck theory. Applying such theory, we propose a plug-and-play CKA-based Sparsity Regularization for sparse network training, dubbed CKA-SR, which utilizes CKA to reduce feature similarity between layers and increase network sparsity. In other words, layers of our sparse network tend to have their own identity compared to each other. Experimentally, we plug the proposed CKA-SR into the training process of sparse network training methods and find that CKA-SR consistently improves the performance of several State-Of-The-Art sparse training methods, especially at extremely high sparsity. Code is included in the supplementary materials

Perovskite light-emitting diodes toward commercial full-colour displays: progress and key technical obstacles

Metal-halide perovskite light-emitting diodes (PeLEDs) possess wide colour gamut, high luminescence efficiency, and low-cost synthesis, making them a promising photonic source for next-generation display applications. Since the first room-temperature emission PeLED was demonstrated in 2014, their performance has improved rapidly within a few years, leading to considerable attention from academia and industry. In this review, we discuss the primary technical bottlenecks of PeLEDs for commercial display applications, including large-area PeLED preparation, patterning strategies, and flexible PeLED devices. We review the technical approaches for achieving these targets and highlight the current challenges while providing an outlook for these perovskite materials and PeLED devices to meet the requirements of the next-generation high-colour-purity full-colour display market

Higher Carbohydrate Antigen 125 Levels Are Associated with Increased Risk of Coronary Heart Disease in Elderly Chinese: A Population-Based Case-Control Study

Background: High carbohydrate antigen 125 (CA-125) level was reported to be associated with some cardiac dysfunctions, such as chronic heart failure, but the relationship between CA-125 level and coronary heart disease (CHD) risk remains unclear. The aim of this study was to explore the potential association in a Chinese older population. Methods: In a population-based case-control study conducted in a Chinese older population, serum CA-125 levels were measured in 1177 diagnosed CHD patients and 3531 age and sex matched control subjects without CHD. Results: Serum CA-125 level was significantly higher in CHD patients than controls (P < 0.001) with adjustment for age, gender, smoking, drinking, BMI, physical activity, hypertension, dyslipidemia, diabetes mellitus, medication history and family history of CHD and myocardial infarction. CHD risk was doubled (OR: 2.10, 95%CI: 1.69-2.60) among subjects in the highest quartile compared to those in the lowest quartile of CA-125 level (Ptrend < 0.001). Furthermore, CA-125 levels were associated with CHD risks in subjects with age over 60 years (OR: 2.19, 95%CI: 1.75-2.73), current smokers (OR: 2.29, 95%CI: 1.50-3.49), current drinkers (OR: 2.35, 95%CI: 1.57-3.53) and subjects with hypertension (OR: 2.04, 95%CI: 1.71-2.43). Conclusions: Elevated serum CA-125 level might be associated with increased risk of coronary heart disease in the Chinese older population. Further investigations are needed to identify the possible biological role of CA-125 in CHD development in the future

Different Physical Activity Subtypes and Risk of Metabolic Syndrome in Middle-Aged and Older Chinese People

Background: The prevalence of metabolic syndrome (MetS) is growing rapidly in China. Tai chi and dancing are common types of exercise among middle-aged and elderly Chinese. It remains unclear whether these activities are associated with a lower risk of MetS. Methodology/Principal Findings A total of 15,514 individuals (6,952 men, 8,562 women) aged 50 to 70 years from the Dongfeng-Tongji Cohort in Shiyan, China participated in a cross-sectional study. Physical activity and other lifestyle factors were assessed with semi-structured questionnaires during face-to-face interviews. MetS was defined by the current National Cholesterol Education Program/Adult treatment Panel III criteria for Asian Americans. The prevalence of MetS was 33.2% in the study population. In the multivariable-adjusted logistic regression analyses, total physical activity levels were monotonically associated with a lower odds of MetS [OR 0.75 comparing extreme quintiles, 95% confidence interval (CI) 0.66–0.86, P<0.001]. Compared with non-exercisers in a specific exercise type, jogging (OR 0.82, 95% CI 0.68–1.00, P = 0.046), tai chi (OR 0.72, 95% CI 0.60–0.88, P<0.001), and dancing (OR 0.56, 95% CI 0.47–0.67, P<0.001) were associated with significantly lower odds of MetS. Furthermore, each 1–h/week increment in tai chi and dancing was associated with a 5% (95% CI 2%–9%) and a 9% (95% CI 6%, 12%) lower risk of MetS. Conclusions/Significance: Jogging, tai chi and dancing are associated with a significantly lower risk of having MetS in middle-aged and older Chinese. Future intervention studies should consider the role of jogging, tai chi and dancing in preventing MetS

Genome-wide analysis of the Tritipyrum WRKY gene family and the response of TtWRKY256 in salt-tolerance

IntroductionThe transcription factor WRKY is widespread in the plant kingdom and plays a crucial role in diverse abiotic stress responses in plant species. Tritipyrum, an octoploid derived from an intergeneric cross between Triticum aestivum (AABBDD) and Thinopyrum elongatum (EE), is a valuable germplasm resource for introducing superior traits of Th. elongatum into T. aestivum. The recent release of the complete genome sequences of T. aestivum and Th. elongatum enabled us to investigate the organization and expression profiling of Tritipyrum WRKY genes across the entire genome.ResultsIn this study, 346 WRKY genes, from TtWRKY1 to TtWRKY346, were identified in Tritipyrum. The phylogenetic analysis grouped these genes into three subfamilies (I-III), and members of the same subfamilies shared a conserved motif composition. The 346 TtWRKY genes were dispersed unevenly across 28 chromosomes, with 218 duplicates. Analysis of synteny suggests that the WRKY gene family may have a common ancestor. Expression profiles derived from transcriptome data and qPCR demonstrated that 54 TtWRKY genes exhibited relatively high levels of expression across various salt stresses and recovery treatments. Tel1E01T143800 (TtWRKY256) is extremely sensitive to salt stress and is on the same evolutionary branch as the salt-tolerant A. thaliana genes AtWRKY25 and AtWRKY33. From 'Y1805', the novel AtWRKY25 was cloned. The Pearson correlation analysis identified 181 genes that were positively correlated (R&gt;0.9) with the expression of TtWRKY256, and these genes were mainly enriched in metabolic processes, cellular processes, response to stimulus, biological regulation, and regulation of biological. Subcellular localization and qRT-PCR analysis revealed that TtWRKY256 was located in the nucleus and was highly expressed in roots, stems, and leaves under salt stress.DiscussionThe above results suggest that TtWRKY256 may be associated with salt stress tolerance in plants and may be a valuable alien gene for improving salt tolerance in wheat

Low trap-state density and long carrier diffusion in organolead trihalide perovskite single crystals

The fundamental properties and ultimate performance limits of organolead trihalide MAPbX3 (MA = CH3NH3 +; X = Br– or I–) perovskites remain obscured by extensive disorder in polycrystalline MAPbX3 films. We report an antisolvent vapor-assisted crystallization approach that enables us to create sizable crack-free MAPbX3 single crystals with volumes exceeding 100 cubic millimeters. These large single crystals enabled a detailed characterization of their optical and charge transport characteristics. We observed exceptionally low trap-state densities on the order of 109 to 1010 per cubic centimeter in MAPbX3 single crystals (comparable to the best photovoltaic-quality silicon) and charge carrier diffusion lengths exceeding 10 micrometers. These results were validated with density functional theory calculations

Genome-wide association study on serum alkaline phosphatase levels in a Chinese population

Background: Serum alkaline phosphatase (ALP) is a complex phenotype influenced by both genetic and environmental factors. Recent Genome-Wide Association Studies (GWAS) have identified several loci affecting ALP levels; however, such studies in Chinese populations are limited. We performed a GWAS analyzing the association between 658,288 autosomal SNPs and serum ALP in 1,461 subjects, and replicated the top SNPs in an additional 8,830 healthy Chinese Han individuals. The interactions between significant locus and environmental factors on serum ALP levels were further investigated. Results: The association between ABO locus and serum ALP levels was replicated (P = 2.50 × 10-21, 1.12 × 10-56 and 2.82 × 10-27 for SNP rs8176720, rs651007 and rs7025162 on ABO locus, respectively). SNP rs651007 accounted for 2.15% of the total variance of serum ALP levels independently of the other 2 SNPs. When comparing our findings with previously published studies, ethnic differences were observed across populations. A significant interaction between ABO rs651007 and overweight and obesity was observed (FDR for interaction was 0.036); for individuals with GG genotype, those with normal weight and those who were overweight or obese have similar serum ALP concentrations; minor allele A of rs651007 remarkably reduced serum ALP levels, but this effect was attenuated in overweight and obese individuals. Conclusions: Our findings indicate that ABO locus is a major determinant for serum ALP levels in Chinese Han population. Overweight and obesity modifies the effect of ABO locus on serum ALP concentrations

A genome-wide association study identifies common variants influencing serum uric acid concentrations in a Chinese population

Background: Uric acid (UA) is a complex phenotype influenced by both genetic and environmental factors as well as their interactions. Current genome-wide association studies (GWASs) have identified a variety of genetic determinants of UA in Europeans; however, such studies in Asians, especially in Chinese populations remain limited. Methods: A two-stage GWAS was performed to identify single nucleotide polymorphisms (SNPs) that were associated with serum uric acid (UA) in a Chinese population of 12,281 participants (GWAS discovery stage included 1452 participants from the Dongfeng-Tongji cohort (DFTJ-cohort) and 1999 participants from the Fangchenggang Area Male Health and Examination Survey (FAMHES). The validation stage included another independent 8830 individuals from the DFTJ-cohort). Affymetrix Genome-Wide Human SNP Array 6.0 chips and Illumina Omni-Express platform were used for genotyping for DFTJ-cohort and FAMHES, respectively. Gene-environment interactions on serum UA levels were further explored in 10,282 participants from the DFTJ-cohort. Results: Briefly, we identified two previously reported UA loci of SLC2A9 (rs11722228, combined P = 8.98 × 10-31) and ABCG2 (rs2231142, combined P = 3.34 × 10-42). The two independent SNPs rs11722228 and rs2231142 explained 1.03% and 1.09% of the total variation of UA levels, respectively. Heterogeneity was observed across different populations. More importantly, both independent SNPs rs11722228 and rs2231142 were nominally significantly interacted with gender on serum UA levels (P for interaction = 4.0 × 10-2 and 2.0 × 10-2, respectively). The minor allele (T) for rs11722228 in SLC2A9 has greater influence in elevating serum UA levels in females compared to males and the minor allele (T) of rs2231142 in ABCG2 had stronger effects on serum UA levels in males than that in females. Conclusions: Two genetic loci (SLC2A9 and ABCG2) were confirmed to be associated with serum UA concentration. These findings strongly support the evidence that SLC2A9 and ABCG2 function in UA metabolism across human populations. Furthermore, we observed these associations are modified by gender

A tumor microenvironment-responsive micelle co-delivered radiosensitizer Dbait and doxorubicin for the collaborative chemo-radiotherapy of glioblastoma

Glioblastoma is rather recalcitrant to existing therapies and effective interventions are needed. Here we report a novel microenvironment-responsive micellar system (ch-K5(s-s)R8-An) for the co-delivery of the radiosensitizer Dbait and the chemotherapeutic doxorubicin (DOX) to glioblastoma. Accordingly, the ch-K5(s-s)R8-An/(Dbait-DOX) micelles plus radiotherapy (RT) treatment resulted in a high degree of apoptosis and DNA damage, which significantly reduced cell viability and proliferation capacity of U251 cells to 64.0% and 16.3%, respectively. The angiopep-2-modified micelles exhibited substantial accumulation in brain-localized U251 glioblastoma xenografts in mice compared to angiopep-2-lacking micelles. The ch-K5(s-s)R8-An/(Dbait-DOX) + RT treatment group exhibited the smallest tumor size and most profound tumor tissue injury in orthotopic U251 tumors, leading to an increase in median survival time of U251 tumor-bearing mice from 26 days to 56 days. The ch-K5(s-s)R8-An/(Dbait-DOX) micelles can be targeted to brain-localized U251 tumor xenografts and sensitize the tumor to chemotherapy and radiotherapy, thereby overcoming the inherent therapeutic challenges associated with malignant glioblastoma