Learning Sparse Neural Networks with Identity Layers

The sparsity of Deep Neural Networks is well investigated to maximize the performance and reduce the size of overparameterized networks as possible. Existing methods focus on pruning parameters in the training process by using thresholds and metrics. Meanwhile, feature similarity between different layers has not been discussed sufficiently before, which could be rigorously proved to be highly correlated to the network sparsity in this paper. Inspired by interlayer feature similarity in overparameterized models, we investigate the intrinsic link between network sparsity and interlayer feature similarity. Specifically, we prove that reducing interlayer feature similarity based on Centered Kernel Alignment (CKA) improves the sparsity of the network by using information bottleneck theory. Applying such theory, we propose a plug-and-play CKA-based Sparsity Regularization for sparse network training, dubbed CKA-SR, which utilizes CKA to reduce feature similarity between layers and increase network sparsity. In other words, layers of our sparse network tend to have their own identity compared to each other. Experimentally, we plug the proposed CKA-SR into the training process of sparse network training methods and find that CKA-SR consistently improves the performance of several State-Of-The-Art sparse training methods, especially at extremely high sparsity. Code is included in the supplementary materials

HIV/AIDS prevalence and behaviour in drug users and pregnant women in Kashgar Prefecture: Case report

Second Generation sub-population HIV Surveillance was undertaken in Kashgar City and Shache County, Xinjiang, Peoples Republic of China between December 2003 and January 2004, targeting injecting and mixed method drug users and pregnant and postnatal women. The study aimed to determine the extent to which the epidemic is shifting from a concentrated stage to a more generalised epidemic. One hundred and forty two (142) exclusively injecting drug users (66) and mixed method drug users (injecting and non-injecting-76) participated in this survey. Eight hundred and two (802) pregnant and postnatal women participated in the survey. In Kashgar City and Shache County the serum prevalence of HIV amongst injecting drug users was 56.06%, for mixed method drug users 48.68% and 0.38% in pregnant women. In Shache County HIV infection rates were significantly lower in drug user groups and amongst pregnant and post-natal women, at 2.22% and 0% respectively. The behavioral survey indicated that 15% of injecting drug users have shared needles (however sero prevalence and knowledge in relation to access to clean needles and syringes suggests that this may not reflect the actual situation). Knowledge of prevention of transmission strategies (not sharing needles and condom utilisation) is similar between both groups at 60–70%. However it appears that this knowledge has not significantly impacted on behavior such as needle sharing and condom utilisation. In Kashgar City and Shache County there have been very few interventions to support HIV/AIDS prevention, care and control. The results from this survey will inform future directions and the development and implementation of targeted interventions including targeted information dissemination and harm reduction strategies. This survey was funded by the Xinjiang HIV/AIDS Prevention and Care Project, a bilateral project jointly implemented by the Government of the People's Republic of China and the Government of Australia

Associations of genetic variation in CASP3 gene with noise-induced hearing loss in a Chinese population: a case–control study

Abstract Background Noise-induced hearing loss (NIHL) is a complex disease caused by environmental and genetic risk factors. This study explored the relationship between the genetic variations in the CASP gene and the risk of developing NIHL among Chinese workers exposed to occupational noise. Methods A case–control study of 272 NIHL workers and 272 normal-hearing workers matched for age, sex and years of noise exposure was conducted. Fifteen single-nucleotide polymorphisms (SNP) in the CASP1, CASP3, CASP4, CASP5, CASP6, CASP8, CASP9, CASP10 and CASP14 genes were genotyped using the polymerase chain reaction–ligase detection reaction method. Using conditional logistic regression models, the adjusted odds ratios (ORs) and 95% confidence intervals (CIs) of genetic variations associated with NIHL risk were calculated. Results Two SNPs in the CASP3 gene were associated with NIHL risk. For rs1049216, TT genotype was associated with a decreased risk of NIHL (OR = 0.246, 95% CI = 0.069–0.886) when compared with the CC genotype. For rs6948, the AC and CC genotype were associated with a decreased NIHL risk (OR = 0.568, 95% CI = 0.352–0.916) compared with AA genotype. There were joint effects of working time and CASP3 polymorphisms on NIHL risk (P < 0.05). Conclusions Genetic variations in the CASP3 gene and the joint effects of working time and CASP3 polymorphisms may modify the risk of developing NIHL

Multi-stemming strategies of Quercus glauca in an evergreen broad-leaved forest:When and where

Aims: Multi-stemming supports plants' resilience to disturbances and then contributes to soil stabilization and forest function, especially in mountain habitats. Many questions remain about (i) the ontogenetic phase at which multiple stems can occur, (ii) how habitat drivers affect multi-stemming and (iii) whether ontogenetic phase and habitat drivers interact. We asked these questions for Quercus glauca (ring-cupped oak), the dominant species and sprouter across large warm-Temperate areas of Asia; its multi-stemmed trees reflect individual survival, population regeneration and forest ecosystem stability. Methods: In a 5-ha permanent plot of subtropical evergreen broad-leaved forest in eastern China, we examined the temporal patterns and spatial distribution of multi-stemmed trees of Q. glauca within 99 quadrats of 20 m × 20 m. Important Findings: There were three temporal modes for multi-stemming among the Q. glauca trees and most of them appeared to produce multiple stems from an early stage. Environmental disturbances related to slope convexity appear to be the main drivers of multi-stemming of Q. glauca. Moreover, the closer to the ridge, the earlier the multi-stemming occurs. Thus, also for other woody species in other forests and climate zones, ontogeny and environmental drivers promoting disturbance (not only geomorphology, but also extreme weather events, soil drought, fire), as well as soil fertility, need to be considered in combination to better understand multi-stemming and its consequences for community structure

Table_1_Plant life history strategies vary in subtropical forests with different disturbance histories: an assessment of biodiversity, biomass, and functional traits.docx

Disturbance alters environmental conditions in forests. Plants growing in forests with different disturbance histories in diverse environments may adopt varying life history strategies, but few studies focus on this effect. This study comprehensively investigated plant biodiversity, biomass, and functional traits in subtropical forests with two different disturbance histories in east China to explore differences in life history strategies. Biodiversity was slightly higher in disturbed compared to conserved forests. Significantly higher biomass was measured in conserved relative to disturbed evergreen broadleaved forests (P < 0.05). In conserved forests, leaf tissue density (LTD) was significantly higher and leaf thickness (LT), leaf dry matter content (LDMC), twig tissue density (TTD), twig dry matter content (TDMC), bark tissue density (BTD) and dry matter content (BDMC), and stem tissue density (STD) and dry matter content (SDMC) were significantly lower than in disturbed forests (P < 0.05). In terms of associated plant biodiversity, biomass, and functional traits, conserved forests adopted a resource acquisition strategy, reducing biodiversity and developing multiple functional traits such as high leaf area and specific leaf area and low LT, LDMC, TTD, TDMC, BTD, BDMC, STD, and SDMC to support a high biomass accumulation rate. Disturbed forests adopted a resource conservation strategy, enhancing biodiversity and developing converse trait combinations to lower the rate of biomass accumulation. A comprehensive investigation of plant biodiversity, biomass, and functional traits and subsequent assessment of plant life history strategies in conserved and disturbed forests will aid investigations of regional biodiversity and carbon reserves, contribute data to the TRY and Chinese plant trait databases, and improve ecological management and restoration efforts in east China.</p