Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition

Recent years have witnessed great strides in self-supervised learning (SSL) on the speech processing. The SSL model is normally pre-trained on a great variety of unlabelled data and a large model size is preferred to increase the modeling capacity. However, this might limit its potential applications due to the expensive computation and memory costs introduced by the oversize model. Miniaturization for SSL models has become an important research direction of practical value. To this end, we explore the effective distillation of HuBERT-based SSL models for automatic speech recognition (ASR). First, in order to establish a strong baseline, a comprehensive study on different student model structures is conducted. On top of this, as a supplement to the regression loss widely adopted in previous works, a discriminative loss is introduced for HuBERT to enhance the distillation performance, especially in low-resource scenarios. In addition, we design a simple and effective algorithm to distill the front-end input from waveform to Fbank feature, resulting in 17% parameter reduction and doubling inference speed, at marginal performance degradation.Comment: Submitted to ICASSP 202

Modeling Anti-HIV-1 HSPC-Based Gene Therapy in Humanized Mice Previously Infected with HIV-1.

Investigations of anti-HIV-1 human hematopoietic stem/progenitor cell (HSPC)-based gene therapy have been performed by HIV-1 challenge after the engraftment of gene-modified HSPCs in humanized mouse models. However, the clinical application of gene therapy is to treat HIV-1-infected patients. Here, we developed a new method to investigate an anti-HIV-1 HSPC-based gene therapy in humanized mice previously infected with HIV-1. First, humanized mice were infected with HIV-1. When plasma viremia reached >107 copies/mL 3 weeks after HIV-1 infection, the mice were myeloablated with busulfan and transplanted with anti-HIV-1 gene-modified CD34+ HSPCs transduced with a lentiviral vector expressing two short hairpin RNAs (shRNAs) against CCR5 and HIV-1 long terminal repeat (LTR), along with human thymus tissue under the kidney capsule. Anti-HIV-1 vector-modified human CD34+ HSPCs successfully repopulated peripheral blood and lymphoid tissues in HIV-1 previously infected humanized mice. Anti-HIV-1 shRNA vector-modified CD4+ T lymphocytes showed selective advantage in HIV-1 previously infected humanized mice. This new method will be useful for investigations of anti-HIV-1 gene therapy when testing in a more clinically relevant experimental setting

Research progress on the impact of mineral surface roughness on particle-bubble interaction

Mineral surface roughness is an important factor affecting flotation efficiency. Surface roughness can affect the hydrophobicity of minerals, the adsorption of reagents, and the rupture of liquid films between particles and bubbles, resulting in a significant impact on the interaction process between particles and bubbles. However, there is currently a lack of systematic review work on the influence of roughness on particle-bubble interaction process. Therefore, the authors firstly reviewed the surface roughening modification techniques and roughness testing methods. Secondly, the influence of roughness on the particle-bubble interaction process was systematically discussed from four aspects: flotation kinetics, contact angle, formation time of triple-phase contact line, and interaction force between particles and bubbles. The concept of roughness scale was proposed for its importance in the research of particle-bubble interactions. Thirdly, based on the coupling mechanism between roughness scale and mineral surface hydrophobicity in the particle-bubble interaction process, the importance of mineral surface wetting state in the interaction process between rough surfaces and bubbles was emphasized. The reasons for the inconsistent research conclusions on the impact of roughness on contact angle and flotation performance were also analyzed and discussed. Finally, the conclusions were drawn through critical analysis and literature review, and the prospects for future research directions were outlined. This paper contributes to a better understanding of the influence of mineral surface roughness on the flotation process, and can provide a theoretical support for regulating mineral surface roughness to create favorable flotation conditions and improve the flotation efficiency and selectivity

Factors affecting HPV infection in U.S. and Beijing females: A modeling study

BackgroundHuman papillomavirus (HPV) infection is an important carcinogenic infection highly prevalent among many populations. However, independent influencing factors and predictive models for HPV infection in both U.S. and Beijing females are rarely confirmed. In this study, our first objective was to explore the overlapping HPV infection-related factors in U.S. and Beijing females. Secondly, we aimed to develop an R package for identifying the top-performing prediction models and build the predictive models for HPV infection using this R package.MethodsThis cross-sectional study used data from the 2009–2016 NHANES (a national population-based study) and the 2019 data on Beijing female union workers from various industries. Prevalence, potential influencing factors, and predictive models for HPV infection in both cohorts were explored.ResultsThere were 2,259 (NHANES cohort, age: 20–59 years) and 1,593 (Beijing female cohort, age: 20–70 years) participants included in analyses. The HPV infection rate of U.S. NHANES and Beijing females were, respectively 45.73 and 8.22%. The number of male sex partners, marital status, and history of HPV infection were the predominant factors that influenced HPV infection in both NHANES and Beijing female cohorts. However, condom application was not an independent influencing factor for HPV infection in both cohorts. R package Modelbest was established. The nomogram developed based on Modelbest package showed better performance than the nomogram which only included significant factors in multivariate regression analysis.ConclusionCollectively, despite the widespread availability of HPV vaccines, HPV infection is still prevalent. Compared with condom promotion, avoidance of multiple sexual partners seems to be more effective for preventing HPV infection. Nomograms developed based on Modelbest can provide improved personalized risk assessment for HPV infection. Our R package Modelbest has potential to be a powerful tool for future predictive model studies

Metabolic Disturbances Associated with Systemic Lupus Erythematosus

The metabolic disturbances that underlie systemic lupus erythematosus are currently unknown. A metabolomic study was executed, comparing the sera of 20 SLE patients against that of healthy controls, using LC/MS and GC/MS platforms. Validation of key differences was performed using an independent cohort of 38 SLE patients and orthogonal assays. SLE sera showed evidence of profoundly dampened glycolysis, Krebs cycle, fatty acid β oxidation and amino acid metabolism, alluding to reduced energy biogenesis from all sources. Whereas long-chain fatty acids, including the n3 and n6 essential fatty acids, were significantly reduced, medium chain fatty acids and serum free fatty acids were elevated. The SLE metabolome exhibited profound lipid peroxidation, reflective of oxidative damage. Deficiencies were noted in the cellular anti-oxidant, glutathione, and all methyl group donors, including cysteine, methionine, and choline, as well as phosphocholines. The best discriminators of SLE included elevated lipid peroxidation products, MDA, gamma-glutamyl peptides, GGT, leukotriene B4 and 5-HETE. Importantly, similar elevations were not observed in another chronic inflammatory autoimmune disease, rheumatoid arthritis. To sum, comprehensive profiling of the SLE metabolome reveals evidence of heightened oxidative stress, inflammation, reduced energy generation, altered lipid profiles and a pro-thrombotic state. Resetting the SLE metabolome, either by targeting selected molecules or by supplementing the diet with essential fatty acids, vitamins and methyl group donors offers novel opportunities for disease modulation in this disabling systemic autoimmune ailment

ABO Blood Group and the Risk of Hepatocellular Carcinoma: A Case-Control Study in Patients with Chronic Hepatitis B

BACKGROUND: Studies have observed an association between the ABO blood group and risk of certain malignancies. However, no studies of the association with hepatocellular carcinoma (HCC) risk are available. We conducted this hospital-based case-control study to examine the association with HCC in patients with chronic hepatitis B (CHB). METHODS: From January 2004 to December 2008, a total of 6275 consecutive eligible patients with chronic hepatitis B virus (HBV) infection were recruited. 1105 of them were patients with HBV-related HCC and 5,170 patients were CHB without HCC. Multivariate logistic regression models were used to investigate the association between the ABO blood group and HCC risk. RESULTS: Compared with subjects with blood type O, the adjusted odds ratio (AOR) for the association of those with blood type A and HCC risk was 1.39 [95% confidence interval (CI), 1.05-1.83] after adjusting for age, sex, type 2 diabetes, cirrhosis, hepatitis B e antigen, and HBV DNA. The associations were only statistically significant [AOR (95%CI) = 1.56(1.14-2.13)] for men, for being hepatitis B e antigen positive [AOR (95%CI) = 4.92(2.83-8.57)], for those with cirrhosis [AOR (95%CI), 1.57(1.12-2.20)], and for those with HBV DNA≤10(5)copies/mL [AOR (95%CI), 1.58(1.04-2.42)]. Stratified analysis by sex indicated that compared with those with blood type O, those with blood type B also had a significantly high risk of HCC among men, whereas, those with blood type AB or B had a low risk of HCC among women. CONCLUSIONS: The ABO blood type was associated with the risk of HCC in Chinese patients with CHB. The association was gender-related

Ferroptosis-Related Molecular Clusters and Diagnostic Model in Rheumatoid Arthritis

Rheumatoid arthritis (RA) is a systemic autoimmune disease characterized by synovitis, joint damage and deformity. A newly described type of cell death, ferroptosis, has an important role in the pathogenesis of RA. However, the heterogeneity of ferroptosis and its association with the immune microenvironment in RA remain unknown. Synovial tissue samples from 154 RA patients and 32 healthy controls (HCs) were obtained from the Gene Expression Omnibus database. Twelve of twenty-six ferroptosis-related genes (FRGs) were differentially expressed between RA patients and HCs. Furthermore, the patterns of correlation among the FRGs were significantly different between the RA and HC groups. RA patients were classified into two distinct ferroptosis-related clusters, of which cluster 1 had a higher abundance of activated immune cells and a corresponding lower ferroptosis score. Enrichment analysis suggested that tumor necrosis factor-α signaling via nuclear factor-κB was upregulated in cluster 1. RA patients in cluster 1 responded better to anti-tumor necrosis factor (anti-TNF) therapy, which was verified by the GSE 198520 dataset. A diagnostic model to identify RA subtypes and immunity was constructed and verified, in which the area under the curve values in the training (70%) and validation (30%) cohorts were 0.849 and 0.810, respectively. This study demonstrated that there were two ferroptosis clusters in RA synovium that exhibited distinct immune profiles and ferroptosis sensitivity. Additionally, a gene scoring system was constructed to classify individual RA patients

Discharge Estimation for an Ungauged Inland River in an Arid Area Related to Anthropogenic Activities: A Case Study of Heihe River Basin, Northwestern China

In the arid areas, the discharge in some reaches is unsurveyed, which makes related works trapped. It is important to estimate a long-term discharge in an ungauged river using available fragmentary data including those on human activities. In this work, the authors proposed a procedure of monthly discharge estimation for an ungauged inland river based on spatiotemporally discontinuous information, such as water diversion for irrigation, water allocation planning, and statistical relations of discharge at different locations. A typical ungauged river reach of Heihe River in northwestern China was selected as a case study. Monthly discharge from 1991 to 2007 at one gauged section was estimated using this procedure to validate the procedure, and the results show its potential in estimating discharge for an ungauged area. Monthly discharge from 1979 to 2014 at four unmonitored sections was estimated using the same procedure, and the trend analysis was conducted to check the facticity of the estimated discharge. The annual and monthly trends could well describe the effects of anthropogenic activities on the flow at different sections. In general, the method is feasible to provide support pertaining to water management or eco-hydrological researches and could be easily extended to other similar places