SeACo-Paraformer: A Non-Autoregressive ASR System with Flexible and Effective Hotword Customization Ability

Hotword customization is one of the important issues remained in ASR field - it is of value to enable users of ASR systems to customize names of entities, persons and other phrases. The past few years have seen both implicit and explicit modeling strategies for ASR contextualization developed. While these approaches have performed adequately, they still exhibit certain shortcomings such as instability in effectiveness. In this paper we propose Semantic-augmented Contextual-Paraformer (SeACo-Paraformer) a novel NAR based ASR system with flexible and effective hotword customization ability. It combines the accuracy of the AED-based model, the efficiency of the NAR model, and the excellent performance in contextualization. In 50,000 hours industrial big data experiments, our proposed model outperforms strong baselines in customization and general ASR tasks. Besides, we explore an efficient way to filter large scale incoming hotwords for further improvement. The source codes and industrial models proposed and compared are all opened as well as two hotword test sets.Comment: updated draf

Generative Model Watermarking Based on Human Visual System

Intellectual property protection of deep neural networks is receiving attention from more and more researchers, and the latest research applies model watermarking to generative models for image processing. However, the existing watermarking methods designed for generative models do not take into account the effects of different channels of sample images on watermarking. As a result, the watermarking performance is still limited. To tackle this problem, in this paper, we first analyze the effects of embedding watermark information on different channels. Then, based on the characteristics of human visual system (HVS), we introduce two HVS-based generative model watermarking methods, which are realized in RGB color space and YUV color space respectively. In RGB color space, the watermark is embedded into the R and B channels based on the fact that HVS is more sensitive to G channel. In YUV color space, the watermark is embedded into the DCT domain of U and V channels based on the fact that HVS is more sensitive to brightness changes. Experimental results demonstrate the effectiveness of the proposed work, which improves the fidelity of the model to be protected and has good universality compared with previous methods.Comment: https://scholar.google.com/citations?user=IdiF7M0AAAAJ&hl=e

Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation

The ability to scene understanding in adverse visual conditions, e.g., nighttime, has sparked active research for RGB-Thermal (RGB-T) semantic segmentation. However, it is essentially hampered by two critical problems: 1) the day-night gap of RGB images is larger than that of thermal images, and 2) the class-wise performance of RGB images at night is not consistently higher or lower than that of thermal images. we propose the first test-time adaptation (TTA) framework, dubbed Night-TTA, to address the problems for nighttime RGBT semantic segmentation without access to the source (daytime) data during adaptation. Our method enjoys three key technical parts. Firstly, as one modality (e.g., RGB) suffers from a larger domain gap than that of the other (e.g., thermal), Imaging Heterogeneity Refinement (IHR) employs an interaction branch on the basis of RGB and thermal branches to prevent cross-modal discrepancy and performance degradation. Then, Class Aware Refinement (CAR) is introduced to obtain reliable ensemble logits based on pixel-level distribution aggregation of the three branches. In addition, we also design a specific learning scheme for our TTA framework, which enables the ensemble logits and three student logits to collaboratively learn to improve the quality of predictions during the testing phase of our Night TTA. Extensive experiments show that our method achieves state-of-the-art (SoTA) performance with a 13.07% boost in mIoU

Small-molecule activation of lysosomal TRP channels ameliorates Duchenne muscular dystrophy in mouse models

Duchenne muscular dystrophy (DMD) is a devastating disease caused by mutations in dystrophin that compromise sarcolemma integrity. Currently, there is no treatment for DMD. Mutations in transient receptor potential mucolipin 1 (ML1), a lysosomal Ca2+ channel required for lysosomal exocytosis, produce a DMD-like phenotype. Here, we show that transgenic overexpression or pharmacological activation of ML1 in vivo facilitates sarcolemma repair and alleviates the dystrophic phenotypes in both skeletal and cardiac muscles of mdx mice (a mouse model of DMD). Hallmark dystrophic features of DMD, including myofiber necrosis, central nucleation, fibrosis, elevated serum creatine kinase levels, reduced muscle force, impaired motor ability, and dilated cardiomyopathies, were all ameliorated by increasing ML1 activity. ML1-dependent activation of transcription factor EB (TFEB) corrects lysosomal insufficiency to diminish muscle damage. Hence, targeting lysosomal Ca2+ channels may represent a promising approach to treat DMD and related muscle diseases

Knowledge structure and hotspots research of glioma immunotherapy: a bibliometric analysis

BackgroundGlioma is the most common primary brain tumor. Traditional treatments for glioma include surgical resection, radiotherapy, chemotherapy, and bevacizumab therapy, but their efficacies are limited. Immunotherapy provides a new direction for glioma treatment. This study aimed to summarize the knowledge structure and research hotspots of glioma immunotherapy through a bibliometric analysis.MethodPublications pertaining to glioma immunotherapy published during the period from 1st January 1990 to 27th March 2023 were downloaded from the Web of Science Core Collection (WoSCC). Bibliometric analysis and visualization were performed using the CiteSpace, VOSviewer, Online Analysis Platform of Literature Metrology, and R software. The hotspots and prospects of glioma immunotherapy research were illustrated via analyzing the countries, institutions, journals, authors, citations and keywords of eligible publications.ResultsA total of 1,929 publications pertaining to glioma immunotherapy in 502 journals were identified as of 27th March 2023, involving 9,505 authors from 1,988 institutions in 62 countries. Among them were 1,285 articles and 644 reviews. Most of publications were produced by the United States. JOURNAL OF NEURO-ONCOLOGY published the majority of publications pertaining to glioma immunotherapy. Among the authors, Lim M contributed the largest number of publications. Through analyzing keyword bursts and co-cited references, immune-checkpoint inhibitors (ICIs) were identified as the research focus and hotspot.ConclusionUsing a bibliometric analysis, this study provided the knowledge structure and research hotspots in glioma immunotherapy research during the past 33 years, with ICIs staying in the current and future hotspot. Our findings may direct the research of glioma immunotherapy in the future

A review of the botany, ethnopharmacology, phytochemistry, analysis method and quality control, processing methods, pharmacological effects, pharmacokinetics and toxicity of codonopsis radix

Codonopsis Radix, a traditional Chinese medicine in China, has great medicinal and scientific value. Moreover, it can also be used as a health product in daily diet. This paper reviews the botany, ethnopharmacology, phytochemistry, analysis method and quality control, processing methods, pharmacological effects, pharmacokinetics and toxicity related to Codonopsis Radix. The information of Codonopsis Radix is obtained from scientific databases (such as Baidu Scholar, CNKI, Google Scholar, PubMed, Science Direct, Web of Science, and SciFinder Scholar), Chinese herbal classics, Chinese Pharmacopoeia, PhD and MSc dissertations, and so on. The chemical components mainly include alkaloids, alkynes and polyacetylenes, flavonoids, lignans, steroids, terpenoids, organic acids, volatile oils, saccharides and other components, which have a wide range of neuroprotective effects, protection of gastrointestinal mucosa and anti-ulcer, regulation of body immunity, anti-tumor, endocrine regulation, improvement of hematopoietic function, cardiovascular protection, anti-aging and antioxidant effects. In conclusion, this paper summarizes in depth the shortcomings of the current research on Codonopsis Radix and proposes corresponding solutions. At the same time, this paper provides theoretical support for further research on the biological function and potential clinical efficacy of Codonopsis Radix

Quantitative analysis of the developmental potential of cells and tissues based on evolutionary conservation of genes and regulatory regions

Objective·To study the relationship between evolution and the developmental process from the perspective of DNA sequence conservation, and explore their inherent principles.Methods·First, conservation rate (CR) was established by analyzing the conservation of amino acid sequences of coding genes in 100 species to quantify the evolutionary conservation of genes. The relationship between CR and developmental potential was verified by using the feature genes involved in embryonic stem cells pathways. Secondly, cell type-specific genes and their characteristics in conservation were studied by analyzing the RNA sequencing (RNA-seq) data of the three early germ layers (ectoderm, mesoderm and endoderm) and their corresponding mature organs (brain, heart, liver, etc). Then, chromatin immunoprecipitation sequencing (ChIP-seq) data of enhancer histone H3 acetylated at lysine 27 (H3K27ac) from early germ layers and mature organs were collected to search for enhancer sites and identify super enhancers in various cells and tissues by using the ROSE procedure. Functional enrichment and signaling pathway analysis of genes was used to examine the identity correlation between SEs-regulated genes and the corresponding cell characteristics, to clarify whether the SEs identified in this study were consistent with the characteristics reported in previous studies. Finally, PhastCons program was used to calculate the DNA conservation score (CS) of non-coding regulatory regions to study their relationship with developmental potential.Results·In the coding region of DNA, CR was successfully established to quantify the conservation of genes. The gene expression data of early germ layers and mature organs showed that the genes with higher conservation rate were more relevant to the stemness and early developmental process, and the differences between the tissues from early and late development could be distinguished by using CR. In the non-coding regions of DNA, it was found that the conservation of regulatory regions was also correlated with development. The CS of the SE sequences in the early developmental germ layers was significantly higher than that of the SE sequences in the corresponding mature organs. However, cell-specific typical enhancers (TEs) did not show such a trend.Conclusion·During the developmental process, CR of genes expressed in the coding region decreases, and CS of super-enhancer DNA in the non-coding region decreases

Prediction of ESRD in IgA Nephropathy Patients from an Asian Cohort: A Random Forest Model

Background/Aims: There is an increasing risk of end-stage renal disease (ESRD) among Asian people with immunoglobulin A nephropathy (IgAN). A computer-aided system for ESRD prediction in Asian IgAN patients has not been well studied. Methods: We retrospectively reviewed biopsy-proven IgAN patients treated at the Department of Nephrology of the Second Xiangya Hospital from January 2009 to November 2013. Demographic and clinicopathological data were obtained within 1 month of renal biopsy. A random forest (RF) model was employed to predict the ESRD status in IgAN patients. All cases were initially trained and validated, taking advantage of the out-of-bagging(OOB) error. Predictors used in the model were selected according to the Gini impurity index in the RF model and verified by logistic regression analysis. The area under the receiver operating characteristic(ROC) curve (AUC) and F-measure were used to evaluate the RF model. Results: A total of 262 IgAN patients were enrolled in this study with a median follow-up time of 4.66 years. The importance rankings of predictors of ESRD in the RF model were first obtained, indicating some of the most important predictors. Logistic regression also showed that these factors were statistically associated with ESRD status. We first trained an initial RF model using gender, age, hypertension, serum creatinine, 24-hour proteinuria and histological grading suggested by the Clinical Decision Support System for IgAN (CDSS, www.IgAN.net). This 6-predictor model achieved a F-measure of 0.8 and an AUC of 92.57%. By adding Oxford-MEST scores, this model outperformed the initial model with an improved AUC (96.1%) and F-measure (0.823). When C3 staining was incorporated, the AUC was 97.29% and F-measure increased to 0.83. Adding the estimated glomerular filtration rate (eGFR) improved the AUC to 95.45%. We also observed improved performance of the model with additional inputs of blood urea nitrogen (BUN), uric acid, hemoglobin and albumin. Conclusion: In addition to the predictors in the CDSS, Oxford-MEST scores, C3 staining and eGFR conveyed additional information for ESRD prediction in Chinese IgAN patients using a RF model