Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues

Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is a great challenging task. Existing studies focus on building a context-response matching model with various neural architectures or PLMs and typically learning with a single response prediction task. These approaches overlook many potential training signals contained in dialogue data, which might be beneficial for context understanding and produce better features for response prediction. Besides, the response retrieved from existing dialogue systems supervised by the conventional way still faces some critical challenges, including incoherence and inconsistency. To address these issues, in this paper, we propose learning a context-response matching model with auxiliary self-supervised tasks designed for the dialogue data based on pre-trained language models. Specifically, we introduce four self-supervised tasks including next session prediction, utterance restoration, incoherence detection and consistency discrimination, and jointly train the PLM-based response selection model with these auxiliary tasks in a multi-task manner. By this means, the auxiliary tasks can guide the learning of the matching model to achieve a better local optimum and select a more proper response. Experiment results on two benchmarks indicate that the proposed auxiliary self-supervised tasks bring significant improvement for multi-turn response selection in retrieval-based dialogues, and our model achieves new state-of-the-art results on both datasets.Comment: 10 page

Non-invasive Amide Proton Transfer Imaging and ZOOM Diffusion-Weighted Imaging in Differentiating Benign and Malignant Thyroid Micronodules

Background: Pre-operative non-invasive differentiation of benign and malignant thyroid nodules is difficult for doctors. This study aims to determine whether amide proton transfer (APT) imaging and zonally oblique multi-slice (ZOOM) diffusion-weighted imaging (DWI) can provide increased accuracy in differentiating benign and malignant thyroid nodules.Methods: This retrospective study was approved by the institutional review board and included 60 thyroid nodules in 50 patients. All of the nodules were classified as malignant (n = 21) or benign (n = 39) based on pathology. It was meaningful to analyze the APT and apparent diffusion coefficient (ADC) values of the two groups by independent t-test to identify the benign and malignant thyroid nodules. The relationship between APT and ZOOM DWI was explored through Pearson correlation analysis. The diagnostic efficacy of APT and ZOOM DWI in determining if thyroid nodules were benign or malignant was compared using receiver operating characteristic (ROC) curve analysis.Results: The mean APTw value of the benign nodules was 2.99 ± 0.79, while that of the malignant nodules was 2.14 ± 0.73. Additionally, there was a significant difference in the APTw values of the two groups (P < 0.05). The mean ADC value of the benign nodules was 1.84 ± 0.41, and was significantly different from that of the malignant nodules, which was 1.21 ± 0.19 (P < 0.05). Scatter point and Pearson test showed a moderate positive correlation between the APT and ADC values (P < 0.05). The ROC curve showed that the area under the curve (AUC) value of ZOOM DWI (AUC = 0.937) was greater than that of APT (AUC = 0.783) (P = 0.028).Conclusion: APT and ZOOM DWI imaging improved the accuracy of distinguishing between benign and malignant thyroid nodules. ZOOM DWI is superior to APTw imaging (Z = 2.198, P < 0.05)

Ectopic tissue engineered ligament with silk collagen scaffold for ACL regeneration: A preliminary study

Anterior cruciate ligament (ACL) reconstruction remains a formidable clinical challenge because of the lack of vascularization and adequate cell numbers in the joint cavity. In this study, we developed a novel strategy to mimic the early stage of repair in vivo, which recapitulated extra-articular inflammatory response to facilitate the early ingrowth of blood vessels and cells. A vascularized ectopic tissue engineered ligament (ETEL) with silk collagen scaffold was developed and then transferred to reconstruct the ACL in rabbits without interruption of perfusion. At 2 weeks after ACL reconstruction, more well-perfused cells and vessels were found in the regenerated ACL with ETEL, which decreased dramatically at the 4 and 12 week time points with collagen deposition and maturation. ACL treated with ETEL exhibited more mature ligament structure and enhanced ligament-bone healing post-reconstructive surgery at 4 and 12 weeks, as compared with the control group. In addition, the ETEL group was demonstrated to have higher modulus and stiffness than the control group significantly at 12 weeks post-reconstructive surgery. In conclusion, our results demonstrated that the ETEL can provide sufficient vascularity and cellularity during the early stages of healing, and subsequently promote ACL regeneration and ligament-bone healing, suggesting its clinic use as a promising therapeutic modality. Statement of Significance Early inflammatory cell infiltration, tissue and vessels ingrowth were significantly higher in the extra articular implanted scaffolds than theses in the joint cavity. By mimicking the early stages of wound repair, which provided extra-articular inflammatory stimulation to facilitate the early ingrowth of blood vessels and cells, a vascularized ectopic tissue engineered ligament (ETEL) with silk collagen scaffold was constructed by subcutaneous implantation for 2 weeks. The fully vascularized TE ligament was then transferred to rebuild ACL without blood perfusion interruption, and was demonstrated to exhibit improved ACL regeneration, bone tunnel healing and mechanical properties. (C) 2017 Published by Elsevier Ltd on behalf of Acta Materialia Inc

Gesture recognition system based on CNN-IndRNN and OpenBCI

Surface electromyography (sEMG), as a key technology of non-invasive muscle computer interface, is an important method of human-computer interaction. We proposed a CNN-IndRNN (Convolutional Neural Network-Independent Recurrent Neural Network) hybrid algorithm to analyse sEMG signals and classify hand gestures. Ninapro’s dataset of 10 volunteers was used to develop the model, and by using only one time-domain feature (root mean square of sEMG), an average accuracy of 87.43% on 18 gestures is achieved. The proposed algorithm obtains a state-of-the-art classification performance with a significantly reduced model. In order to verify the robustness of the CNN-IndRNN model, a compact real¬time recognition system was constructed. The system was based on open-source hardware (OpenBCI) and a custom Python-based software. Results show that the 10-subject rock-paper-scissors gesture recognition accuracy reaches 99.1%

Non-Invasive Muscular Atrophy Causes Evaluation for Limb Fracture Based on Flexible Surface Electromyography System

Muscular atrophy after limb fracture is a frequently occurring complication with multiple causes. Different treatments and targeted rehabilitation procedures should be carried out based on the causes. However, bedside evaluation methods are invasive in clinical practice nowadays, lacking reliable non-invasive methods. In this study, we propose a non-invasive flexible surface electromyography system with machine learning algorithms to distinguish nerve-injury and limb immobilization-related atrophy. First, a flexible surface electromyography sensor was designed and verified by in vitro tests for its robustness and flexibility. Then, in vivo tests on rats proved the reliability compared with the traditional invasive diagnosis method. Finally, this system was applied for the diagnosis of muscular atrophy in 10 patients. The flexible surface electromyography sensor can achieve a max strain of 12.0%, which ensures close contact with the skin. The in vivo tests on rats show great comparability with the traditional invasive diagnosis method. It can achieve a high specificity of 95.28% and sensitivity of 98.98%. Application on patients reaches a relatively high specificity of 89.44% and sensitivity of 91.94%. The proposed painless surface electromyography system can be an easy and accurate supplementary for bedside muscular atrophy causes evaluation, holding excellent contact with the body

Table_1_Integrated analysis reveals crosstalk between pyroptosis and immune regulation in renal fibrosis.xlsx

PurposeThe pathogenesis of renal fibrosis (RF) involves intricate interactions between profibrotic processes and immune responses. This study aimed to explore the potential involvement of the pyroptosis signaling pathway in immune microenvironment regulation within the context of RF. Through comprehensive bioinformatics analysis and experimental validation, we investigated the influence of pyroptosis on the immune landscape in RF.MethodsWe obtained RNA-seq datasets from Gene Expression Omnibus (GEO) databases and identified Pyroptosis-Associated Regulators (PARs) through literature reviews. Systematic evaluation of alterations in 27 PARs was performed in RF and normal kidney samples, followed by relevant functional analyses. Unsupervised cluster analysis revealed distinct pyroptosis modification patterns. Using single-sample gene set enrichment analysis (ssGSEA), we examined the correlation between pyroptosis and immune infiltration. Hub regulators were identified via weighted gene coexpression network analysis (WGCNA) and further validated in a single-cell RNA-seq dataset. We also established a unilateral ureteral obstruction-induced RF mouse model to verify the expression of key regulators at the mRNA and protein levels.ResultsOur comprehensive analysis revealed altered expression of 19 PARs in RF samples compared to normal samples. Five hub regulators, namely PYCARD, CASP1, AIM2, NOD2, and CASP9, exhibited potential as biomarkers for RF. Based on these regulators, a classifier capable of distinguishing normal samples from RF samples was developed. Furthermore, we identified correlations between immune features and PARs expression, with PYCARD positively associated with regulatory T cells abundance in fibrotic tissues. Unsupervised clustering of RF samples yielded two distinct subtypes (Subtype A and Subtype B), with Subtype B characterized by active immune responses against RF. Subsequent WGCNA analysis identified PYCARD, CASP1, and NOD2 as hub PARs in the pyroptosis modification patterns. Single-cell level validation confirmed PYCARD expression in myofibroblasts, implicating its significance in the stress response of myofibroblasts to injury. In vivo experimental validation further demonstrated elevated PYCARD expression in RF, accompanied by infiltration of Foxp3+ regulatory T cells.ConclusionsOur findings suggest that pyroptosis plays a pivotal role in orchestrating the immune microenvironment of RF. This study provides valuable insights into the pathogenesis of RF and highlights potential targets for future therapeutic interventions.</p

DataSheet_1_Integrated analysis reveals crosstalk between pyroptosis and immune regulation in renal fibrosis.docx

PurposeThe pathogenesis of renal fibrosis (RF) involves intricate interactions between profibrotic processes and immune responses. This study aimed to explore the potential involvement of the pyroptosis signaling pathway in immune microenvironment regulation within the context of RF. Through comprehensive bioinformatics analysis and experimental validation, we investigated the influence of pyroptosis on the immune landscape in RF.MethodsWe obtained RNA-seq datasets from Gene Expression Omnibus (GEO) databases and identified Pyroptosis-Associated Regulators (PARs) through literature reviews. Systematic evaluation of alterations in 27 PARs was performed in RF and normal kidney samples, followed by relevant functional analyses. Unsupervised cluster analysis revealed distinct pyroptosis modification patterns. Using single-sample gene set enrichment analysis (ssGSEA), we examined the correlation between pyroptosis and immune infiltration. Hub regulators were identified via weighted gene coexpression network analysis (WGCNA) and further validated in a single-cell RNA-seq dataset. We also established a unilateral ureteral obstruction-induced RF mouse model to verify the expression of key regulators at the mRNA and protein levels.ResultsOur comprehensive analysis revealed altered expression of 19 PARs in RF samples compared to normal samples. Five hub regulators, namely PYCARD, CASP1, AIM2, NOD2, and CASP9, exhibited potential as biomarkers for RF. Based on these regulators, a classifier capable of distinguishing normal samples from RF samples was developed. Furthermore, we identified correlations between immune features and PARs expression, with PYCARD positively associated with regulatory T cells abundance in fibrotic tissues. Unsupervised clustering of RF samples yielded two distinct subtypes (Subtype A and Subtype B), with Subtype B characterized by active immune responses against RF. Subsequent WGCNA analysis identified PYCARD, CASP1, and NOD2 as hub PARs in the pyroptosis modification patterns. Single-cell level validation confirmed PYCARD expression in myofibroblasts, implicating its significance in the stress response of myofibroblasts to injury. In vivo experimental validation further demonstrated elevated PYCARD expression in RF, accompanied by infiltration of Foxp3+ regulatory T cells.ConclusionsOur findings suggest that pyroptosis plays a pivotal role in orchestrating the immune microenvironment of RF. This study provides valuable insights into the pathogenesis of RF and highlights potential targets for future therapeutic interventions.</p