Temporal Modeling Matters: A Novel Temporal Emotional Modeling Approach for Speech Emotion Recognition

Speech emotion recognition (SER) plays a vital role in improving the interactions between humans and machines by inferring human emotion and affective states from speech signals. Whereas recent works primarily focus on mining spatiotemporal information from hand-crafted features, we explore how to model the temporal patterns of speech emotions from dynamic temporal scales. Towards that goal, we introduce a novel temporal emotional modeling approach for SER, termed Temporal-aware bI-direction Multi-scale Network (TIM-Net), which learns multi-scale contextual affective representations from various time scales. Specifically, TIM-Net first employs temporal-aware blocks to learn temporal affective representation, then integrates complementary information from the past and the future to enrich contextual representations, and finally, fuses multiple time scale features for better adaptation to the emotional variation. Extensive experimental results on six benchmark SER datasets demonstrate the superior performance of TIM-Net, gaining 2.34% and 2.61% improvements of the average UAR and WAR over the second-best on each corpus. The source code is available at https://github.com/Jiaxin-Ye/TIM-Net_SER.Comment: Accepted by ICASSP 202

Diagnosis of T-cell-mediated kidney rejection by biopsy-based proteomic biomarkers and machine learning

BackgroundBiopsy-based diagnosis is essential for maintaining kidney allograft longevity by ensuring prompt treatment for graft complications. Although histologic assessment remains the gold standard, it carries significant limitations such as subjective interpretation, suboptimal reproducibility, and imprecise quantitation of disease burden. It is hoped that molecular diagnostics could enhance the efficiency, accuracy, and reproducibility of traditional histologic methods.MethodsQuantitative label-free mass spectrometry analysis was performed on a set of formalin-fixed, paraffin-embedded (FFPE) biopsies from kidney transplant patients, including five samples each with diagnosis of T-cell-mediated rejection (TCMR), polyomavirus BK nephropathy (BKPyVN), and stable (STA) kidney function control tissue. Using the differential protein expression result as a classifier, three different machine learning algorithms were tested to build a molecular diagnostic model for TCMR.ResultsThe label-free proteomics method yielded 800-1350 proteins that could be quantified with high confidence per sample by single-shot measurements. Among these candidate proteins, 329 and 467 proteins were defined as differentially expressed proteins (DEPs) for TCMR in comparison with STA and BKPyVN, respectively. Comparing the FFPE quantitative proteomics data set obtained in this study using label-free method with a data set we previously reported using isobaric labeling technology, a classifier pool comprised of features from DEPs commonly quantified in both data sets, was generated for TCMR prediction. Leave-one-out cross-validation result demonstrated that the random forest (RF)-based model achieved the best predictive power. In a follow-up blind test using an independent sample set, the RF-based model yields 80% accuracy for TCMR and 100% for STA. When applying the established RF-based model to two public transcriptome datasets, 78.1%-82.9% sensitivity and 58.7%-64.4% specificity was achieved respectively.ConclusionsThis proof-of-principle study demonstrates the clinical feasibility of proteomics profiling for FFPE biopsies using an accurate, efficient, and cost-effective platform integrated of quantitative label-free mass spectrometry analysis with a machine learning-based diagnostic model. It costs less than 10 dollars per test

A Distance Transformation Deep Forest Framework With Hybrid-Feature Fusion for CXR Image Classification

Detecting pneumonia, especially coronavirus disease 2019 (COVID-19), from chest X-ray (CXR) images is one of the most effective ways for disease diagnosis and patient triage. The application of deep neural networks (DNNs) for CXR image classification is limited due to the small sample size of the well-curated data. To tackle this problem, this article proposes a distance transformation-based deep forest framework with hybrid-feature fusion (DTDF-HFF) for accurate CXR image classification. In our proposed method, hybrid features of CXR images are extracted in two ways: hand-crafted feature extraction and multigrained scanning. Different types of features are fed into different classifiers in the same layer of the deep forest (DF), and the prediction vector obtained at each layer is transformed to form distance vector based on a self-adaptive scheme. The distance vectors obtained by different classifiers are fused and concatenated with the original features, then input into the corresponding classifier at the next layer. The cascade grows until DTDF-HFF can no longer gain benefits from the new layer. We compare the proposed method with other methods on the public CXR datasets, and the experimental results show that the proposed method can achieve state-of-the art (SOTA) performance. The code will be made publicly available at https://github.com/hongqq/DTDF-HFF

3D vasculature segmentation using localized hybrid level-set method

Background: Intensity inhomogeneity occurs in many medical images, especially in vessel images. Overcoming the difficulty due to image inhomogeneity is crucial for the segmentation of vessel image. Methods: This paper proposes a localized hybrid level-set method for the segmentation of 3D vessel image. The proposed method integrates both local region information and boundary information for vessel segmentation, which is essential for the accurate extraction of tiny vessel structures. The local intensity information is firstly embedded into a region-based contour model, and then incorporated into the level-set formulation of the geodesic active contour model. Compared with the preset global threshold based method, the use of automatically calculated local thresholds enables the extraction of the local image information, which is essential for the segmentation of vessel images. Results: Experiments carried out on the segmentation of 3D vessel images demonstrate the strengths of using locally specified dynamic thresholds in our level-set method. Furthermore, both qualitative comparison and quantitative validations have been performed to evaluate the effectiveness of our proposed model. Conclusions: Experimental results and validations demonstrate that our proposed model can achieve more promising segmentation results than the original hybrid method does

High precision implicit modeling for patient-specific coronary arteries

High precision geometric reconstruction of patient-specific coronary arteries plays a crucial role in visual diagnosis, treatment decision-making, and the evaluation of the therapeutic effect of interventions in coronary artery diseases. It is also a fundamental task and a basic requirement in the numerical simulation of coronary blood flow dynamics. In this paper, a new implicit modeling technique for the geometric reconstruction of patient-specific coronary arteries has been developed. In the proposed method, the coronary arteries geometry is reconstructed segment by segment using radial basis functions with ellipsoid constraint from the point cloud obtained with a volumetric vascular image segmentation method, and the individually reconstructed coronary branches are then combined using a shape-preserving implicit blending operation to form a complete coronary artery surface. The experiment results and validations indicate that the reconstructed vascular shapes are of high smoothness and faithfulness

Accurate geometry modeling of vasculatures using implicit fitting with 2D radial basis functions

Accurate vascular geometry modeling is an essential task in computer assisted vascular surgery and therapy. This paper presents a vessel cross-section based implicit vascular modeling technique, which represents a vascular surface as a set of locally fitted implicit surfaces. In the proposed method, a cross-section based technique is employed to extract from each cross-section of the vascular surface a set of points, which are then fitted with an implicit curve represented as 2D radial basis functions. All these implicitly represented cross-section curves are then being considered as 3D cylindrical objects and combined together using a certain partial shape-preserving spline to build a complete vessel branch; different vessel branches are then blended using a extended smooth maximum function to construct the complete vascular tree. Experimental results show that the proposed method can correctly represent the morphology and topology of vascular structures with high level of smoothness. Both qualitative comparison with other methods and quantitative validations to the proposed method have been performed to verify the accuracy and smoothness of the generated vascular geometric models