Object Segmentation with Audio Context

Visual objects often have acoustic signatures that are naturally synchronized with them in audio-bearing video recordings. For this project, we explore the multimodal feature aggregation for video instance segmentation task, in which we integrate audio features into our video segmentation model to conduct an audio-visual learning scheme. Our method is based on existing video instance segmentation method which leverages rich contextual information across video frames. Since this is the first attempt to investigate the audio-visual instance segmentation, a novel dataset, including 20 vocal classes with synchronized video and audio recordings, is collected. By utilizing combined decoder to fuse both video and audio features, our model shows a slight improvements compared to the base model. Additionally, we managed to show the effectiveness of different modules by conducting extensive ablations.Comment: Research project for Introduction to Deep Learning (11785) at Carnegie Mellon Universit

Wear monitoring of diamond saw wire based on YOLOv5 and DeepSORT

In order to improve the efficiency and quality of diamond wire saw cutting and meet the demand of real-time monitoring of saw wire wear, a detection algorithm based on improved YOLOv5 was proposed. The algorithm combined coordinate attention mechanism and BiFPN module on the basis of YOLOv5. The detection accuracy, recall rate and average accuracy were increased by 1.7%, 3.7% and 3.2% respectively. Abrasive particles with different wear degrees can be effectively detected. Besides, the DeepSORT multi-target tracking algorithm was connected to set up a virtual detection line, count the number of abrasive particles with different wear degrees, and monitor the wear of diamond saw wire

Long noncoding RNA DGCR5 involves in tumorigenesis of esophageal squamous cell carcinoma via SRSF1-mediated alternative splicing of Mcl-1

Abstract Long noncoding RNAs (lncRNAs) emerge as essential roles in the regulation of alternative splicing (AS) in various malignancies. Serine- and arginine-rich splicing factor 1 (SRSF1)-mediated AS events are the most important molecular hallmarks in cancer. Nevertheless, the biological mechanism underlying tumorigenesis of lncRNAs correlated with SRSF1 in esophageal squamous cell carcinoma (ESCC) remains elusive. In this study, we found that lncRNA DiGeorge syndrome critical region gene 5 (DGCR5) was upregulated in ESCC clinical samples, which associated with poor prognosis. Through RNA interference and overexpression approaches, we confirmed that DGCR5 contributed to promote ESCC cell proliferation, migration, and invasion while inhibited apoptosis in vitro. Mechanistically, DGCR5 could directly bind with SRSF1 to increase its stability and thus stimulate alternative splicing events. Furthermore, we clarified that SRSF1 regulated the aberrant splicing of myeloid cell leukemia-1 (Mcl-1) and initiated a significant Mcl-1L (antiapoptotic) isoform switch, which contributed to the expression of the full length of Mcl-1. Moreover, the cell-derived xenograft (CDX) model was validated that DGCR5 could facilitate the tumorigenesis of ESCC in vivo. Collectively, our findings identified that the key biological role of lncRNA DGCR5 in alternative splicing regulation and emphasized DGCR5 as a potential biomarker and therapeutic target for ESCC