125 research outputs found

    Background prior-based salient object detection via deep reconstruction residual

    Get PDF
    Detection of salient objects from images is gaining increasing research interest in recent years as it can substantially facilitate a wide range of content-based multimedia applications. Based on the assumption that foreground salient regions are distinctive within a certain context, most conventional approaches rely on a number of hand designed features and their distinctiveness measured using local or global contrast. Although these approaches have shown effective in dealing with simple images, their limited capability may cause difficulties when dealing with more complicated images. This paper proposes a novel framework for saliency detection by first modeling the background and then separating salient objects from the background. We develop stacked denoising autoencoders with deep learning architectures to model the background where latent patterns are explored and more powerful representations of data are learnt in an unsupervised and bottom up manner. Afterwards, we formulate the separation of salient objects from the background as a problem of measuring reconstruction residuals of deep autoencoders. Comprehensive evaluations on three benchmark datasets and comparisons with 9 state-of-the-art algorithms demonstrate the superiority of the proposed work

    A Comparative Study of Theoretical Graph Models for Characterizing Structural Networks of Human Brain

    Get PDF
    Previous studies have investigated both structural and functional brain networks via graph-theoretical methods. However, there is an important issue that has not been adequately discussed before: what is the optimal theoretical graph model for describing the structural networks of human brain? In this paper, we perform a comparative study to address this problem. Firstly, large-scale cortical regions of interest (ROIs) are localized by recently developed and validated brain reference system named Dense Individualized Common Connectivity-based Cortical Landmarks (DICCCOL) to address the limitations in the identification of the brain network ROIs in previous studies. Then, we construct structural brain networks based on diffusion tensor imaging (DTI) data. Afterwards, the global and local graph properties of the constructed structural brain networks are measured using the state-of-the-art graph analysis algorithms and tools and are further compared with seven popular theoretical graph models. In addition, we compare the topological properties between two graph models, namely, stickiness-index-based model (STICKY) and scale-free gene duplication model (SF-GD), that have higher similarity with the real structural brain networks in terms of global and local graph properties. Our experimental results suggest that among the seven theoretical graph models compared in this study, STICKY and SF-GD models have better performances in characterizing the structural human brain network

    Network-selective vulnerability of the human cerebellum to Alzheimer’s disease and frontotemporal dementia

    Get PDF
    Neurodegenerative diseases are associated with distinct and distributed patterns of atrophy in the cerebral cortex. Emerging evidence suggests that these atrophy patterns resemble intrinsic connectivity networks in the healthy brain, supporting the network-based degeneration framework where neuropathology spreads across connectivity networks. An intriguing yet untested possibility is that the cerebellar circuits, which share extensive connections with the cerebral cortex, could be selectively targeted by major neurodegenerative diseases. Here we examined the structural atrophy in the cerebellum across common types of neurodegenerative diseases, and characterized the functional connectivity patterns of these cerebellar atrophy regions. Our results showed that Alzheimer’s disease and frontotemporal dementia are associated with distinct and circumscribed atrophy in the cerebellum. These cerebellar atrophied regions share robust and selective intrinsic connectivity with the atrophied regions in the cerebral cortex. These findings for the first time demonstrated the selective vulnerability of the cerebellum to common neurodegenerative disease, extending the network-based degeneration framework to the cerebellum. Our work also has direct implications on the cerebellar contribution to the cognitive and affective processes that are compromised in neurodegeneration as well as the practice of using the cerebellum as reference region for ligand neuroimaging studies

    Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation

    Full text link
    Diffusion models have proven to be highly effective in image and video generation; however, they still face composition challenges when generating images of varying sizes due to single-scale training data. Adapting large pre-trained diffusion models for higher resolution demands substantial computational and optimization resources, yet achieving a generation capability comparable to low-resolution models remains elusive. This paper proposes a novel self-cascade diffusion model that leverages the rich knowledge gained from a well-trained low-resolution model for rapid adaptation to higher-resolution image and video generation, employing either tuning-free or cheap upsampler tuning paradigms. Integrating a sequence of multi-scale upsampler modules, the self-cascade diffusion model can efficiently adapt to a higher resolution, preserving the original composition and generation capabilities. We further propose a pivot-guided noise re-schedule strategy to speed up the inference process and improve local structural details. Compared to full fine-tuning, our approach achieves a 5X training speed-up and requires only an additional 0.002M tuning parameters. Extensive experiments demonstrate that our approach can quickly adapt to higher resolution image and video synthesis by fine-tuning for just 10k steps, with virtually no additional inference time.Comment: Project Page: https://guolanqing.github.io/Self-Cascade

    Fine-Granularity Functional Interaction Signatures for Characterization of Brain Conditions

    Get PDF
    In the human brain, functional activity occurs at multiple spatial scales. Current studies on functional brain networks and their alterations in brain diseases via resting-state functional magnetic resonance imaging (rs-fMRI) are generally either at local scale (regionally confined analysis and inter-regional functional connectivity analysis) or at global scale (graph theoretic analysis). In contrast, inferring functional interaction at fine-granularity sub-network scale has not been adequately explored yet. Here our hypothesis is that functional interaction measured at fine-granularity subnetwork scale can provide new insight into the neural mechanisms of neurological and psychological conditions, thus offering complementary information for healthy and diseased population classification. In this paper, we derived fine-granularity functional interaction (FGFI) signatures in subjects with Mild Cognitive Impairment (MCI) and Schizophrenia by diffusion tensor imaging (DTI) and rsfMRI, and used patient-control classification experiments to evaluate the distinctiveness of the derived FGFI features. Our experimental results have shown that the FGFI features alone can achieve comparable classification performance compared with the commonly used inter-regional connectivity features. However, the classification performance can be substantially improved when FGFI features and inter-regional connectivity features are integrated, suggesting the complementary information achieved from the FGFI signatures

    Anatomy-Guided Dense Individualized and Common Connectivity-Based Cortical Landmarks (A-DICCCOL)

    Get PDF
    Establishment of structural and functional correspondences of human brain that can be quantitatively encoded and reproduced across different subjects and populations is one of the key issues in brain mapping. As an attempt to address this challenge, our recently developed Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOL) system reported 358 connectional landmarks, each of which possesses consistent DTI-derived white matter fiber connection pattern that is reproducible in over 240 healthy brains. However, the DICCCOL system can be substantially improved by integrating anatomical and morphological information during landmark initialization and optimization procedures. In this paper, we present a novel anatomy-guided landmark discovery framework that defines and optimizes landmarks via integrating rich anatomical, morphological, and fiber connectional information for landmark initialization, group-wise optimization and prediction, which are formulated and solved as an energy minimization problem. The framework finally determined 555 consistent connectional landmarks. Validation studies demonstrated that the 555 landmarks are reproducible, predictable, and exhibited reasonably accurate anatomical, connectional, and functional correspondences across individuals and populations and thus are named anatomy-guided DICCCOL or A-DICCCOL. This A-DICCCOL system represents common cortical architectures with anatomical, connectional, and functional correspondences across different subjects and would potentially provide opportunities for various applications in brain science

    Automatic landslide identification by Dual Graph Convolutional Network and GoogLeNet model-a case study for Xinjiang province, China

    Get PDF
    Landslides are a natural disaster that exists widely in the world and poses a great threat to human life and property, so it is of great importance to identify and locate landslides. Traditional manual interpretation can effectively identify landslides, but its efficiency is very low for large interpreted areas. In this sense, a landslide recognition method based on the Dual Graph Convolutional Network (DGCNet) is proposed to identify the landslide in remote sensing images quickly and accurately. The remote sensing image (regional remote sensing image) of the northern mountainous area of Tuergen Township, Xinyuan County, Xinjiang Province, was obtained by GeoEye-1 (spatial resolution: 0.5 m). Then, the DGCNet is used to train the labeled images, which finally shows good accuracy of landslide recognition. To show the difference with the traditional convolutional network model, this paper adopts a convolution neural network algorithm named GoogLeNet for image recognition to carry out a comparative analysis, the remote sensing satellite images (single terrain image) of Xinyuan County, Xinjiang Province is used as the data set, and the prediction accuracy is 81.25%. Compared with the GoogLeNet model, the DGCNet model has a larger identification range, which provides a new method for landslide recognition of large-scale regional remote sensing images, but the performance of DGCNet is highly dependent on the quality and characteristics of the input image. If the input data quality is poor or the image structure is unclear, the model’s performance may decline

    SRSF5‐Mediated Alternative Splicing of M Gene is Essential for Influenza A Virus Replication: A Host‐Directed Target Against Influenza Virus

    Get PDF
    Abstract: Splicing of influenza A virus (IAV) RNA is an essential process in the viral life cycle that involves the co‐opting of host factors. Here, it is demonstrated that induction of host serine and arginine‐rich splicing factor 5 (SRSF5) by IAV facilitated viral replication by enhancing viral M mRNA splicing. Mechanistically, SRSF5 with its RRM2 domain directly bounds M mRNA at conserved sites (M mRNA position 163, 709, and 712), and interacts with U1 small nuclear ribonucleoprotein (snRNP) to promote M mRNA splicing and M2 production. Mutations introduced to the three binding sites, without changing amino acid code, significantly attenuates virus replication and pathogenesis in vivo. Likewise, SRSF5 conditional knockout in the lung protects mice against lethal IAV challenge. Furthermore, anidulafungin, an approved antifungal drug, is identified as an inhibitor of SRSF5 that effectively blocks IAV replication in vitro and in vivo. In conclusion, SRSF5 as an activator of M mRNA splicing promotes IAV replication and is a host‐derived antiviral target

    ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data

    Full text link
    Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels. However, complex and diverse radiology reports with cross-source heterogeneity pose a huge generalizability challenge to the current methods under massive data volume, mainly because the style and normativity of radiology reports are obviously distinctive among institutions, body regions inspected and radiologists. Recently, the advent of large language models (LLM) offers great potential for recognizing signs of health conditions. To resolve the above problem, we collaborate with the Second Xiangya Hospital in China and propose ChatRadio-Valuer based on the LLM, a tailored model for automatic radiology report generation that learns generalizable representations and provides a basis pattern for model adaptation in sophisticated analysts' cases. Specifically, ChatRadio-Valuer is trained based on the radiology reports from a single institution by means of supervised fine-tuning, and then adapted to disease diagnosis tasks for human multi-system evaluation (i.e., chest, abdomen, muscle-skeleton, head, and maxillofacial &\& neck) from six different institutions in clinical-level events. The clinical dataset utilized in this study encompasses a remarkable total of \textbf{332,673} observations. From the comprehensive results on engineering indicators, clinical efficacy and deployment cost metrics, it can be shown that ChatRadio-Valuer consistently outperforms state-of-the-art models, especially ChatGPT (GPT-3.5-Turbo) and GPT-4 et al., in terms of the diseases diagnosis from radiology reports. ChatRadio-Valuer provides an effective avenue to boost model generalization performance and alleviate the annotation workload of experts to enable the promotion of clinical AI applications in radiology reports
    • …
    corecore