125 research outputs found
Background prior-based salient object detection via deep reconstruction residual
Detection of salient objects from images is gaining increasing research interest in recent years as it can substantially facilitate a wide range of content-based multimedia applications. Based on the assumption that foreground salient regions are distinctive within a certain context, most conventional approaches rely on a number of hand designed features and their distinctiveness measured using local or global contrast. Although these approaches have shown effective in dealing with simple images, their limited capability may cause difficulties when dealing with more complicated images. This paper proposes a novel framework for saliency detection by first modeling the background and then separating salient objects from the background. We develop stacked denoising autoencoders with deep learning architectures to model the background where latent patterns are explored and more powerful representations of data are learnt in an unsupervised and bottom up manner. Afterwards, we formulate the separation of salient objects from the background as a problem of measuring reconstruction residuals of deep autoencoders. Comprehensive evaluations on three benchmark datasets and comparisons with 9 state-of-the-art algorithms demonstrate the superiority of the proposed work
A Comparative Study of Theoretical Graph Models for Characterizing Structural Networks of Human Brain
Previous studies have investigated both structural and functional brain networks via graph-theoretical methods. However, there is an important issue that has not been adequately discussed before: what is the optimal theoretical graph model for describing the structural networks of human brain? In this paper, we perform a comparative study to address this problem. Firstly, large-scale cortical regions of interest (ROIs) are localized by recently developed and validated brain reference system named Dense Individualized Common Connectivity-based Cortical Landmarks (DICCCOL) to address the limitations in the identification of the brain network ROIs in previous studies. Then, we construct structural brain networks based on diffusion tensor imaging (DTI) data. Afterwards, the global and local graph properties of the constructed structural brain networks are measured using the state-of-the-art graph analysis algorithms and tools and are further compared with seven popular theoretical graph models. In addition, we compare the topological properties between two graph models, namely, stickiness-index-based model (STICKY) and scale-free gene duplication model (SF-GD), that have higher similarity with the real structural brain networks in terms of global and local graph properties. Our experimental results suggest that among the seven theoretical graph models compared in this study, STICKY and SF-GD models have better performances in characterizing the structural human brain network
Network-selective vulnerability of the human cerebellum to Alzheimerâs disease and frontotemporal dementia
Neurodegenerative diseases are associated with distinct and distributed patterns of atrophy in the cerebral cortex. Emerging evidence suggests that these atrophy patterns resemble intrinsic connectivity networks in the healthy brain, supporting the network-based degeneration framework where neuropathology spreads across connectivity networks. An intriguing yet untested possibility is that the cerebellar circuits, which share extensive connections with the cerebral cortex, could be selectively targeted by major neurodegenerative diseases. Here we examined the structural atrophy in the cerebellum across common types of neurodegenerative diseases, and characterized the functional connectivity patterns of these cerebellar atrophy regions. Our results showed that Alzheimerâs disease and frontotemporal dementia are associated with distinct and circumscribed atrophy in the cerebellum. These cerebellar atrophied regions share robust and selective intrinsic connectivity with the atrophied regions in the cerebral cortex. These findings for the first time demonstrated the selective vulnerability of the cerebellum to common neurodegenerative disease, extending the network-based degeneration framework to the cerebellum. Our work also has direct implications on the cerebellar contribution to the cognitive and affective processes that are compromised in neurodegeneration as well as the practice of using the cerebellum as reference region for ligand neuroimaging studies
Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation
Diffusion models have proven to be highly effective in image and video
generation; however, they still face composition challenges when generating
images of varying sizes due to single-scale training data. Adapting large
pre-trained diffusion models for higher resolution demands substantial
computational and optimization resources, yet achieving a generation capability
comparable to low-resolution models remains elusive. This paper proposes a
novel self-cascade diffusion model that leverages the rich knowledge gained
from a well-trained low-resolution model for rapid adaptation to
higher-resolution image and video generation, employing either tuning-free or
cheap upsampler tuning paradigms. Integrating a sequence of multi-scale
upsampler modules, the self-cascade diffusion model can efficiently adapt to a
higher resolution, preserving the original composition and generation
capabilities. We further propose a pivot-guided noise re-schedule strategy to
speed up the inference process and improve local structural details. Compared
to full fine-tuning, our approach achieves a 5X training speed-up and requires
only an additional 0.002M tuning parameters. Extensive experiments demonstrate
that our approach can quickly adapt to higher resolution image and video
synthesis by fine-tuning for just 10k steps, with virtually no additional
inference time.Comment: Project Page: https://guolanqing.github.io/Self-Cascade
Fine-Granularity Functional Interaction Signatures for Characterization of Brain Conditions
In the human brain, functional activity occurs at multiple spatial scales. Current studies on functional brain networks and their alterations in brain diseases via resting-state functional magnetic resonance imaging (rs-fMRI) are generally either at local scale (regionally confined analysis and inter-regional functional connectivity analysis) or at global scale (graph theoretic analysis). In contrast, inferring functional interaction at fine-granularity sub-network scale has not been adequately explored yet. Here our hypothesis is that functional interaction measured at fine-granularity subnetwork scale can provide new insight into the neural mechanisms of neurological and psychological conditions, thus offering complementary information for healthy and diseased population classification. In this paper, we derived fine-granularity functional interaction (FGFI) signatures in subjects with Mild Cognitive Impairment (MCI) and Schizophrenia by diffusion tensor imaging (DTI) and rsfMRI, and used patient-control classification experiments to evaluate the distinctiveness of the derived FGFI features. Our experimental results have shown that the FGFI features alone can achieve comparable classification performance compared with the commonly used inter-regional connectivity features. However, the classification performance can be substantially improved when FGFI features and inter-regional connectivity features are integrated, suggesting the complementary information achieved from the FGFI signatures
Anatomy-Guided Dense Individualized and Common Connectivity-Based Cortical Landmarks (A-DICCCOL)
Establishment of structural and functional correspondences of human brain that can be quantitatively encoded and reproduced across different subjects and populations is one of the key issues in brain mapping. As an attempt to address this challenge, our recently developed Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOL) system reported 358 connectional landmarks, each of which possesses consistent DTI-derived white matter fiber connection pattern that is reproducible in over 240 healthy brains. However, the DICCCOL system can be substantially improved by integrating anatomical and morphological information during landmark initialization and optimization procedures. In this paper, we present a novel anatomy-guided landmark discovery framework that defines and optimizes landmarks via integrating rich anatomical, morphological, and fiber connectional information for landmark initialization, group-wise optimization and prediction, which are formulated and solved as an energy minimization problem. The framework finally determined 555 consistent connectional landmarks. Validation studies demonstrated that the 555 landmarks are reproducible, predictable, and exhibited reasonably accurate anatomical, connectional, and functional correspondences across individuals and populations and thus are named anatomy-guided DICCCOL or A-DICCCOL. This A-DICCCOL system represents common cortical architectures with anatomical, connectional, and functional correspondences across different subjects and would potentially provide opportunities for various applications in brain science
Automatic landslide identification by Dual Graph Convolutional Network and GoogLeNet model-a case study for Xinjiang province, China
Landslides are a natural disaster that exists widely in the world and poses a great threat to human life and property, so it is of great importance to identify and locate landslides. Traditional manual interpretation can effectively identify landslides, but its efficiency is very low for large interpreted areas. In this sense, a landslide recognition method based on the Dual Graph Convolutional Network (DGCNet) is proposed to identify the landslide in remote sensing images quickly and accurately. The remote sensing image (regional remote sensing image) of the northern mountainous area of Tuergen Township, Xinyuan County, Xinjiang Province, was obtained by GeoEye-1 (spatial resolution: 0.5Â m). Then, the DGCNet is used to train the labeled images, which finally shows good accuracy of landslide recognition. To show the difference with the traditional convolutional network model, this paper adopts a convolution neural network algorithm named GoogLeNet for image recognition to carry out a comparative analysis, the remote sensing satellite images (single terrain image) of Xinyuan County, Xinjiang Province is used as the data set, and the prediction accuracy is 81.25%. Compared with the GoogLeNet model, the DGCNet model has a larger identification range, which provides a new method for landslide recognition of large-scale regional remote sensing images, but the performance of DGCNet is highly dependent on the quality and characteristics of the input image. If the input data quality is poor or the image structure is unclear, the modelâs performance may decline
SRSF5âMediated Alternative Splicing of M Gene is Essential for Influenza A Virus Replication: A HostâDirected Target Against Influenza Virus
Abstract: Splicing of influenza A virus (IAV) RNA is an essential process in the viral life cycle that involves the coâopting of host factors. Here, it is demonstrated that induction of host serine and arginineârich splicing factor 5 (SRSF5) by IAV facilitated viral replication by enhancing viral M mRNA splicing. Mechanistically, SRSF5 with its RRM2 domain directly bounds M mRNA at conserved sites (M mRNA position 163, 709, and 712), and interacts with U1 small nuclear ribonucleoprotein (snRNP) to promote M mRNA splicing and M2 production. Mutations introduced to the three binding sites, without changing amino acid code, significantly attenuates virus replication and pathogenesis in vivo. Likewise, SRSF5 conditional knockout in the lung protects mice against lethal IAV challenge. Furthermore, anidulafungin, an approved antifungal drug, is identified as an inhibitor of SRSF5 that effectively blocks IAV replication in vitro and in vivo. In conclusion, SRSF5 as an activator of M mRNA splicing promotes IAV replication and is a hostâderived antiviral target
ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data
Radiology report generation, as a key step in medical image analysis, is
critical to the quantitative analysis of clinically informed decision-making
levels. However, complex and diverse radiology reports with cross-source
heterogeneity pose a huge generalizability challenge to the current methods
under massive data volume, mainly because the style and normativity of
radiology reports are obviously distinctive among institutions, body regions
inspected and radiologists. Recently, the advent of large language models (LLM)
offers great potential for recognizing signs of health conditions. To resolve
the above problem, we collaborate with the Second Xiangya Hospital in China and
propose ChatRadio-Valuer based on the LLM, a tailored model for automatic
radiology report generation that learns generalizable representations and
provides a basis pattern for model adaptation in sophisticated analysts' cases.
Specifically, ChatRadio-Valuer is trained based on the radiology reports from a
single institution by means of supervised fine-tuning, and then adapted to
disease diagnosis tasks for human multi-system evaluation (i.e., chest,
abdomen, muscle-skeleton, head, and maxillofacial neck) from six different
institutions in clinical-level events. The clinical dataset utilized in this
study encompasses a remarkable total of \textbf{332,673} observations. From the
comprehensive results on engineering indicators, clinical efficacy and
deployment cost metrics, it can be shown that ChatRadio-Valuer consistently
outperforms state-of-the-art models, especially ChatGPT (GPT-3.5-Turbo) and
GPT-4 et al., in terms of the diseases diagnosis from radiology reports.
ChatRadio-Valuer provides an effective avenue to boost model generalization
performance and alleviate the annotation workload of experts to enable the
promotion of clinical AI applications in radiology reports
- âŚ