33 research outputs found

    Likelihood-Based Text-to-Image Evaluation with Patch-Level Perceptual and Semantic Credit Assignment

    Full text link
    Text-to-image synthesis has made encouraging progress and attracted lots of public attention recently. However, popular evaluation metrics in this area, like the Inception Score and Fr'echet Inception Distance, incur several issues. First of all, they cannot explicitly assess the perceptual quality of generated images and poorly reflect the semantic alignment of each text-image pair. Also, they are inefficient and need to sample thousands of images to stabilise their evaluation results. In this paper, we propose to evaluate text-to-image generation performance by directly estimating the likelihood of the generated images using a pre-trained likelihood-based text-to-image generative model, i.e., a higher likelihood indicates better perceptual quality and better text-image alignment. To prevent the likelihood of being dominated by the non-crucial part of the generated image, we propose several new designs to develop a credit assignment strategy based on the semantic and perceptual significance of the image patches. In the experiments, we evaluate the proposed metric on multiple popular text-to-image generation models and datasets in accessing both the perceptual quality and the text-image alignment. Moreover, it can successfully assess the generation ability of these models with as few as a hundred samples, making it very efficient in practice

    Reproducibility and effect of tissue composition on cerebellar GABA MRS in an elderly population.

    Get PDF
    Magnetic resonance spectroscopy (MRS) provides a valuable tool to non-invasively detect brain gamma-amino butyric acid (GABA) in vivo. GABAergic dysfunction has been observed in the aging cerebellum. Studying cerebellar GABA changes is of considerable interest in understanding certain age-related motor disorders. However, little is known about the reproducibility of GABA MRS in an aged population. Therefore, this study aimed to explore the feasibility and reproducibility of GABA MRS in the aged cerebellum at 3.0 Tesla and to examine the effect of differing tissue composition on GABA measurements. MRI and 1H MRS exams were performed on 10 healthy elderly volunteers (mean age 75.2 years ± 6.5 years) using a 3.0 Tesla Siemens Tim Trio scanner. Among them, 5 subjects were scanned twice to assess short-term reproducibility. The MEGA-PRESS J-editing sequence was used for GABA detection in two volumes of interest (VOIs) in left and right cerebellar dentate. MRS data processing and quantification were performed with LCModel 6.3-0L using two separate basis sets, generated from density matrix simulations using published values for chemical shifts an

    Cingulate cortex hypoperfusion predicts Alzheimer's disease in mild cognitive impairment

    Get PDF
    BACKGROUND: Mild cognitive impairment (MCI) was recently described as a heterogeneous group with a variety of clinical outcomes and high risk to develop Alzheimer's disease (AD). Regional cerebral blood flow (rCBF) as measured by single photon emission computed tomography (SPECT) was used to study the heterogeneity of MCI and to look for predictors of future development of AD. METHODS: rCBF was investigated in 54 MCI subjects using Tc-99m hexamethylpropyleneamine oxime (HMPAO). An automated analysis software (BRASS) was applied to analyze the relative blood flow (cerebellar ratios) of 24 cortical regions. After the baseline examination, the subjects were followed clinically for an average of two years. 17 subjects progressed to Alzheimer's disease (PMCI) and 37 subjects remained stable (SMCI). The baseline SPECT ratio values were compared between PMCI and SMCI. Receiver operating characteristic (ROC) analysis was applied for the discrimination of the two subgroups at baseline. RESULTS: The conversion rate of MCI to AD was 13.7% per year. PMCI had a significantly decreased rCBF in the left posterior cingulate cortex, as compared to SMCI. Left posterior cingulate rCBF ratios were entered into a logistic regression model for ROC curve calculation. The area under the ROC curve was 74%–76%, which indicates an acceptable discrimination between PMCI and SMCI at baseline. CONCLUSION: A reduced relative blood flow of the posterior cingulate gyrus could be found at least two years before the patients met the clinical diagnostic criteria of AD

    Mild cognitive impairment neuroimaging markers for early diagnosis of dementia

    Get PDF
    This thesis concerns the investigation of mild cognitive impairment (MCI) and Alzheimer's disease (AD) using single photon emission computed tomography (SPECT) and quantitative electroencepholography (qEEG). In study I, The qEEG values were cross-sectionally compared between AD, MCI and controls. AD had decreased global field power (GFP) and more anterior localization of three-dimensional dipole source in alpha and beta frequency. The results of longitudinal investigation of MCI showed a decreased alpha GFP and a more anterior localization of sources of theta, alpha and beta frequency in progressive mild cognitive impairment (PMCI), as compared to non-progressive mild cognitive impairment (SMCI). EEG values showed a moderate diagnostic accuracy in the study of AD and MCI. In study II & III, the baseline regional cerebral blood flow (rCBF) and neuropsychology were investigated in PMCI and SMCI. PMCI had decreased regional cerebral blood flow (rCBF) in posterior cingulate and parietal lobe as well as increased brain perfusion in prefrontal cortex compared to SMCI at baseline. The cognitive functions of PMCI were lower than SMCI with respect to episodic memory, visuospatial and general cognitive function represented by Mini-Mental State Examination (MMSE). Both SPECT and Neuropsychological test had moderate discriminant function between PMCI and SMCI at baseline and combining two methods can improve the diagnostic accuracy. In study IV, the longitudinal rCBF changes of PMCI and SMCI were investigated. SPECT data were analyzed with statistical parametric mapping (SPM) and BRASS program. No significant findings were detected using SPM. The results of BRASS showed a significant rCBF longitudinal reduction of PMCI in superior parietal lobe, parieto-temporal association cortex and medial temporal lobe and a significantly decreased general cognitive function represented by MMSE. To summarize, SPECT and EEG could provide promising markers for the early diagnosis of dementia and track the disease progression. Combining imaging investigation with neuropsychological testing may increase the diagnostic accuracy of preclinical dementia

    Individual-level precision diagnosis for coronavirus disease 2019 related severe outcome: an early study in New York

    No full text
    Abstract Because of inadequate information provided by the on-going population level risk analyses for Coronavirus disease 2019 (COVID-19), this study aimed to evaluate the risk factors and develop an individual-level precision diagnostic method for COVID-19 related severe outcome in New York State (NYS) to facilitate early intervention and predict resource needs for patients with COVID-19. We analyzed COVID-19 related hospital encounter and hospitalization in NYS using Statewide Planning and Research Cooperative System hospital discharge dataset. Logistic regression was performed to evaluate the risk factors for COVID-19 related mortality. We proposed an individual-level precision diagnostic method by taking into consideration of the different weights and interactions of multiple risk factors. Age was the greatest risk factor for COVID-19 related fatal outcome. By adding other demographic variables, dyspnea or hypoxemia and multiple chronic co-morbid conditions, the model predictive accuracy was improved to 0.85 (95% CI 0.84–0.85). We selected cut-off points for predictors and provided a general recommendation to categorize the levels of risk for COVID-19 related fatal outcome, which can facilitate the individual-level diagnosis and treatment, as well as medical resource prediction. We further provided a use case of our method to evaluate the feasibility of public health policy for monoclonal antibody therapy

    A 3D Printing Triboelectric Sensor for Gait Analysis and Virtual Control Based on Human–Computer Interaction and the Internet of Things

    No full text
    Gait is the information that can reflect the state index of the human body, and at the same time, the leg is the organ with the maximum output power of the human body. Effective collection of maximum mechanical power output and gait information can play an important role in sustainable energy acquisition and human health monitoring. In this paper, a 3D printing triboelectric nanogenerator (3D printed TENG) is fabricated by 3D printing technology, it is composited of Poly tetra fluoroethylene (PTFE) film, Nylon film, and 3D printing substrate. Based on the principle of friction electrification and electrostatic induction, it can be used as the equipment for human sustainable mechanical energy collection and gait monitoring. In order to solve the problems of energy collection, gait monitoring, and immersion experience, we conducted the following experiments. Firstly, the problem of sustainable energy recovery and reuse of the human body was solved. Three-dimensionally printed TENG was used to collect human mechanical energy and convert it into electric energy. The capacitor of 2 ÎŒF can be charged to 1.92 V in 20 s. Therefore, 3D printed TENG can be used as a miniature sustainable power supply for microelectronic devices. Then, the gait monitoring software is used to monitor human gait, including the number of steps, the frequency of steps, and the establishment of a personal gait password. This gait password can only identify a specific individual through machine learning. Through remote wireless transmission means, remote real-time information monitoring can be achieved. Finally, we use the Internet of Things to control virtual games through electrical signals and achieve the effect of human–computer interaction. The peak search algorithm is mainly used to detect the extreme points whose amplitude is greater than a certain threshold and the distance is more than 0.1 s. Therefore, this study proposed a 3D printed TENG method to collect human mechanical energy, monitor gait information, and then conduct human–computer interaction, which opened up a multi-dimensional channel for human energy and information interaction
    corecore