Explaining generative diffusion models via visual analysis for interpretable decision-making process

Diffusion models have demonstrated remarkable performance in generation tasks. Nevertheless, explaining the diffusion process remains challenging due to it being a sequence of denoising noisy images that are difficult for experts to interpret. To address this issue, we propose the three research questions to interpret the diffusion process from the perspective of the visual concepts generated by the model and the region where the model attends in each time step. We devise tools for visualizing the diffusion process and answering the aforementioned research questions to render the diffusion process human-understandable. We show how the output is progressively generated in the diffusion process by explaining the level of denoising and highlighting relationships to foundational visual concepts at each time step through the results of experiments with various visual analyses using the tools. Throughout the training of the diffusion model, the model learns diverse visual concepts corresponding to each time-step, enabling the model to predict varying levels of visual concepts at different stages. We substantiate our tools using Area Under Cover (AUC) score, correlation quantification, and cross-attention mapping. Our findings provide insights into the diffusion process and pave the way for further research into explainable diffusion mechanisms.Comment: 22 pages, published in Expert Systems with Application

Integrated In-vehicle Monitoring System Using 3D Human Pose Estimation and Seat Belt Segmentation

Recently, along with interest in autonomous vehicles, the importance of monitoring systems for both drivers and passengers inside vehicles has been increasing. This paper proposes a novel in-vehicle monitoring system the combines 3D pose estimation, seat-belt segmentation, and seat-belt status classification networks. Our system outputs various information necessary for monitoring by accurately considering the data characteristics of the in-vehicle environment. Specifically, the proposed 3D pose estimation directly estimates the absolute coordinates of keypoints for a driver and passengers, and the proposed seat-belt segmentation is implemented by applying a structure based on the feature pyramid. In addition, we propose a classification task to distinguish between normal and abnormal states of wearing a seat belt using results that combine 3D pose estimation with seat-belt segmentation. These tasks can be learned simultaneously and operate in real-time. Our method was evaluated on a private dataset we newly created and annotated. The experimental results show that our method has significantly high performance that can be applied directly to real in-vehicle monitoring systems.Comment: AAAI 2022 workshop AI for Transportation accepte

Epigallocatechin-3-gallate protects toluene diisocyanate-induced airway inflammation in a murine model of asthma

AbstractEpigallocatechin-3-gallate (EGCG), a major form of tea catechin, has anti-allergic properties. To elucidate the anti-allergic mechanisms of EGCG, we investigated its regulation of matrix metalloproteinase (MMP-9) expression in toluene diisocyanate (TDI)-inhalation lung tissues as well as TNF-α and Th2 cytokine (IL-5) production in BAL fluid. Compared with untreated asthmatic mice those administrated with EGCG had significantly reduced asthmatic reaction. Also, increased reactive oxygen species (ROS) generation by TDI inhalation was diminished by administration of EGCG in BAL fluid. These results suggest that EGCG regulates inflammatory cell migration possibly by suppressing MMP-9 production and ROS generation, and indicate that EGCG may be useful as an adjuvant therapy for bronchial asthma

Neural Correlates of Transient Mal de Debarquement Syndrome: Activation of Prefrontal and Deactivation of Cerebellar Networks Correlate With Neuropsychological Assessment

Background: Mal de debarquement syndrome (MdDS) is characterized by a subjective perception of self-motion after exposure to passive motion, mostly after sea travel. A transient form of MdDS (t-MdDS) is common in healthy individuals without pathophysiological certainty. In the present cross-sectional study, the possible neuropsychiatric and functional neuroimaging changes in local fishermen with t-MdDS were evaluated. Methods: The present study included 28 fishermen from Buan County in South Korea; 15 (15/28, 53.6%) participants experienced t-MdDS for 1–6 h, and 13 were asymptomatic (13/28, 46.4%). Vestibular function tests were performed using video-oculography, the video head impulse test, and ocular and cervical vestibular-evoked myogenic potentials. Visuospatial function was also assessed by the Corsi block test. Brain imaging comprised structural MRI, resting-state functional MRI, and [18F]FDG PET scans. Results: The results of vestibular function tests did not differ between the fishermen with and those without t-MdDS. However, participants with t-MdDS showed better performance in visuospatial memory function than those without t-MdDS (6.40 vs. 5.31, p-value = 0.016) as determined by the Corsi block test. Structural brain MRIs were normal in both groups. [18F]FDG PET showed a relative hypermetabolism in the bilateral occipital and prefrontal cortices and hypometabolism in the vestibulocerebellum (nodulus and uvula) in participants with t-MdDS compared to those without t-MdDS. Resting-state functional connectivities were significantly decreased between the vestibular regions of the flocculus, superior temporal gyrus, and parietal operculum and the visual association areas of the middle occipital gyrus, fusiform gyrus, and cuneus in participants with t-MdDS. Analysis of functional connectivity of the significant regions in the PET scans revealed decreased connectivity between the prefrontal cortex and visual processing areas in the t-MdDS group. Conclusion: Increased visuospatial memory, altered metabolism in the prefrontal cortex, visual cognition cortices, and the vestibulocerebellum, and decreased functional connectivity between these two functional areas might indicate reductions in the integration of vestibular input and enhancement of visuospatial attention in subjects with t-MdDS. Current functional neuroimaging similarities from transient MdDS via chronic MdDS to functional dizziness and anxiety disorders suggest a shared mechanism of enhanced self-awareness as a kind of continuum or as overlap disorders

Altered Resting-State Functional Connectivity in Wernicke's Encephalopathy With Vestibular Impairment

Objectives: To reveal the neural basis of Wernicke's encephalopathy (WE) with impaired vestibulo-ocular reflex (VOR), we evaluated resting-state functional connectivity (rs-fc) in the vestibular processing brain regions. Methods: Rs-fc between the vestibular regions and the rest of the brain were compared with neurotological features including the head-impulse tests (vHIT) and caloric responses in patients with WE (n = 5, mean age 53.4 ± 10 years) and healthy controls (n = 20, mean age 55.0 ± 9.2 years). Rs-fc analyses employed a region of interest (ROI)-based approach using regions selected a priori that participate in vestibular processing including the cerebellar vermis, insula, parietal operculum, and calcarine cortex. Results: The main neurologic findings for patients with WE were mental changes; gait ataxia; spontaneous and gaze-evoked nystagmus (GEN); and bilaterally positive HIT for the horizontal canals. Video HIT documented bilateral horizontal canal dysfunction with decreased gain and corrective saccades. Caloric irrigation and rotation chair testing revealed prominent bilateral horizontal canal paresis. Patients with WE also had decreased spatial memory, which substantially recovered after treatments. Functional connections at the predefined seed regions, including the insular cortex and parietal operculum, were attenuated in the WE group compared to healthy controls. Conclusions: WE is related to impaired VOR and visuospatial dysfunction, and fMRI documented changes in the rs-fc of multisensory vestibular processing regions including the insula, parietal operculum, and superior temporal gyrus, which participate in integration of vestibular perception

CT-Guided Percutaneous Vertebroplasty in the Treatment of an Upper Thoracic Compression Fracture

Percutaneous vertebroplasty (PVP) has been used to relieve pain and to prevent further collapse of the vertebral body in patients with an osteoporotic compression fracture. The most commonly affected site for the use of PVP is the thoracolumbar junction. There are few reports that have described on the usefulness of PVP in the treatment of a high thoracic compression fracture. We report a case of an upper thoracic compression fracture that was treated with computed tomography (CT)-guided PVP. It was possible to obtain easy access to the narrow thoracic pedicle and it was also possible to monitor continuously the proper volume of polymethylmethacrylate employed, under CT guidance

Microbiome dataset of spontaneously fermented Ethiopian honey wine, Tej.

This dataset contains raw and analyzed microbial data for the samples of spontaneously fermented Ethiopian honey wine, Tej, collected from three locations of Ethiopia. It was generated using culture independent amplicon sequencing technique. To gain a better understanding of microbial community variance and similarity across Tej samples from the same and different locations, the raw sequenced data obtained from the Illumina Miseq sequencer was subjected to a bioinformatics analysis. Lower diversity and richness of both bacterial and fungal communities were observed for all of the Tej samples. Besides, samples collected from Debre Markos area showed a significant discriminating tax for both bacterial and fungal communities. In nutshell, this amplicon sequencing dataset provides a useful collection of data for modernizing this spontaneous fermentation into a directed inoculated fermentation. Detail discussion on microbiome of Tej samples is given in [1]

Could Fractional Exhaled Nitric Oxide Test be Useful in Predicting Inhaled Corticosteroid Responsiveness in Chronic Cough? A Systematic Review

© 2016 Background Fractional exhaled nitric oxide (FENO) is a safe and convenient test for assessing T H 2 airway inflammation, which is potentially useful in the management of patients with chronic cough. Objective To summarize the current evidence on the diagnostic usefulness of FENO for predicting inhaled corticosteroid (ICS) responsiveness in patients with chronic cough. Methods A systematic literature review was conducted to identify articles published in peer-reviewed journals up to February 2015, without language restriction. We included studies that reported the usefulness of FENO (index test) for predicting ICS responsiveness (reference standard) in patients with chronic cough (target condition). The data were extracted to construct a 2 × 2 accuracy table. Study quality was assessed with Quality Assessment of Diagnostic Accuracy Studies 2. Results We identified 5 original studies (2 prospective and 3 retrospective studies). We identified considerable heterogeneities in study design and outcome definitions, and thus were unable to perform a meta-analysis. The proportion of ICS responders ranged from 44% to 59%. Sensitivity and specificity ranged from 53% to 90%, and from 63% to 97%, respectively. The reported area under the curve ranged from abou t 0.60 to 0.87; however, studies with a prospective design and a lower prevalence of asthma had lower area under the curve values. None measured placebo effects or objective cough frequency. Conclusions We did not find strong evidence to support the use of FENO tests for predicting ICS responsiveness in chronic cough. Further studies need to have a randomized, placebo-controlled design, and should use validated measurement tools for cough. Standardization would facilitate the development of clinical evidence