Where and When: {S}pace-Time Attention for Audio-Visual Explanations

Explaining the decision of a multi-modal decision-maker requires to determine the evidence from both modalities. Recent advances in XAI provide explanations for models trained on still images. However, when it comes to modeling multiple sensory modalities in a dynamic world, it remains underexplored how to demystify the mysterious dynamics of a complex multi-modal model. In this work, we take a crucial step forward and explore learnable explanations for audio-visual recognition. Specifically, we propose a novel space-time attention network that uncovers the synergistic dynamics of audio and visual data over both space and time. Our model is capable of predicting the audio-visual video events, while justifying its decision by localizing where the relevant visual cues appear, and when the predicted sounds occur in videos. We benchmark our model on three audio-visual video event datasets, comparing extensively to multiple recent multi-modal representation learners and intrinsic explanation models. Experimental results demonstrate the clear superior performance of our model over the existing methods on audio-visual video event recognition. Moreover, we conduct an in-depth study to analyze the explainability of our model based on robustness analysis via perturbation tests and pointing games using human annotations

Isotope Composition and Chemical Species of Monthly Precipitation Collected at the Site of a Fusion Test Facility in Japan

The deuterium plasma experiment was started using the Large Helical Device (LHD) at the National Institute for Fusion Science (NIFS) in March 2017 to investigate high-temperature plasma physics and the hydrogen isotope effects towards the realization of fusion energy. In order to clarify any experimental impacts on precipitation, precipitation has been collected at the NIFS site since November 2013 as a means to assess the relationship between isotope composition and chemical species in precipitation containing tritium. The tritium concentration ranged from 0.10 to 0.61 Bq L−1 and was high in spring and low in summer. The stable isotope composition and the chemical species were unchanged before and after the deuterium plasma experiment. Additionally, the tritium concentration after starting the deuterium plasma experiment was within three sigma of the average tritium concentration before the deuterium plasma experiment. These results suggested that there was no impact by tritium on the environment surrounding the fusion test facility

Multi-Target Prediction: A Unifying View on Problems and Methods

Multi-target prediction (MTP) is concerned with the simultaneous prediction of multiple target variables of diverse type. Due to its enormous application potential, it has developed into an active and rapidly expanding research field that combines several subfields of machine learning, including multivariate regression, multi-label classification, multi-task learning, dyadic prediction, zero-shot learning, network inference, and matrix completion. In this paper, we present a unifying view on MTP problems and methods. First, we formally discuss commonalities and differences between existing MTP problems. To this end, we introduce a general framework that covers the above subfields as special cases. As a second contribution, we provide a structured overview of MTP methods. This is accomplished by identifying a number of key properties, which distinguish such methods and determine their suitability for different types of problems. Finally, we also discuss a few challenges for future research

TRITIUM, HYDROGEN AND OXYGEN ISOTOPE COMPOSITIONS IN MONTHLY PRECIPITATION SAMPLES COLLECTED AT TOKI, JAPAN

Monthly precipitation samples have been collected at Toki, Japan, from November 2013 to March 2017. In this report, selected data were analysed to identify the regional hydrogen and oxygen isotope compositions. Tritium (3H) concentration in the precipitation ranged from 0.10 to 0.61 Bq L−1 and higher 3H concentrations were observed in spring rather than in other seasons. This range was similar to values reported in Chiba City, Japan. 3H concentration and the ratio d-excess, and δD values were roughly clustered according to each separate season. These regional hydrogen and oxygen isotope compositions will be used for environmental assessments of effects of the deuterium plasma experiments of the large fusion test device

MRI of the lung (3/3)-current applications and future perspectives

BACKGROUND: MRI of the lung is recommended in a number of clinical indications. Having a non-radiation alternative is particularly attractive in children and young subjects, or pregnant women. METHODS: Provided there is sufficient expertise, magnetic resonance imaging (MRI) may be considered as the preferential modality in specific clinical conditions such as cystic fibrosis and acute pulmonary embolism, since additional functional information on respiratory mechanics and regional lung perfusion is provided. In other cases, such as tumours and pneumonia in children, lung MRI may be considered an alternative or adjunct to other modalities with at least similar diagnostic value. RESULTS: In interstitial lung disease, the clinical utility of MRI remains to be proven, but it could provide additional information that will be beneficial in research, or at some stage in clinical practice. Customised protocols for chest imaging combine fast breath-hold acquisitions from a "buffet" of sequences. Having introduced details of imaging protocols in previous articles, the aim of this manuscript is to discuss the advantages and limitations of lung MRI in current clinical practice. CONCLUSION: New developments and future perspectives such as motion-compensated imaging with self-navigated sequences or fast Fourier decomposition MRI for non-contrast enhanced ventilation- and perfusion-weighted imaging of the lung are discussed. Main Messages • MRI evolves as a third lung imaging modality, combining morphological and functional information. • It may be considered first choice in cystic fibrosis and pulmonary embolism of young and pregnant patients. • In other cases (tumours, pneumonia in children), it is an alternative or adjunct to X-ray and CT. • In interstitial lung disease, it serves for research, but the clinical value remains to be proven. • New users are advised to make themselves familiar with the particular advantages and limitations