188 research outputs found

    Zero-shot keyword spotting for visual speech recognition in-the-wild

    Full text link
    Visual keyword spotting (KWS) is the problem of estimating whether a text query occurs in a given recording using only video information. This paper focuses on visual KWS for words unseen during training, a real-world, practical setting which so far has received no attention by the community. To this end, we devise an end-to-end architecture comprising (a) a state-of-the-art visual feature extractor based on spatiotemporal Residual Networks, (b) a grapheme-to-phoneme model based on sequence-to-sequence neural networks, and (c) a stack of recurrent neural networks which learn how to correlate visual features with the keyword representation. Different to prior works on KWS, which try to learn word representations merely from sequences of graphemes (i.e. letters), we propose the use of a grapheme-to-phoneme encoder-decoder model which learns how to map words to their pronunciation. We demonstrate that our system obtains very promising visual-only KWS results on the challenging LRS2 database, for keywords unseen during training. We also show that our system outperforms a baseline which addresses KWS via automatic speech recognition (ASR), while it drastically improves over other recently proposed ASR-free KWS methods.Comment: Accepted at ECCV-201

    Learning Decision Trees Recurrently Through Communication

    Get PDF

    Keep {CALM} and Improve Visual Feature Attribution

    Get PDF

    Effects of Complementary use of Organic and Inorganic fertilizers on the growth and yield of Cucumber (Cucumu sativus. L.) on an ultisol

    Get PDF
    A field study was conducted in 2008 and 2009 early cropping seasons to assess the response of cucumber (Cucumus sativus L.) to complementary use of organic and inorganic fertilizers in Uyo agro-ecology. The fertilizer treatments were: NPK (15:15:15) at 100 and 200 kgha-1, poultry manure (PM) at 5 and 10 tha-1 , and complementary application of 100 kgha-1 of NPK + 5 tha-1 of PM, 100 kgha-1 of NPK + 10 tha-1 of PM, 200 kgha1 of NPK +5 tha-1 of PM ,200 kgha-1 of NPK +10 tha-1 of PM and control (no fertilizer). Results showed significant differences (P<0.05) in all the growth and yield parameters considered in both cropping seasons. The combined application of 200 kgha-1 of NPK and 10 tha-1 of PM performed better than sole application of either organic or inorganic fertilizer, with fresh fruit yield of 14.63 and 14.92 tha-1 in 2008 and 2009, respectively and exceeded other treatments by 1 -76% and 1-73% in 2009 and 2010, respectively. This indicates strongly the synergistic benefits of using both organic and inorganic fertilizers even at lower rates

    Proton density fat fraction: magnetic resonance imaging applications beyond the liver

    Get PDF
    Magnetic resonance imaging-proton density fat fraction (MRI-PDFF) is an emerging quantitative imaging biomarker that accurately measures the fat fraction of tissue by correcting factors influencing magnetic resonance signal intensity. Beyond fat quantification, it also measures R2* which is a direct measure of iron concentration. The utilization of MRI-PDFF in liver diseases is well established. In the present review, we focused on applications of MRI-PDFF in different body areas including pancreas, bone, muscle, spleen, testis, visceral, and subcutaneous adipose tissue. Future studies can enable tracking of quantitative fat fraction changes in different organs simultaneously, which can be critical in understanding fat metabolism

    TRITIUM, HYDROGEN AND OXYGEN ISOTOPE COMPOSITIONS IN MONTHLY PRECIPITATION SAMPLES COLLECTED AT TOKI, JAPAN

    Get PDF
    Monthly precipitation samples have been collected at Toki, Japan, from November 2013 to March 2017. In this report, selected data were analysed to identify the regional hydrogen and oxygen isotope compositions. Tritium (3H) concentration in the precipitation ranged from 0.10 to 0.61 Bq L−1 and higher 3H concentrations were observed in spring rather than in other seasons. This range was similar to values reported in Chiba City, Japan. 3H concentration and the ratio d-excess, and δD values were roughly clustered according to each separate season. These regional hydrogen and oxygen isotope compositions will be used for environmental assessments of effects of the deuterium plasma experiments of the large fusion test device

    Multi-Target Prediction: A Unifying View on Problems and Methods

    Full text link
    Multi-target prediction (MTP) is concerned with the simultaneous prediction of multiple target variables of diverse type. Due to its enormous application potential, it has developed into an active and rapidly expanding research field that combines several subfields of machine learning, including multivariate regression, multi-label classification, multi-task learning, dyadic prediction, zero-shot learning, network inference, and matrix completion. In this paper, we present a unifying view on MTP problems and methods. First, we formally discuss commonalities and differences between existing MTP problems. To this end, we introduce a general framework that covers the above subfields as special cases. As a second contribution, we provide a structured overview of MTP methods. This is accomplished by identifying a number of key properties, which distinguish such methods and determine their suitability for different types of problems. Finally, we also discuss a few challenges for future research

    MRI of the lung (3/3)-current applications and future perspectives

    Get PDF
    BACKGROUND: MRI of the lung is recommended in a number of clinical indications. Having a non-radiation alternative is particularly attractive in children and young subjects, or pregnant women. METHODS: Provided there is sufficient expertise, magnetic resonance imaging (MRI) may be considered as the preferential modality in specific clinical conditions such as cystic fibrosis and acute pulmonary embolism, since additional functional information on respiratory mechanics and regional lung perfusion is provided. In other cases, such as tumours and pneumonia in children, lung MRI may be considered an alternative or adjunct to other modalities with at least similar diagnostic value. RESULTS: In interstitial lung disease, the clinical utility of MRI remains to be proven, but it could provide additional information that will be beneficial in research, or at some stage in clinical practice. Customised protocols for chest imaging combine fast breath-hold acquisitions from a "buffet" of sequences. Having introduced details of imaging protocols in previous articles, the aim of this manuscript is to discuss the advantages and limitations of lung MRI in current clinical practice. CONCLUSION: New developments and future perspectives such as motion-compensated imaging with self-navigated sequences or fast Fourier decomposition MRI for non-contrast enhanced ventilation- and perfusion-weighted imaging of the lung are discussed. Main Messages • MRI evolves as a third lung imaging modality, combining morphological and functional information. • It may be considered first choice in cystic fibrosis and pulmonary embolism of young and pregnant patients. • In other cases (tumours, pneumonia in children), it is an alternative or adjunct to X-ray and CT. • In interstitial lung disease, it serves for research, but the clinical value remains to be proven. • New users are advised to make themselves familiar with the particular advantages and limitations
    corecore