978 research outputs found

    Facial affect "in the wild": a survey and a new database

    Get PDF
    Well-established databases and benchmarks have been developed in the past 20 years for automatic facial behaviour analysis. Nevertheless, for some important problems regarding analysis of facial behaviour, such as (a) estimation of affect in a continuous dimensional space (e.g., valence and arousal) in videos displaying spontaneous facial behaviour and (b) detection of the activated facial muscles (i.e., facial action unit detection), to the best of our knowledge, well-established in-the-wild databases and benchmarks do not exist. That is, the majority of the publicly available corpora for the above tasks contain samples that have been captured in controlled recording conditions and/or captured under a very specific milieu. Arguably, in order to make further progress in automatic understanding of facial behaviour, datasets that have been captured in in the-wild and in various milieus have to be developed. In this paper, we survey the progress that has been recently made on understanding facial behaviour in-the-wild, the datasets that have been developed so far and the methodologies that have been developed, paying particular attention to deep learning techniques for the task. Finally, we make a significant step further and propose a new comprehensive benchmark for training methodologies, as well as assessing the performance of facial affect/behaviour analysis/ understanding in-the-wild. To the best of our knowledge, this is the first time that such a benchmark for valence and arousal "in-the-wild" is presente

    AgeDB: the first manually collected, in-the-wild age database

    Get PDF
    Over the last few years, increased interest has arisen with respect to age-related tasks in the Computer Vision community. As a result, several "in-the-wild" databases annotated with respect to the age attribute became available in the literature. Nevertheless, one major drawback of these databases is that they are semi-automatically collected and annotated and thus they contain noisy labels. Therefore, the algorithms that are evaluated in such databases are prone to noisy estimates. In order to overcome such drawbacks, we present in this paper the first, to the best of knowledge, manually collected "in-the-wild" age database, dubbed AgeDB, containing images annotated with accurate to the year, noise-free labels. As demonstrated by a series of experiments utilizing state-of-the-art algorithms, this unique property renders AgeDB suitable when performing experiments on age-invariant face verification, age estimation and face age progression "in-the-wild"

    Aff-Wild: Valence and Arousal ‘in-the-wild’ Challenge

    Get PDF
    The Affect-in-the-Wild (Aff-Wild) Challenge proposes a new comprehensive benchmark for assessing the performance of facial affect/behaviour analysis/understanding 'in-the-wild'. The Aff-wild benchmark contains about 300 videos (over 2,000 minutes of data) annotated with regards to valence and arousal, all captured 'in-the-wild' (the main source being Youtube videos). The paper presents the database description, the experimental set up, the baseline method used for the Challenge and finally the summary of the performance of the different methods submitted to the Affect-in-the-Wild Challenge for Valence and Arousal estimation. The challenge demonstrates that meticulously designed deep neural networks can achieve very good performance when trained with in-the-wild data

    Deep affect prediction in-the-wild: Aff-wild database and challenge, deep architectures, and beyond

    Get PDF
    Automatic understanding of human affect using visual signals is of great importance in everyday human–machine interac- tions. Appraising human emotional states, behaviors and reactions displayed in real-world settings, can be accomplished using latent continuous dimensions (e.g., the circumplex model of affect). Valence (i.e., how positive or negative is an emo- tion) and arousal (i.e., power of the activation of the emotion) constitute popular and effective representations for affect. Nevertheless, the majority of collected datasets this far, although containing naturalistic emotional states, have been captured in highly controlled recording conditions. In this paper, we introduce the Aff-Wild benchmark for training and evaluating affect recognition algorithms. We also report on the results of the First Affect-in-the-wild Challenge (Aff-Wild Challenge) that was recently organized in conjunction with CVPR 2017 on the Aff-Wild database, and was the first ever challenge on the estimation of valence and arousal in-the-wild. Furthermore, we design and extensively train an end-to-end deep neural architecture which performs prediction of continuous emotion dimensions based on visual cues. The proposed deep learning architecture, AffWildNet, includes convolutional and recurrent neural network layers, exploiting the invariant properties of convolutional features, while also modeling temporal dynamics that arise in human behavior via the recurrent layers. The AffWildNet produced state-of-the-art results on the Aff-Wild Challenge. We then exploit the AffWild database for learning features, which can be used as priors for achieving best performances both for dimensional, as well as categorical emo- tion recognition, using the RECOLA, AFEW-VA and EmotiW 2017 datasets, compared to all other methods designed for the same goal. The database and emotion recognition models are available at http://ibug.doc.ic.ac.uk/resources/first-affect-wild-challenge

    Monitoring the growth of Salmonella enterica serovar typhimurium in silico and in situ with a view in gene expression

    Get PDF
    In the present study, the ability of S. Typhimurium to develop a biofilm community on rocket tissue was investigated at 20°C. The differences on expression of genes associated with several functional roles during growth of S. Typhimurium on rocket extract and rocket tissue regarding a laboratory growth medium (Luria – Bertani broth, LB) was also monitored. The findings of the present study could show that Salmonella reacts as exposed to different types of stress when inoculated to a heat sterile plant extract and plant tissue. However, further studies are needed to better determine the survival and / or growth of these as “real” biofilm cells on plant tissues

    Unilateral hypertransparency on chest radiograph: the congenital Poland Syndrome

    Get PDF
      Unilateral hypertransparent hemithorax requires a particular diagnostic approach as it can be the result of diverse pulmonary diseases, including pneumothorax, large pulmonary embolus, unilateral large bullae, mucous plag, airway obstruction and contralateral pleural effusion. Congenital syndromes with chest wall abnormalities, are rare, but often underdiagnosed causes. Poland Syndrome consists of such a rare, congenital anomaly and is characterized by the absence of the pectoralis major muscle and upper limb ipsilateral abnormalities. We present a case of a patient with acute exacerbation of chronic obstructive pulmonary disease (COPD) and a unilateral hypertransparency on chest radiology, attributed to the underlying Poland Syndrome.  
    • 

    corecore