Every Smile is Unique: Landmark-Guided Diverse Smile Generation

Each smile is unique: one person surely smiles in different ways (e.g., closing/opening the eyes or mouth). Given one input image of a neutral face, can we generate multiple smile videos with distinctive characteristics? To tackle this one-to-many video generation problem, we propose a novel deep learning architecture named Conditional Multi-Mode Network (CMM-Net). To better encode the dynamics of facial expressions, CMM-Net explicitly exploits facial landmarks for generating smile sequences. Specifically, a variational auto-encoder is used to learn a facial landmark embedding. This single embedding is then exploited by a conditional recurrent network which generates a landmark embedding sequence conditioned on a specific expression (e.g., spontaneous smile). Next, the generated landmark embeddings are fed into a multi-mode recurrent landmark generator, producing a set of landmark sequences still associated to the given smile class but clearly distinct from each other. Finally, these landmark sequences are translated into face videos. Our experimental results demonstrate the effectiveness of our CMM-Net in generating realistic videos of multiple smile expressions.Comment: Accepted as a poster in Conference on Computer Vision and Pattern Recognition (CVPR), 201

Air Quality Prediction in Smart Cities Using Machine Learning Technologies Based on Sensor Data: A Review

The influence of machine learning technologies is rapidly increasing and penetrating almost in every field, and air pollution prediction is not being excluded from those fields. This paper covers the revision of the studies related to air pollution prediction using machine learning algorithms based on sensor data in the context of smart cities. Using the most popular databases and executing the corresponding filtration, the most relevant papers were selected. After thorough reviewing those papers, the main features were extracted, which served as a base to link and compare them to each other. As a result, we can conclude that: (1) instead of using simple machine learning techniques, currently, the authors apply advanced and sophisticated techniques, (2) China was the leading country in terms of a case study, (3) Particulate matter with diameter equal to 2.5 micrometers was the main prediction target, (4) in 41% of the publications the authors carried out the prediction for the next day, (5) 66% of the studies used data had an hourly rate, (6) 49% of the papers used open data and since 2016 it had a tendency to increase, and (7) for efficient air quality prediction it is important to consider the external factors such as weather conditions, spatial characteristics, and temporal features

Identification and prediction of abnormal behaviour activities of daily living in intelligent environments

The aim of this research is to investigate efficient mining of useful information from a sensor network forming an Ambient Intelligence (AmI) environment. In this thesis, we investigate methods for supporting independent living of the elderly (and specifically patients who are suffering from dementia) by means of equipping their home with a simple sensor network to monitor their behaviour and identify their Activities of Daily Living (ADL). Dementia is considered to be one of the most important causes of disability in the elderly. Mostpatients would prefer to use non-intrusive technology to help them tomaintain their independence. Such monitoring and prediction would allow the caregiver to see any trend in the behaviour of the elderly person and to be informed of any abnormal behaviour

A survey on generative adversarial networks for imbalance problems in computer vision tasks

Any computer vision application development starts off by acquiring images and data, then preprocessing and pattern recognition steps to perform a task. When the acquired images are highly imbalanced and not adequate, the desired task may not be achievable. Unfortunately, the occurrence of imbalance problems in acquired image datasets in certain complex real-world problems such as anomaly detection, emotion recognition, medical image analysis, fraud detection, metallic surface defect detection, disaster prediction, etc., are inevitable. The performance of computer vision algorithms can significantly deteriorate when the training dataset is imbalanced. In recent years, Generative Adversarial Neural Networks (GANs) have gained immense attention by researchers across a variety of application domains due to their capability to model complex real-world image data. It is particularly important that GANs can not only be used to generate synthetic images, but also its fascinating adversarial learning idea showed good potential in restoring balance in imbalanced datasets. In this paper, we examine the most recent developments of GANs based techniques for addressing imbalance problems in image data. The real-world challenges and implementations of synthetic image generation based on GANs are extensively covered in this survey. Our survey first introduces various imbalance problems in computer vision tasks and its existing solutions, and then examines key concepts such as deep generative image models and GANs. After that, we propose a taxonomy to summarize GANs based techniques for addressing imbalance problems in computer vision tasks into three major categories: 1. Image level imbalances in classification, 2. object level imbalances in object detection and 3. pixel level imbalances in segmentation tasks. We elaborate the imbalance problems of each group, and provide GANs based solutions in each group. Readers will understand how GANs based techniques can handle the problem of imbalances and boost performance of the computer vision algorithms

Towards explainable face aging with Generative Adversarial Networks

Generative Adversarial Networks (GAN) are being increasingly used to perform face aging due to their capabilities of automatically generating highly-realistic synthetic images by using an adversarial model often based on Convolutional Neural Networks (CNN). However, GANs currently represent black box models since it is not known how the CNNs store and process the information learned from data. In this paper, we propose the \ufb01rst method that deals with explaining GANs, by introducing a novel qualitative and quantitative analysis of the inner structure of the model. Similarly to analyzing the common genes in two DNA sequences, we analyze the common \ufb01lters in two CNNs. We show that the GANs for face aging partially share their parameters with GANs trained for heterogeneous applications and that the aging transformation can be learned using general purpose image databases and a \ufb01ne-tuning step. Results on public databases con\ufb01rm the validity of our approach, also enabling future studies on similar models

A life course approach to balance ability

Balance ability is a crucial component of everyday life, underlying physical movement at all stages in life. Despite this, balance is an overlooked aspect of physical health and ageing, with minimal evidence of how factors throughout life are associated with balance ability. This PhD thesis used a life course approach to investigate how factors across life contribute to standing balance in mid and later life, and to examine associations between balance ability and subsequent falls risk. Data from the MRC National Survey of Health and Development (NSHD) were used. NSHD is a nationally representative sample of 5362 males and females, born in England, Scotland and Wales in March 1946 and followed up to 24 times across life. One-legged balance time with eyes closed was assessed at ages 53, 60-64 and 69 (n=3111 individuals with a balance time at one or more age). Analytical methods included multilevel models, structural equation models, linear and logistic regressions and receiver-operating characteristic analyses. In adulthood, disadvantaged socioeconomic position, poor health and adverse health related behaviours were associated with poorer balance ability (Chapter 3). In childhood, disadvantaged socioeconomic position, lower cognitive ability, slower coordination and early or late attainment of motor milestones were associated with poorer balance ability (Chapter 3, 4). Across several domains, higher cognitive ability in midlife was associated with better balance ability (Chapter 5). The association between verbal memory and subsequent balance ability was unidirectional, with some evidence of more complex bidirectional associations with search speed (Chapter 6). Most factors across life demonstrated changing patterns of association with balance with age. Finally, balance ability was associated with subsequent falls, although the one-legged stand did not appear to be a sensitive prognostic indicator of fall risk (Chapter 7). Better understanding of the socioeconomic, cognitive, behavioural and health pathways across life which relate to subsequent balance ability, identified in this thesis, provides an opportunity to intervene earlier in life to minimise, prevent or delay balance impairment or decline

Generative Adversarial Networks (GANs): Challenges, Solutions, and Future Directions

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However, there exists major challenges in training of GANs, i.e., mode collapse, non-convergence and instability, due to inappropriate design of network architecture, use of objective function and selection of optimization algorithm. Recently, to address these challenges, several solutions for better design and optimization of GANs have been investigated based on techniques of re-engineered network architectures, new objective functions and alternative optimization algorithms. To the best of our knowledge, there is no existing survey that has particularly focused on broad and systematic developments of these solutions. In this study, we perform a comprehensive survey of the advancements in GANs design and optimization solutions proposed to handle GANs challenges. We first identify key research issues within each design and optimization technique and then propose a new taxonomy to structure solutions by key research issues. In accordance with the taxonomy, we provide a detailed discussion on different GANs variants proposed within each solution and their relationships. Finally, based on the insights gained, we present the promising research directions in this rapidly growing field.Comment: 42 pages, Figure 13, Table

Data-Driven Methods for the State of Charge Estimation of Lithium-Ion Batteries: An Overview

In recent years, there has been a noticeable shift towards electric mobility and an increasing emphasis on integrating renewable energy sources. Consequently, batteries and their management have been prominent in this context. A vital aspect of the BMS revolves around accurately determining the battery pack’s SOC. Notably, the advent of advanced microcontrollers and the availability of extensive datasets have contributed to the growing popularity and practicality of data-driven methodologies. This study examines the developments in SOC estimation over the past half-decade, explicitly focusing on data-driven estimation techniques. It comprehensively assesses the performance of each algorithm, considering the type of battery and various operational conditions. Additionally, intricate details concerning the models’ hyperparameters, including the number of layers, type of optimiser, and neuron, are provided for thorough examination. Most of the models analysed in the paper demonstrate strong performance, with both the MAE and RMSE for the estimation of SOC hovering around 2% or even lower