FRUGAL & SCALABLE FRAMEWORK FOR ROBUST & INTELLIGENT REMOTE MONITORING IN AN AGING DEMOGRAPHY

Ph.DDOCTOR OF PHILOSOPH

Occupancy monitoring and prediction in ambient intelligent environment

Occupancy monitoring and prediction as an influential factor in the extraction of occupants' behavioural patterns for the realisation of ambient intelligent environments is addressed in this research. The proposed occupancy monitoring technique uses occupancy detection sensors with unobtrusive features to monitor occupancy in the environment. Initially the occupancy detection is conducted for a purely single-occupant environment. Then, it is extended to the multipleoccupant environment and associated problems are investigated. Along with the occupancy monitoring, it is aimed to supply prediction techniques with a suitable occupancy signal as the input which can enhance efforts in developing ambient intelligent environments. By predicting the occupancy pattern of monitored occupants, safety, security, the convenience of occupants, and energy saving can be improved. Elderly care and supporting people with health problems like dementia and Alzheimer disease are amongst the applications of such an environment. In the research, environments are considered in different scenarios based on the complexity of the problem including single-occupant and multiple-occupant scenarios. Using simple sensory devices instead of visual equipment without any impact on privacy and her/his normal daily activity, an occupant is monitored in a living or working environment in the single-occupant scenario. ZigBee wireless communication technology is used to collect signals from sensory devices such as motion detection sensors and door contact sensors. All these technologies together including sensors, wireless communication, and tagging are integrated as a wireless sensory agent

Predicting remaining useful life of rotating machinery based artificial neural network

Accurate remaining useful life (RUL) prediction of machines is important for condition based maintenance (CBM) to improve the reliability and cost of maintenance. This paper proposes artificial neural network (ANN) as a method to improve accurate RUL prediction of bearing failure. For this purpose, ANN model uses time and fitted measurements Weibull hazard rates of root mean square (RMS) and kurtosis from its present and previous points as input. Meanwhile, the normalized life percentage is selected as output. By doing that, the noise of a degradation signal from a target bearing can be minimized and the accuracy of prognosis system can be improved. The ANN RUL prediction uses FeedForward Neural Network (FFNN) with Levenberg Marquardt of training algorithm. The results from the proposed method shows that better performance is achieved in order to predict bearing failure

IoT in smart communities, technologies and applications.

Internet of Things is a system that integrates different devices and technologies, removing the necessity of human intervention. This enables the capacity of having smart (or smarter) cities around the world. By hosting different technologies and allowing interactions between them, the internet of things has spearheaded the development of smart city systems for sustainable living, increased comfort and productivity for citizens. The Internet of Things (IoT) for Smart Cities has many different domains and draws upon various underlying systems for its operation, in this work, we provide a holistic coverage of the Internet of Things in Smart Cities by discussing the fundamental components that make up the IoT Smart City landscape, the technologies that enable these domains to exist, the most prevalent practices and techniques which are used in these domains as well as the challenges that deployment of IoT systems for smart cities encounter and which need to be addressed for ubiquitous use of smart city applications. It also presents a coverage of optimization methods and applications from a smart city perspective enabled by the Internet of Things. Towards this end, a mapping is provided for the most encountered applications of computational optimization within IoT smart cities for five popular optimization methods, ant colony optimization, genetic algorithm, particle swarm optimization, artificial bee colony optimization and differential evolution. For each application identified, the algorithms used, objectives considered, the nature of the formulation and constraints taken in to account have been specified and discussed. Lastly, the data setup used by each covered work is also mentioned and directions for future work have been identified. Within the smart health domain of IoT smart cities, human activity recognition has been a key study topic in the development of cyber physical systems and assisted living applications. In particular, inertial sensor based systems have become increasingly popular because they do not restrict users’ movement and are also relatively simple to implement compared to other approaches. Fall detection is one of the most important tasks in human activity recognition. With an increasingly aging world population and an inclination by the elderly to live alone, the need to incorporate dependable fall detection schemes in smart devices such as phones, watches has gained momentum. Therefore, differentiating between falls and activities of daily living (ADLs) has been the focus of researchers in recent years with very good results. However, one aspect within fall detection that has not been investigated much is direction and severity aware fall detection. Since a fall detection system aims to detect falls in people and notify medical personnel, it could be of added value to health professionals tending to a patient suffering from a fall to know the nature of the accident. In this regard, as a case study for smart health, four different experiments have been conducted for the task of fall detection with direction and severity consideration on two publicly available datasets. These four experiments not only tackle the problem on an increasingly complicated level (the first one considers a fall only scenario and the other two a combined activity of daily living and fall scenario) but also present methodologies which outperform the state of the art techniques as discussed. Lastly, future recommendations have also been provided for researchers

Inferring Complex Activities for Context-aware Systems within Smart Environments

The rising ageing population worldwide and the prevalence of age-related conditions such as physical fragility, mental impairments and chronic diseases have significantly impacted the quality of life and caused a shortage of health and care services. Over-stretched healthcare providers are leading to a paradigm shift in public healthcare provisioning. Thus, Ambient Assisted Living (AAL) using Smart Homes (SH) technologies has been rigorously investigated to help address the aforementioned problems. Human Activity Recognition (HAR) is a critical component in AAL systems which enables applications such as just-in-time assistance, behaviour analysis, anomalies detection and emergency notifications. This thesis is aimed at investigating challenges faced in accurately recognising Activities of Daily Living (ADLs) performed by single or multiple inhabitants within smart environments. Specifically, this thesis explores five complementary research challenges in HAR. The first study contributes to knowledge by developing a semantic-enabled data segmentation approach with user-preferences. The second study takes the segmented set of sensor data to investigate and recognise human ADLs at multi-granular action level; coarse- and fine-grained action level. At the coarse-grained actions level, semantic relationships between the sensor, object and ADLs are deduced, whereas, at fine-grained action level, object usage at the satisfactory threshold with the evidence fused from multimodal sensor data is leveraged to verify the intended actions. Moreover, due to imprecise/vague interpretations of multimodal sensors and data fusion challenges, fuzzy set theory and fuzzy web ontology language (fuzzy-OWL) are leveraged. The third study focuses on incorporating uncertainties caused in HAR due to factors such as technological failure, object malfunction, and human errors. Hence, existing studies uncertainty theories and approaches are analysed and based on the findings, probabilistic ontology (PR-OWL) based HAR approach is proposed. The fourth study extends the first three studies to distinguish activities conducted by more than one inhabitant in a shared smart environment with the use of discriminative sensor-based techniques and time-series pattern analysis. The final study investigates in a suitable system architecture with a real-time smart environment tailored to AAL system and proposes microservices architecture with sensor-based off-the-shelf and bespoke sensing methods. The initial semantic-enabled data segmentation study was evaluated with 100% and 97.8% accuracy to segment sensor events under single and mixed activities scenarios. However, the average classification time taken to segment each sensor events have suffered from 3971ms and 62183ms for single and mixed activities scenarios, respectively. The second study to detect fine-grained-level user actions was evaluated with 30 and 153 fuzzy rules to detect two fine-grained movements with a pre-collected dataset from the real-time smart environment. The result of the second study indicate good average accuracy of 83.33% and 100% but with the high average duration of 24648ms and 105318ms, and posing further challenges for the scalability of fusion rule creations. The third study was evaluated by incorporating PR-OWL ontology with ADL ontologies and Semantic-Sensor-Network (SSN) ontology to define four types of uncertainties presented in the kitchen-based activity. The fourth study illustrated a case study to extended single-user AR to multi-user AR by combining RFID tags and fingerprint sensors discriminative sensors to identify and associate user actions with the aid of time-series analysis. The last study responds to the computations and performance requirements for the four studies by analysing and proposing microservices-based system architecture for AAL system. A future research investigation towards adopting fog/edge computing paradigms from cloud computing is discussed for higher availability, reduced network traffic/energy, cost, and creating a decentralised system. As a result of the five studies, this thesis develops a knowledge-driven framework to estimate and recognise multi-user activities at fine-grained level user actions. This framework integrates three complementary ontologies to conceptualise factual, fuzzy and uncertainties in the environment/ADLs, time-series analysis and discriminative sensing environment. Moreover, a distributed software architecture, multimodal sensor-based hardware prototypes, and other supportive utility tools such as simulator and synthetic ADL data generator for the experimentation were developed to support the evaluation of the proposed approaches. The distributed system is platform-independent and currently supported by an Android mobile application and web-browser based client interfaces for retrieving information such as live sensor events and HAR results

Device-Free, Radio-based Activity Recognition using Smart Home Wireless Communication Technologies

This dissertation demonstrates the use of received signal strength to infer human activities. It has the following contributions: 1) Reference design of a device-free, 2.4GHz IEEE 802.15.4-based sensor system for Activity Recognition; 2) Fundamental description of influences affecting Activity Recognition performance; 3) Software design pattern for device-free, radio-based Inference Systems; 4) Development and characterization of three specialized device-free, radio-based Inference System

Behavioural modelling for ambient assisted living

Tese de doutoramento - MAP-i (University of Minho, Aveiro, and Porto)A mudança incomum na rotina diária ao nível da mobilidade de um idoso em sua casa, pode ser um sinal ou sintoma precoce para a possibilidade de vir a desenvolver um problema de saúde. O recurso a diferentes sensores pode ser um meio para complementar os sistemas de cuidados de saúde tradicionais, de forma a obter uma visão mais detalhada da mobilidade diária do individuo em sua casa, enquanto realiza as suas tarefas diárias. Acreditamos, que os dados recolhidos a partir de sensores de baixo custo, como sensores de presença e ocupação, podem ser utilizados para fornecer evidências sobre os hábitos diários de mobilidade dos idosos que vivem sozinhos em casa e detetar desta forma mudanças nas suas rotinas. Neste trabalho, validamos esta hipótese, desenvolvendo um sistema que aprende automaticamente as transições diárias entre divisões da habitação e hábitos de estadia em cada uma dessas divisões em cada momento do dia e consequentemente gera alarmes sempre que os desvios são detetados. Apresentamos neste trabalho um algoritmo que processa os fluxos de dados dos diferentes sensores e identifica características que descrevem a rotina diária de mobilidade de um idoso que vive sozinho em casa. Para isso foi definido um conjunto de dimensões baseadas nos dados extraídos dos sensores, como parte do nosso Behaviour Monitoring System (BMS). Fomos capazes de detetar com um atraso mínimo os comportamentos incomuns e ao mesmo tempo, durações de confirmação da deteção elevadas, de tal modo suficientes para um conjunto comum de situações anormais. Apresentamos e avaliamos o BMS com dados sintetizados, produzidos por um gerador de dados desenvolvido para este efeito e projetado para simular diferentes perfis de mobilidade de indivíduos em casa, e também com dados reais obtidos de trabalhos de investigação anteriores. Os resultados indicam que o BMS deteta várias mudanças de mobilidade que podem ser sintomas para problemas de saúde comuns. O sistema proposto é uma abordagem útil para a aprendizagem dos hábitos de mobilidade em ambientes domésticos, com potencial para detetar alterações comportamentais que ocorrem devido a problemas de saúde, e assim encorajar a monitorização dos comportamentos e dos cuidados de saúde dos idosos.Unusual changes in the regular daily mobility routine of an elderly at home can be an indicator or early symptoms for developing a health problem. Sensor technology can be utilised to complement the traditional healthcare systems to gain a more detailed view of the daily mobility of a person at home when performing everyday tasks. We hypothesise that data collected from low-cost sensors such as presence and occupancy sensors can be analysed to provide insights on the daily mobility habits of the elderly living alone at home and to detect routine changes. We validate this hypothesis by designing a system that automatically learns the daily room-to-room transitions and stays habits in each room at each time of the day and generates alarm notifications when deviations are detected. We present an algorithm to process the sensor data streams and compute features that describe the daily mobility routine of an elderly living alone at home. This was done by defining a set of sensor-driven dimensions extracted from the sensor data as part of our Behaviour Monitoring System (BMS). We are able to achieve low detection delay with confirmation time that is high enough to convey the detection of a set of common abnormal situations. We illustrate and evaluate BMS with synthetic data, generated by a developed data generator that was designed to mimic different users’ mobility profiles at home, and also with real-life dataset collected from prior research work. Results indicate BMS detects several mobility changes that can be symptoms of common health problems. The proposed system is a useful approach for learning the mobility habits at home environments, with the potential to detect behaviour changes that occur due to health problems, and therefore, motivating progress toward behaviour monitoring and elder’s care

A Mobile Healthcare Solution for Ambient Assisted Living Environments

Elderly people need regular healthcare services and, several times, are dependent of physicians’ personal attendance. This dependence raises several issues to elders, such as, the need to travel and mobility support. Ambient Assisted Living (AAL) and Mobile Health (m-Health) services and applications offer good healthcare solutions that can be used both on indoor and in mobility environments. This dissertation presents an ambient assisted living (AAL) solution for mobile environments. It includes elderly biofeedback monitoring using body sensors for data collection offering support for remote monitoring. The used sensors are attached to the human body (such as the electrocardiogram, blood pressure, and temperature). They collect data providing comfort, mobility, and guaranteeing efficiency and data confidentiality. Periodic collection of patients’ data is important to gather more accurate measurements and to avoid common risky situations, like a physical fall may be considered something natural in life span and it is more dangerous for senior people. One fall can out a life in extreme cases or cause fractures, injuries, but when it is early detected through an accelerometer, for example, it can avoid a tragic outcome. The presented proposal monitors elderly people, storing collected data in a personal computer, tablet, or smartphone through Bluetooth. This application allows an analysis of possible health condition warnings based on the input of supporting charts, and real-time bio-signals monitoring and is able to warn users and the caretakers. These mobile devices are also used to collect data, which allow data storage and its possible consultation in the future. The proposed system is evaluated, demonstrated and validated through a prototype and it is ready for use. The watch Texas ez430-Chronos, which is capable to store information for later analysis and the sensors Shimmer who allow the creation of a personalized application that it is capable of measuring biosignals of the patient in real time is described throughout this dissertation

Adaptive Health Monitoring Using Aggregated Energy Readings from Smart Meters

Worldwide, the number of people living with self-limiting conditions, such as Dementia, Parkinson’s disease and depression, is increasing. The resulting strain on healthcare resources means that providing 24-hour monitoring for patients is a challenge. As this problem escalates, caring for an ageing population will become more demanding over the next decade, and the need for new, innovative and cost effective home monitoring technologies are now urgently required. The research presented in this thesis directly proposes an alternative and cost effective method for supporting independent living that offers enhancements for Early Intervention Practices (EIP). In the UK, a national roll out of smart meters is underway. Energy suppliers will install and configure over 50 million smart meters by 2020. The UK is not alone in this effort. In other countries such as Italy and the USA, large scale deployment of smart meters is in progress. These devices enable detailed around-the-clock monitoring of energy usage. Specifically, each smart meter records accurately the electrical load for a given property at 10 second intervals, 24 hours a day. This granular data captures detailed habits and routines through user interactions with electrical devices. The research presented in this thesis exploits this infrastructure by using a novel approach that addresses the limitations associated with current Ambient Assistive Living technologies. By applying a novel load disaggregation technique and leveraging both machine learning and cloud computing infrastructure, a comprehensive, nonintrusive and personalised solution is achieved. This is accomplished by correlating the detection of individual electrical appliances and correlating them with an individual’s Activities of Daily Living. By utilising a random decision forest, the system is able to detect the use of 5 appliance types from an aggregated load environment with an accuracy of 96%. By presenting the results as vectors to a second classifier both normal and abnormal patient behaviour is detected with an accuracy of 92.64% and a mean squared error rate of 0.0736 using a random decision forest. The approach presented in this thesis is validated through a comprehensive patient trial, which demonstrates that the detection of both normal and abnormal patient behaviour is possible

SHELDON Smart habitat for the elderly.

An insightful document concerning active and assisted living under different perspectives: Furniture and habitat, ICT solutions and Healthcare