Activities of daily life recognition using process representation modelling to support intention analysis

Purpose – This paper aims to focus on applying a range of traditional classification- and semantic reasoning-based techniques to recognise activities of daily life (ADLs). ADL recognition plays an important role in tracking functional decline among elderly people who suffer from Alzheimer’s disease. Accurate recognition enables smart environments to support and assist the elderly to lead an independent life for as long as possible. However, the ability to represent the complex structure of an ADL in a flexible manner remains a challenge. Design/methodology/approach – This paper presents an ADL recognition approach, which uses a hierarchical structure for the representation and modelling of the activities, its associated tasks and their relationships. This study describes an approach in constructing ADLs based on a task-specific and intention-oriented plan representation language called Asbru. The proposed method is particularly flexible and adaptable for caregivers to be able to model daily schedules for Alzheimer’s patients. Findings – A proof of concept prototype evaluation has been conducted for the validation of the proposed ADL recognition engine, which has comparable recognition results with existing ADL recognition approaches. Originality/value – The work presented in this paper is novel, as the developed ADL recognition approach takes into account all relationships and dependencies within the modelled ADLs. This is very useful when conducting activity recognition with very limited features

A hierarchal framework for recognising activities of daily life

PhDIn today’s working world the elderly who are dependent can sometimes be neglected by society. Statistically, after toddlers it is the elderly who are observed to have higher accident rates while performing everyday activities. Alzheimer’s disease is one of the major impairments that elderly people suffer from, and leads to the elderly person not being able to live an independent life due to forgetfulness. One way to support elderly people who aspire to live an independent life and remain safe in their home is to find out what activities the elderly person is carrying out at a given time and provide appropriate assistance or institute safeguards. The aim of this research is to create improved methods to identify tasks related to activities of daily life and determine a person’s current intentions and so reason about that person’s future intentions. A novel hierarchal framework has been developed, which recognises sensor events and maps them to significant activities and intentions. As privacy is becoming a growing concern, the monitoring of an individual’s behaviour can be seen as intrusive. Hence, the monitoring is based around using simple non intrusive sensors and tags on everyday objects that are used to perform daily activities around the home. Specifically there is no use of any cameras or visual surveillance equipment, though the techniques developed are still relevant in such a situation. Models for task recognition and plan recognition have been developed and tested on scenarios where the plans can be interwoven. Potential targets are people in the first stages of Alzheimer’s disease and in the structuring of the library of kernel plan sequences, typical routines used to sustain meaningful activity have been used. Evaluations have been carried out using volunteers conducting activities of daily life in an experimental home environment. The results generated from the sensors have been interpreted and analysis of developed algorithms has been made. The outcomes and findings of these experiments demonstrate that the developed hierarchal framework is capable of carrying activity recognition as well as being able to carry out intention analysis, e.g. predicting what activity they are most likely to carry out next

Inference Engine Based on a Hierarchical Structure for Detecting Everyday Activities within the Home

One of the key objectives of an ambient assisted living environment is to enable elderly people to lead a healthy and independent life. These assisted environments have the capability to capture and infer activities performed by individuals, which can be useful for providing assistance and tracking functional decline among the elderly community. This paper presents an activity recognition engine based on a hierarchal structure, which allows modelling, representation and recognition of ADLs, their associated tasks, objects, relationships and dependencies. The structure of this contextual information plays a vital role in conducting accurate ADL recognition. The recognition performance of the inference engine has been validated with a series of experiments based on object usage data collected within the home environment

Achieving Model Completeness for Hierarchally Structured Activities of Daily Life

Being able to recognise everyday activities of daily life provides the opportunity of tracking functional decline among elderly people who suffer from Alzheimer’s disease. This paper describes an approach that has been developed for recognising activities of daily life based on a hierarchal structure of plans. While it is logical to envisage that the most common activities will be modelled within a library of plans, it can be impossible to imagine that the library contains plans for every possible hierarchal activity. In order to generalise the activity recognition capability outside the framework of the core activities constructed to support recognition, decision trees are constructed using a well - known induction algorithm during a train period. The motivation of this work is to allow people with Alzheimer’s disease to have additional years of independent living before the disease reaches a stage where it becomes incurable

Recognising Activities of Daily Life through the Usage of Everyday Objects around the Home

The integration of RFID sensors into everyday products has become a widespread solution for increasing efficiency in supply chain management. This has also led to a way of being able to monitor everyday activities in the home based on when and how these products are used, which is less intrusive than other monitoring approaches such as visual based systems. Monitoring activities in a home environment can be seen as a good way of analyzing behavior and tracking functional decline among elderly people. This paper describes a hierarchal approach for activity recognition using object usage data generated by everyday products used around the home. The motivation of this work is to allow people with early Alzheimer’s disease to have additional years of independent living before the disease reaches a stage where the person is fully dependable on someone else

A Hierarchal Approach to Activity Recognition in the Home Environment based on Object Usage

Being able to monitor everyday activities of daily life is seen as a key approach for mitigating functional decline among elderly people as it allows context sensitive support to be offered. This paper describes a hierarchal approach for modelling activities of daily life using task sequences generated by object usage data and a mechanism for recognising these activities from sensor data. The underlying motivation of this work is to allow people with early Alzheimer’s disease to have additional years of independent living before the disease reaches the moderate and severe stages. To ameliorate intrusion into personal privacy the monitoring of activities is via simple non-visual sensors with a greater emphasis placed on intelligent reasoning that exploits structures of typical behaviours

Device-Free, Activity during Daily Life, Recognition Using a Low-Cost Lidar

Device-free or off-body sensing methods, such as Lidar, can be used for location-driven Activities during Daily Life (ADL) recognition without the need for a mobile host such as a human or robot to use on-body location sensors. Because if such an attachment fails, or is not operational (powered up), when such mobile hosts are device free, it still works. Hence, this paper proposes an innovative method for recognizing ADLs using a state-of-art seq2seq Recurrent Neural Network (RNN) model to classify centimeter level accurate location data from a low-cost, 360°rotating 2D Lidar device. We researched, developed, deployed and validated the system. The results indicate that it can provide a centimeter-level localization accuracy of 88% when recognizing 17 targeted location-related daily activities

Machine learning for smart building applications: Review and taxonomy

© 2019 Association for Computing Machinery. The use of machine learning (ML) in smart building applications is reviewed in this article. We split existing solutions into two main classes: occupant-centric versus energy/devices-centric. The first class groups solutions that use ML for aspects related to the occupants, including (1) occupancy estimation and identification, (2) activity recognition, and (3) estimating preferences and behavior. The second class groups solutions that use ML to estimate aspects related either to energy or devices. They are divided into three categories: (1) energy profiling and demand estimation, (2) appliances profiling and fault detection, and (3) inference on sensors. Solutions in each category are presented, discussed, and compared; open perspectives and research trends are discussed as well. Compared to related state-of-the-art survey papers, the contribution herein is to provide a comprehensive and holistic review from the ML perspectives rather than architectural and technical aspects of existing building management systems. This is by considering all types of ML tools, buildings, and several categories of applications, and by structuring the taxonomy accordingly. The article ends with a summary discussion of the presented works, with focus on lessons learned, challenges, open and future directions of research in this field

A Framework to Recognise Daily Life Activities with Wireless Proximity and Object Usage Data

The profusion of wireless enabled mobile devices in daily life routine and advancement in pervasive computing has opened new horizons to analyse and model the contextual information. This contextual information (for example, proximity data and location information) can be very helpful in analysing the human behaviours. Wireless proximity data can provide important information about the behaviour and daily life routines of an individual. In this paper, we used Bluetooth proximity data to validate this concept by detecting repeated activity patterns and behaviour of low entropy mobile people by using n-gram and correlative matrix techniques. Primary purpose is to find out whether contextual information obtained from Bluetooth proximity data is useful for activities and behaviour detection of individuals. Repeated patterns found in Bluetooth proximity data can also show the long term routines such as, monthly or yearly patterns in an individual's daily life that can further help to analyse more complex and abnormal routines of human behaviour

Network Analysis with Stochastic Grammars

Digital forensics requires significant manual effort to identify items of evidentiary interest from the ever-increasing volume of data in modern computing systems. One of the tasks digital forensic examiners conduct is mentally extracting and constructing insights from unstructured sequences of events. This research assists examiners with the association and individualization analysis processes that make up this task with the development of a Stochastic Context -Free Grammars (SCFG) knowledge representation for digital forensics analysis of computer network traffic. SCFG is leveraged to provide context to the low-level data collected as evidence and to build behavior profiles. Upon discovering patterns, the analyst can begin the association or individualization process to answer criminal investigative questions. Three contributions resulted from this research. First , domain characteristics suitable for SCFG representation were identified and a step -by- step approach to adapt SCFG to novel domains was developed. Second, a novel iterative graph-based method of identifying similarities in context-free grammars was developed to compare behavior patterns represented as grammars. Finally, the SCFG capabilities were demonstrated in performing association and individualization in reducing the suspect pool and reducing the volume of evidence to examine in a computer network traffic analysis use case