Enhanced fuzzy finite state machine for human activity modelling and recognition

A challenging key aspect of modelling and recognising human activity is to design a model that can deal with the uncertainty in human behaviour. Several machine learning and deep learning techniques are employed to model the Activity of Daily Living (ADL) representing the human activity. This paper proposes an enhanced Fuzzy Finite State Machine (FFSM) model by combining the classical FFSM with Long Short-Term Memory (LSTM) neural network and Convolutional Neural Network (CNN). The learning capability in the LSTM and CNN allows the system to learn the relationship in the temporal human activity data and to identify the parameters of the rule-based system as building blocks of the FFSM through time steps in the learning mode. The learned parameters are then used for generating the fuzzy rules that govern the transitions between the system’s states representing activities. The proposed enhanced FFSMs were tested and evaluated using two different datasets; a real dataset collected by our research group and a public dataset collected from CASAS smart home project. Using LSTM-FFSM, the experimental results achieved 95.7% and 97.6% for the first dataset and the second dataset, respectively. Once CNN-FFSM was applied to both datasets, the obtained results were 94.2% and 99.3%, respectively

Data Processing for Device-Free Fine-Grained Occupancy Sensing Using Infrared Sensors

Fine-grained occupancy information plays an essential role for various emerging applications in smart homes, such as personalized thermal comfort control and human behavior analysis. Existing occupancy sensors, such as passive infrared (PIR) sensors generally provide limited coarse information such as motion. However, the detection of fine-grained occupancy information such as stationary presence, posture, identification, and activity tracking can be enabled with the advance of sensor technologies. Among these, infrared sensing is a low-cost, device-free, and privacy-preserving choice that detects the fluctuation (PIR sensors) or the thermal profiles (thermopile array sensors) from objects' infrared radiation. This work focuses on developing data processing models towards fine-grained occupancy sensing using the synchronized low-energy electronically chopped PIR (SLEEPIR) sensor or the thermopile array sensors. The main contributions of this dissertation include: (1) creating and validating the mathematical model of the SLEEPIR sensor output towards stationary occupancy detection; (2) developing the SLEEPIR detection algorithm using statistical features and long-short term memory (LSTM) deep learning; (3) building machine learning framework for posture detection and activity tracking using thermopile array sensors; and (4) creating convolutional neural network (CNN) models for facing direction detection and identification using thermopile array sensors