Hardware for recognition of human activities: a review of smart home and AAL related technologies

Activity recognition (AR) from an applied perspective of ambient assisted living (AAL) and smart homes (SH) has become a subject of great interest. Promising a better quality of life, AR applied in contexts such as health, security, and energy consumption can lead to solutions capable of reaching even the people most in need. This study was strongly motivated because levels of development, deployment, and technology of AR solutions transferred to society and industry are based on software development, but also depend on the hardware devices used. The current paper identifies contributions to hardware uses for activity recognition through a scientific literature review in the Web of Science (WoS) database. This work found four dominant groups of technologies used for AR in SH and AAL—smartphones, wearables, video, and electronic components—and two emerging technologies: Wi-Fi and assistive robots. Many of these technologies overlap across many research works. Through bibliometric networks analysis, the present review identified some gaps and new potential combinations of technologies for advances in this emerging worldwide field and their uses. The review also relates the use of these six technologies in health conditions, health care, emotion recognition, occupancy, mobility, posture recognition, localization, fall detection, and generic activity recognition applications. The above can serve as a road map that allows readers to execute approachable projects and deploy applications in different socioeconomic contexts, and the possibility to establish networks with the community involved in this topic. This analysis shows that the research field in activity recognition accepts that specific goals cannot be achieved using one single hardware technology, but can be using joint solutions, this paper shows how such technology works in this regard

Creating dynamic groups using context-awareness

This article presents the conceptual communication model of dynamic groups, that dynamically utilizes three traditional communication metaphors through the use of context-based information. Dynamic groups makes creation, management and usage of groups easy. It enables social network structures to be maintained in both virtual and face-to-face settings as well as in the combination thereof. This article defines the dynamic management of advanced contact lists which can include presence and status information, a/synchronous multimedia communication tools, and methods for structuring social networks. It also contains an initial evaluation and a proposed architecture for technical realisation.Godkänd; 2007; 20071130 (miabac

Automatic Annotation for Human Activity Recognition in Free Living Using a Smartphone

Data annotation is a time-consuming process posing major limitations to the development of Human Activity Recognition (HAR) systems. The availability of a large amount of labeled data is required for supervised Machine Learning (ML) approaches, especially in the case of online and personalized approaches requiring user specific datasets to be labeled. The availability of such datasets has the potential to help address common problems of smartphone-based HAR, such as inter-person variability. In this work, we present (i) an automatic labeling method facilitating the collection of labeled datasets in free-living conditions using the smartphone, and (ii) we investigate the robustness of common supervised classification approaches under instances of noisy data. We evaluated the results with a dataset consisting of 38 days of manually labeled data collected in free living. The comparison between the manually and the automatically labeled ground truth demonstrated that it was possible to obtain labels automatically with an 80–85% average precision rate. Results obtained also show how a supervised approach trained using automatically generated labels achieved an 84% f-score (using Neural Networks and Random Forests); however, results also demonstrated how the presence of label noise could lower the f-score up to 64–74% depending on the classification approach (Nearest Centroid and Multi-Class Support Vector Machine)

Combining scanning haptic microscopy and fibre optic Raman spectroscopy for tissue characterization

The tactile resonance method (TRM) and Raman spectroscopy (RS) are promising for tissue characterization in vivo. Our goal is to combine these techniques into one instrument, to use TRM for swift scanning, and RS for increasing the diagnostic power. The aim of this study was to determine the classification accuracy, using support vector machines, for measurements on porcine tissue and also produce preliminary data on human prostate tissue. This was done by developing a new experimental set-up combining micro-scale TRM—scanning haptic microscopy (SHM)—for assessing stiffness on a micro-scale, with fibre optic RS measurements for assessing biochemical content. We compared the accuracy using SHM alone versus SHM combined with RS, for different degrees of tissue homogeneity. The cross-validation classification accuracy for healthy porcine tissue types using SHM alone was 65–81%, and when RS was added it increased to 81–87%. The accuracy for healthy and cancerous human tissue was 67–70% when only SHM was used, and increased to 72–77% for the combined measurements. This shows that the potential for swift and accurate classification of healthy and cancerous prostate tissue is high. This is promising for developing a tool for probing the surgical margins during prostate cancer surgery

Creating digital life stories through activity recognition with image filtering

Abstract. This paper presents two algorithms that enables the MemoryLane system to support persons with mild dementia through creation of digital life stories. The MemoryLane system consists of a Logging Kit that captures context and image data, and a Review Client that recognizes activities and enables review of the captured data. The image filtering algorithm is based on image characteristics such as brightness, blurriness and similarity, and is a central component of the Logging Kit. The activity recognition algorithm is based on the captured contextual data together with concepts of persons and places. The initial results indicate that the MemoryLane system is technically feasible and that activity-based creation of digital life stories for persons with mild dementia is possible

An initiative for the creation of open datasets within pervasive healthcare

In this paper issues surrounding the collection, annotation, management and sharing of data gathered from pervasive health systems are presented. The overarching motivation for this work has been to provide an approach whereby annotated data sets can be made readily accessible to the research community in an effort to assist the advancement of the state-of-the-art in activity recognition and behavioural analysis using pervasive health systems. Recommendations of how this can be made a reality are presented in addition to the initial steps which have been taken to facilitate such an initiative involving the definition of common formats for data storage and a common set of tools for data processing and visualization

Classifier Optimized for Resource-constrained Pervasive Systems and Energy-efficiency

Computational intelligence is often used in smart environment applications in order to determine a user’s context. Many computational intelligence algorithms are complex and resource-consuming which can be problematic for implementation devices such as FPGA:s, ASIC:s and low-level microcontrollers. These types of devices are, however, highly useful in pervasive and mobile computing due to their small size, energy-efficiency and ability to provide fast real-time responses. In this paper, we propose a classifier, CORPSE, specifically targeted for implementation in FPGA:s, ASIC:s or low-level microcontrollers. CORPSE has a small memory footprint, is computationally inexpensive, and is suitable for parallel processing. The classifier was evaluated on eight different datasets of various types. Our results show that CORPSE, despite its simplistic design, has comparable performance to some common machine learning algorithms. This makes the classifier a viable choice for use in pervasive systems that have limited resources, requires energy-efficiency, or have the need for fast real-time responses.publishedVersionnivå

Improving the quality of user generated data sets for activity recognition

It is fully appreciated that progress in the development of data driven approaches to activity recognition are being hampered due to the lack of large scale, high quality, annotated data sets. In an effort to address this the Open Data Initiative (ODI) was conceived as a potential solution for the creation of shared resources for the collection and sharing of open data sets. As part of this process, an analysis was undertaken of datasets collected using a smart environment simulation tool. A noticeable difference was found in the first 1–2 cycles of users generating data. Further analysis demonstrated the effects that this had on the development of activity recognition models with a decrease of performance for both support vector machine and decision tree based classifiers. The outcome of the study has led to the production of a strategy to ensure an initial training phase is considered prior to full scale collection of the data