A Survey of Applications and Human Motion Recognition with Microsoft Kinect

Microsoft Kinect, a low-cost motion sensing device, enables users to interact with computers or game consoles naturally through gestures and spoken commands without any other peripheral equipment. As such, it has commanded intense interests in research and development on the Kinect technology. In this paper, we present, a comprehensive survey on Kinect applications, and the latest research and development on motion recognition using data captured by the Kinect sensor. On the applications front, we review the applications of the Kinect technology in a variety of areas, including healthcare, education and performing arts, robotics, sign language recognition, retail services, workplace safety training, as well as 3D reconstructions. On the technology front, we provide an overview of the main features of both versions of the Kinect sensor together with the depth sensing technologies used, and review literatures on human motion recognition techniques used in Kinect applications. We provide a classification of motion recognition techniques to highlight the different approaches used in human motion recognition. Furthermore, we compile a list of publicly available Kinect datasets. These datasets are valuable resources for researchers to investigate better methods for human motion recognition and lower-level computer vision tasks such as segmentation, object detection and human pose estimation

A virtual reality game-like tool for assessing the risk of falling in the elderly

© 2019 The authors and IOS Press. This article is published online with Open Access by IOS Press and distributed under the terms of the Creative Commons Attribution Non-Commercial License 4.0 (CC BY-NC 4.0). In recent years, the use of interactive game technology has gained much interest in the research community as a means to measure indicators associated with the risk of falling in the elderly. Input devices used for gaming offer an inexpensive but yet reliable alternative to the costly apparatuses used in clinics and medical centers. In this paper, we explore the feasibility of using virtual reality technology as a tool to assess the risk of falling in the senior community in a more immersive, intuitive and descriptive manner. Our VR-based tool captures stepping performance parameters in order to fulfill the requirements of a well-established clinical test for fall risk assessment. The use of virtual reality allows for an immersive experience where elderly users can fully concentrate on the motor and cognitive functions being assessed rather than the technology being used

Augmented Reality in Physical Therapy: Systematic Review and Meta-analysis

Background: Augmented reality (AR) is a rapidly expanding technology; it comprises the generation of new images from digital information in the real physical environment of a person, which simulates an environment where the artificial and real are mixed. The use of AR in physiotherapy has shown benefits in certain areas of patient health. However, these benefits have not been studied as a whole. Objective: This study aims to ascertain the current scientific evidence on AR therapy as a complement to physiotherapy and to determine the areas in which it has been used the most and which variables and methods have been most effective. Methods: A systematic review registered in PROSPERO (International Prospective Register of Systematic Reviews) was conducted following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta - Analyses) recommendations. The search was conducted from July to August 2021 in the PubMed, PEDro, Web of Science, Scopus, and Cochrane Library scientific databases using the keywords augmented reality, physiotherapy, physical therapy, exercise therapy, rehabilitation, physical medicine, fitness, and occupational therapy. The methodological quality was evaluated using the PEDro scale and the Scottish Intercollegiate Guidelines Network scale to determine the degree of recommendation The Cochrane Collaboration tool was used to evaluate the risk of bias. Results: In total, 11 articles were included in the systematic review. Of the 11 articles, 4 (36%) contributed information to the meta-analysis. Overall, 64% (7/11) obtained a good level of evidence, and most had a B degree of recommendation of evidence. A total of 308 participants were analyzed. Favorable results were found for the Berg Balance Scale (standardized mean change 0.473, 95% CI -0.0877 to 1.0338; z=1.65; P=.10) and the Timed Up and Go test (standardized mean change -1.211, 95% CI -3.2005 to 0.7768; z=1.194; P=.23). Conclusions: AR, in combination with conventional therapy, has been used for the treatment of balance and fall prevention in geriatrics, lower and upper limb functionality in stroke, pain in phantom pain syndrome, and turning in place in patients with Parkinson disease with freezing of gait. AR is effective for the improvement of balance; however, given the small size of the samples and the high heterogeneity of the studies, the results were not conclusive. Future studies using larger sample sizes and with greater homogeneity in terms of the devices used and the frequency and intensity of the interventions are needed

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Exergaming for dementia and mild cognitive impairment

Objectives: This is a protocol for a Cochrane Review (intervention). The objectives are as follows:. To assess the effects of exergame applications on physical and cognitive outcomes, and activities of daily living (ADL), in people with dementia and mild cognitive impairment (MCI).</p

Exergaming for dementia and mild cognitive impairment

Objectives: This is a protocol for a Cochrane Review (intervention). The objectives are as follows:. To assess the effects of exergame applications on physical and cognitive outcomes, and activities of daily living (ADL), in people with dementia and mild cognitive impairment (MCI).</p

Scoping Review on the Interactive Digital Tools Used for the Physical and Cognitive Stimulation of Healthy Older Adults

As more of our lives are spent using electronic devices, it comes as a natural deduction that those digital tools could be used to maintain people’s health. Gamified exercise or exergames are indeed promising means to motivate the population to get physically active and even cognitively active if paired with the appropriate games. Considering the global concern of an aging population which could benefit from both physical and cognitive stimulation, these tools appear to be an encouraging solution to keep the population healthier over time. This scoping review reports on the digital tools used in publications between January 2015 and December 2023 regarding the physical and cognitive stimulation of healthy elderly people. The search was conducted in PubMed, Web of Science, and ScienceDirect databases. Of the 1579 publications retrieved, a total of 68 publications were analyzed in this review. A wide variety of digital tools were used in the corpus for the combined physical and cognitive stimulation of the elderly. These tools can be categorized into six types of hardware: pressure plates, optical motion capture, inertial motion capture, virtual reality, ergometers, and driving simulators. The apparition of publications using virtual reality and an increase in publications using inertial motion capture in 2020 could be an indicator that digital tools used for cognitive and physical stimulation of the elderly are evolving. Another finding is the wide variety in evaluation tools used to monitor the outcomes of each protocol. A standardization of the testing process might be needed in order to improve comparisons between experiments

The Use of digital games to enhance the physical exercise activity of the elderly : a case of Finland

According to the World Health Organization (WHO), population ageing is a global phenomenon, which brings both challenges and opportunities for society. The current longer expected lifespan can create opportunities for the elderly to contribute in many ways to their families and communities. However, it greatly depends on their quality of life, which is affected by many factors, including physical and functional health, social well-being, and cognitive abilities. The WHO (2012) states that physical health is one of the indicators for the elderly’s quality of life, and it declines with increasing age. Participation in regular physical exercises can help the elderly improve their physical and mental health, and this has been aided by the use of modern technologies to promote the elderly’s physical and functional health. Of these latest technologies, digital games have shown promise to improve and enhance the elderly’s physical activities through fun and engaging gameplay. The literature highlights that some commercial games in the market (e.g. Microsoft Kinect- Sports and Nintendo Wii Sports games) have the potential to improve the elderly’s physical health such as gait, balance, and fall prevention. However, researchers argue that these commercial games are not designed specifically for the elderly and their physical exercise activities. They state that most commercial games are not user-friendly for the elderly whose functional and physical abilities are limited due to their advanced years. The literature points out that more studies need to be undertaken to understand the usability and usefulness of digital games for physical exercise activities so that game designers can create elderly-friendly digital games in the future. In Finland, the government has been focusing on promoting healthy ageing and increasing home care services for the elderly. In recent years, Finnish researchers have used digital games to promote older Finns’ healthy and active ageing. The existing literature, whilst showing the potential of digital games for elderly Finns’ physical health, also acknowledges further research is needed particularly in the context of Finland. Thus, in this study, we aimed at investigating digital games to specifically assess their applications for older Finns’ physical activities, focusing on the quality of users’ experiences, and their reported ease of use and perceived usefulness. We used the mixed methods approach, which applies both qualitative and quantitative research methods. The study design included four stages: requirements gathering, analysis and design, prototyping, and evaluation. Firstly, we conducted pre-studies to elicit users’ requirements. This was followed by the analysis of the resulting data to identify trends and patterns, which fuelled ideas in the brainstorming game design and development phases. The final product was a digital game-based physical exercise called the Skiing Game. We then evaluated the Skiing Game in Finland with 21 elderly Finns (M=7, F=14, Average Age =76). By using questionnaires, observation, and interviews, we investigated user experiences, focusing on the game’s usability, and usefulness for enhancing the physical activity and wellbeing of the elderly. We also conducted a comparative test of the Skiing Game in Japan with 24 elderly Japanese participants (M=12, F=12, Average Age = 72) to further understand non-Finnish elderly users’ experiences. The findings from the usability study of the Skiing Game in Finland demonstrated that elderly Finns had a positive experience in the gameplay, and their motivation was noticeably high. It also confirmed that elderly Finns have a genuine interest in digital game-based exercises and strong intentions to play digital games as a form of physical exercise in the future. Although prior to the study most of them had negative views and misconceptions about digital games, after the gameplay their attitudes were decidedly positive. They acknowledged that whilst playing digital games could be an alternative way of exercising for them their use would primarily be when they don’t have access to their usual non-digital physical exercise. The Japanese usability of the Skiing Game showed that the elderly Japanese people also had positive user experiences in playing digital games, and also intend to use them in the future. Similarly, after playing the game they reported that their attitudes towards digital games become positive, and indicated playing digital games could be an alternative way of exercising. Although the comparison of the two studies suggests that the elderly Finns had relatively more positive experiences whilst playing the Skiing Game, compared to their Japanese counterparts, in general, both groups had a positive experience in the gameplay and showed interest in digital games as an alternative exercise. Based on the usability lessons learned from these two studies, recommendations for practitioners and designers regarding improvements in game design and development are made in this report. Implementing these modifications into future designs and further development of digital games for the elderly will improve their commercial viability and user uptake. The findings from this study can provide valuable insights, particularly for Finnish policymakers and healthcare practitioners who are keen to introduce digital games into the aged-care sector in Finland. The studies have also provided valuable insights into the optimal methods for introducing Finnish digital games to international markets, in particular, digital games tailored specifically for the physical exercise needs and motivations of the elderly. By taking into consideration the limitations of the study, we provide our future studies and further improvements of the game to be conducted