Recognition of Activities of Daily Living with Egocentric Vision: A Review.

Video-based recognition of activities of daily living (ADLs) is being used in ambient assisted living systems in order to support the independent living of older people. However, current systems based on cameras located in the environment present a number of problems, such as occlusions and a limited field of view. Recently, wearable cameras have begun to be exploited. This paper presents a review of the state of the art of egocentric vision systems for the recognition of ADLs following a hierarchical structure: motion, action and activity levels, where each level provides higher semantic information and involves a longer time frame. The current egocentric vision literature suggests that ADLs recognition is mainly driven by the objects present in the scene, especially those associated with specific tasks. However, although object-based approaches have proven popular, object recognition remains a challenge due to the intra-class variations found in unconstrained scenarios. As a consequence, the performance of current systems is far from satisfactory

Exploring Methods to Improve Pressure Ulcer Detection: Spectroscopic Assessment of the Blanch Response

Pressure damage in intact skin is difficult to detect, particularly in individuals with dark skin, because color changes and tissue blanching are masked by the skin's pigmentation. Tissue reflectance spectroscopy (TRS) may be able to detect the blanch response regardless of skin color by measuring the change in total hemoglobin (delta tHb) that occurs when pressure is applied to the skin. The objective of this dissertation was to examine the ability of TRS to detect the blanch response at sites at risk for pressure ulcer development in individuals with various levels of skin pigmentation. Three studies were conducted to address this objective. In Study 1, delta tHb was assessed at the heel and sacrum of light and dark-skinned healthy participants using a portable TRS system. Study 1 showed that a significant decrease (p less than 0.001) in tHb could be measured in both light and dark skinned-participants with good intra-rater reliability (ICC greater than or equal to 0.80) at the heel, but not at the sacrum. Study 2 was conducted to identify a reliable method of skin color description for use in subsequent studies of the spectroscopic blanch response. Two examiners (B and C) performed three skin color assessments at the volar forearm of ten healthy participants using Munsell color tile matching and colorimetry. Intra and inter-rater reliability was excellent for colorimetry (ICCs typically greater than or equal to 0.90). Reliability for Munsell color tile matching was highest for Munsell value within Examiner B (93% agreement, kappa 0.87-1.00), which was determined to be sufficiently high for use in subsequent studies. In Study 3, delta tHb was assessed at the heels of light, moderate, and dark-skinned elderly nursing home residents at risk for pressure ulcers. As in the pilot study, a significant decrease in tHb was observed in all skin color groups (p less than 0.05). Intra-rater reliability for delta tHb was moderate or greater (ICC greater than or equal to 0.61). In combination, the results of Study 1 and Study 3 demonstrated that a significant spectroscopic blanch response could be detected with moderate or greater intra-rater reliability at the heel regardless of age or pressure ulcer risk status

The validity of an accelerometer-based activity monitoring system and the consistency of locomotive activity of community-living older adults

BACKGROUND: The amount and intensity of people's activities are related to latent chronic diseases and the aging process. Accurate information about people's patterns of activity in their natural environments would go a long way toward understanding the relationship between types/levels of activity and health. Unlike the commercially available activity monitors, an algorithm developed at Boston University utilizes frequency (cycles/second) to identify overground gait and pedaling. These studies evaluate the validity of this system in a real-life environment and then investigate people's locomotive behavior across weekdays of the same week. METHODS: Wearing the monitoring system developed at BU on their right ankles, 16 older adults performed a battery of functional locomotive activities continuously in a residential setting, while being video recorded for reference. For the validity algorithm output regarding gait and pedaling variables was statistically compared to the video analysis of the same using the intraclass correlation coefficient (ICC). To investigate the consistency of locomotor behavior across weekdays of the same week, 227 older adults wore the monitoring system under study on their right ankles continuously for a week. Daily gait and pedaling values were correlated across weekdays of the same week also using ICCs. An investigation into the differences in gait variability for the average of 3 weekdays according to the subgroups; age, gender, and BMI was conducted on this sample using the Wilcoxon Signed Ranks test. RESULTS: Three of the four gait validity ICCs were significant (p ≤ 0.019) ranging from 0.267 to 0.778. All pedaling validity variables had ICCs ≥ 0.993 The locomotive consistency study found all 6 daily gait variables significantly (p < 0.001) correlated across 3 weekdays, ranging from 0.534 to 0.914. Three of four ICCs for pedaling consistency variables were significant (p ≤ 0.029) ranging from 0.277 to 0.838. CONCLUSIONS: This study's validity results support this monitoring system's gait and pedaling identification approach. There is also evidence to suggest how the system could improve its real-life locomotive detection validity and potentially diversify its applications. Additionally, based on this dissertation's results, some of people's daily locomotive behaviors remain relatively constant over weekdays during the same week

Multimedia

The nowadays ubiquitous and effortless digital data capture and processing capabilities offered by the majority of devices, lead to an unprecedented penetration of multimedia content in our everyday life. To make the most of this phenomenon, the rapidly increasing volume and usage of digitised content requires constant re-evaluation and adaptation of multimedia methodologies, in order to meet the relentless change of requirements from both the user and system perspectives. Advances in Multimedia provides readers with an overview of the ever-growing field of multimedia by bringing together various research studies and surveys from different subfields that point out such important aspects. Some of the main topics that this book deals with include: multimedia management in peer-to-peer structures & wireless networks, security characteristics in multimedia, semantic gap bridging for multimedia content and novel multimedia applications

Comprehensive Modernization of Firearm Discharge Residue Analysis; Advanced Analytical Techniques, Complexing Agents, and Tandem Mass Spectrometry

The use of firearm discharge residue (FDR) evidence has been on the decline as a result of instrumental and analytical limitations and the inability to evaluate and assign evidentiary value. To utilize FDR evidence to its fullest extent, detection methods exploiting modern advancements in instrumentation must be explored and developed. Research has been performed in an effort to modernize FDR analysis but to date nothing has been implemented or found widespread use in forensic laboratories. This research investigated three analytical techniques for the detection of FDR; (1) ion mobility spectrometry (IMS), (2) thermal desorption gas chromatography mass spectrometry (TD-GC/MS), and (3) electrospray ionization tandem mass spectrometry (ESI-MSn). An IMS method for organic gunshot residues was validated and then employed in a population study to determine shooter from non-shooters by analyzing samples taken from a subject\u27s hands. Peaks corresponding to three organic gunshot residue (OGSR) compounds were detected in approximately 70% of shooter samples. Matrix issues associated with the swab material and the hands of subjects inherently complicated spectra. The results show a need of a pattern-based analysis rather than relying on peak identification for characterizing shooters vs. non-shooters hand swabs.;The next phase of this research was prompted by the need to develop confirmatory detection methods and reach lower limits of detection. A thermal separation probe was affixed to a GC/MS and allowed direct analysis of hand swabs without any prior sample preparation. A method was developed and authentic shooter swabs were analyzed. Although, three OGSR compounds were detected in 14-81% of authentic samples, additional work remains before the technique can begin to be implemented. Finally, experiments on detecting gunshot residue with ESI-MSn via complexing with a macrocyclic host were performed. The macrocyclic host, 15-crown-5, was evaluated for complexation with known GSR metals. Foundational parameters were established and single and double ligand complexes were identified using isotopic ratios and fragment ions. Mass spectral intensities were used to determine the binding selectivities of the metals to the crown ether and in turn the preferential binding of the target metals. Additionally, preliminary molecular modeling provided insight into some experimental observations. Overall, three methods were evaluated in an effort to modernize the analysis of firearm discharge residues and in doing so increase the evidentiary value. IMS and thermal desorption GC/MS proved adequate as screening methods for OGSR and while additional work is required, ESI-MSn proved promising for detecting complexed GSR metals. The advantage of coupling ESI-MSn and complexation is that it allows for the dual detection of OGSR and GSR. While modernizing analysis is key to increasing the evidentiary value it is apparent that coupling the detection of OGSR and GSR is the future of FDR analysis

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

APPLICATIONS IN VIBROARTHROGRAPHY: ASSESSMENTS OF INSTABILITY IN TOTAL HIP ARTHROPLASTY, CAM-POST ENGAGEMENT IN TOTAL KNEE ARTHROPLASTY, AND VISCOSUPPLEMENTATION IN OSTEOARTHRITIC KNEES

Measurement of joint sounds and vibrations for non-invasive orthopaedic diagnostic purposes has slowly advanced since the 1960s. Most work has been focused in the development of methods for screening of abnormal knees. To date the technique has not gained clinical traction as is it fraught with various obstacles and skepticism. This doctoral thesis is neither an argument in favor of nor against the clinical use of vibroarthrography for musculoskeletal diagnostics in humans, but rather an exploration of its potential in cases of orthopaedic interest. These areas include 1) instability in total hip arthroplasty, 2) cam-post engagement in posterior stabilized total knee arthroplasty, and 3) viscosupplementation in osteoarthritic knees. It was expected that each of these unique cases would be characterized by dynamic phenomena that could be measured in the form of surface vibrations at the skin.Methods previously presented in various vibroarthrography research were adopted, modified, and expounded upon to best suit the needs of each experiment. In a mechanical hip simulator, it was found that vibroarthrography could be effectively used to distinguish the difference between 1 mm and 2 mm of hip separation. In posterior stabilized total knee arthroplasty subjects, it was found that multiple vibroarthrographic features may be used to approximate the occurrence of cam-post engagement, and that vibrations measured at the joint surface may be correlated to cam-post engagement velocity. In osteoarthritic knees, the relationship between clinical evidence, viscosupplementation, and vibroarthrography varied on a case by case basis.To the knowledge of the author, all three of these experiments are the first of their kind. Ultimately, the methods and results presented within provide new foundations for vibroarthrography that may be used to further explore the clinical potential of this noninvasive diagnostic