Motion synthesis for sports using unobtrusive lightweight body-worn and environment sensing

The ability to accurately achieve performance capture of athlete motion during competitive play in near real-time promises to revolutionise not only broadcast sports graphics visualisation and commentary, but also potentially performance analysis, sports medicine, fantasy sports and wagering. In this paper, we present a highly portable, non-intrusive approach for synthesising human athlete motion in competitive game-play with lightweight instru- mentation of both the athlete and field of play. Our data-driven puppetry technique relies on a pre-captured database of short segments of motion capture data to construct a motion graph augmented with interpolated mo- tions and speed variations. An athlete’s performed motion is synthesised by finding a related action sequence through the motion graph using a sparse set of measurements from the performance, acquired from both worn inertial and global location sensors. We demonstrate the efficacy of our approach in a challenging application scenario, with a high-performance tennis athlete wearing one or more lightweight body-worn accelerometers and a single overhead camera providing the athlete’s global position and orientation data. However, the approach is flexible in both the number and variety of input sensor data used. The technique can also be adopted for searching a motion graph efficiently in linear time in alternative applications

Natural human interaction in virtual immersive environments

REVERIE (REal and Virtual Engagement in Realistic Immersive Environments [1]) targets novel research to address the demanding challenges involved with developing state-of-the-art technologies for online human interaction. The REVERIE framework enables users to meet, socialise and share experiences online by integrating cutting-edge technologies for 3D data acquisition and processing, networking, autonomy and real-time rendering. In this paper, we describe the innovative research that is showcased through the REVERIE integrated framework through richly defined use-cases which demonstrate the validity and potential for natural interaction in a virtual immersive and safe environment. Previews of the REVERIE demo and its key research components can be viewed at www.youtube.com/user/REVERIEFP7

Eyewear Computing \u2013 Augmenting the Human with Head-Mounted Wearable Assistants

The seminar was composed of workshops and tutorials on head-mounted eye tracking, egocentric vision, optics, and head-mounted displays. The seminar welcomed 30 academic and industry researchers from Europe, the US, and Asia with a diverse background, including wearable and ubiquitous computing, computer vision, developmental psychology, optics, and human-computer interaction. In contrast to several previous Dagstuhl seminars, we used an ignite talk format to reduce the time of talks to one half-day and to leave the rest of the week for hands-on sessions, group work, general discussions, and socialising. The key results of this seminar are 1) the identification of key research challenges and summaries of breakout groups on multimodal eyewear computing, egocentric vision, security and privacy issues, skill augmentation and task guidance, eyewear computing for gaming, as well as prototyping of VR applications, 2) a list of datasets and research tools for eyewear computing, 3) three small-scale datasets recorded during the seminar, 4) an article in ACM Interactions entitled \u201cEyewear Computers for Human-Computer Interaction\u201d, as well as 5) two follow-up workshops on \u201cEgocentric Perception, Interaction, and Computing\u201d at the European Conference on Computer Vision (ECCV) as well as \u201cEyewear Computing\u201d at the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)

Latest research trends in gait analysis using wearable sensors and machine learning: a systematic review

Gait is the locomotion attained through the movement of limbs and gait analysis examines the patterns (normal/abnormal) depending on the gait cycle. It contributes to the development of various applications in the medical, security, sports, and fitness domains to improve the overall outcome. Among many available technologies, two emerging technologies that play a central role in modern day gait analysis are: A) wearable sensors which provide a convenient, efficient, and inexpensive way to collect data and B) Machine Learning Methods (MLMs) which enable high accuracy gait feature extraction for analysis. Given their prominent roles, this paper presents a review of the latest trends in gait analysis using wearable sensors and Machine Learning (ML). It explores the recent papers along with the publication details and key parameters such as sampling rates, MLMs, wearable sensors, number of sensors, and their locations. Furthermore, the paper provides recommendations for selecting a MLM, wearable sensor and its location for a specific application. Finally, it suggests some future directions for gait analysis and its applications

Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer Interaction: A Comprehensive Survey

Due to the fact that roughly sixty percent of the human body is essentially composed of water, the human body is inherently a conductive object, being able to, firstly, form an inherent electric field from the body to the surroundings and secondly, deform the distribution of an existing electric field near the body. Body-area capacitive sensing, also called body-area electric field sensing, is becoming a promising alternative for wearable devices to accomplish certain tasks in human activity recognition and human-computer interaction. Over the last decade, researchers have explored plentiful novel sensing systems backed by the body-area electric field. On the other hand, despite the pervasive exploration of the body-area electric field, a comprehensive survey does not exist for an enlightening guideline. Moreover, the various hardware implementations, applied algorithms, and targeted applications result in a challenging task to achieve a systematic overview of the subject. This paper aims to fill in the gap by comprehensively summarizing the existing works on body-area capacitive sensing so that researchers can have a better view of the current exploration status. To this end, we first sorted the explorations into three domains according to the involved body forms: body-part electric field, whole-body electric field, and body-to-body electric field, and enumerated the state-of-art works in the domains with a detailed survey of the backed sensing tricks and targeted applications. We then summarized the three types of sensing frontends in circuit design, which is the most critical part in body-area capacitive sensing, and analyzed the data processing pipeline categorized into three kinds of approaches. Finally, we described the challenges and outlooks of body-area electric sensing

The 2023 wearable photoplethysmography roadmap

Photoplethysmography is a key sensing technology which is used in wearable devices such as smartwatches and fitness trackers. Currently, photoplethysmography sensors are used to monitor physiological parameters including heart rate and heart rhythm, and to track activities like sleep and exercise. Yet, wearable photoplethysmography has potential to provide much more information on health and wellbeing, which could inform clinical decision making. This Roadmap outlines directions for research and development to realise the full potential of wearable photoplethysmography. Experts discuss key topics within the areas of sensor design, signal processing, clinical applications, and research directions. Their perspectives provide valuable guidance to researchers developing wearable photoplethysmography technology

Smart Second Skin and Scent Whisper at Siggraph 2005

The annual Cyber Fashion Show was hosted by Psymbiote, the technology-clad cyborg and produced by Charmed Technology. The show featured a variety of wearable computers, head-mounted displays, smart clothes, luminous clothing and accessories, futuristic club wear, and CAD/CAM jewellery and bodywear. It also featured contributions from the Banff New Media Institute, the MIT Media Lab, WIN Wearable Fashion Group, ViewStation, (whisper research group), the Wearable Fashion Group at Keio University, SONY CSL Paris, The Innovation Centre @ Central St. Martin's College of Art and Design, CuteCircuit, eMagin, Elise Co, Tina Gonsalves, Laura Bardier, and a number of other experimental artists, progressive designers, and hi-tech corporations. The wide-ranging selection of products, innovative prototypes, and unique creations projected the future realms of body-technology assimilation. Scent Whisper ‘Scent Whisper’ is a wireless jewellery set inspired by the comic hero Spiderman. It can be worn by two people and works by the first user whispering a secret into the spider’s abdomen which has a humidity sensor embedded in a brooch. A message is ‘scent by a wireless web’ to a the second user wearing a wireless bombardier beetle brooch. The beetle brooch retaliates by spraying a scent (or poison) to a lover (or enemy) dependent upon the response from the humidity sensor embedded in the spider. This jewellery device is able to dispense airborne nano-litre sized droplets of fragrance at about 20,000 droplets per second using lab-on-a-chip technology that allows efficient scent delivery SmartSecondSkin The SmartSecondSkin Dress is a conceptual garment that concentrates on a more active approach to fashion offering direct life-enhancing and analgesic assistance through different mechanisms’ whilst soothing, stimulating, motivating or invigorating the wearer. The dress demonstrates a new way to deliver fragrances for health, wellbeing and stress-reduction. It mimics the human body, in particular the circulation and nervous system, senses and scent glands. The dress interacts with human emotions whereby the aroma dimension is an integral part of the wearer’s sensory experience. It is made from two layers of while organza silk with medical tubes in-between, containing coloured liquid that demonstrate a selection of different fragrances embedded within the garment. The fragrances are diffused depending on the different moods and emotions of the user. The tubes represent an “aroma rainbow”, so that the fabric gives the impression it is creating an olfactory experience. The fundamental advantage is the use of body sensors to determine ‘colour therapeutic’ scent release when a person is stressed, with the ability to shield a ‘Scentient Being’ (the user) from a negative mood they should be protected from. The benefits are for everyone, as recent research shows that fragrance has a positive effect on brain activity to improve mental and physical health. The dress therefore enhances mental and physical well-being, whilst acting as a medium for communicating thoughts or emotions through smell, our most ancient and primitive sense

Interwoven Waves:Enhancing the Scalability and Robustness of Wi-Fi Channel State Information for Human Activity Recognition

This PhD dissertation investigates the future of unobtrusive radio wave-based sensing, specifically focusing on Wi-Fi sensing in realistic healthcare scenarios. Wi-Fi sensing leverages the analysis of multi-path reflections of radio waves to monitor human activities and physiological states, providing a scalable solution without intruding on daily life.Wi-Fi-based sensing, particularly through channel state information, fits well in healthcare due to its ubiquitous presence and unobtrusiveness. As our society ages and populations grow, continuous health monitoring becomes increasingly critical. Existing solutions like wearable devices, audiovisual technologies, and expensive infrastructure modifications each have limitations, such as forgetting to wear devices, privacy invasions, and high costs. Channel state information-based sensing offers a promising alternative, enabling remote monitoring without the need for additional infrastructure changes.Nevertheless, implementing channel state information-based sensing in already congested Wi-Fi bands could present challenges in the future. Current solutions often exacerbate congestion by adding random noise, which can degrade network performance. These solutions also tend to address niche problems in idealistic settings, making it difficult to justify their use in everyday environments due to potential impacts on network latency and overall user experience.To realise the potential of Wi-Fi sensing, future solutions must integrate seamlessly with wireless communication networks, ensuring that sensing and communication processes coexist and collaborate effectively. This dissertation categorises the relationship between sensing and communication into three models: parasitic, opportunistic, and mutualistic. In the parasitic model, sensing operates independently of the wireless infrastructure, potentially adding noise and congestion. The opportunistic model leverages existing traffic flows, avoiding adverse effects on communication. The mutualistic model aims for a balance, enhancing both sensing and communication without compromising either function.The primary research objective is to enhance the robustness and scalability of channel state information-based sensing for human activity recognition, facilitating seamless integration into home environments with minimal impact on existing infrastructure. Overall, this dissertation provides an exploration of the challenges and solutions for unobtrusive Wi-Fi sensing in healthcare, paving the way for future advancements in the field