Designing Auditory Feedback from Wearable Weightlifting Devices

While wearable devices for fitness have gained broad popularity, most are focused on tracking general activity types rather than correcting exercise forms, which is extremely important for weightlifters. We interviewed 7 frequent gym-goers about their opinions and expectations for feedback from wearable devices for weightlifting. We describe their desired feedback, and how their expectations and concerns could be balanced in future wearable fitness technologies

Exploring the Design Space for Body Transformation Wearables to Support Physical Activity through Sensitizing and Bodystorming

Negative or disturbed body perceptions are often interwoven with people's physical inactivity. While wearables can support body perception changes (body transformation), the design space of body transformation wearables supporting physical activity remains narrow. To expand this design space, we conducted an embodied co-design workshop with users. Using conceptual and tangible sensitizing tools, we explored/reflected on bodily sensations at three moments of movement execution (before/during/after). Conceptual tools were used to evoke/reflect/capture past lived experiences, while tangible tools were used as ideation probes for sensory bodystorming. Two design concepts emerged, reflecting diverging approaches to body transformation wearables: one focused on reminders and movement correction; the other on sensory augmentation and facilitation. We reflect on how each facilitates useful representations of body sensations during movement, and present methodological recommendations for designing technology for sensory augmentation in this area. Finally, we propose a preliminary prototype based on our design concepts and discuss future steps

Design and Evaluation of a Virtual Reality Game to Improve Physical and Cognitive Acuity

Physical and mental health are both integral to healthy living and ageing, and a causal-cum-symbiotic relationship has been observed between the two. Physical and cognitive activities such as exercise and board games are known to promote healthy ageing. In this regard, highly engaging lightboard games are known to improve hand-eye coordination, reflexes, and motor skills for individuals. Immersivity of virtual reality games can transform mundane and repetitive exercise routines into stimulating experiences, and they can be utilized by users to improve physical and cognitive performance from the comfort of their homes. In this study, we adopt design science framework to design, develop and evaluate a VR BATAK lightboard game to improve physical reaction, hand-eye coordination, visual memory and cognitive processing. Based on the findings from evaluation over three phases, we propose three design principles related to accessibility, sensory cueing and cognitive loading, as theoretical and practical contributions of this study

Design Resources in Movement-based Design Methods:A Practice-based Characterization

Movement-based design methods are increasingly adopted to help design rich embodied experiences. While there are well-known methods in the field, there is no systematic overview to help designers choose among them, adapt them, or create their own. We collected 41 methods used by movement design researchers and employed a practice-based, bottom-up approach to analyze and characterize their properties. We found 17 categories and arranged them into five main groups: Design Resources, Activities, Delivery, Framing, and Context. In this paper, we describe these groups in general and then focus on Design Resources containing the categories of Movement, Space, and Objects. We ground the characterization with examples from empirical material provided by the design researchers and references to previous work. Additionally, we share recommendations and action points to bring these into practice. This work can help novice and seasoned design researchers who want to employ movement-based design methods in their practice.This research was supported by the EU Erasmus+ project Method Cardsfor Movement-based Interaction Design (2020-1-DK01-KA203-075164) IO4: Gathering movement-frst methods for the design of movement-based experiences. This work was also partially supported by the Madrid Government (Comunidad de Madrid) under the Multiannual Agreement with UC3M in the line of Research Funds for Beatriz Galindo Fellowships (MovIntPlayLab-CM-UC3M 2021/00050/001) in the context of the V PRICIT (Regional Programme of Research and Technological Innovation), and by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 101002711; project BODYinTRANSIT). We would like to collectively acknowledge all the people and institutions that have made possible the individual projects featured in this paper: ACHIEVE, KOMPAN Workshop, Astaire, Super Trouper (Vetenskapsrådet grant number 2017-04880), Magic outFit (Spanish Agencia Estatal de Investigación, PID2019-105579RBI00), Sense2makeSense (SpanishAgencia Estatal de Investigación, PID2019-109388GB-I00), LearnSPORTtech, Tangibles, DigiFys (Sweden Innovation Agency Vinnova grant number 2016-03777), Diverging Squash, GIFT, and Online Course in Embodied Interaction

Toward the design of persuasive systems for a healthy workplace: a real-time posture detection

Persuasive technologies, in connection with human factor engineering requirements for healthy workplaces, have played a significant role in ensuring a change in human behavior. Healthy workplaces suggest different best practices applicable to body posture, proximity to the computer system, movement, lighting conditions, computer system layout, and other significant psychological and cognitive aspects. Most importantly, body posture suggests how users should sit or stand in workplaces in line with best and healthy practices. In this study, we developed two study phases (pilot and main) using two deep learning models: convolutional neural networks (CNN) and Yolo-V3. To train the two models, we collected posture datasets from creative common license YouTube videos and Kaggle. We classified the dataset into comfortable and uncomfortable postures. Results show that our YOLO-V3 model outperformed CNN model with a mean average precision of 92%. Based on this finding, we recommend that YOLO-V3 model be integrated in the design of persuasive technologies for a healthy workplace. Additionally, we provide future implications for integrating proximity detection taking into consideration the ideal number of centimeters users should maintain in a healthy workplace

Proficiency-aware systems

In an increasingly digital world, technological developments such as data-driven algorithms and context-aware applications create opportunities for novel human-computer interaction (HCI). We argue that these systems have the latent potential to stimulate users and encourage personal growth. However, users increasingly rely on the intelligence of interactive systems. Thus, it remains a challenge to design for proficiency awareness, essentially demanding increased user attention whilst preserving user engagement. Designing and implementing systems that allow users to become aware of their own proficiency and encourage them to recognize learning benefits is the primary goal of this research. In this thesis, we introduce the concept of proficiency-aware systems as one solution. In our definition, proficiency-aware systems use estimates of the user's proficiency to tailor the interaction in a domain and facilitate a reflective understanding for this proficiency. We envision that proficiency-aware systems leverage collected data for learning benefit. Here, we see self-reflection as a key for users to become aware of necessary efforts to advance their proficiency. A key challenge for proficiency-aware systems is the fact that users often have a different self-perception of their proficiency. The benefits of personal growth and advancing one's repertoire might not necessarily be apparent to users, alienating them, and possibly leading to abandoning the system. To tackle this challenge, this work does not rely on learning strategies but rather focuses on the capabilities of interactive systems to provide users with the necessary means to reflect on their proficiency, such as showing calculated text difficulty to a newspaper editor or visualizing muscle activity to a passionate sportsperson. We first elaborate on how proficiency can be detected and quantified in the context of interactive systems using physiological sensing technologies. Through developing interaction scenarios, we demonstrate the feasibility of gaze- and electromyography-based proficiency-aware systems by utilizing machine learning algorithms that can estimate users' proficiency levels for stationary vision-dominant tasks (reading, information intake) and dynamic manual tasks (playing instruments, fitness exercises). Secondly, we show how to facilitate proficiency awareness for users, including design challenges on when and how to communicate proficiency. We complement this second part by highlighting the necessity of toolkits for sensing modalities to enable the implementation of proficiency-aware systems for a wide audience. In this thesis, we contribute a definition of proficiency-aware systems, which we illustrate by designing and implementing interactive systems. We derive technical requirements for real-time, objective proficiency assessment and identify design qualities of communicating proficiency through user reflection. We summarize our findings in a set of design and engineering guidelines for proficiency awareness in interactive systems, highlighting that proficiency feedback makes performance interpretable for the user.In einer zunehmend digitalen Welt schaffen technologische Entwicklungen - wie datengesteuerte Algorithmen und kontextabhängige Anwendungen - neuartige Interaktionsmöglichkeiten mit digitalen Geräten. Jedoch verlassen sich Nutzer oftmals auf die Intelligenz dieser Systeme, ohne dabei selbst auf eine persönliche Weiterentwicklung hinzuwirken. Wird ein solches Vorgehen angestrebt, verlangt dies seitens der Anwender eine erhöhte Aufmerksamkeit. Es ist daher herausfordernd, ein entsprechendes Design für Kompetenzbewusstsein (Proficiency Awareness) zu etablieren. Das primäre Ziel dieser Arbeit ist es, eine Methodik für das Design und die Implementierung von interaktiven Systemen aufzustellen, die Nutzer dabei unterstützen über ihre eigene Kompetenz zu reflektieren, um dadurch Lerneffekte implizit wahrnehmen können. Diese Arbeit stellt ein Konzept für fähigkeitsbewusste Systeme (proficiency-aware systems) vor, welche die Fähigkeiten von Nutzern abschätzen, die Interaktion entsprechend anpassen sowie das Bewusstsein der Nutzer über deren Fähigkeiten fördern. Hierzu sollten die Systeme gesammelte Daten von Nutzern einsetzen, um Lerneffekte sichtbar zu machen. Die Möglichkeit der Anwender zur Selbstreflexion ist hierbei als entscheidend anzusehen, um als Motivation zur Verbesserung der eigenen Fähigkeiten zu dienen. Eine zentrale Herausforderung solcher Systeme ist die Tatsache, dass Nutzer - im Vergleich zur Abschätzung des Systems - oft eine divergierende Selbstwahrnehmung ihrer Kompetenz haben. Im ersten Moment sind daher die Vorteile einer persönlichen Weiterentwicklung nicht unbedingt ersichtlich. Daher baut diese Forschungsarbeit nicht darauf auf, Nutzer über vorgegebene Lernstrategien zu unterrichten, sondern sie bedient sich der Möglichkeiten interaktiver Systeme, die Anwendern die notwendigen Hilfsmittel zur Verfügung stellen, damit diese selbst über ihre Fähigkeiten reflektieren können. Einem Zeitungseditor könnte beispielsweise die aktuelle Textschwierigkeit angezeigt werden, während einem passionierten Sportler dessen Muskelaktivität veranschaulicht wird. Zunächst wird herausgearbeitet, wie sich die Fähigkeiten der Nutzer mittels physiologischer Sensortechnologien erkennen und quantifizieren lassen. Die Evaluation von Interaktionsszenarien demonstriert die Umsetzbarkeit fähigkeitsbewusster Systeme, basierend auf der Analyse von Blickbewegungen und Muskelaktivität. Hierbei kommen Algorithmen des maschinellen Lernens zum Einsatz, die das Leistungsniveau der Anwender für verschiedene Tätigkeiten berechnen. Im Besonderen analysieren wir stationäre Aktivitäten, die hauptsächlich den Sehsinn ansprechen (Lesen, Aufnahme von Informationen), sowie dynamische Betätigungen, die die Motorik der Nutzer fordern (Spielen von Instrumenten, Fitnessübungen). Der zweite Teil zeigt auf, wie Systeme das Bewusstsein der Anwender für deren eigene Fähigkeiten fördern können, einschließlich der Designherausforderungen , wann und wie das System erkannte Fähigkeiten kommunizieren sollte. Abschließend wird die Notwendigkeit von Toolkits für Sensortechnologien hervorgehoben, um die Implementierung derartiger Systeme für ein breites Publikum zu ermöglichen. Die Forschungsarbeit beinhaltet eine Definition für fähigkeitsbewusste Systeme und veranschaulicht dieses Konzept durch den Entwurf und die Implementierung interaktiver Systeme. Ferner werden technische Anforderungen objektiver Echtzeitabschätzung von Nutzerfähigkeiten erforscht und Designqualitäten für die Kommunikation dieser Abschätzungen mittels Selbstreflexion identifiziert. Zusammengefasst sind die Erkenntnisse in einer Reihe von Design- und Entwicklungsrichtlinien für derartige Systeme. Insbesondere die Kommunikation, der vom System erkannten Kompetenz, hilft Anwendern, die eigene Leistung zu interpretieren

Quantifying Cognitive Efficiency of Display in Human-Machine Systems

As a side effect of fast growing informational technology, information overload becomes prevalent in the operation of many human-machine systems. Overwhelming information can degrade operational performance because it imposes large mental workload on human operators. One way to address this issue is to improve the cognitive efficiency of display. A cognitively efficient display should be more informative while demanding less mental resources so that an operator can process larger displayed information using their limited working memory and achieve better performance. In order to quantitatively evaluate this display property, a Cognitive Efficiency (CE) metric is formulated as the ratio of the measures of two dimensions: display informativeness and required mental resources (each dimension can be affected by display, human, and contextual factors). The first segment of the dissertation discusses the available measurement techniques to construct the CE metric and initially validates the CE metric with basic discrete displays. The second segment demonstrates that displays showing higher cognitive efficiency improve multitask performance. This part also identifies the version of the CE metric that is the most predictive of multitask performance. The last segment of the dissertation applies the CE metric in driving scenarios to evaluate novel speedometer displays; however, it finds that the most efficient display may not better enhance concurrent tracking performance in driving. Although the findings of dissertation show several limitations, they provide valuable insight into the complicated relationship among display, human cognition, and multitask performance in human-machine systems

Stretch sensors for measuring knee kinematics in sports

The popularity of wearable technology in sport has increased, due to its ability to provide unobtrusive monitoring of athletes. This technology has been used to objectively measure kinetic and kinematic variables, with the aim of preventing injury, maximising athletic performance and classifying the skill level of athletes, all of which can influence training and coaching practices. Wearable technologies overcome the limitations of motion capture systems which are limited in their capture volume, enabling the collection of data in-field, during training and competition. Inertial sensors are a common form of technology used in these environments however, their high-cost and complex calibration due to multiple sensor integration can make them prohibitive for widespread use. This thesis focuses on the development of a strain sensor that can be used to measure knee range of motion in sports, specifically rowing and cycling, as a potential low-cost, lightweight alternative to inertial sensors which can also be integrated into clothing, making them more discreet. A systematic review highlighted the lack of alternate technologies to inertial sensors such as strain sensors, as well as the limited use of wearable technologies in both rowing and cycling. Strain sensors were fabricated from a carbon nanotube-natural rubber composite using solvent exchange techniques and employed a piezoresistive sensing mechanism. These were then characterised using mechanical testing, to determine their electrical properties under cyclical strain. The strain sensors displayed hysteretic behaviour, but were durable, withstanding over 4500 strain cycles. Statistical analysis indicated that over 60% of the tests conducted had good intra-test variability with regards to the resistance response range in each strain cycle and sensor response deviating by less than 10% at strain rates below 100 mm/min and less than 20% at a strain rate of 350 mm/min. These sensors were integrated into a wearable sensor system and tested on rowing and cycling cohorts consisting of ten athletes each, to assess the translational use of the strain sensor. This preliminary testing indicated that strain sensors were able to track the motion of the knee during the rowing stroke and cycling pedalling motion, when compared to the output of a motion capture system. Perspectives of participants on the wearable system were collected, which indicated their desire for a system that they could use in their sport, and they considered the translation of this system for real-life use with further development to improve comfort of the system and consistency of the sensor response. The strain sensors developed in this project, when integrated into a wearable sensor system, have the potential to provide an unobtrusive method of measuring knee kinematics, helping athletes, coaches and other support staff make technical changes that can reduce injury risk and improve performance.Open Acces