AUTOMATIC DETECTION OF NYSTAGMUS IN BEDSIDE VOG RECORDINGS FROM PATIENTS WITH VERTIGO

Benign Paroxysmal Positional Vertigo (BPPV) is the most common cause of vertigo. It can be diagnosed and treated using simple maneuvers done by vestibular experts. However, patients with this condition presenting to the emergency department have high chance of being misdiagnosed. Such high rate of misdiagnosis results in significant morbidity to the patient and also incurs huge medical costs from unnecessary neuroimaging tests. Hence, automatic medical diagnosis is the next step to aid ED practitioners to reduce diagnostic errors. However, current software employed for this diagnosis has been found to have very low specificity. This can be attributed to factors such as low sampling frequency of recording device and the fact that bedside recordings from patients are susceptible to noise and artifacts. This study aims to improve methods for automatic quantification of nystagmus, a key sign of BPPV. Testing the current method using eye movement data recorded in patients during the diagnostic maneuver yielded better results than the commercial software

Vision Pipelines and Optimizations

This chapter explores some hypothetical computer vision pipeline designs to understand HW/SW design alternatives and optimizations. Instead of looking at isolated computer vision algorithms, this chapter ties together many concepts into complete vision pipelines. Vision pipelines are sketched out for a few example applications to illustrate the use of different methods. Example applications include object recognition using shape and color for automobiles, face detection and emotion detection using local features, image classification using global features, and augmented reality. The examples have been chosen to illustrate the use of different families of feature description metrics within the Vision Metrics Taxonomy presented in Chap. 5. Alternative optimizations at each stage of the vision pipeline are explored. For example, we consider which vision algorithms run better on a CPU versus a GPU, and discuss how data transfer time between compute units and memory affects performance. Document type: Part of book or chapter of boo

Automatic parametric digital design of custom-fit bicycle helmets based on 3D anthropometry and novel clustering algorithm

Bicycle helmets can provide valuable protective effects to the wearer’s head in the event of a crash. However, the level of protection that helmets offer varies greatly between the users for similar impacts. Although these discrepancies can be due to many causes, several researchers highlighted the poor fit of helmets experienced by some users as a possible explanation. Poor helmet fit may be attributed to two main causes. First, the helmet could be worn incorrectly, with the helmet either worn back to front, or tilted forward or backward. The chin strap could also be unfastened. Second, helmet sizes and shapes available to the public might not be suitable for the full range of head morphologies observed in the population. Indeed, for some users, there could either be a large gap and/or pressure points between the inner surfaces of the helmet and the head, or a low coverage of the skull area with significant unprotected regions of the head. While the poorly informed usage of bicycle helmets is partly rectifiable through education programs, the mismatch between the head and the helmet’s inside surfaces primarily relates to the conventional design method and manufacturing techniques used in the industry today. In addition to the safety concerns described above, poorly fitted helmets can cause significant discomfort and may lead people to cycle infrequently or even not cycle altogether. Such a reaction could be somewhat detrimental to the user since the health benefits of regular cycling are significant. Some organisations and institutions even believe that the risks involved in cycling without a helmet (in not-extreme practices such as mountain biking) might be outweighed by the health benefits of consistent physical workout that the activity procures. However, this is impractical in countries such as Australia where mandatory helmet laws (MHL) are in place. Improper helmet fit coupled with MHL might be the reason why Australians cycle less than formerly, despite many initiatives undertaken by the government to grow the activity. In summary, current commercially available bicycle helmets suffer from the lack of fit accuracy, are uncomfortable, and consequently can discourage riding activities in the community, especially in populations like Australia where MHL exist. Therefore, the main purpose of this research has been to develop an innovative method to produce bicycle helmet models that provide a highly accurate fit to the wearer’s head. To achieve this goal, a mass customisation (MC) framework was initiated. MC systems enable the association of the small unit costs of mass production with the compliance of individual customisation. Although MC is defined as the use of both computer-aided design and manufacturing systems to produce custom output, it was decided to focus exclusively, in this study, on the design part of the MC framework of bicycle helmets. More specifically, I tried to answer the following central research question: How can one automatically create commercially ready, custom-fit digital 3D models of bicycle helmets based on 3D anthropometric data? One objective was to create certified design models, since helmets must comply with relevant safety regulations to be sold in a country. Safety standards generally determine the amount of energy a helmet must absorb during a crash, which mostly affects the thickness of its foam liner. Since customisation plays a major role in the helmet liner’s thickness, special considerations on how the automatic process should affect the helmet’s shape were provided. Contrary to conventional helmet production techniques, this method was based on state of the art technologies and techniques, such as three-dimensional (3D) anthropometry, supervised and unsupervised machine-learning methods, and fully parametric design models. Indeed, until today, traditional 1D anthropometric data (e.g., head circumference, head length, and head breath) have been the primary sources of information used by ergonomists for the design of user-centred products such as helmets. Although these data are simple to use and understand, they only provide univariate measures of key dimensions, and these tend to only partially represent the actual shape characteristics of the head. However, 3D anthropometric data can capture the full shape of a scanned surface, thereby providing meaningful information for the design of properly fitted headgear. However, the interpretation of these data can be complicated due to the abundance of information they contain (i.e., a 3D head scan can contain up to several million data points). In recent years, the use of 3D measurements for product design has become more appealing thanks to the advances in mesh parameterization, multivariate analyses, and clustering algorithms. Such analyses and algorithms have been adopted in this project. To the author’s knowledge, this is the first time that these methods have been applied to the design of helmets within a mass customisation framework. As a result, a novel method has been developed to automatically create a complete, certified custom-fit 3D model of a bicycle helmet based on the 3D head scan of a specific individual. Even though the manufacturing of the generated customised helmets is not discussed in detail in this research, it is envisaged that the models could be fabricated using either advanced subtractive and additive manufacturing technologies (e.g., numerical control machining and 3D printing.), standard moulding techniques, or a combination of both. The proposed design framework was demonstrated using a case study where customised helmet models were created for Australian cyclists. The computed models were evaluated and validated using objective (digital models) fit assessments. Thus, a significant improvement in terms of fit accuracy was observed compared to commercially available helmet models. More specifically, a set of new techniques and algorithms were developed, which successively: (i) clean, repair, and transform a digitized head scan to a registered state; (ii) compare it to the population of interest and categorize it into a predefined group; and (iii) modify the group’s generic helmet 3D model to precisely follow the head shape considered. To successfully implement the described steps, a 3D anthropometric database comprising 222 Australian cyclists was first established using a cutting edge handheld white light 3D scanner. Subsequently, a clustering algorithm, called 3D-HEAD-CLUSTERING, was introduced to categorize individuals with similar head shapes into groups. The algorithm successfully classified 95% of the sample into four groups. A new supervised learning method was then developed to classify new customers into one of the four computed groups. It was named the 3D-HEAD-CLASSIFIER. Generic 3D helmet models were then generated for each of the computed groups using the minimum, maximum, and mean shapes of all the participants classified inside a group. The generic models were designed specifically to comply with the relevant safety standard when accounting for all the possible head shape variations within a group. Furthermore, a novel quantitative method that investigates the fit accuracy of helmets was presented. The creation of the new method was deemed necessary, since the scarce computational methods available in the literature for fit assessment of user-centred products were inadequate for the complex shapes of today’s modern bicycle helmets. The HELMET-FIT-INDEX (HFI) was thus introduced, providing a fit score ranging on a scale from 0 (excessively poor fit) to 100 (perfect fit) for a specific helmet and a specific individual. In-depth analysis of three commercially available helmets and 125 participants demonstrated a consistent correlation between subjective assessment of helmet fit and the index. The HFI provided a detailed understanding of helmet efficiency regarding fit. For example, it was shown that females and Asians experience lower helmet fit accuracy than males and Caucasians, respectively. The index was used during the MC design process to validate the high fit accuracy of the generated customised helmet models. As far as the author is aware, HFI is the first method to successfully demonstrate an ability to evaluate users’ feelings regarding fit using computational analysis. The user-centred framework presented in this work for the customisation of bicycle helmet models is proved to be a valuable alternative to the current standard design processes. With the new approach presented in this research study, the fit accuracy of bicycle helmets is optimised, improving both the comfort and the safety characteristics of the headgear. Notwithstanding the fact that the method is easily adjustable to other helmet types (e.g., motorcycle, rock climbing, football, military, and construction), the author believes that the development of similar MC frameworks for user-centred products such as shoes, glasses and gloves could be adapted effortlessly. Future work should first emphasise the fabrication side of the proposed MC system and describe how customised helmet models can be accommodated in a global supply chain model. Other research projects could focus on adjusting the proposed customisation framework to other user-centred products

Continuous Restoration of the Human Vestibulo-Ocular Reflex Using a Multichannel Vestibular Implant

Bilateral loss of vestibular sensation causes blurry vision during head movement, postural instability, chronic unsteadiness, and an increased fall risk. Individuals who fail to compensate despite rehabilitation therapy and cessation of exacerbating medications have no adequate treatment options. Inspired by the success of cochlear implants in restoring hearing, prosthetic stimulation of vestibular afferent neurons to encode head motion has been investigated as a potential treatment. Until now, no human had been continuously stimulated for more than a day, and human responses had not been assessed using 3-dimensional (3D) binocular oculography, without which one cannot determine whether an implant independently stimulates each of the implanted ear’s three semicircular canals. We report 3D binocular vestibulo-ocular reflex (VOR) responses in four human subjects with bilateral vestibular loss who were each implanted with a system designed to provide long-term motion-modulated prosthetic stimulation via electrodes in the semicircular canals of one ear. Initiation of prosthetic stimulation evoked nystagmus that decayed within 30 minutes. Stimulation targeting one canal produced 3D VOR responses aligned with that canal’s anatomic axis, while targeting canal pairs reliably yielded responses aligned with a vector sum of individual responses. Over 8 weeks of continuous use, modulated electrical stimulation produced robust and stable VOR responses that grew predictably with stimulus intensity and aligned approximately with any specified 3D head rotation axis. Combining mechanical and electrical stimulation enhanced low frequency responses. These results demonstrate that a vestibular implant can partially restore 3D inner ear sensation to individuals disabled by vestibular loss. Lastly, we show that temporal discretization inherent to cochlear implant signal processing has minimal effects on evoked responses, motivating a future combined device

Proficiency-aware systems

In an increasingly digital world, technological developments such as data-driven algorithms and context-aware applications create opportunities for novel human-computer interaction (HCI). We argue that these systems have the latent potential to stimulate users and encourage personal growth. However, users increasingly rely on the intelligence of interactive systems. Thus, it remains a challenge to design for proficiency awareness, essentially demanding increased user attention whilst preserving user engagement. Designing and implementing systems that allow users to become aware of their own proficiency and encourage them to recognize learning benefits is the primary goal of this research. In this thesis, we introduce the concept of proficiency-aware systems as one solution. In our definition, proficiency-aware systems use estimates of the user's proficiency to tailor the interaction in a domain and facilitate a reflective understanding for this proficiency. We envision that proficiency-aware systems leverage collected data for learning benefit. Here, we see self-reflection as a key for users to become aware of necessary efforts to advance their proficiency. A key challenge for proficiency-aware systems is the fact that users often have a different self-perception of their proficiency. The benefits of personal growth and advancing one's repertoire might not necessarily be apparent to users, alienating them, and possibly leading to abandoning the system. To tackle this challenge, this work does not rely on learning strategies but rather focuses on the capabilities of interactive systems to provide users with the necessary means to reflect on their proficiency, such as showing calculated text difficulty to a newspaper editor or visualizing muscle activity to a passionate sportsperson. We first elaborate on how proficiency can be detected and quantified in the context of interactive systems using physiological sensing technologies. Through developing interaction scenarios, we demonstrate the feasibility of gaze- and electromyography-based proficiency-aware systems by utilizing machine learning algorithms that can estimate users' proficiency levels for stationary vision-dominant tasks (reading, information intake) and dynamic manual tasks (playing instruments, fitness exercises). Secondly, we show how to facilitate proficiency awareness for users, including design challenges on when and how to communicate proficiency. We complement this second part by highlighting the necessity of toolkits for sensing modalities to enable the implementation of proficiency-aware systems for a wide audience. In this thesis, we contribute a definition of proficiency-aware systems, which we illustrate by designing and implementing interactive systems. We derive technical requirements for real-time, objective proficiency assessment and identify design qualities of communicating proficiency through user reflection. We summarize our findings in a set of design and engineering guidelines for proficiency awareness in interactive systems, highlighting that proficiency feedback makes performance interpretable for the user.In einer zunehmend digitalen Welt schaffen technologische Entwicklungen - wie datengesteuerte Algorithmen und kontextabhängige Anwendungen - neuartige Interaktionsmöglichkeiten mit digitalen Geräten. Jedoch verlassen sich Nutzer oftmals auf die Intelligenz dieser Systeme, ohne dabei selbst auf eine persönliche Weiterentwicklung hinzuwirken. Wird ein solches Vorgehen angestrebt, verlangt dies seitens der Anwender eine erhöhte Aufmerksamkeit. Es ist daher herausfordernd, ein entsprechendes Design für Kompetenzbewusstsein (Proficiency Awareness) zu etablieren. Das primäre Ziel dieser Arbeit ist es, eine Methodik für das Design und die Implementierung von interaktiven Systemen aufzustellen, die Nutzer dabei unterstützen über ihre eigene Kompetenz zu reflektieren, um dadurch Lerneffekte implizit wahrnehmen können. Diese Arbeit stellt ein Konzept für fähigkeitsbewusste Systeme (proficiency-aware systems) vor, welche die Fähigkeiten von Nutzern abschätzen, die Interaktion entsprechend anpassen sowie das Bewusstsein der Nutzer über deren Fähigkeiten fördern. Hierzu sollten die Systeme gesammelte Daten von Nutzern einsetzen, um Lerneffekte sichtbar zu machen. Die Möglichkeit der Anwender zur Selbstreflexion ist hierbei als entscheidend anzusehen, um als Motivation zur Verbesserung der eigenen Fähigkeiten zu dienen. Eine zentrale Herausforderung solcher Systeme ist die Tatsache, dass Nutzer - im Vergleich zur Abschätzung des Systems - oft eine divergierende Selbstwahrnehmung ihrer Kompetenz haben. Im ersten Moment sind daher die Vorteile einer persönlichen Weiterentwicklung nicht unbedingt ersichtlich. Daher baut diese Forschungsarbeit nicht darauf auf, Nutzer über vorgegebene Lernstrategien zu unterrichten, sondern sie bedient sich der Möglichkeiten interaktiver Systeme, die Anwendern die notwendigen Hilfsmittel zur Verfügung stellen, damit diese selbst über ihre Fähigkeiten reflektieren können. Einem Zeitungseditor könnte beispielsweise die aktuelle Textschwierigkeit angezeigt werden, während einem passionierten Sportler dessen Muskelaktivität veranschaulicht wird. Zunächst wird herausgearbeitet, wie sich die Fähigkeiten der Nutzer mittels physiologischer Sensortechnologien erkennen und quantifizieren lassen. Die Evaluation von Interaktionsszenarien demonstriert die Umsetzbarkeit fähigkeitsbewusster Systeme, basierend auf der Analyse von Blickbewegungen und Muskelaktivität. Hierbei kommen Algorithmen des maschinellen Lernens zum Einsatz, die das Leistungsniveau der Anwender für verschiedene Tätigkeiten berechnen. Im Besonderen analysieren wir stationäre Aktivitäten, die hauptsächlich den Sehsinn ansprechen (Lesen, Aufnahme von Informationen), sowie dynamische Betätigungen, die die Motorik der Nutzer fordern (Spielen von Instrumenten, Fitnessübungen). Der zweite Teil zeigt auf, wie Systeme das Bewusstsein der Anwender für deren eigene Fähigkeiten fördern können, einschließlich der Designherausforderungen , wann und wie das System erkannte Fähigkeiten kommunizieren sollte. Abschließend wird die Notwendigkeit von Toolkits für Sensortechnologien hervorgehoben, um die Implementierung derartiger Systeme für ein breites Publikum zu ermöglichen. Die Forschungsarbeit beinhaltet eine Definition für fähigkeitsbewusste Systeme und veranschaulicht dieses Konzept durch den Entwurf und die Implementierung interaktiver Systeme. Ferner werden technische Anforderungen objektiver Echtzeitabschätzung von Nutzerfähigkeiten erforscht und Designqualitäten für die Kommunikation dieser Abschätzungen mittels Selbstreflexion identifiziert. Zusammengefasst sind die Erkenntnisse in einer Reihe von Design- und Entwicklungsrichtlinien für derartige Systeme. Insbesondere die Kommunikation, der vom System erkannten Kompetenz, hilft Anwendern, die eigene Leistung zu interpretieren

Aerospace medicine and biology: A continuing bibliography with indexes (supplement 390)

This bibliography lists 102 reports, articles, and other documents introduced into the NASA Scientific and Technical Information System. Subject coverage includes: life sciences (general), aerospace medicine, behavioral sciences, man/system technology and life support, and space biology

Pathway to Future Symbiotic Creativity

This report presents a comprehensive view of our vision on the development path of the human-machine symbiotic art creation. We propose a classification of the creative system with a hierarchy of 5 classes, showing the pathway of creativity evolving from a mimic-human artist (Turing Artists) to a Machine artist in its own right. We begin with an overview of the limitations of the Turing Artists then focus on the top two-level systems, Machine Artists, emphasizing machine-human communication in art creation. In art creation, it is necessary for machines to understand humans' mental states, including desires, appreciation, and emotions, humans also need to understand machines' creative capabilities and limitations. The rapid development of immersive environment and further evolution into the new concept of metaverse enable symbiotic art creation through unprecedented flexibility of bi-directional communication between artists and art manifestation environments. By examining the latest sensor and XR technologies, we illustrate the novel way for art data collection to constitute the base of a new form of human-machine bidirectional communication and understanding in art creation. Based on such communication and understanding mechanisms, we propose a novel framework for building future Machine artists, which comes with the philosophy that a human-compatible AI system should be based on the "human-in-the-loop" principle rather than the traditional "end-to-end" dogma. By proposing a new form of inverse reinforcement learning model, we outline the platform design of machine artists, demonstrate its functions and showcase some examples of technologies we have developed. We also provide a systematic exposition of the ecosystem for AI-based symbiotic art form and community with an economic model built on NFT technology. Ethical issues for the development of machine artists are also discussed

Enabling Context-Awareness in Mobile Systems via Multi-Modal Sensing

<p>The inclusion of rich sensors on modern smartphones has changed mobile phones from simple communication devices to powerful human-centric sensing platforms. Similar trends are influencing other personal gadgets such as the tablets, cameras, and wearable devices like the Google glass. Together, these sensors can provide</p><p>a high-resolution view of the user's context, ranging from simple information like locations and activities, to high-level inferences about the users' intention, behavior, and social interactions. Understanding such context can help solving existing system-side</p><p>challenges and eventually enable a new world of real-life applications. </p><p>In this thesis, we propose to learn human behavior via multi-modal sensing. The intuition is that human behaviors leave footprints on different sensing dimensions - visual, acoustic, motion and in cyber space. By collaboratively analyzing these footprints, the system can obtain valuable insights about the user. We show that the</p><p>analysis results can lead to a series of applications including capturing life-logging videos, tagging user-generated photos and enabling new ways for human-object interactions. Moreover, the same intuition may potentially be applied to enhance existing</p><p>system-side functionalities - offloading, prefetching and compression.</p>Dissertatio

Development of a sensorized physical model of the human head for the innovation of helmet safety tests

Aim of the work is to present the design and development of an Instrumented Human Head Surrogate and display the Data collected during multi directional impacts while wearing a modern ski helmet

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task