Auxilio: A Sensor-Based Wireless Head-Mounted Mouse for People with Upper Limb Disability

Upper limb disability may be caused either due to accidents, neurological disorders, or even birth defects, imposing limitations and restrictions on the interaction with a computer for the concerned individuals using a generic optical mouse. Our work proposes the design and development of a working prototype of a sensor-based wireless head-mounted Assistive Mouse Controller (AMC), Auxilio, facilitating interaction with a computer for people with upper limb disability. Combining commercially available, low-cost motion and infrared sensors, Auxilio solely utilizes head and cheek movements for mouse control. Its performance has been juxtaposed with that of a generic optical mouse in different pointing tasks as well as in typing tasks, using a virtual keyboard. Furthermore, our work also analyzes the usability of Auxilio, featuring the System Usability Scale. The results of different experiments reveal the practicality and effectiveness of Auxilio as a head-mounted AMC for empowering the upper limb disabled community.Comment: 28 pages, 9 figures, 5 table

Advancing Medical Technology for Motor Impairment Rehabilitation: Tools, Protocols, and Devices

Excellent motor control skills are necessary to live a high-quality life. Activities such as walking, getting dressed, and feeding yourself may seem mundane, but injuries to the neuromuscular system can render these tasks difficult or even impossible to accomplish without assistance. Statistics indicate that well over 100 million people are affected by diseases or injuries, such as stroke, Parkinson’s Disease, Multiple Sclerosis, Cerebral Palsy, peripheral nerve injury, spinal cord injury, and amputation, that negatively impact their motor abilities. This wide array of injuries presents a challenge to the medical field as optimal treatment paradigms are often difficult to implement due to a lack of availability of appropriate assessment tools, the inability for people to access the appropriate medical centers for treatment, or altogether gaps in technology for treating the underlying impairments causing the disability. Addressing each of these challenges will improve the treatment of movement impairments, provide more customized and continuous treatment to a larger number of patients, and advance rehabilitative and assistive device technology. In my research, the key approach was to develop tools to assess and treat upper extremity movement impairment. In Chapter 2.1, I challenged a common biomechanical[GV1] modeling technique of the forearm. Comparing joint torque values through inverse dynamics simulation between two modeling platforms, I discovered that representing the forearm as a single cylindrical body was unable to capture the inertial parameters of a physiological forearm which is made up of two segments, the radius and ulna. I split the forearm segment into a proximal and distal segment, with the rationale being that the inertial parameters of the proximal segment could be tuned to those of the ulna and the inertial parameters of the distal segment could be tuned to those of the radius. Results showed a marked increase in joint torque calculation accuracy for those degrees of freedom that are affected by the inertial parameters of the radius and ulna. In Chapter 2.2, an inverse kinematic upper extremity model was developed for joint angle calculations from experimental motion capture data, with the rationale being that this would create an easy-to-use tool for clinicians and researchers to process their data. The results show accurate angle calculations when compared to algebraic solutions. Together, these chapters provide easy-to-use models and tools for processing movement assessment data. In Chapter 3.1, I developed a protocol to collect high-quality movement data in a virtual reality task that is used to assess hand function as part of a Box and Block Test. The goal of this chapter is to suggest a method to not only collect quality data in a research setting but can also be adapted for telehealth and at home movement assessment and rehabilitation. Results indicate that the data collected in this protocol are good and the virtual nature of this approach can make it a useful tool for continuous, data driven care in clinic or at home. In Chapter 3.2 I developed a high-density electromyography device for collecting motor unit action potentials of the arm. Traditional surface electromyography is limited by its ability to obtain signals from deep muscles and can also be time consuming to selectively place over appropriate muscles. With this high-density approach, muscle coverage is increased, placement time is decreased, and deep muscle activity can potentially be collected due to the high-density nature of the device[GV2] . Furthermore, the high-density electromyography device is built as a precursor to a high-density electromyography-electrical stimulation device for functional electrical stimulation. The customizable nature of the prototype in Chapter 3.2 allows for the implementation both recording and stimulating electrodes. Furthermore, signal results show that the electromyography data obtained from the device are of high quality and are correlated with gold standard surface electromyography sensors. One key factor in a device that can record and then stimulate based on the information from the recorded signals is an accurate movement intent decoder. High-quality movement decoders have been designed by closed-loop device controllers in the past, but they still struggle when the user interacts with objects of varying weight due to underlying alterations in muscle signals. In Chapter 4, I investigate this phenomenon by administering an experiment where participants perform a Box and Block Task with objects of 3 different weights, 0 kg, 0.02 kg, and 0.1 kg. Electromyography signals of the participants right arm were collected and co-contraction levels between antagonistic muscles were analyzed to uncover alterations in muscle forces and joint dynamics. Results indicated contraction differences between the conditions and also between movement stages (contraction levels before grabbing the block vs after touching the block) for each condition. This work builds a foundation for incorporating object weight estimates into closed-loop electromyography device movement decoders. Overall, we believe the chapters in this thesis provide a basis for increasing availability to movement assessment tools, increasing access to effective movement assessment and rehabilitation, and advance the medical device and technology field

Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice

Effects of Physical Exertion and Alignment Alterations on Trans-Tibial Amputee Gait, and Concurrent Validity of Prosthesis-Integrated Measurement of Gait Kinetics

This study investigated the effects of slight changes in the alignment of the artificial limb of trans-tibial amputees on the walking pattern on the level of forces and moments, particularly when physical exertion levels increase. Two alignment conditions were assessed in ten trans-tibial amputees while walking with low and with strong levels of exertion. Two separate data collection methods were utilized simultaneously: a conventional motion analysis, and continuous recordings from prosthesis-integrated force sensors. While the former was used to compare bilateral leg symmetry across conditions, the latter allowed analyzing unilateral step variability within subjects. This paper presents both analyses in separate chapters. A third chapter addresses the question of concurrent validity of the utilized integrated-sensor-based gait data collection method. Findings indicate that increased physical exertion and prosthesis ankle plantar-flexion angle was related to decreases in step length symmetry, maximal knee flexion angle, knee moment, and dorsi-flexion moment, but had no significant effect on an overall gait symmetry index. It was also shown, that effects were different among participants, with only three of them showing a significant change in parameters measured by the integrated sensor system. Integrated sensor measurements namely of axial force and joint moments were found to be closely correlated to conventional measurements, while pertaining to slightly different biomechanical quantities. The detected effects of alignment perturbations and physical exertion were small in magnitude and inconsistent between participants of our sample population. The concept of a range of acceptable prosthesis alignments, within which no optimization is feasible, is supported. However, amputee gait pattern and responses to alignment perturbations seem to change with the level of exertion. This suggests a consideration of real life conditions for the individual optimization of prosthetic alignment. Provided the systematic limitations of the integrated sensor measurements are carefully considered, it appears possible to use this method for the assessment of individual effects of alignment changes

Mechanical Redesign and Implementation of Intuitive User Input Methods for a Hand Exoskeleton Informed by User Studies on Individuals with Chronic Upper Limb Impairments

Individuals with upper limb motor deficits due to neurological conditions, such as stroke and traumatic brain injury, may exhibit hypertonia and spasticity, which makes it difficult for these individuals to open their hand. The Hand Orthosis with Powered Extension (HOPE) Hand was created in 2018. The performance of the HOPE Hand was evaluated by conducting a Box and Blocks test with an impaired subject. Improvements were identified and the HOPE Hand was mechanically redesigned to increase the functionality in performing grasps. The original motor configuration was reorganized to include active thumb flexion and extension, as well as thumb abduction/adduction. An Electromyography (EMG) study was conducted on 19 individuals (10 healthy, 9 impaired) to evaluate the viability of EMG device control for the specified user group. EMG control, voice control, and manual control were implemented with the HOPE Hand 2.0 and the exoskeleton system was tested for usability during a second Box and Blocks test

Signal Processing Using Non-invasive Physiological Sensors

Non-invasive biomedical sensors for monitoring physiological parameters from the human body for potential future therapies and healthcare solutions. Today, a critical factor in providing a cost-effective healthcare system is improving patients' quality of life and mobility, which can be achieved by developing non-invasive sensor systems, which can then be deployed in point of care, used at home or integrated into wearable devices for long-term data collection. Another factor that plays an integral part in a cost-effective healthcare system is the signal processing of the data recorded with non-invasive biomedical sensors. In this book, we aimed to attract researchers who are interested in the application of signal processing methods to different biomedical signals, such as an electroencephalogram (EEG), electromyogram (EMG), functional near-infrared spectroscopy (fNIRS), electrocardiogram (ECG), galvanic skin response, pulse oximetry, photoplethysmogram (PPG), etc. We encouraged new signal processing methods or the use of existing signal processing methods for its novel application in physiological signals to help healthcare providers make better decisions