Distributed Sensing and Stimulation Systems Towards Sense of Touch Restoration in Prosthetics

Modern prostheses aim at restoring the functional and aesthetic characteristics of the lost limb. To foster prosthesis embodiment and functionality, it is necessary to restitute both volitional control and sensory feedback. Contemporary feedback interfaces presented in research use few sensors and stimulation units to feedback at most two discrete feedback variables (e.g. grasping force and aperture), whereas the human sense of touch relies on a distributed network of mechanoreceptors providing high-fidelity spatial information. To provide this type of feedback in prosthetics, it is necessary to sense tactile information from artificial skin placed on the prosthesis and transmit tactile feedback above the amputation in order to map the interaction between the prosthesis and the environment. This thesis proposes the integration of distributed sensing systems (e-skin) to acquire tactile sensation, and non-invasive multichannel electrotactile feedback and virtual reality to deliver high-bandwidth information to the user. Its core focus addresses the development and testing of close-loop sensory feedback human-machine interface, based on the latest distributed sensing and stimulation techniques for restoring the sense of touch in prosthetics. To this end, the thesis is comprised of two introductory chapters that describe the state of art in the field, the objectives and the used methodology and contributions; as well as three studies distributed over stimulation system level and sensing system level. The first study presents the development of close-loop compensatory tracking system to evaluate the usability and effectiveness of electrotactile sensory feedback in enabling real-time close-loop control in prosthetics. It examines and compares the subject\u2019s adaptive performance and tolerance to random latencies while performing the dynamic control task (i.e. position control) and simultaneously receiving either visual feedback or electrotactile feedback for communicating the momentary tracking error. Moreover, it reported the minimum time delay needed for an abrupt impairment of users\u2019 performance. The experimental results have shown that electrotactile feedback performance is less prone to changes with longer delays. However, visual feedback drops faster than electrotactile with increased time delays. This is a good indication for the effectiveness of electrotactile feedback in enabling close- loop control in prosthetics, since some delays are inevitable. The second study describes the development of a novel non-invasive compact multichannel interface for electrotactile feedback, containing 24 pads electrode matrix, with fully programmable stimulation unit, that investigates the ability of able-bodied human subjects to localize the electrotactile stimulus delivered through the electrode matrix. Furthermore, it designed a novel dual parameter -modulation (interleaved frequency and intensity) and compared it to conventional stimulation (same frequency for all pads). In addition and for the first time, it compared the electrotactile stimulation to mechanical stimulation. More, it exposes the integration of virtual prosthesis with the developed system in order to achieve better user experience and object manipulation through mapping the acquired real-time collected tactile data and feedback it simultaneously to the user. The experimental results demonstrated that the proposed interleaved coding substantially improved the spatial localization compared to same-frequency stimulation. Furthermore, it showed that same-frequency stimulation was equivalent to mechanical stimulation, whereas the performance with dual-parameter modulation was significantly better. The third study presents the realization of a novel, flexible, screen- printed e-skin based on P(VDF-TrFE) piezoelectric polymers, that would cover the fingertips and the palm of the prosthetic hand (particularly the Michelangelo hand by Ottobock) and an assistive sensorized glove for stroke patients. Moreover, it developed a new validation methodology to examine the sensors behavior while being solicited. The characterization results showed compatibility between the expected (modeled) behavior of the electrical response of each sensor to measured mechanical (normal) force at the skin surface, which in turn proved the combination of both fabrication and assembly processes was successful. This paves the way to define a practical, simplified and reproducible characterization protocol for e-skin patches In conclusion, by adopting innovative methodologies in sensing and stimulation systems, this thesis advances the overall development of close-loop sensory feedback human-machine interface used for restoration of sense of touch in prosthetics. Moreover, this research could lead to high-bandwidth high-fidelity transmission of tactile information for modern dexterous prostheses that could ameliorate the end user experience and facilitate it acceptance in the daily life

Crexens™: an expandable general-purpose electrochemical analyzer

2019 Fall.Includes bibliographical references.Electrochemical analysis has gained a great deal of attention of late due to its low-cost, easy-to-perform, and easy-to-miniaturize, especially in personal health care where accuracy and mobility are key factors to bring diagnostics to patients. According to data from Centers for Medicare & Medicaid Services (CMS) in the US, the share of health expenditure in the US has been kept growing in the past 3 decades and reached 17.9% of its overall Gross Domestic Product till 2016, which is equivalent to $10,348 for every person in the US per year. On the other hand, health care resources are often limited not only in rural area but also appeared in well-developed countries. The urgent need and the lack of health resource brings to front the research interest of Point-of-Care (PoC) diagnosis devices. Electrochemical methods have been largely adopted by chemist and biologist for their research purposes. However, several issues exist within current commercial benchtop instruments for electrochemical measurement. First of all, the current commercial instruments are usually bulky and do not have handheld feature for point-of-care applications and the cost are easily near$5,000 each or above. Secondly, most of the instruments do not have good integration level that can perform different types of electrochemical measurements for different applications. The last but not the least, the existing generic benchtops instruments for electrochemical measurements have complex operational procedures that require users to have a sufficient biochemistry and electrochemistry background to operate them correctly. The proposed Crexens™ analyzer platform is aimed to present an affordable electrochemical analyzerwhile achieving comparable performance to the existing commercial instruments, thus, making general electrochemical measurement applications accessible to general public. In this dissertation, the overall Crexens™ electrochemical analyzer architecture and its evolution are presented. The foundation of the Crexens™ architecture was derived from two separate but related research in electrochemical sensing. One of them is a microelectrode sensor array using CMOS for neurotransmitter sensing; the other one is a DNA affinity-based capacitive sensor for infectious disease, such as ZIKA. The CMOS microelectrode sensor array achieved a 320uM sensitivity for norepinephrine, whereas the capacitive sensor achieved a dynamic range of detection from 1 /uL to 105 /uL target molecules (20 to 2 million targets), which makes it be within the detection range in a typical clinical application environment. This dissertation also covers the design details of the CMOS microelectrode array sensor and the capacitive sensor design as a prelude to the development of the Crexens™ analyzer architecture. Finally, an expandable integrated electrochemical analyzer architecture (Crexens™) has been designed for mobile point-of-care (POC) applications. Electrochemical methods have been explored in detecting various bio-molecules such as glucose, lactate, protein, DNA, neurotransmitter, steroid hormone, which resulted in good sensitivity and selectivity. The proposed system is capable of running electrochemical experiments including cyclic voltammetry (CV), electrochemical impedance spectroscopy (EIS), electrochemical capacitive spectroscopy (ECS), amperometry, potentiometry, and other derived electrochemical based tests. This system consist of a front-end interface to sensor electrodes, a back-end user interface on smart phone and PC, a base unit as master module, a low-noise add-on module, a high-speed add-on module, and a multi-channel add-on module. The architecture allows LEGO™-like capability to stack add-on modules on to the base-unit for performance enhancements in noise, speed or parallelism. The analyzer is capable of performing up to 1900 V/s CV with 10 mV step, up to 12 kHz EIS scan range and a limit of detection at 637 pA for amperometric applications with the base module. With high performance module, the EIS scan range can be extended upto 5 MHz. The limit of detection can be further improved to be at 333 fA using the low-noise module. The form factor of the electrochemical analyzer is designed for its mobile/point-of-care applications, integrating its entire functionality on to a 70 cm² area of surface space. A glutamine enzymatic sensor was used to valid the capability of the proposed electrochemical analyzer and turned out to give good linearity and reached a limit of detection at 50 uM

Digital CMOS ISFET architectures and algorithmic methods for point-of-care diagnostics

Over the past decade, the surge of infectious diseases outbreaks across the globe is redefining how healthcare is provided and delivered to patients, with a clear trend towards distributed diagnosis at the Point-of-Care (PoC). In this context, Ion-Sensitive Field Effect Transistors (ISFETs) fabricated on standard CMOS technology have emerged as a promising solution to achieve a precise, deliverable and inexpensive platform that could be deployed worldwide to provide a rapid diagnosis of infectious diseases. This thesis presents advancements for the future of ISFET-based PoC diagnostic platforms, proposing and implementing a set of hardware and software methodologies to overcome its main challenges and enhance its sensing capabilities. The first part of this thesis focuses on novel hardware architectures that enable direct integration with computational capabilities while providing pixel programmability and adaptability required to overcome pressing challenges on ISFET-based PoC platforms. This section explores oscillator-based ISFET architectures, a set of sensing front-ends that encodes the chemical information on the duty cycle of a PWM signal. Two initial architectures are proposed and fabricated in AMS 0.35um, confirming multiple degrees of programmability and potential for multi-sensing. One of these architectures is optimised to create a dual-sensing pixel capable of sensing both temperature and chemical information on the same spatial point while modulating this information simultaneously on a single waveform. This dual-sensing capability, verified in silico using TSMC 0.18um process, is vital for DNA-based diagnosis where protocols such as LAMP or PCR require precise thermal control. The COVID-19 pandemic highlighted the need for a deliverable diagnosis that perform nucleic acid amplification tests at the PoC, requiring minimal footprint by integrating sensing and computational capabilities. In response to this challenge, a paradigm shift is proposed, advocating for integrating all elements of the portable diagnostic platform under a single piece of silicon, realising a ``Diagnosis-on-a-Chip". This approach is enabled by a novel Digital ISFET Pixel that integrates both ADC and memory with sensing elements on each pixel, enhancing its parallelism. Furthermore, this architecture removes the need for external instrumentation or memories and facilitates its integration with computational capabilities on-chip, such as the proposed ARM Cortex M3 system. These computational capabilities need to be complemented with software methods that enable sensing enhancement and new applications using ISFET arrays. The second part of this thesis is devoted to these methods. Leveraging the programmability capabilities available on oscillator-based architectures, various digital signal processing algorithms are implemented to overcome the most urgent ISFET non-idealities, such as trapped charge, drift and chemical noise. These methods enable fast trapped charge cancellation and enhanced dynamic range through real-time drift compensation, achieving over 36 hours of continuous monitoring without pixel saturation. Furthermore, the recent development of data-driven models and software methods open a wide range of opportunities for ISFET sensing and beyond. In the last section of this thesis, two examples of these opportunities are explored: the optimisation of image compression algorithms on chemical images generated by an ultra-high frame-rate ISFET array; and a proposed paradigm shift on surface Electromyography (sEMG) signals, moving from data-harvesting to information-focused sensing. These examples represent an initial step forward on a journey towards a new generation of miniaturised, precise and efficient sensors for PoC diagnostics.Open Acces

Design, control and error analysis of a fast tool positioning system for ultra-precision machining of freeform surfaces

This thesis was previously held under moratorium from 03/12/19 to 03/12/21Freeform surfaces are widely found in advanced imaging and illumination systems, orthopaedic implants, high-power beam shaping applications, and other high-end scientific instruments. They give the designers greater ability to cope with the performance limitations commonly encountered in simple-shape designs. However, the stringent requirements for surface roughness and form accuracy of freeform components pose significant challenges for current machining techniques—especially in the optical and display market where large surfaces with tens of thousands of micro features are to be machined. Such highly wavy surfaces require the machine tool cutter to move rapidly while keeping following errors small. Manufacturing efficiency has been a bottleneck in these applications. The rapidly changing cutting forces and inertial forces also contribute a great deal to the machining errors. The difficulty in maintaining good surface quality under conditions of high operational frequency suggests the need for an error analysis approach that can predict the dynamic errors. The machining requirements also impose great challenges on machine tool design and the control process. There has been a knowledge gap on how the mechanical structural design affects the achievable positioning stability. The goal of this study was to develop a tool positioning system capable of delivering fast motion with the required positioning accuracy and stiffness for ultra-precision freeform manufacturing. This goal is achieved through deterministic structural design, detailed error analysis, and novel control algorithms. Firstly, a novel stiff-support design was proposed to eliminate the structural and bearing compliances in the structural loop. To implement the concept, a fast positioning device was developed based on a new-type flat voice coil motor. Flexure bearing, magnet track, and motor coil parameters were designed and calculated in detail. A high-performance digital controller and a power amplifier were also built to meet the servo rate requirement of the closed-loop system. A thorough understanding was established of how signals propagated within the control system, which is fundamentally important in determining the loop performance of high-speed control. A systematic error analysis approach based on a detailed model of the system was proposed and verified for the first time that could reveal how disturbances contribute to the tool positioning errors. Each source of disturbance was treated as a stochastic process, and these disturbances were synthesised in the frequency domain. The differences between following error and real positioning error were discussed and clarified. The predicted spectrum of following errors agreed with the measured spectrum across the frequency range. It is found that the following errors read from the control software underestimated the real positioning errors at low frequencies and overestimated them at high frequencies. The error analysis approach thus successfully revealed the real tool positioning errors that are mingled with sensor noise. Approaches to suppress disturbances were discussed from the perspectives of both system design and control. A deterministic controller design approach was developed to preclude the uncertainty associated with controller tuning, resulting in a control law that can minimize positioning errors. The influences of mechanical parameters such as mass, damping, and stiffness were investigated within the closed-loop framework. Under a given disturbance condition, the optimal bearing stiffness and optimal damping coefficients were found. Experimental positioning tests showed that a larger moving mass helped to combat all disturbances but sensor noise. Because of power limits, the inertia of the fast tool positioning system could not be high. A control algorithm with an additional acceleration-feedback loop was then studied to enhance the dynamic stiffness of the cutting system without any need for large inertia. An analytical model of the dynamic stiffness of the system with acceleration feedback was established. The dynamic stiffness was tested by frequency response tests as well as by intermittent diamond-turning experiments. The following errors and the form errors of the machined surfaces were compared with the estimates provided by the model. It is found that the dynamic stiffness within the acceleration sensor bandwidth was proportionally improved. The additional acceleration sensor brought a new error source into the loop, and its contribution of errors increased with a larger acceleration gain. At a certain point, the error caused by the increased acceleration gain surpassed other disturbances and started to dominate, representing the practical upper limit of the acceleration gain. Finally, the developed positioning system was used to cut some typical freeform surfaces. A surface roughness of 1.2 nm (Ra) was achieved on a NiP alloy substrate in flat cutting experiments. Freeform surfaces—including beam integrator surface, sinusoidal surface, and arbitrary freeform surface—were successfully machined with optical-grade quality. Ideas for future improvements were proposed in the end of this thesis.Freeform surfaces are widely found in advanced imaging and illumination systems, orthopaedic implants, high-power beam shaping applications, and other high-end scientific instruments. They give the designers greater ability to cope with the performance limitations commonly encountered in simple-shape designs. However, the stringent requirements for surface roughness and form accuracy of freeform components pose significant challenges for current machining techniques—especially in the optical and display market where large surfaces with tens of thousands of micro features are to be machined. Such highly wavy surfaces require the machine tool cutter to move rapidly while keeping following errors small. Manufacturing efficiency has been a bottleneck in these applications. The rapidly changing cutting forces and inertial forces also contribute a great deal to the machining errors. The difficulty in maintaining good surface quality under conditions of high operational frequency suggests the need for an error analysis approach that can predict the dynamic errors. The machining requirements also impose great challenges on machine tool design and the control process. There has been a knowledge gap on how the mechanical structural design affects the achievable positioning stability. The goal of this study was to develop a tool positioning system capable of delivering fast motion with the required positioning accuracy and stiffness for ultra-precision freeform manufacturing. This goal is achieved through deterministic structural design, detailed error analysis, and novel control algorithms. Firstly, a novel stiff-support design was proposed to eliminate the structural and bearing compliances in the structural loop. To implement the concept, a fast positioning device was developed based on a new-type flat voice coil motor. Flexure bearing, magnet track, and motor coil parameters were designed and calculated in detail. A high-performance digital controller and a power amplifier were also built to meet the servo rate requirement of the closed-loop system. A thorough understanding was established of how signals propagated within the control system, which is fundamentally important in determining the loop performance of high-speed control. A systematic error analysis approach based on a detailed model of the system was proposed and verified for the first time that could reveal how disturbances contribute to the tool positioning errors. Each source of disturbance was treated as a stochastic process, and these disturbances were synthesised in the frequency domain. The differences between following error and real positioning error were discussed and clarified. The predicted spectrum of following errors agreed with the measured spectrum across the frequency range. It is found that the following errors read from the control software underestimated the real positioning errors at low frequencies and overestimated them at high frequencies. The error analysis approach thus successfully revealed the real tool positioning errors that are mingled with sensor noise. Approaches to suppress disturbances were discussed from the perspectives of both system design and control. A deterministic controller design approach was developed to preclude the uncertainty associated with controller tuning, resulting in a control law that can minimize positioning errors. The influences of mechanical parameters such as mass, damping, and stiffness were investigated within the closed-loop framework. Under a given disturbance condition, the optimal bearing stiffness and optimal damping coefficients were found. Experimental positioning tests showed that a larger moving mass helped to combat all disturbances but sensor noise. Because of power limits, the inertia of the fast tool positioning system could not be high. A control algorithm with an additional acceleration-feedback loop was then studied to enhance the dynamic stiffness of the cutting system without any need for large inertia. An analytical model of the dynamic stiffness of the system with acceleration feedback was established. The dynamic stiffness was tested by frequency response tests as well as by intermittent diamond-turning experiments. The following errors and the form errors of the machined surfaces were compared with the estimates provided by the model. It is found that the dynamic stiffness within the acceleration sensor bandwidth was proportionally improved. The additional acceleration sensor brought a new error source into the loop, and its contribution of errors increased with a larger acceleration gain. At a certain point, the error caused by the increased acceleration gain surpassed other disturbances and started to dominate, representing the practical upper limit of the acceleration gain. Finally, the developed positioning system was used to cut some typical freeform surfaces. A surface roughness of 1.2 nm (Ra) was achieved on a NiP alloy substrate in flat cutting experiments. Freeform surfaces—including beam integrator surface, sinusoidal surface, and arbitrary freeform surface—were successfully machined with optical-grade quality. Ideas for future improvements were proposed in the end of this thesis