A Multi-functional Touch Panel for Multi-Dimensional Sensing in Interactive Displays

This thesis presents a flexible graphene/polyvinylidene difluoride (PVDF)/graphene sandwich for three-dimensional touch interactivity. Here, an x-y plane touch is sensed using graphene capacitive elements, while force sensing in the z-direction is by a piezoelectric PVDF/graphene sandwich. By employing different frequency bands for the capacitive- and force-induced electrical signals, the two stimuli are detected simultaneously, achieving three-dimensional touch sensing. Static force sensing and elimination of propagated stress are achieved by augmenting the transient piezo output with the capacitive touch, thus overcoming the intrinsic inability of the piezoelectric material in detecting non-transient force signals and avoiding force touch mis-registration by propagated stress. As a capacitive signal is important for force touch interpretation, optimization algorithms have been developed and implemented. With correlated double sampling (CDS) and spatial low-pass filtering (SLPF) based techniques, the signal-to-noise ratio (SNR) of the capacitive touch signal is boosted by 15.6 dB, indicating improved detection accuracy. In terms of the readout speed, fixed pattern and random pattern related down-sampling techniques are applied, giving rise to reductions in both readout time (11.3 ms) and power consumption (8.79 mW).China Scholarship Counci

Machine Learning in Sensors and Imaging

Machine learning is extending its applications in various fields, such as image processing, the Internet of Things, user interface, big data, manufacturing, management, etc. As data are required to build machine learning networks, sensors are one of the most important technologies. In addition, machine learning networks can contribute to the improvement in sensor performance and the creation of new sensor applications. This Special Issue addresses all types of machine learning applications related to sensors and imaging. It covers computer vision-based control, activity recognition, fuzzy label classification, failure classification, motor temperature estimation, the camera calibration of intelligent vehicles, error detection, color prior model, compressive sensing, wildfire risk assessment, shelf auditing, forest-growing stem volume estimation, road management, image denoising, and touchscreens

From wearable towards epidermal computing : soft wearable devices for rich interaction on the skin

Human skin provides a large, always available, and easy to access real-estate for interaction. Recent advances in new materials, electronics, and human-computer interaction have led to the emergence of electronic devices that reside directly on the user's skin. These conformal devices, referred to as Epidermal Devices, have mechanical properties compatible with human skin: they are very thin, often thinner than human hair; they elastically deform when the body is moving, and stretch with the user's skin. Firstly, this thesis provides a conceptual understanding of Epidermal Devices in the HCI literature. We compare and contrast them with other technical approaches that enable novel on-skin interactions. Then, through a multi-disciplinary analysis of Epidermal Devices, we identify the design goals and challenges that need to be addressed for advancing this emerging research area in HCI. Following this, our fundamental empirical research investigated how epidermal devices of different rigidity levels affect passive and active tactile perception. Generally, a correlation was found between the device rigidity and tactile sensitivity thresholds as well as roughness discrimination ability. Based on these findings, we derive design recommendations for realizing epidermal devices. Secondly, this thesis contributes novel Epidermal Devices that enable rich on-body interaction. SkinMarks contributes to the fabrication and design of novel Epidermal Devices that are highly skin-conformal and enable touch, squeeze, and bend sensing with co-located visual output. These devices can be deployed on highly challenging body locations, enabling novel interaction techniques and expanding the design space of on-body interaction. Multi-Touch Skin enables high-resolution multi-touch input on the body. We present the first non-rectangular and high-resolution multi-touch sensor overlays for use on skin and introduce a design tool that generates such sensors in custom shapes and sizes. Empirical results from two technical evaluations confirm that the sensor achieves a high signal-to-noise ratio on the body under various grounding conditions and has a high spatial accuracy even when subjected to strong deformations. Thirdly, Epidermal Devices are in contact with the skin, they offer opportunities for sensing rich physiological signals from the body. To leverage this unique property, this thesis presents rapid fabrication and computational design techniques for realizing Multi-Modal Epidermal Devices that can measure multiple physiological signals from the human body. Devices fabricated through these techniques can measure ECG (Electrocardiogram), EMG (Electromyogram), and EDA (Electro-Dermal Activity). We also contribute a computational design and optimization method based on underlying human anatomical models to create optimized device designs that provide an optimal trade-off between physiological signal acquisition capability and device size. The graphical tool allows for easily specifying design preferences and to visually analyze the generated designs in real-time, enabling designer-in-the-loop optimization. Experimental results show high quantitative agreement between the prediction of the optimizer and experimentally collected physiological data. Finally, taking a multi-disciplinary perspective, we outline the roadmap for future research in this area by highlighting the next important steps, opportunities, and challenges. Taken together, this thesis contributes towards a holistic understanding of Epidermal Devices}: it provides an empirical and conceptual understanding as well as technical insights through contributions in DIY (Do-It-Yourself), rapid fabrication, and computational design techniques.Die menschliche Haut bietet eine große, stets verfügbare und leicht zugängliche Fläche für Interaktion. Jüngste Fortschritte in den Bereichen Materialwissenschaft, Elektronik und Mensch-Computer-Interaktion (Human-Computer-Interaction, HCI) [so that you can later use the Englisch abbreviation] haben zur Entwicklung elektronischer Geräte geführt, die sich direkt auf der Haut des Benutzers befinden. Diese sogenannten Epidermisgeräte haben mechanische Eigenschaften, die mit der menschlichen Haut kompatibel sind: Sie sind sehr dünn, oft dünner als ein menschliches Haar; sie verformen sich elastisch, wenn sich der Körper bewegt, und dehnen sich mit der Haut des Benutzers. Diese Thesis bietet, erstens, ein konzeptionelles Verständnis von Epidermisgeräten in der HCI-Literatur. Wir vergleichen sie mit anderen technischen Ansätzen, die neuartige Interaktionen auf der Haut ermöglichen. Dann identifizieren wir durch eine multidisziplinäre Analyse von Epidermisgeräten die Designziele und Herausforderungen, die angegangen werden müssen, um diesen aufstrebenden Forschungsbereich voranzubringen. Im Anschluss daran untersuchten wir in unserer empirischen Grundlagenforschung, wie epidermale Geräte unterschiedlicher Steifigkeit die passive und aktive taktile Wahrnehmung beeinflussen. Im Allgemeinen wurde eine Korrelation zwischen der Steifigkeit des Geräts und den taktilen Empfindlichkeitsschwellen sowie der Fähigkeit zur Rauheitsunterscheidung festgestellt. Basierend auf diesen Ergebnissen leiten wir Designempfehlungen für die Realisierung epidermaler Geräte ab. Zweitens trägt diese Thesis zu neuartigen Epidermisgeräten bei, die eine reichhaltige Interaktion am Körper ermöglichen. SkinMarks trägt zur Herstellung und zum Design neuartiger Epidermisgeräte bei, die hochgradig an die Haut angepasst sind und Berührungs-, Quetsch- und Biegesensoren mit gleichzeitiger visueller Ausgabe ermöglichen. Diese Geräte können an sehr schwierigen Körperstellen eingesetzt werden, ermöglichen neuartige Interaktionstechniken und erweitern den Designraum für die Interaktion am Körper. Multi-Touch Skin ermöglicht hochauflösende Multi-Touch-Eingaben am Körper. Wir präsentieren die ersten nicht-rechteckigen und hochauflösenden Multi-Touch-Sensor-Overlays zur Verwendung auf der Haut und stellen ein Design-Tool vor, das solche Sensoren in benutzerdefinierten Formen und Größen erzeugt. Empirische Ergebnisse aus zwei technischen Evaluierungen bestätigen, dass der Sensor auf dem Körper unter verschiedenen Bedingungen ein hohes Signal-Rausch-Verhältnis erreicht und eine hohe räumliche Auflösung aufweist, selbst wenn er starken Verformungen ausgesetzt ist. Drittens, da Epidermisgeräte in Kontakt mit der Haut stehen, bieten sie die Möglichkeit, reichhaltige physiologische Signale des Körpers zu erfassen. Um diese einzigartige Eigenschaft zu nutzen, werden in dieser Arbeit Techniken zur schnellen Herstellung und zum computergestützten Design von multimodalen Epidermisgeräten vorgestellt, die mehrere physiologische Signale des menschlichen Körpers messen können. Die mit diesen Techniken hergestellten Geräte können EKG (Elektrokardiogramm), EMG (Elektromyogramm) und EDA (elektrodermale Aktivität) messen. Darüber hinaus stellen wir eine computergestützte Design- und Optimierungsmethode vor, die auf den zugrunde liegenden anatomischen Modellen des Menschen basiert, um optimierte Gerätedesigns zu erstellen. Diese Designs bieten einen optimalen Kompromiss zwischen der Fähigkeit zur Erfassung physiologischer Signale und der Größe des Geräts. Das grafische Tool ermöglicht die einfache Festlegung von Designpräferenzen und die visuelle Analyse der generierten Designs in Echtzeit, was eine Optimierung durch den Designer im laufenden Betrieb ermöglicht. Experimentelle Ergebnisse zeigen eine hohe quantitative Übereinstimmung zwischen den Vorhersagen des Optimierers und den experimentell erfassten physiologischen Daten. Schließlich skizzieren wir aus einer multidisziplinären Perspektive einen Fahrplan für zukünftige Forschung in diesem Bereich, indem wir die nächsten wichtigen Schritte, Möglichkeiten und Herausforderungen hervorheben. Insgesamt trägt diese Arbeit zu einem ganzheitlichen Verständnis von Epidermisgeräten bei: Sie liefert ein empirisches und konzeptionelles Verständnis sowie technische Einblicke durch Beiträge zu DIY (Do-It-Yourself), schneller Fertigung und computergestützten Entwurfstechniken

New generation of interactive platforms based on novel printed smart materials

Programa doutoral em Engenharia Eletrónica e de Computadores (área de Instrumentação e Microssistemas Eletrónicos)The last decade was marked by the computer-paradigm changing with other digital devices suddenly becoming available to the general public, such as tablets and smartphones. A shift in perspective from computer to materials as the centerpiece of digital interaction is leading to a diversification of interaction contexts, objects and applications, recurring to intuitive commands and dynamic content that can proportionate more interesting and satisfying experiences. In parallel, polymer-based sensors and actuators, and their integration in different substrates or devices is an area of increasing scientific and technological interest, which current state of the art starts to permit the use of smart sensors and actuators embodied within the objects seamlessly. Electronics is no longer a rigid board with plenty of chips. New technological advances and perspectives now turned into printed electronics in polymers, textiles or paper. We are assisting to the actual scaling down of computational power into everyday use objects, a fusion of the computer with the material. Interactivity is being transposed to objects erstwhile inanimate. In this work, strain and deformation sensors and actuators were developed recurring to functional polymer composites with metallic and carbonaceous nanoparticles (NPs) inks, leading to capacitive, piezoresistive and piezoelectric effects, envisioning the creation of tangible user interfaces (TUIs). Based on smart polymer substrates such as polyvinylidene fluoride (PVDF) or polyethylene terephthalate (PET), among others, prototypes were prepared using piezoelectric and dielectric technologies. Piezoresistive prototypes were prepared with resistive inks and restive functional polymers. Materials were printed by screen printing, inkjet printing and doctor blade coating. Finally, a case study of the integration of the different materials and technologies developed is presented in a book-form factor.A última década foi marcada por uma alteração do paradigma de computador pelo súbito aparecimento dos tablets e smartphones para o público geral. A alteração de perspetiva do computador para os materiais como parte central de interação digital levou a uma diversificação dos contextos de interação, objetos e aplicações, recorrendo a comandos intuitivos e conteúdos dinâmicos capazes de tornarem a experiência mais interessante e satisfatória. Em simultâneo, sensores e atuadores de base polimérica, e a sua integração em diferentes substratos ou dispositivos é uma área de crescente interesse científico e tecnológico, e o atual estado da arte começa a permitir o uso de sensores e atuadores inteligentes perfeitamente integrados nos objetos. Eletrónica já não é sinónimo de placas rígidas cheias de componentes. Novas perspetivas e avanços tecnológicos transformaram-se em eletrónica impressa em polímeros, têxteis ou papel. Neste momento estamos a assistir à redução da computação a objetos do dia a dia, uma fusão do computador com a matéria. A interatividade está a ser transposta para objetos outrora inanimados. Neste trabalho foram desenvolvidos atuadores e sensores e de pressão e de deformação com recurso a compostos poliméricos funcionais com tintas com nanopartículas (NPs) metálicas ou de base carbónica, recorrendo aos efeitos capacitivo, piezoresistivo e piezoelétrico, com vista à criação de interfaces de usuário tangíveis (TUIs). Usando substratos poliméricos inteligentes tais como fluoreto de polivinilideno (PVDF) ou politereftalato de etileno (PET), entre outos, foi possível a preparação de protótipos de tecnologia piezoelétrica ou dielétrica. Os protótipos de tecnologia piezoresistiva foram feitos com tintas resistivas e polímeros funcionais resistivos. Os materiais foram impressos por serigrafia, jato de tinta, impressão por aerossol e revestimento de lâmina doctor blade. Para terminar, é apresentado um caso de estudo da integração dos diferentes materiais e tecnologias desenvolvidos sob o formato de um livro.This project was supported by FCT – Fundação para a Ciência e a Tecnologia, within the doctorate grant with reference SFRH/BD/110622/2015, by POCH – Programa Operacional Capital Humano, and by EU – European Union

Grasp-sensitive surfaces

Grasping objects with our hands allows us to skillfully move and manipulate them. Hand-held tools further extend our capabilities by adapting precision, power, and shape of our hands to the task at hand. Some of these tools, such as mobile phones or computer mice, already incorporate information processing capabilities. Many other tools may be augmented with small, energy-efficient digital sensors and processors. This allows for graspable objects to learn about the user grasping them - and supporting the user's goals. For example, the way we grasp a mobile phone might indicate whether we want to take a photo or call a friend with it - and thus serve as a shortcut to that action. A power drill might sense whether the user is grasping it firmly enough and refuse to turn on if this is not the case. And a computer mouse could distinguish between intentional and unintentional movement and ignore the latter. This dissertation gives an overview of grasp sensing for human-computer interaction, focusing on technologies for building grasp-sensitive surfaces and challenges in designing grasp-sensitive user interfaces. It comprises three major contributions: a comprehensive review of existing research on human grasping and grasp sensing, a detailed description of three novel prototyping tools for grasp-sensitive surfaces, and a framework for analyzing and designing grasp interaction: For nearly a century, scientists have analyzed human grasping. My literature review gives an overview of definitions, classifications, and models of human grasping. A small number of studies have investigated grasping in everyday situations. They found a much greater diversity of grasps than described by existing taxonomies. This diversity makes it difficult to directly associate certain grasps with users' goals. In order to structure related work and own research, I formalize a generic workflow for grasp sensing. It comprises *capturing* of sensor values, *identifying* the associated grasp, and *interpreting* the meaning of the grasp. A comprehensive overview of related work shows that implementation of grasp-sensitive surfaces is still hard, researchers often are not aware of related work from other disciplines, and intuitive grasp interaction has not yet received much attention. In order to address the first issue, I developed three novel sensor technologies designed for grasp-sensitive surfaces. These mitigate one or more limitations of traditional sensing techniques: **HandSense** uses four strategically positioned capacitive sensors for detecting and classifying grasp patterns on mobile phones. The use of custom-built high-resolution sensors allows detecting proximity and avoids the need to cover the whole device surface with sensors. User tests showed a recognition rate of 81%, comparable to that of a system with 72 binary sensors. **FlyEye** uses optical fiber bundles connected to a camera for detecting touch and proximity on arbitrarily shaped surfaces. It allows rapid prototyping of touch- and grasp-sensitive objects and requires only very limited electronics knowledge. For FlyEye I developed a *relative calibration* algorithm that allows determining the locations of groups of sensors whose arrangement is not known. **TDRtouch** extends Time Domain Reflectometry (TDR), a technique traditionally used for inspecting cable faults, for touch and grasp sensing. TDRtouch is able to locate touches along a wire, allowing designers to rapidly prototype and implement modular, extremely thin, and flexible grasp-sensitive surfaces. I summarize how these technologies cater to different requirements and significantly expand the design space for grasp-sensitive objects. Furthermore, I discuss challenges for making sense of raw grasp information and categorize interactions. Traditional application scenarios for grasp sensing use only the grasp sensor's data, and only for mode-switching. I argue that data from grasp sensors is part of the general usage context and should be only used in combination with other context information. For analyzing and discussing the possible meanings of grasp types, I created the GRASP model. It describes five categories of influencing factors that determine how we grasp an object: *Goal* -- what we want to do with the object, *Relationship* -- what we know and feel about the object we want to grasp, *Anatomy* -- hand shape and learned movement patterns, *Setting* -- surrounding and environmental conditions, and *Properties* -- texture, shape, weight, and other intrinsics of the object I conclude the dissertation with a discussion of upcoming challenges in grasp sensing and grasp interaction, and provide suggestions for implementing robust and usable grasp interaction.Die Fähigkeit, Gegenstände mit unseren Händen zu greifen, erlaubt uns, diese vielfältig zu manipulieren. Werkzeuge erweitern unsere Fähigkeiten noch, indem sie Genauigkeit, Kraft und Form unserer Hände an die Aufgabe anpassen. Digitale Werkzeuge, beispielsweise Mobiltelefone oder Computermäuse, erlauben uns auch, die Fähigkeiten unseres Gehirns und unserer Sinnesorgane zu erweitern. Diese Geräte verfügen bereits über Sensoren und Recheneinheiten. Aber auch viele andere Werkzeuge und Objekte lassen sich mit winzigen, effizienten Sensoren und Recheneinheiten erweitern. Dies erlaubt greifbaren Objekten, mehr über den Benutzer zu erfahren, der sie greift - und ermöglicht es, ihn bei der Erreichung seines Ziels zu unterstützen. Zum Beispiel könnte die Art und Weise, in der wir ein Mobiltelefon halten, verraten, ob wir ein Foto aufnehmen oder einen Freund anrufen wollen - und damit als Shortcut für diese Aktionen dienen. Eine Bohrmaschine könnte erkennen, ob der Benutzer sie auch wirklich sicher hält und den Dienst verweigern, falls dem nicht so ist. Und eine Computermaus könnte zwischen absichtlichen und unabsichtlichen Mausbewegungen unterscheiden und letztere ignorieren. Diese Dissertation gibt einen Überblick über Grifferkennung (*grasp sensing*) für die Mensch-Maschine-Interaktion, mit einem Fokus auf Technologien zur Implementierung griffempfindlicher Oberflächen und auf Herausforderungen beim Design griffempfindlicher Benutzerschnittstellen. Sie umfasst drei primäre Beiträge zum wissenschaftlichen Forschungsstand: einen umfassenden Überblick über die bisherige Forschung zu menschlichem Greifen und Grifferkennung, eine detaillierte Beschreibung dreier neuer Prototyping-Werkzeuge für griffempfindliche Oberflächen und ein Framework für Analyse und Design von griff-basierter Interaktion (*grasp interaction*). Seit nahezu einem Jahrhundert erforschen Wissenschaftler menschliches Greifen. Mein Überblick über den Forschungsstand beschreibt Definitionen, Klassifikationen und Modelle menschlichen Greifens. In einigen wenigen Studien wurde bisher Greifen in alltäglichen Situationen untersucht. Diese fanden eine deutlich größere Diversität in den Griffmuster als in existierenden Taxonomien beschreibbar. Diese Diversität erschwert es, bestimmten Griffmustern eine Absicht des Benutzers zuzuordnen. Um verwandte Arbeiten und eigene Forschungsergebnisse zu strukturieren, formalisiere ich einen allgemeinen Ablauf der Grifferkennung. Dieser besteht aus dem *Erfassen* von Sensorwerten, der *Identifizierung* der damit verknüpften Griffe und der *Interpretation* der Bedeutung des Griffes. In einem umfassenden Überblick über verwandte Arbeiten zeige ich, dass die Implementierung von griffempfindlichen Oberflächen immer noch ein herausforderndes Problem ist, dass Forscher regelmäßig keine Ahnung von verwandten Arbeiten in benachbarten Forschungsfeldern haben, und dass intuitive Griffinteraktion bislang wenig Aufmerksamkeit erhalten hat. Um das erstgenannte Problem zu lösen, habe ich drei neuartige Sensortechniken für griffempfindliche Oberflächen entwickelt. Diese mindern jeweils eine oder mehrere Schwächen traditioneller Sensortechniken: **HandSense** verwendet vier strategisch positionierte kapazitive Sensoren um Griffmuster zu erkennen. Durch die Verwendung von selbst entwickelten, hochauflösenden Sensoren ist es möglich, schon die Annäherung an das Objekt zu erkennen. Außerdem muss nicht die komplette Oberfläche des Objekts mit Sensoren bedeckt werden. Benutzertests ergaben eine Erkennungsrate, die vergleichbar mit einem System mit 72 binären Sensoren ist. **FlyEye** verwendet Lichtwellenleiterbündel, die an eine Kamera angeschlossen werden, um Annäherung und Berührung auf beliebig geformten Oberflächen zu erkennen. Es ermöglicht auch Designern mit begrenzter Elektronikerfahrung das Rapid Prototyping von berührungs- und griffempfindlichen Objekten. Für FlyEye entwickelte ich einen *relative-calibration*-Algorithmus, der verwendet werden kann um Gruppen von Sensoren, deren Anordnung unbekannt ist, semi-automatisch anzuordnen. **TDRtouch** erweitert Time Domain Reflectometry (TDR), eine Technik die üblicherweise zur Analyse von Kabelbeschädigungen eingesetzt wird. TDRtouch erlaubt es, Berührungen entlang eines Drahtes zu lokalisieren. Dies ermöglicht es, schnell modulare, extrem dünne und flexible griffempfindliche Oberflächen zu entwickeln. Ich beschreibe, wie diese Techniken verschiedene Anforderungen erfüllen und den *design space* für griffempfindliche Objekte deutlich erweitern. Desweiteren bespreche ich die Herausforderungen beim Verstehen von Griffinformationen und stelle eine Einteilung von Interaktionsmöglichkeiten vor. Bisherige Anwendungsbeispiele für die Grifferkennung nutzen nur Daten der Griffsensoren und beschränken sich auf Moduswechsel. Ich argumentiere, dass diese Sensordaten Teil des allgemeinen Benutzungskontexts sind und nur in Kombination mit anderer Kontextinformation verwendet werden sollten. Um die möglichen Bedeutungen von Griffarten analysieren und diskutieren zu können, entwickelte ich das GRASP-Modell. Dieses beschreibt fünf Kategorien von Einflussfaktoren, die bestimmen wie wir ein Objekt greifen: *Goal* -- das Ziel, das wir mit dem Griff erreichen wollen, *Relationship* -- das Verhältnis zum Objekt, *Anatomy* -- Handform und Bewegungsmuster, *Setting* -- Umgebungsfaktoren und *Properties* -- Eigenschaften des Objekts, wie Oberflächenbeschaffenheit, Form oder Gewicht. Ich schließe mit einer Besprechung neuer Herausforderungen bei der Grifferkennung und Griffinteraktion und mache Vorschläge zur Entwicklung von zuverlässiger und benutzbarer Griffinteraktion

DESIGN, OPTIMIZATION AND IMPLEMENTATION OF AN ORTHO-TAG RFID SYSTEM

There are two major problems with traditional methods of operating an RFID tag embedded on orthopedic implants by wireless transmission: (1) interference with metallic orthopedic implants causes significant signal attenuation around the RFID tag; (2) interference with other medical devices may lead to the failure of their functionality. The creation of a feasible solution to the above two problems is critical to the success of operation of implanted RFID devices embedded on or near metallic implants and in any other situation where wireless interference may occur. The solution proposed in this dissertation is the Ortho-tag RFID system which uses the conductivity of human tissue at radio frequencies for energy and signal transmission. With the viability experiments proving the feasibility of using volume conduction in this research, two present issues have been addressed: (1) the lack of availability of a matching technique between tissue/saline and the RFID device; (2) the lack of an efficiency study on the operation of RFID through tissue/saline with variable thickness. This fundamental work then details the development of a general solution for the above two issues, in a power and communication platform technology for implanted RFID devices. The platform is developed using equipment in the RFID Center of Excellence in which pig skin and saline are used as a medium for in vivo environment as human tissue surrogates. The selection and design of the volume conduction electrodes are discussed and optimized using ANSYS/HFSS. The system optimization focuses on matching the RFID reader and the tag to the tissue/saline based on an equivalent 2-port network model for tissue using Z parameters. Matching networks are designed and optimized so that the tag is matched to the tissue from the internal side, and the tissue is matched to the RFID reader from the external side. For high data rate considerations, two RFID frequencies are utilized for the Ortho-tag RFID system. The frequencies are HF at 13.56 MHz and UHF at 915 MHz. The system is finally prototyped and demonstrated as the proof of concept

Multi-Finger Haptic Devices Integrating Miniature Short-Stroke Actuators

The omnipresence of electronic devices in our everyday life goes together with a trend that makes us always more immersed during their utilization. By immersion, we mean that during the development of a new product, it is more and more required to stimulate several senses of the user so as to make the product more attractive. The sense of touch does not escape the rule and is more and more considered. Definitely democratized by its integration in smart phones with touchscreens, the haptic feedback allows enhancing the human-machine interactions in many ways. For instance by improving the comfort of use of a button through the modification of its force feedback. It can also offer an interactive experience during the manipulation of digital information and even improve the communication, particularly through the internet and for blind people, with the introduction of non-verbal signals. For these reasons, the present thesis focuses on the conception of multi-finger haptic devices, a new kind of peripherals integrating multiple actuators and capable of providing a fully programmable force feedback to the user's fingers. A global methodology is presented, outlining the different constituents necessary for their conception: actuator, sensor, control, communication and software user interface. Then, generic tools corresponding to the two first elements are presented. An accurate modeling of miniature electromagnetic short-stroke actuators is made possible thanks to the combination of 3D finite element modeling (FEM) and design of experiments (DOE). The non-usual behavior of magnetic flux lines in miniature actuators with relatively large airgaps imposes to avoid simplified analytical models and to use the reliable results of finite elements. The long computation times required by 3D FEM are balanced by the use of selective DOE making the modeling methodology easily adaptable, rapid and accurate. The parametrical model of the force provided by the modeling methodology is then integrated in a full parametrical setup allowing for the optimization of the actuator force using a conventional algorithm. The advantage of the parametrical optimization is that complementary non-linear constraints such as weight and temperature can be added, making the model multi-physic. Then, several original position measurement techniques using existing sensors are developed including a low-cost custom single-photointerrupter sensor allowing for direction discrimination for fast-prototyping and a hybrid sensing method using tiny Hall sensors and taking advantage of the leaks of the main actuator magnet. Two innovative self-sensing methods are then presented, allowing for the measurement of the mover position of linear short-stroke actuators. The first solution estimates the position of the coil by measuring the acceleration through the back emf. However in this case, a constant acceleration is required, which strongly restrains the application scope. The second solution allows for a real-time measurement of the position thanks to a passive oscillating RLC circuit influenced by the variation of the coil impedance. All the solutions presented are low-cost, compact and require few computation resources. Finally, in order to illustrate the methodology proposed along the thesis, several prototypes are fabricated, giving an overview of the possibilities offered by multi-finger haptic devices. A haptic numeric pad is notably used in an experiment made in collaboration with the University Service of Child and Adolescent Psychiatry in Lausanne with the aim of improving the impaired emotional processing of psychotic adolescents. Moreover, the successful identification of several touch sensations on the same haptic pad lays the first stones of a new tactile language

Partial Discharge Mitigation in Power Modules using an Automation-Driven Design Rule Development Method

Power modules used for the conversion and conditioning of electrical power for applications like electric vehicles, more-electric aircraft, the power grid, etc., are largely designed manually by engineers. Design automation of power modules is starting to gain recognition as a timely and necessary alternative to intuitive manual design and fabrication. With increasing need for wide bandgap materials that can operate at higher voltages, and the need to make modules more compact, hazards like electrical breakdown are more likely. Partial discharge (PD) is a silent and invisible precursor to electrical breakdown. It is compounded with compaction, creating a potential for electrical breakdown and catastrophic failure of the module package. Instead of being the limiting factor, or even a hazard, power module packages need to keep pace with the advancements being made in wide bandgap technology. While the automation of power module design is still new, and research and standards on PD in power modules are limited, this dissertation is a significant step in designing for high voltage operation while assessing tradeoffs against module compaction in an electronic design automation tool. This dissertation describes a method of systematically accounting for partial discharge in power modules using a unique approach where improvements to a module layout are determined in terms of design rules. Trace gaps, in this method, are designed to be functions of operating voltage, substrate and encapsulant material choice, and layer thicknesses of the substrate. These design rules are based on simulations that are validated by physical PD experiments. Furthermore, filleting is performed on the final layouts to further reduce PD by reducing the E-field concentrations by a third. This methodology has been implemented in PowerSynth, an in-house hardware-validated electronic design automation tool that performs electro-thermal and mechanical layout optimization. Before the implementation of this work, layouts were agnostic to PD. From the contribution of this work, the layouts now generated by the tool are PD-mitigated, with a maximum operating voltage for each layer stack. Below the rated voltage, the user can choose multiple voltage-trace gap trade off options for the layout. Demonstrating this implementation in this work shows that the user can achieve either a 24% improvement in voltage level, or a 20% improvement in area reduction, or a trade-off combination of the two. As layouts increase in complexity, these improvements will likely grow. The implementation of this work allows room for growth by allowing customized PD data libraries from various manufacturing lines to inform design rules much like a process design kit in the field of integrated circuit design. The designer using PowerSynth can: 1.) Use default libraries for design rules, or 2.) Perform their own simulations to augment the existing PD data library according to the method presented here, or 3.) Fabricate their own test structures and design corresponding simulations to develop their own complete PD data library and import it to PowerSynth. The manufacturable modules resulting from this tool are thus designed to be practical and reliable for high voltage operation