Analysis of Product Architectures of Pin Array Technologies for Tactile Displays

Refreshable tactile displays based on pin array technologies have a significant impact on the education of children with visual impairments, but they are prohibitively expensive. To better understand their design and the reason for the high cost, we created a database and analyzed the product architectures of 67 unique pin array technologies from literature and patents. We qualitatively coded their functional elements and analyzed the physical parts that execute the functions. Our findings highlight that pin array surfaces aim to achieve three key functions, i.e., raise and lower pins, lock pins, and create a large array. We also contribute a concise morphological chart that organises the various mechanisms for these three functions. Based on this, we discuss the reasons for the high cost and complexity of these surface haptic technologies and infer why larger displays and more affordable devices are not available. Our findings can be used to design new mechanisms for more affordable and scalable pin array display systems

FingerTac - A Wearable Tactile Thimble for Mobile Haptic Augmented Reality Applications

ingerTac is a novel concept for a wearable augmented haptic thimble. It makes use of the limited spatial discrimination capabilities of vibrotactile stimuli at the skin and generates tactile feedback perceived at the bottom center of a fingertip by applying simultaneous vibrations at both sides of the finger. Since the bottom of the finger is thus kept free of obstruction, the device is well promising for augmented haptic applications, where real world interactions need to be enriched or amalgamated with virtual tactile feedback. To minimize its lateral dimension, the vibration actuators are placed on top of the device, and mechanical links transmit the vibrations to the skin. Two evaluation studies with N=10 participants investigate (i) the loss of vibration intensity through these mechanical links, and (ii) the effect of lateral displacement between stimulus and induced vibration. The results of both studies support the introduced concept of the FingerTac

Towards tactile sensing active capsule endoscopy

Examination of the gastrointestinal(GI) tract has traditionally been performed using tethered endoscopy tools with limited reach and more recently with passive untethered capsule endoscopy with limited capability. Inspection of small intestines is only possible using the latter capsule endoscopy with on board camera system. Limited to visual means it cannot detect features beneath the lumen wall if they have not affected the lumen structure or colour. This work presents an improved capsule endoscopy system with locomotion for active exploration of the small intestines and tactile sensing to detect deformation of the capsule outer surface when it follows the intestinal wall. In laboratory conditions this system is capable of identifying sub-lumen features such as submucosal tumours.Through an extensive literary review the current state of GI tract inspection in particular using remote operated miniature robotics, was investigated, concluding no solution currently exists that utilises tactile sensing with a capsule endoscopy. In order to achieve such a platform, further investigation was made in to tactile sensing technologies, methods of locomotion through the gut, and methods to support an increased power requirement for additional electronics and actuation. A set of detailed criteria were compiled for a soft formed sensor and flexible bodied locomotion system. The sensing system is built on the biomimetic tactile sensing device, Tactip, \cite{Chorley2008, Chorley2010, Winstone2012, Winstone2013} which has been redesigned to fit the form of a capsule endoscopy. These modifications have required a $360^{o}$ cylindrical sensing surface with $360^{o}$ panoramic optical system. Multi-material 3D printing has been used to build an almost complete sensor assembly with a combination of hard and soft materials, presenting a soft compliant tactile sensing system that mimics the tactile sensing methods of the human finger. The cylindrical Tactip has been validated using artificial submucosal tumours in laboratory conditions. The first experiment has explored the new form factor and measured the device's ability to detect surface deformation when travelling through a pipe like structure with varying lump obstructions. Sensor data was analysed and used to reconstruct the test environment as a 3D rendered structure. A second tactile sensing experiment has explored the use of classifier algorithms to successfully discriminate between three tumour characteristics; shape, size and material hardness. Locomotion of the capsule endoscopy has explored further bio-inspiration from earthworm's peristaltic locomotion, which share operating environment similarities. A soft bodied peristaltic worm robot has been developed that uses a tuned planetary gearbox mechanism to displace tendons that contract each worm segment. Methods have been identified to optimise the gearbox parameter to a pipe like structure of a given diameter. The locomotion system has been tested within a laboratory constructed pipe environment, showing that using only one actuator, three independent worm segments can be controlled. This configuration achieves comparable locomotion capabilities to that of an identical robot with an actuator dedicated to each individual worm segment. This system can be miniaturised more easily due to reduced parts and number of actuators, and so is more suitable for capsule endoscopy. Finally, these two developments have been integrated to demonstrate successful simultaneous locomotion and sensing to detect an artificial submucosal tumour embedded within the test environment. The addition of both tactile sensing and locomotion have created a need for additional power beyond what is available from current battery technology. Early stage work has reviewed wireless power transfer (WPT) as a potential solution to this problem. Methods for optimisation and miniaturisation to implement WPT on a capsule endoscopy have been identified with a laboratory built system that validates the methods found. Future work would see this combined with a miniaturised development of the robot presented. This thesis has developed a novel method for sub-lumen examination. With further efforts to miniaturise the robot it could provide a comfortable and non-invasive procedure to GI tract inspection reducing the need for surgical procedures and accessibility for earlier stage of examination. Furthermore, these developments have applicability in other domains such as veterinary medicine, industrial pipe inspection and exploration of hazardous environments

Design of Novel Sensors and Instruments for Minimally Invasive Lung Tumour Localization via Palpation

Minimally Invasive Thoracoscopic Surgery (MITS) has become the treatment of choice for lung cancer. However, MITS prevents the surgeons from using manual palpation, thereby often making it challenging to reliably locate the tumours for resection. This thesis presents the design, analysis and validation of novel tactile sensors, a novel miniature force sensor, a robotic instrument, and a wireless hand-held instrument to address this limitation. The low-cost, disposable tactile sensors have been shown to easily detect a 5 mm tumour located 10 mm deep in soft tissue. The force sensor can measure six degrees of freedom forces and torques with temperature compensation using a single optical fiber. The robotic instrument is compatible with the da Vinci surgical robot and allows the use of tactile sensing, force sensing and ultrasound to localize the tumours. The wireless hand-held instrument allows the use of tactile sensing in procedures where a robot is not available

Contribution au micro-actionnement multi-stable piloté par radiations optiques

In this work, a bistable mechanism based on antagonistic pre-shaped double beams was proposed. Employing the proposed bistable mechanism, a quadristable micro-actuator was designed. ln order to validate the quadristability of the device, a meso-scaled prototype was fabricated from MDF by laser cutting. After the quadristability was experimentally confirmed, a quadristable micro-actuator was realized on SOl wafer using DRIE technique. Strokes for inner row and outer row were reduced to 300 µm and 200 µm respectively. For the actuation of the quadristable micro-actuator,laser heated SMA elements with deposited Si02 layer were used to realize the optical wireless actuation. With the help of a laser beam steering micro-mirror, both inner row and outer row were successfully actuated. ln order to further reduce the stroke, a bistable actuator with stroke reducing structure was designed and a prototype eut from MDF was tested. Bistability was validated and a stroke of 1µm was experimentally achieved. Based on this bistable module, a multistable nano-actuator, which contains four parallel coupled bistable modules,was designed and simulated. The simulated result have indicated that it was capable of outputs 16 discrete stable positions available from 0 nm to 150 nm with a step of 10 nm between two stable positions.Cette thèse traite le sujet du micro-actionnement multistable employant des radiations optiques pour atteindre les différentes positions offertes par le micro-actionneur. Dans le cadre des travaux réalisés, un mécanisme bistable reposant sur un principe de doubles poutres préformées situées en position antagoniste est proposé, et, sur cette brique élémentaire, un micro-actionneur quadristable a été conçu. Afin de valider le principe de fonctionnement de micro-actionneur, des procédés de fabrication Laser (sur le matériau « médium - MDF») puis DRIE (sur un wafer SOI de silicium) ont été utilisés. Sur le prototype en silicium, permettant une réduction des courses du rang interne et du rang externe du micro-actionneur, celles-ci ont été fixées à 300 µm et 200 µm respectivement. L’actionnement à distance de ce micro-actionneur a été prouvé en utilisant le chauffage laser d’un élément actif en Nitinol structuré par un dépôt de SiO2, ceci générant un effet « deux sens » de l’élément actif permettant d’annuler la charge sur les poutres du micro-actionneur une fois celui-ci déclenché puis en position stable. L’utilisation d’un banc expérimental incluant une membrane MEMS de balayage laser a permis de démontrer la quadristabilité du micro-actionneur sur 90 000 cycles. Afin de réduire davantage la course de ce micro-actionneur, des concepts de dispositifs de réduction de course ont été développés pour démontrer, à partir de prototypes fabriqué en MDF par usinage laser, la capacité à atteindre une course de 1 µm. Enfin, à la suite de ces travaux de réduction de course, un concept de nano-actionneur multistable a été proposé. Ce nano-actionneur est composé de quatre modules bistables liés et disposés en parallèle pour offrir 16 positions discrètes sur une course rectiligne. Les simulations de cet actionneur montrent la possibilité d’atteindre les 15 positions espacées de 10 nm sur une course de 150 nm