A review on model-based and model-free approaches to control soft actuators and their potentials in colonoscopy

Colorectal cancer (CRC) is the third most common cancer worldwide and responsible for approximately 1 million deaths annually. Early screening is essential to increase the chances of survival, and it can also reduce the cost of treatments for healthcare centres. Colonoscopy is the gold standard for CRC screening and treatment, but it has several drawbacks, including difficulty in manoeuvring the device, patient discomfort, and high cost. Soft endorobots, small and compliant devices thatcan reduce the force exerted on the colonic wall, offer a potential solution to these issues. However, controlling these soft robots is challenging due to their deformable materials and the limitations of mathematical models. In this Review, we discuss model-free and model-based approaches for controlling soft robots that can potentially be applied to endorobots for colonoscopy. We highlight the importance of selecting appropriate control methods based on various parameters, such as sensor and actuator solutions. This review aims to contribute to the development of smart control strategies for soft endorobots that can enhance the effectiveness and safety of robotics in colonoscopy. These strategies can be defined based on the available information about the robot and surrounding environment, control demands, mechanical design impact and characterization data based on calibration.<br/

Snake Robots for Surgical Applications: A Review

Although substantial advancements have been achieved in robot-assisted surgery, the blueprint to existing snake robotics predominantly focuses on the preliminary structural design, control, and human–robot interfaces, with features which have not been particularly explored in the literature. This paper aims to conduct a review of planning and operation concepts of hyper-redundant serpentine robots for surgical use, as well as any future challenges and solutions for better manipulation. Current researchers in the field of the manufacture and navigation of snake robots have faced issues, such as a low dexterity of the end-effectors around delicate organs, state estimation and the lack of depth perception on two-dimensional screens. A wide range of robots have been analysed, such as the i2Snake robot, inspiring the use of force and position feedback, visual servoing and augmented reality (AR). We present the types of actuation methods, robot kinematics, dynamics, sensing, and prospects of AR integration in snake robots, whilst addressing their shortcomings to facilitate the surgeon’s task. For a smoother gait control, validation and optimization algorithms such as deep learning databases are examined to mitigate redundancy in module linkage backlash and accidental self-collision. In essence, we aim to provide an outlook on robot configurations during motion by enhancing their material compositions within anatomical biocompatibility standards

Development of a Highly Flexible and Stretchable Tubular Shape Tactile Sensor Array

University of Minnesota M.S.E.E. thesis. August 2016. Major: Electrical Engineering. Advisors: Jing Bai, Debao Zhou. 1 computer file (PDF); viii, 68 pages.Highly flexible skin-like sensors, such as electrical skin (e-skin) sensor for pressure measurement, have the potential to provide quantitative physical contact assessments, when equipped on household and medical devices to benefit human society. One of the promising applications is to monitor the contact pressure of a colonoscope to the colonic wall during a colonoscopy to reduce the possibility of perforation and hemorrhaging.Colon, as the largest intestine, is a long winding tube at end of human's digestive tract. Many disorders affect the colon's ability to work properly, thus the American Cancer Society suggests that citizens over 50 years old should be subject to a colon screen test. However, risks do exist during colonoscopy. A rate of 0.19% perforation occurs in the diagnostic colonoscopy. Many attempts have been made to fabricate highly stretchable electronic devices, but no effort has been made to design or investigate the mechanical behaviors of a tubular-shaped e-skin that meet the need for controlling the risks during colonoscopy. In this project, a high performance three-layer tactile sensor array was designed and fabricated, and a pressure detection system was set up as well. The operating mode was thoroughly investigated and the pressure detection on curved surface, such as a tube was realized. A detailed study about false positive error was performed to improve the sensor’s reliability and accuracy. Based on a tubular-shaped, highly flexible skin-like sensor array we developed, we conducted both modeling and experimental studies on the change of the maximum pressure distribution of a tubular e-skin sensor under various bending conditions with and without external compressive forces. These studies revealed the value of the maximum stress on a tubular shaped e-skin sensor array when bent. The measuring errors due to bending in pressure detection during colonoscopy can be quantified for compensation. Thus, high accuracy diagnose can be achieved. Based on all these work, the pressure detection in the colon-simulator was successfully realized. The results could also be used to address strategies on optimizing the design of tactile sensors for other medical application

Towards tactile sensing active capsule endoscopy

Examination of the gastrointestinal(GI) tract has traditionally been performed using tethered endoscopy tools with limited reach and more recently with passive untethered capsule endoscopy with limited capability. Inspection of small intestines is only possible using the latter capsule endoscopy with on board camera system. Limited to visual means it cannot detect features beneath the lumen wall if they have not affected the lumen structure or colour. This work presents an improved capsule endoscopy system with locomotion for active exploration of the small intestines and tactile sensing to detect deformation of the capsule outer surface when it follows the intestinal wall. In laboratory conditions this system is capable of identifying sub-lumen features such as submucosal tumours.Through an extensive literary review the current state of GI tract inspection in particular using remote operated miniature robotics, was investigated, concluding no solution currently exists that utilises tactile sensing with a capsule endoscopy. In order to achieve such a platform, further investigation was made in to tactile sensing technologies, methods of locomotion through the gut, and methods to support an increased power requirement for additional electronics and actuation. A set of detailed criteria were compiled for a soft formed sensor and flexible bodied locomotion system. The sensing system is built on the biomimetic tactile sensing device, Tactip, \cite{Chorley2008, Chorley2010, Winstone2012, Winstone2013} which has been redesigned to fit the form of a capsule endoscopy. These modifications have required a $360^{o}$ cylindrical sensing surface with $360^{o}$ panoramic optical system. Multi-material 3D printing has been used to build an almost complete sensor assembly with a combination of hard and soft materials, presenting a soft compliant tactile sensing system that mimics the tactile sensing methods of the human finger. The cylindrical Tactip has been validated using artificial submucosal tumours in laboratory conditions. The first experiment has explored the new form factor and measured the device's ability to detect surface deformation when travelling through a pipe like structure with varying lump obstructions. Sensor data was analysed and used to reconstruct the test environment as a 3D rendered structure. A second tactile sensing experiment has explored the use of classifier algorithms to successfully discriminate between three tumour characteristics; shape, size and material hardness. Locomotion of the capsule endoscopy has explored further bio-inspiration from earthworm's peristaltic locomotion, which share operating environment similarities. A soft bodied peristaltic worm robot has been developed that uses a tuned planetary gearbox mechanism to displace tendons that contract each worm segment. Methods have been identified to optimise the gearbox parameter to a pipe like structure of a given diameter. The locomotion system has been tested within a laboratory constructed pipe environment, showing that using only one actuator, three independent worm segments can be controlled. This configuration achieves comparable locomotion capabilities to that of an identical robot with an actuator dedicated to each individual worm segment. This system can be miniaturised more easily due to reduced parts and number of actuators, and so is more suitable for capsule endoscopy. Finally, these two developments have been integrated to demonstrate successful simultaneous locomotion and sensing to detect an artificial submucosal tumour embedded within the test environment. The addition of both tactile sensing and locomotion have created a need for additional power beyond what is available from current battery technology. Early stage work has reviewed wireless power transfer (WPT) as a potential solution to this problem. Methods for optimisation and miniaturisation to implement WPT on a capsule endoscopy have been identified with a laboratory built system that validates the methods found. Future work would see this combined with a miniaturised development of the robot presented. This thesis has developed a novel method for sub-lumen examination. With further efforts to miniaturise the robot it could provide a comfortable and non-invasive procedure to GI tract inspection reducing the need for surgical procedures and accessibility for earlier stage of examination. Furthermore, these developments have applicability in other domains such as veterinary medicine, industrial pipe inspection and exploration of hazardous environments

Fiber bragg gratings for medical applications and future challenges: A review

In the last decades, fiber Bragg gratings (FBGs) have become increasingly attractive to medical applications due to their unique properties such as small size, biocompatibility, immunity to electromagnetic interferences, high sensitivity and multiplexing capability. FBGs have been employed in the development of surgical tools, assistive devices, wearables, and biosensors, showing great potentialities for medical uses. This paper reviews the FBG-based measuring systems, their principle of work, and their applications in medicine and healthcare. Particular attention is given to sensing solutions for biomechanics, minimally invasive surgery, physiological monitoring, and medical biosensing. Strengths, weaknesses, open challenges, and future trends are also discussed to highlight how FBGs can meet the demands of next-generation medical devices and healthcare system

Fiber Bragg Gratings for Medical Applications and Future Challenges: A Review

[EN] In the last decades, fiber Bragg gratings (FBGs) have become increasingly attractive to medical applications due to their unique properties such as small size, biocompatibility, immunity to electromagnetic interferences, high sensitivity and multiplexing capability. FBGs have been employed in the development of surgical tools, assistive devices, wearables, and biosensors, showing great potentialities for medical uses. This paper reviews the FBG-based measuring systems, their principle of work, and their applications in medicine and healthcare. Particular attention is given to sensing solutions for biomechanics, minimally invasive surgery, physiological monitoring, and medical biosensing. Strengths, weaknesses, open challenges, and future trends are also discussed to highlight how FBGs can meet the demands of next-generation medical devices and healthcare system.This work was supported in part by INAIL (the Italian National Institute for Insurance against Accident at Work), through the BRIC (Bando ricerche in collaborazione) 2018 SENSE-RISC (Sviluppo di abiti intelligENti Sensorizzati per prevenzione e mitigazione di Rischi per la SiCurezza dei lavoratori) Project under Grant ID10/2018, in part by the UCBM (Universita Campus Bio-Medico di Roma) under the University Strategic HOPE (HOspital to the PatiEnt) Project, in part by the EU Framework Program H2020-FETPROACT-2018-01 NeuHeart Project under Grant GA 824071, by FCT/MEC (Fundacao para a Ciencia e Tecnologia) under the Projects UIDB/50008/2020 - UIDP/50008/2020, and by REACT (Development of optical fiber solutions for Rehabilitation and e-Health applications) FCT-IT-LA scientific action.Lo Presti, D.; Massaroni, C.; Leitao, CSJ.; Domingues, MDF.; Sypabekova, M.; Barrera, D.; Floris, I.... (2020). Fiber Bragg Gratings for Medical Applications and Future Challenges: A Review. IEEE Access. 8:156863-156888. https://doi.org/10.1109/ACCESS.2020.3019138S156863156888

Robotics 2010

Without a doubt, robotics has made an incredible progress over the last decades. The vision of developing, designing and creating technical systems that help humans to achieve hard and complex tasks, has intelligently led to an incredible variety of solutions. There are barely technical fields that could exhibit more interdisciplinary interconnections like robotics. This fact is generated by highly complex challenges imposed by robotic systems, especially the requirement on intelligent and autonomous operation. This book tries to give an insight into the evolutionary process that takes place in robotics. It provides articles covering a wide range of this exciting area. The progress of technical challenges and concepts may illuminate the relationship between developments that seem to be completely different at first sight. The robotics remains an exciting scientific and engineering field. The community looks optimistically ahead and also looks forward for the future challenges and new development

Soft pneumatic actuators: a review of design, fabrication, modeling, sensing, control and applications

Soft robotics is a rapidly evolving field where robots are fabricated using highly deformable materials and usually follow a bioinspired design. Their high dexterity and safety make them ideal for applications such as gripping, locomotion, and biomedical devices, where the environment is highly dynamic and sensitive to physical interaction. Pneumatic actuation remains the dominant technology in soft robotics due to its low cost and mass, fast response time, and easy implementation. Given the significant number of publications in soft robotics over recent years, newcomers and even established researchers may have difficulty assessing the state of the art. To address this issue, this article summarizes the development of soft pneumatic actuators and robots up until the date of publication. The scope of this article includes the design, modeling, fabrication, actuation, characterization, sensing, control, and applications of soft robotic devices. In addition to a historical overview, there is a special emphasis on recent advances such as novel designs, differential simulators, analytical and numerical modeling methods, topology optimization, data-driven modeling and control methods, hardware control boards, and nonlinear estimation and control techniques. Finally, the capabilities and limitations of soft pneumatic actuators and robots are discussed and directions for future research are identified

Characterization and modelling of complex motion patterns

Movement analysis is the principle of any interaction with the world and the survival of living beings completely depends on the effciency of such analysis. Visual systems have remarkably developed eficient mechanisms that analyze motion at different levels, allowing to recognize objects in dynamical and cluttered environments. In artificial vision, there exist a wide spectrum of applications for which the study of complex movements is crucial to recover salient information. Yet each domain may be different in terms of scenarios, complexity and relationships, a common denominator is that all of them require a dynamic understanding that captures the relevant information. Overall, current strategies are highly dependent on the appearance characterization and usually they are restricted to controlled scenarios. This thesis proposes a computational framework that is inspired in known motion perception mechanisms and structured as a set of modules. Each module is in due turn composed of a set of computational strategies that provide qualitative and quantitative descriptions of the dynamic associated to a particular movement. Diverse applications were herein considered and an extensive validation was performed for each of them. Each of the proposed strategies has shown to be reliable at capturing the dynamic patterns of different tasks, identifying, recognizing, tracking and even segmenting objects in sequences of video.Resumen. El análisis del movimiento es el principio de cualquier interacción con el mundo y la supervivencia de los seres vivos depende completamente de la eficiencia de este tipo de análisis. Los sistemas visuales notablemente han desarrollado mecanismos eficientes que analizan el movimiento en diferentes niveles, lo cual permite reconocer objetos en entornos dinámicos y saturados. En visión artificial existe un amplio espectro de aplicaciones para las cuales el estudio de los movimientos complejos es crucial para recuperar información saliente. A pesar de que cada dominio puede ser diferente en términos de los escenarios, la complejidad y las relaciones de los objetos en movimiento, un común denominador es que todos ellos requieren una comprensión dinámica para capturar información relevante. En general, las estrategias actuales son altamente dependientes de la caracterización de la apariencia y por lo general están restringidos a escenarios controlados. Esta tesis propone un marco computacional que se inspira en los mecanismos de percepción de movimiento conocidas y esta estructurado como un conjunto de módulos. Cada módulo esta a su vez compuesto por un conjunto de estrategias computacionales que proporcionan descripciones cualitativas y cuantitativas de la dinámica asociada a un movimiento particular. Diversas aplicaciones fueron consideradas en este trabajo y una extensa validación se llevó a cabo para cada uno de ellas. Cada una de las estrategias propuestas ha demostrado ser fiable en la captura de los patrones dinámicos de diferentes tareas identificando, reconociendo, siguiendo e incluso segmentando objetos en secuencias de video.Doctorad

Investigation of mobile devices usage and mobile augmented reality applications among older people

Mobile devices such as tablets and smartphones have allow users to communicate, entertainment, access information and perform productivity. However, older people are having issues to utilise mobile devices that may affect their quality of life and wellbeing. There are some potentials of mobile Augmented Reality (AR) applications to increase older users mobile usage by enhancing their experience and learning. The study aims to investigate mobile devices potential barriers and influence factors in using mobile devices. It also seeks to understand older people issues in using AR applications