Chip-on-tip endoscope incorporating a soft robotic pneumatic bending microactuator.

In the ever advancing field of minimally invasive surgery, flexible instruments with local degrees of freedom are needed to navigate through the intricate topologies of the human body. Although cable or concentric tube driven solutions have proven their merits in this field, they are inadequate for realizing small bending radii and suffer from friction, which is detrimental when automation is envisioned. Soft robotic actuators with locally actuated degrees of freedom are foreseen to fill in this void, where elastic inflatable actuators are very promising due to their S3-principle, being Small, Soft and Safe. This paper reports on the characterization of a chip-on-tip endoscope, consisting out of a soft robotic pneumatic bending microactuator equipped with a 1.1 × 1.1 mm2 CMOS camera. As such, the total diameter of the endoscope measures 1.66 mm. To show the feasibility of using this system in a surgical environment, a preliminary test on an eye mock-up is conducted

Image Sensors in Security and Medical Applications

This paper briefly reviews CMOS image sensor technology and its utilization in security and medical applications. The role and future trends of image sensors in each of the applications are discussed. To provide the reader deeper understanding of the technology aspects the paper concentrates on the selected applications such as surveillance, biometrics, capsule endoscopy and artificial retina. The reasons for concentrating on these applications are due to their importance in our daily life and because they present leading-edge applications for imaging systems research and development. In addition, review of image sensors implementation in these applications allows the reader to investigate image sensor technology from the technical and from other views as well

Field test of multi-hop image sensing network prototype on a city-wide scale

Open Access funded by Chongqing University of Posts and Telecommuniocations Under a Creative Commons license, https://creativecommons.org/licenses/by-nc-nd/4.0/Wireless multimedia sensor network drastically stretches the horizon of traditional monitoring and surveillance systems, of which most existing research have utilised Zigbee or WiFi as the communication technology. Both technologies use ultra high frequencies (mainly 2.4 GHz) and suffer from relatively short transmission range (i.e. 100 m line-of-sight). The objective of this paper is to assess the feasibility and potential of transmitting image information using RF modules with lower frequencies (e.g. 433 MHz) in order to achieve a larger scale deployment such as a city scenario. Arduino platform is used for its low cost and simplicity. The details of hardware properties are elaborated in the article, followed by an investigation of optimum configurations for the system. Upon an initial range testing outcome of over 2000 m line-of-sight transmission distance, the prototype network has been installed in a real life city plot for further examination of performance. A range of suitable applications has been proposed along with suggestions for future research.Peer reviewe

Self-organized aggregation without computation

This paper presents a solution to the problem of self-organized aggregation of embodied robots that requires no arithmetic computation. The robots have no memory and are equipped with one binary sensor, which informs them whether or not there is another robot in their line of sight. It is proven that the sensor needs to have a sufficiently long range; otherwise aggregation cannot be guaranteed, irrespective of the controller used. The optimal controller is found by performing a grid search over the space of all possible controllers. With this controller, robots rotate on the spot when they perceive another robot, and move backwards along a circular trajectory otherwise. This controller is proven to always aggregate two simultaneously moving robots in finite time, an upper bound for which is provided. Simulations show that the controller also aggregates at least 1000 robots into a single cluster consistently. Moreover, in 30 experiments with 40 physical e-puck robots, 98.6% of the robots aggregated into one cluster. The results obtained have profound implications for the implementation of multi-robot systems at scales where conventional approaches to sensing and information processing are no longer applicable

The Geometry and Usage of the Supplementary Fisheye Lenses in Smartphones

Nowadays, mobile phones are more than a device that can only satisfy the communication need between people. Since fisheye lenses integrated with mobile phones are lightweight and easy to use, they are advantageous. In addition to this advantage, it is experimented whether fisheye lens and mobile phone combination can be used in a photogrammetric way, and if so, what will be the result. Fisheye lens equipment used with mobile phones was tested in this study. For this, standard calibration of ‘Olloclip 3 in one’ fisheye lens used with iPhone 4S mobile phone and ‘Nikon FC‐E9’ fisheye lens used with Nikon Coolpix8700 are compared based on equidistant model. This experimental study shows that Olloclip 3 in one fisheye lens developed for mobile phones has at least the similar characteristics with classic fisheye lenses. The dimensions of fisheye lenses used with smart phones are getting smaller and the prices are reducing. Moreover, as verified in this study, the accuracy of fisheye lenses used in smartphones is better than conventional fisheye lenses. The use of smartphones with fisheye lenses will give the possibility of practical applications to ordinary users in the near future

NASA Tech Briefs, December 2005

Topics covered include: Video Mosaicking for Inspection of Gas Pipelines; Shuttle-Data-Tape XML Translator; Highly Reliable, High-Speed, Unidirectional Serial Data Links; Data-Analysis System for Entry, Descent, and Landing; Hybrid UV Imager Containing Face-Up AlGaN/GaN Photodiodes; Multiple Embedded Processors for Fault-Tolerant Computing; Hybrid Power Management; Magnetometer Based on Optoelectronic Microwave Oscillator; Program Predicts Time Courses of Human/ Computer Interactions; Chimera Grid Tools; Astronomer's Proposal Tool; Conservative Patch Algorithm and Mesh Sequencing for PAB3D; Fitting Nonlinear Curves by Use of Optimization Techniques; Tool for Viewing Faults Under Terrain; Automated Synthesis of Long Communication Delays for Testing; Solving Nonlinear Euler Equations With Arbitrary Accuracy; Self-Organizing-Map Program for Analyzing Multivariate Data; Tool for Sizing Analysis of the Advanced Life Support System; Control Software for a High-Performance Telerobot; Java Radar Analysis Tool; Architecture for Verifiable Software; Tool for Ranking Research Options; Enhanced, Partially Redundant Emergency Notification System; Close-Call Action Log Form; Task Description Language; Improved Small-Particle Powders for Plasma Spraying; Bonding-Compatible Corrosion Inhibitor for Rinsing Metals; Wipes, Coatings, and Patches for Detecting Hydrazines; Rotating Vessels for Growing Protein Crystals; Oscillating-Linear-Drive Vacuum Compressor for CO2; Mechanically Biased, Hinged Pairs of Piezoelectric Benders; Apparatus for Precise Indium-Bump Bonding of Microchips; Radiation Dosimetry via Automated Fluorescence Microscopy; Multistage Magnetic Separator of Cells and Proteins; Elastic-Tether Suits for Artificial Gravity and Exercise; Multichannel Brain-Signal-Amplifying and Digitizing System; Ester-Based Electrolytes for Low-Temperature Li-Ion Cells; Hygrometer for Detecting Water in Partially Enclosed Volumes; Radio-Frequency Plasma Cleaning of a Penning Malmberg Trap; Reduction of Flap Side Edge Noise - the Blowing Flap; and Preventing Accidental Ignition of Upper-Stage Rocket Motors

Optimised multi-camera systems for dimensional control in factory environments

As part of the United Kingdom’s Light Controlled Factory project, University College London aims to develop a large-scale multi-camera system for dimensional control tasks in manufacturing, such as part assembly and tracking. Accuracy requirements in manufacturing are demanding, and improvements in the modelling and analysis of both camera imaging and the measurement environment are essential. A major aspect to improved camera modelling is the use of monochromatic imaging of retro-reflective target points, together with a camera model designed for a particular illumination wavelength. A small-scale system for laboratory testing has been constructed using eight low-cost monochrome cameras with C-mount lenses on a rigid metal framework. Red, green and blue monochromatic light-emitting diode ring illumination has been tested, with a broadband white illumination for comparison. Potentially, accuracy may be further enhanced by the reduction in refraction errors caused by a non-homogeneous factory environment, typically manifest in varying temperatures in the workspace. A refraction modelling tool under development in the parallel European Union LUMINAR project is being used to simulate refraction in order to test methods which may be able to reduce or eliminate this effect in practice

Locomotion Optimization of Photoresponsive Small-scale Robot: A Deep Reinforcement Learning Approach

Soft robots comprise of elastic and flexible structures, and actuatable soft materials are often used to provide stimuli-responses, remotely controlled with different kinds of external stimuli, which is beneficial for designing small-scale devices. Among different stimuli-responsive materials, liquid crystal networks (LCNs) have gained a significant amount of attention for soft small-scale robots in the past decade being stimulated and actuated by light, which is clean energy, able to transduce energy remotely, easily available and accessible to sophisticated control. One of the persistent challenges in photoresponsive robotics is to produce controllable autonomous locomotion behavior. In this Thesis, different types of photoresponsive soft robots were used to realize light-powered locomotion, and an artificial intelligence-based approach was developed for controlling the movement. A robot tracking system, including an automatic laser steering function, was built for efficient robotic feature detection and steering the laser beam automatically to desired locations. Another robot prototype, a swimmer robot, driven by the automatically steered laser beam, showed directional movements including some degree of uncertainty and randomness in their locomotion behavior. A novel approach is developed to deal with the challenges related to the locomotion of photoresponsive swimmer robots. Machine learning, particularly deep reinforcement learning method, was applied to develop a control policy for autonomous locomotion behavior. This method can learn from its experiences by interacting with the robot and its environment without explicit knowledge of the robot structure, constituent material, and robotic mechanics. Due to the requirement of a large number of experiences to correlate the goodness of behavior control, a simulator was developed, which mimicked the uncertain and random movement behavior of the swimmer robots. This approach effectively adapted the random movement behaviors and developed an optimal control policy to reach different destination points autonomously within a simulated environment. This work has successfully taken a step towards the autonomous locomotion control of soft photoresponsive robots

Autonomous Soft Robotic Fish Capable of Escape Maneuvers Using Fluidic Elastomer Actuators

In this work we describe an autonomous soft-bodied robot that is both self-contained and capable of rapid, continuum-body motion. We detail the design, modeling, fabrication, and control of the soft fish, focusing on enabling the robot to perform rapid escape responses. The robot employs a compliant body with embedded actuators emulating the slender anatomical form of a fish. In addition, the robot has a novel fluidic actuation system that drives body motion and has all the subsystems of a traditional robot onboard: power, actuation, processing, and control. At the core of the fish's soft body is an array of fluidic elastomer actuators. We design the fish to emulate escape responses in addition to forward swimming because such maneuvers require rapid body accelerations and continuum-body motion. These maneuvers showcase the performance capabilities of this self-contained robot. The kinematics and controllability of the robot during simulated escape response maneuvers are analyzed and compared with studies on biological fish. We show that during escape responses, the soft-bodied robot has similar input–output relationships to those observed in biological fish. The major implication of this work is that we show soft robots can be both self-contained and capable of rapid body motion.National Science Foundation (U.S.) (NSF IIS1226883)National Science Foundation (U.S.) (NSF CCF1138967)National Science Foundation (U.S.) (1122374

Miniaturized Embryo Array for Automated Trapping, Immobilization and Microperfusion of Zebrafish Embryos

Zebrafish (Danio rerio) has recently emerged as a powerful experimental model in drug discovery and environmental toxicology. Drug discovery screens performed on zebrafish embryos mirror with a high level of accuracy the tests usually performed on mammalian animal models, and fish embryo toxicity assay (FET) is one of the most promising alternative approaches to acute ecotoxicity testing with adult fish. Notwithstanding this, automated in-situ analysis of zebrafish embryos is still deeply in its infancy. This is mostly due to the inherent limitations of conventional techniques and the fact that metazoan organisms are not easily susceptible to laboratory automation. In this work, we describe the development of an innovative miniaturized chip-based device for the in-situ analysis of zebrafish embryos. We present evidence that automatic, hydrodynamic positioning, trapping and long-term immobilization of single embryos inside the microfluidic chips can be combined with time-lapse imaging to provide real-time developmental analysis. Our platform, fabricated using biocompatible polymer molding technology, enables rapid trapping of embryos in low shear stress zones, uniform drug microperfusion and high-resolution imaging without the need of manual embryo handling at various developmental stages. The device provides a highly controllable fluidic microenvironment and post-analysis eleuthero-embryo stage recovery. Throughout the incubation, the position of individual embryos is registered. Importantly, we also for first time show that microfluidic embryo array technology can be effectively used for the analysis of anti-angiogenic compounds using transgenic zebrafish line (fli1a:EGFP). The work provides a new rationale for rapid and automated manipulation and analysis of developing zebrafish embryos at a large scale