Proximity sensor for thin wire recognition and manipulation

In robotic grasping and manipulation, the knowledge of a precise object pose represents a key issue. The point acquires even more importance when the objects and, then, the grasping areas become smaller. This is the case of Deformable Linear Object manipulation application where the robot shall autonomously work with thin wires which pose and shape estimation could become difficult given the limited object size and possible occlusion conditions. In such applications, a vision-based system could not be enough to obtain accurate pose and shape estimation. In this work the authors propose a Time-of-Flight pre-touch sensor, integrated with a previously designed tactile sensor, for an accurate estimation of thin wire pose and shape. The paper presents the design and the characterization of the proposed sensor. Moreover, a specific object scanning and shape detection algorithm is presented. Experimental results support the proposed methodology, showing good performance. Hardware design and software applications are freely accessible to the reader

Sensors for Robotic Hands: A Survey of State of the Art

Recent decades have seen significant progress in the field of artificial hands. Most of the surveys, which try to capture the latest developments in this field, focused on actuation and control systems of these devices. In this paper, our goal is to provide a comprehensive survey of the sensors for artificial hands. In order to present the evolution of the field, we cover five year periods starting at the turn of the millennium. At each period, we present the robot hands with a focus on their sensor systems dividing them into categories, such as prosthetics, research devices, and industrial end-effectors.We also cover the sensors developed for robot hand usage in each era. Finally, the period between 2010 and 2015 introduces the reader to the state of the art and also hints to the future directions in the sensor development for artificial hands

Capacitive sensor to detect fallen humans in conditions of low visibility

This paper examines the potential for a capacitive sensor to be used as part of a system to detect fallen humans at very close range. Previous research suggests that a robotic system incorporating a low cost capacitive sensor could potentially distinguish between different materials. The work reported in this paper stemmed from an attempt to determine the true extent to which such a system might reliably differentiate between fallen humans and other objects. The work is motivated by the fact that there are several different emergency circumstances in which such a system might save lives if it could reliably detect immobile humans. These scenarios include situations where older people have fallen and are unable to move or raise an alert, and circumstances where people have been overcome by smoke in a burning building. Current sensing systems are typically unsuitable in conditions of low visibility such as smoke filled rooms. This analysis focused specifically on the potential for a robot equipped with a capacitive sensing system to identify an immobile human in a low visibility emergency scenario. It is concluded that further work would be required to determine whether this type of capacitive sensing system is genuinely suitable for this task

Design and Implementation of Bio-inspired Underwater Electrosense

Underwater electrosense, manipulating underwater electric field for sensing purpose, is a growing technology bio-inspired by weakly electric fish that can navigate in dark or cluttered water. We studied its theoretical foundations and developed sophisticated sensing algorithms including some first-introduced techniques such as discrete dipole approximation (DDA) and convolutional neural networks (CNN), which were tested and validated by simulation and a planar sensor prototype. This work pave a solid way to applications on practical underwater robots

Low Frequency Electric Field Imaging

abstract: Electric field imaging allows for a low cost, compact, non-invasive, non-ionizing alternative to other methods of imaging. It has many promising industrial applications including security, safely imaging power lines at construction sites, finding sources of electromagnetic interference, geo-prospecting, and medical imaging. The work presented in this dissertation concerns low frequency electric field imaging: the physics, hardware, and various methods of achieving it. Electric fields have historically been notoriously difficult to work with due to how intrinsically noisy the data is in electric field sensors. As a first contribution, an in-depth study demonstrates just how prevalent electric field noise is. In field tests, various cables were placed underneath power lines. Despite being shielded, the 60 Hz power line signal readily penetrated several types of cables. The challenges of high noise levels were largely addressed by connecting the output of an electric field sensor to a lock-in amplifier. Using the more accurate means of collecting electric field data, D-dot sensors were arrayed in a compact grid to resolve electric field images as a second contribution. This imager has successfully captured electric field images of live concealed wires and electromagnetic interference. An active method was developed as a third contribution. In this method, distortions created by objects when placed in a known electric field are read. This expands the domain of what can be imaged because the object does not need to be a time-varying electric field source. Images of dielectrics (e.g. bodies of water) and DC wires were captured using this new method. The final contribution uses a collection of one-dimensional electric field images, i.e. projections, to reconstruct a two-dimensional image. This was achieved using algorithms based in computed tomography such as filtered backprojection. An algebraic approach was also used to enforce sparsity regularization with the L1 norm, further improving the quality of some images.Dissertation/ThesisDoctoral Dissertation Electrical Engineering 201

Evaluation und Weiterentwicklung eines kapazitiven taktilen Näherungssensors

Die vorliegende Arbeit hat die Technologie eines kapazitiven taktilen Näherungssensors zum Thema. Zunächst wird anhand eines existierenden Sensors gezeigt, wie dieser in der Robotik in zwei Aufgabenbereichen gewinnbringend eingesetzt werden kann: in der robusten Manipulation und in der Überwachung des Umfelds des Roboters. Im Bereich der Manipulation werden zwei neue Untergebiete für diese Art von Sensoren erschlossen: die Haptische Exploration und die Telemanipulation. Dann wird diese Technologie in einem neuen Entwurf entscheidend weiterentwickelt, indem ihre Funktionalität erweitert, ihre Integrierbarkeit verbessert und ihre Ortsauflösung erhöht wird. Für den Bereich der Manipulation wird ein Zwei-Backen-Greifer mit vorhandenen Sensormodulen ausgestattet. Eine gradientenbasierte Regelung ermöglicht das berührungslose Ausrichten an Objekten in den sechs Raumfreiheitsgraden. Diese Methode ist Grundlage für die weiteren Methoden der Haptischen Exploration und der Telemanipulation. Die traditionelle Haptische Exploration wird erweitert, indem berührungslose Explorationsschritte eingeführt werden, welche effizient ausgeführt werden können. Die Telemanipulation beinhaltet, dass der Nutzer des Systems eine Kraftrückkopplung spürt, welche mit dem Gradienten, der durch die Näherungssensoren detektiert wird, korrespondiert. Mit dieser Unterstützung kann der Nutzer Objekte effizienter explorieren und greifen. Die Überwachung des Umfelds des Roboters wird realisiert, indem ein End-Effektor mit den vorhandenen Sensormodulen ausgestattet wird. In einem Szenario zur Konturverfolgung bzw. Kollisionsvermeidung wird gezeigt, dass der End-Effektor unvorhergesehene Hindernisse erfolgreich umfahren kann. Im vorgestellten Ansatz wird gezeigt, dass die geschätzte Krümmung der Hindernisfläche für eine prädiktive Regelung verwendet werden kann. Aus der anwendungsbezogenen Evaluation des Sensors werden die Anforderungen des neuen Entwurfs abgeleitet. Der Sensor wird in seiner Funktionalität erweitert, insbesondere mit der Fähigkeit, im beidseitig-kapazitiven Modus zu messen. Dieser Modus verbessert die Robustheit bei der Detektion von nicht leitenden Materialien. Hinsichtlich der Integrierbarkeit wird der Sensor modularisiert, d. h. einzelne Sensoreinheiten sind in der Lage autark zu messen und die Signale zu verarbeiten. Schließlich wird eine flexible Ortsauflösung für den Sensor realisiert, damit dieser situativ eine höhere Ortsauflösung oder eine höhere Empfindlichkeit aufweisen kann. Es wird gezeigt, dass sich die Methoden, welche für den ersten Sensor entwickelt wurden, auch mit dem neuen Sensor umsetzen lassen. Durch die bessere Integrierbarkeit und Vielseitigkeit werden die Voraussetzungen für eine weitere Verbreitung der Technologie geschaffen

Enhancing tele-operation - Investigating the effect of sensory feedback on performance

The decline in the number of healthcare service providers in comparison to the growing numbers of service users prompts the development of technologies to improve the efficiency of healthcare services. One such technology which could offer support are assistive robots, remotely tele-operated to provide assistive care and support for older adults with assistive care needs and people living with disabilities. Tele-operation makes it possible to provide human-in-the-loop robotic assistance while also addressing safety concerns in the use of autonomous robots around humans. Unlike many other applications of robot tele-operation, safety is particularly significant as the tele-operated assistive robots will be used in close proximity to vulnerable human users. It is therefore important to provide as much information about the robot (and the robot workspace) as possible to the tele-operators to ensure safety, as well as efficiency. Since robot tele-operation is relatively unexplored in the context of assisted living, this thesis explores different feedback modalities that may be employed to communicate sensor information to tele-operators. The thesis presents research as it transitioned from identifying and evaluating additional feedback modalities that may be used to supplement video feedback, to exploring different strategies for communicating the different feedback modalities. Due to the fact that some of the sensors and feedback needed are not readily available, different design iterations were carried out to develop the necessary hardware and software for the studies carried out. The first human study was carried out to investigate the effect of feedback on tele-operator performance. Performance was measured in terms of task completion time, ease of use of the system, number of robot joint movements, and success or failure of the task. The effect of verbal feedback between the tele-operator and service users was also investigated. Feedback modalities have differing effects on performance metrics and as a result, the choice of optimal feedback may vary from task to task. Results show that participants preferred scenarios with verbal feedback relative to scenarios without verbal feedback, which also reflects in their performance. Gaze metrics from the study also showed that it may be possible to understand how tele-operators interact with the system based on their areas of interest as they carry out tasks. This findings suggest that such studies can be used to improve the design of tele-operation systems.The need for social interaction between the tele-operator and service user suggests that visual and auditory feedback modalities will be engaged as tasks are carried out. This further reduces the number of available sensory modalities through which information can be communicated to tele-operators. A wrist-worn Wi-Fi enabled haptic feedback device was therefore developed and a study was carried out to investigate haptic sensitivities across the wrist. Results suggest that different locations on the wrist have varying sensitivities to haptic stimulation with and without video distraction, duration of haptic stimulation, and varying amplitudes of stimulation. This suggests that dynamic control of haptic feedback can be used to improve haptic perception across the wrist, and it may also be possible to display more than one type of sensor data to tele-operators during a task. The final study carried out was designed to investigate if participants can differentiate between different types of sensor data conveyed through different locations on the wrist via haptic feedback. The effect of increased number of attempts on performance was also investigated. Total task completion time decreased with task repetition. Participants with prior gaming and robot experience had a more significant reduction in total task completion time when compared to participants without prior gaming and robot experience. Reduction in task completion time was noticed for all stages of the task but participants with additional feedback had higher task completion time than participants without supplementary feedback. Reduction in task completion time varied for different stages of the task. Even though gripper trajectory reduced with task repetition, participants with supplementary feedback had longer gripper trajectories than participants without supplementary feedback, while participants with prior gaming experience had shorter gripper trajectories than participants without prior gaming experience. Perceived workload was also found to reduce with task repetition but perceived workload was higher for participants with feedback reported higher perceived workload than participants without feedback. However participants without feedback reported higher frustration than participants without feedback.Results show that the effect of feedback may not be significant where participants can get necessary information from video feedback. However, participants were fully dependent on feedback when video feedback could not provide requisite information needed.The findings presented in this thesis have potential applications in healthcare, and other applications of robot tele-operation and feedback. Findings can be used to improve feedback designs for tele-operation systems to ensure safe and efficient tele-operation. The thesis also provides ways visual feedback can be used with other feedback modalities. The haptic feedback designed in this research may also be used to provide situational awareness for the visually impaired