Design and Implementation of Bio-inspired Underwater Electrosense

Underwater electrosense, manipulating underwater electric field for sensing purpose, is a growing technology bio-inspired by weakly electric fish that can navigate in dark or cluttered water. We studied its theoretical foundations and developed sophisticated sensing algorithms including some first-introduced techniques such as discrete dipole approximation (DDA) and convolutional neural networks (CNN), which were tested and validated by simulation and a planar sensor prototype. This work pave a solid way to applications on practical underwater robots

Underwater robots equipped with artificial electric sense for the exploration of unconventional aquatic niches

International audienceThis article presents different use of the electric field perception in the context of underwater robot navigation. To illustrate the developed navigation behaviours we will introduce a recently launched european project named subCULTron and will show some simulation and experimentation results. The project sub- CULTron aims at achieving long-term collective robot exploration and monitoring of underwater environments. The demonstration will take place in the lagoon of Venice, a large shallow embayment composed of salt turbib water that represents a challenging environment for underwater robots as common sensor like vision or acoustic are difficult to handle. To overcome turbidity and confinement problems our robots will be equipped with artificial electric sensors that will be used as the main sensorial modality for navigation. Electric sense is a bio-inspired sense that has been developed by several species of fish living in turbib and confined underwater environment. In this paper, many different robotic behaviours based on the electric field perception will be presented, in particular we will address reactive navigation, object/robots detection, and object localization and estimation

Underwater robots equipped with artificial electric sense for the exploration of unconventional aquatic niches

This article presents different use of the electric field perception in the context of underwater robot navigation. To illustrate the developed navigation behaviours we will introduce a recently launched european project named subCULTron and will show some simulation and experimentation results. The project sub- CULTron aims at achieving long-term collective robot exploration and monitoring of underwater environments. The demonstration will take place in the lagoon of Venice, a large shallow embayment composed of salt turbib water that represents a challenging environment for underwater robots as common sensor like vision or acoustic are difficult to handle. To overcome turbidity and confinement problems our robots will be equipped with artificial electric sensors that will be used as the main sensorial modality for navigation. Electric sense is a bio-inspired sense that has been developed by several species of fish living in turbib and confined underwater environment. In this paper, many different robotic behaviours based on the electric field perception will be presented, in particular we will address reactive navigation, object/robots detection, and object localization and estimation

GRAINS: Proximity Sensing of Objects in Granular Materials

Proximity sensing detects an object's presence without contact. However, research has rarely explored proximity sensing in granular materials (GM) due to GM's lack of visual and complex properties. In this paper, we propose a granular-material-embedded autonomous proximity sensing system (GRAINS) based on three granular phenomena (fluidization, jamming, and failure wedge zone). GRAINS can automatically sense buried objects beneath GM in real-time manner (at least ~20 hertz) and perceive them 0.5 ~ 7 centimeters ahead in different granules without the use of vision or touch. We introduce a new spiral trajectory for the probe raking in GM, combining linear and circular motions, inspired by a common granular fluidization technique. Based on the observation of force-raising when granular jamming occurs in the failure wedge zone in front of the probe during its raking, we employ Gaussian process regression to constantly learn and predict the force patterns and detect the force anomaly resulting from granular jamming to identify the proximity sensing of buried objects. Finally, we apply GRAINS to a Bayesian-optimization-algorithm-guided exploration strategy to successfully localize underground objects and outline their distribution using proximity sensing without contact or digging. This work offers a simple yet reliable method with potential for safe operation in building habitation infrastructure on an alien planet without human intervention.Comment: 35 pages, 5 figures,2 tables. Videos available at https://sites.google.com/view/grains2/hom

Desarrollo de un prototipo de sistema electro-localizador en entornos acuáticos

En entornos acuáticos ruidosos o fangosos, océanos profundos u otras zonas sumergidas donde algunos sistemas de detección del entorno habituales como las cámaras de vídeo o el sonar pueden no resultar efectivos surge la necesidad de buscar una alternativa que permita reemplazarlos de manera efectiva y fiable. Para solventar esta necesidad, se ha tomado como referencia e inspiración una de las maneras en las que lo resuelve la naturaleza. La evolución ha hecho desarrollar a una serie de especies un sentido muy especial y extraño para el ser humano: el sentido eléctrico. Estos animales, mayoritariamente acuáticos, poseen un sistema muy sofisticado que les permite detectar e incluso en algunos casos generar pequeños pulsos eléctricos y utilizarlos tanto para detectar objetos en sus inmediaciones (“electro-localización”) como para interactuar con otros individuos (“electro-comunicación”). Inspirado en los peces eléctricos, en el laboratorio del Grupo de Neurocomputación Biológica se ha diseñado y construido un sistema robótico de experimentación con el objetivo de analizar y reproducir el proceso de electro-localización de manera replicable y precisa. Por este motivo, todo el sistema está desarrollado y diseñado con herramientas de código libre y tecnologías de impresión 3D, para poder ser fácilmente reproducido. El proyecto, al que se le ha dado el nombre de “AquaRide”, consiste en una plataforma robótica propia que implementa el esquema de movimiento CoreXY y que posee un sensor eléctrico que es capaz de desplazarse por un acuario detectando obstáculos a su alrededor utilizando exclusivamente las fluctuaciones del campo eléctrico emitido por el sensor. AquaRide tiene como objetivo ser el sistema que abra las puertas a la realización de un robot de movimiento autónomo que incorpore un sensor de proximidad eléctrico como el desarrollado y esto le permita realizar una función de exploración en entornos no controlados. A lo largo de esta memoria se explica cómo se han realizado los diseños de las piezas que componen el proyecto, el desarrollo del firmware para la placa Sanguinololu que controla el sistema y los programas en lenguaje Python que permiten el análisis de resultados. Por último, se analizan los experimentos realizados para comprobar el comportamiento del dipolo ante objetos, mostrándose la capacidad del sistema de detectar y reaccionar ante elementos resistivos existentes en su trayectoria.In noisy or muddy underwater environments, deep waters or other submerged zones where some usual environment detection systems such as video cameras or sonars can be useless, a necessity for an alternative solution that can replace those in an effective and trustworthy way arises. To solve this need, the way nature solves this problem has been taken as a reference. Evolution has developed in some species a very special and strange sense from the human species point of view; the electrical sense. These animals, mostly aquatic, posess a very sophisticated system that allows them to detect, (and even in some cases generate) small electrical pulses and use them both to detect objects nearby (electrolocation) and to interact with other individuals (electrocommunication). Inspired by electrical fish, in the Grupo de Neurocomputación Biológica a robotic experimentation system was designed with the objective of analyzing and reproducing the process of electrolocation in a replicable and precise way. For this reason, the whole system was developed and designed with opensource tools and 3D printing techologies, increasing this way the reproducibility. The project, named "AquaRide", consists of a robotic platform of our own design that implements the CoreXY motion technique, and has an electrical sensor that allows it to move through a fish tank detecting obstacles on its surroundings using exclusively the fluctuations of the electric field emitted by the sensor. AquaRide wants to be the system that allows for the creation of an autonomous movement robot that incorporates an electrical proximity sensor similar to the one developed that allows it to explore non-controlled environments. Throughout this document one can find explanations for the designs of the different 3D models that were created for this project, the development of the firmware for the Sanguinololu board that controls the system, and also the Python programs that perform the results analysis. Finally, the results of the experiments are analyzed to check the behavior of the sensor, and the ability of detecting and reacting to resistive objects located in its path

Animal-Robot Interactions: Electrocommunication, Sensory Ecology, and Group Dynamics in a Mormyrid Weakly Electric Fish

Mormyrid weakly electric fish possess a specialized electrosensory system. During the process of active electrolocation, these animals perceive self-generated electric organ dis-charges (EOD) and are thereby able to detect objects in their nearby environment. The EOD is a short, biphasic pulse, which is simultaneously used to communicate with conspe-cifics. There are two principles according to which information exchange occurs during electrocommunication. The waveform of the EOD constitutes a relatively stable identity marker that signals species, gender, and status of an individual. In contrast, the temporal sequence of inter-discharge intervals (IDI) is highly variable and encodes context-specific information. Modifications of IDI-duration not only alter the instantaneous discharge fre-quency but also enable the generation of specific signaling patterns and interactive dis-charge sequences. One such interactive discharge behavior is the so-called echo response, during which a fish responds with a constant latency of only a few milliseconds to the EOD of a conspecific. Animals can synchronize their signaling sequences by mutually generating echoes to each other's signals over a coherent period. Although active electrolocation and electrocommunication are mediated by different types of electroreceptor organs and neural pathways, an unambiguous assignment of electromotor behavior to only one of the two functions is often problematic. In this thesis, the significance of IDI-based signaling sequences during motor and electro-motor interactions of the mormyrid fish Mormyrus rume proboscirostris were investigated. To this end, different electrical playback sequences of species-specific EODs were generated via mobile fish dummies, and the motor and electromotor responses of live fish were analyzed. In Part One of this thesis, electrocommunication strategies of the fish were analyzed, and particularly the functions of double pulses, discharge regularizations, and echo responses were examined in an adaptive context. Double pulses were classified as an aggressive mo-tivation signal, whereas regularizations may have a communicative function during the early stages of the sequential assessment of a potential opponent. In this context, discharge synchronization by means of echo responses may enable a mutual assessment for the net benefit of both contestants. Because echo responses occur in various behavioral contexts, and artificial echoes of the dummy evoked increased echoing by the fish, it was hypothesized that the echo response serves a more general purpose by enabling mutual allocation of social attention between two fish. In Part Two of this thesis, a biomimetic robotic fish was designed to investigate the senso-ry basis on which fish followed the dummy. It was shown that electrical playback signals induced following-behavior in live fish, whereas biomimetic motility patterns had no ef-fect. By subsequently reducing the mobile dummy to only the electric signaling sequence from the perspective of the fish, it could be shown that passive perception of electrical communication signals is also involved in mediating the spatial coordination of social in-teractions. This passive perception is likely mediated by the same electroreceptor organs that are used during electrocommunication. The EOD can therefore be considered to be an essential social stimulus that makes it possible to integrate a dummy into a group of weak-ly electric fish as an artificial conspecific. The influence of an interactively signaling mobile dummy fish on small groups of up to four individuals was investigated in Part Three of this thesis. Typical schooling behavior was a rare occurrence in this context. However, EOD-synchronizations through mutual echo responses between two fish, or between a fish and the interactive dummy, were fre-quently observed during social interactions in small groups. Motor interactions during synchronization episodes supported the hypothesis that mormyrids may use discharge synchronizations between individuals to allocate social attention, and the echo response may thus adopt a particularly useful function during communication in groups.Schwach elektrische Fisch aus der Familie der Mormyriden verfügen über ein spezialisier-tes elektrosensorisches Sinnessystem. In einem Prozess, der als aktive Elektroortung be-zeichnet wird, sind diese Tiere in der Lage, selbstgenerierte elektrische Organentladungen (EOD) wahrzunehmen, und dadurch Objekte in ihrer unmittelbaren Nähe zu detektieren. Das EOD ist ein kurzer bipolarer Puls, der gleichzeitig auch zur Kommunikation mit Artge-nossen dient. Informationsaustausch während der Elektrokommunikation basiert auf zwei verschiedenen Prinzipien: Die Wellenform des EOD stellt einen relativ konstanten Identi-tätsmarker dar, der beispielsweise Art, Geschlecht und Status eines Individuums signali-siert. Die zeitliche Abfolge der Intervalle zwischen den EODs ist hingegen höchst variabel und kodiert kontextspezifische Information. Durch Modifikation der Intervalldauer ändert sich nicht nur die Entladungsfrequenz, sondern es können auch spezifische Signalmuster und interaktive Entladungssequenzen generiert werden. Ein interaktives Entladungsver-halten stellt beispielsweise die Echoantwort dar, bei der ein Fisch mit einer konstanten Latenz von wenigen Millisekunden auf das EOD eines Artgenossen reagiert. Zwei Tiere können ihre Entladungssequenzen synchronisieren, indem sie ihre Signale über einen kohärenten Zeitraum gegenseitig mit Echos beantworten. Obwohl aktive Elektroortung und Elektrokommunikation über unterschiedliche Rezeptororgansysteme und neuronale Pfade vermittelt werden, ist eine eindeutige Zuordnung der elektromotorischen Verhal-tensäußerungen der Fische zu nur einer der beiden Funktionen oft problematisch. In der vorliegenden Arbeit wurde die Bedeutung intervallbasierter EOD-Sequenzen für motorische und elektromotorische Interaktionen des Mormyriden Mormyrus rume proboscirostris erforscht. Hierzu wurden verschiedene elektrische Playbacksequenzen artspezifischer EODs generiert und durch mobile Fischattrappen wiedergegeben. Die mo-torischen und elektromotorischen Verhaltensreaktionen der Fische wurden analysiert. Im ersten Teil der Arbeit wurden Elektrokommunikationsstrategien der Fische analysiert und die adaptive Funktion insbesondere von Doppelpulsen, Entladungsregularisierungen und Echoantworten untersucht. Doppelpulse wurden als aggressives Motivationssignal kategorisiert, wohingegen die Kommunikationsfunktion von Regularisierungen im gegen-seitigen Einschätzen zu Beginn einer kompetitiven Begegnung zu liegen scheint. Entla-dungssynchronisation durch gegenseitige Echoantworten kann dabei eine Einschätzung des Gegenübers zum Vorteil beider Parteien erleichtern. Da Echoantworten in verschiede-nen Verhaltenssituationen auftreten und artifizielle Echoantworten der Attrappe vermehrt zu Echos vonseiten der Fische führten, wurde postuliert, dass die Echoantwort eine generellere Funktion bei der Fokussierung gegenseitiger sozialer Aufmerksamkeit über-nehmen kann. Im zweiten Teil der Arbeit wurde ein biomimetischer Fischroboter konstruiert, um zu untersuchen, auf welcher sensorischen Grundlage die Fische der Attrappe folgen. Es konnte gezeigt werden, dass elektrische Playbacksignale, nicht aber biomimetische Bewe-gungsmuster, Folgeverhalten der Fische induzieren. In einem weiteren Schritt konnte durch die Reduktion der Attrappe auf die elektrischen Signalsequenzen aus der Perspektive der Versuchsfische gezeigt werden, dass passive Wahrnehmung elektrischer Kommu-nikationssignale auch bei der räumlichen Koordination sozialer Interaktionen von Bedeu-tung ist. Dies wird mutmaßlich über die gleichen Rezeptororgane vermittelt, die auch für die Elektrokommunikation verantwortlich sind. Das EOD kann daher als ein soziales Signal betrachtet werden, das es ermöglicht, eine Attrappe als künstlichen Artgenossen in eine Gruppe schwach elektrischer Fische zu integrieren. Der Einfluss einer elektrisch interaktiven mobilen Fischattrappe auf kleine Gruppen von bis zu vier Individuen wurde im dritten Teil der Arbeit getestet. Typisches Schwarmver-halten konnte in diesem Zusammenhang nur selten beobachtet werden. In kleinen Gruppen kam es während sozialer Interaktionen jedoch häufig zu EOD-Synchronisationen durch Echoantworten zwischen zwei Fischen, oder zwischen einem Fisch und der interaktiven Attrappe. Motorische Verhaltensinteraktionen im Zeitraum dieser Synchronisationen stützen die Hypothese, dass Mormyriden durch elektrische Entladungssynchronisation soziale Aufmerksamkeit zwischen Individuen herstellen können, und die Echoantwort somit besonders in Gruppen eine nützliche Kommunikationsfunktion übernehmen kann

Sensing capacitance of underwater objects in bio-inspired electrosense

Abstract—Certain electric fish use a self-generated AC electric field to navigate and hunt. Thousands of sensors on the surface of the fish’s body detect the pattern of amplitude and phase distortions of the field caused by nearby objects. Prior research has suggested that phase distortions may be especially useful for recognition of live objects. Here we present the first study of the utility of phase information in a robotic implementation of active electrosense. Using our robotic implementation, we investigated how the phase information depends on the frequency of the emitted field, the conductivity of the surrounding water, and object properties. An analytical model was developed serving as qualitative explanation of the dependency. We show that in certain situations phase information enables discrimination between two ob-jects that are otherwise very similar in the amplitude of their electric images. We also show the utility of probing objects with multiple frequencies. I