Recurrent neural networks for hydrodynamic imaging using a 2D-sensitive artificial lateral line

The lateral line is a mechanosensory organ found in fish and amphibians that allows them to sense and act on their near-field hydrodynamic environment. We present a 2D-sensitive Artificial lateral line (ALL) comprising eight all-optical flow sensors, which we use to measure hydrodynamic velocity profiles along the sensor array in response to a moving object in its vicinity. We then use the measured velocity profiles to reconstruct the objects location, via two types of neural networks: feed-forward and recurrent. Several implementations of feed-forward neural networks for ALL source localisation exist, while recurrent neural networks may be more appropriate for this task. The performance of a recurrent neural network (the Long Short-Term Memory, LSTM) is compared to that of a feed-forward neural network (the Online-Sequential Extreme Learning Machine, OS-ELM) via localizing a 6 cm sphere moving at 13 cm/s. Results show that, in a 62 cm × 9.5 cm area of interest, the LSTM outperforms the OS-ELM with an average localisation error of 0.72 cm compared to 4.27 cm respectively. Furthermore, the recurrent network is relatively less affected by noise, indicating that recurrent connections can be beneficial for hydrodynamic object localisation

Shape Classification Using Hydrodynamic Detection via a Sparse Large-Scale 2D-Sensitive Artificial Lateral Line

Artificial lateral lines are fluid flow sensor arrays, bio-inspired by the fish lateral line organ, that measure a local hydrodynamic environment. These arrays are used to detect objects in water, without relying on light, sound, or on an active beacon. This passive sensing method, called hydrodynamic imaging, is complementary to sonar and vision systems and is suitable for collision avoidance and near-field covert sensing. This sensing method has so far been demonstrated on a biological scale from several to tens of centimeters. Here, we present measurements using a large-scale artificial lateral line of 3.5 meters, consisting of eight all-optical 2D-sensitive flow sensors. We measure the fluid flow as produced by the motion of five different objects, towed across a swimming pool. This results in repeatable stimuli, whose measurements demonstrate a complementary aspect of 2D-sensing. These measurements are both used for constructing temporal hydrodynamic signatures, which reflect the object’s shape, and for flow-feature based near-field object classification. For the latter, we present a location-invariant feature extraction method which, using an Extreme Learning Machine neural network, results in a classification F1-score up to 98.6% with selected flow features. We find that, compared to the traditional sensing dimension parallel to the sensor array, the novel transverse fluid velocity component bears more information about the object shape. The classification of objects via hydrodynamic imaging thus benefits from 2D-sensing and can be scaled up to a supra biological scale of several meters