A real-time 3D reconstruction of staircases for rehabilitative exoskeletons

In medical contexts, the use of assistive exoskeletons for the rehabilitation of people with impaired mobility represents a common practice. Recent advances suggest that, soon, such mechatronic systems will also be used to assist people in their everyday life. In order to reach such target, exoskeletons must become able to perceive the environment. To this purpose, a system for the parametric identification of a staircase is proposed in this paper. More precisely, given a staircase of unknown geometry, the system identifies its 3D shape. Furthermore, it also estimates the reciprocal orientation and distance between the exoskeleton and the staircase. Differently from other approaches, this result is achieved by means of low cost devices: an inertial measurement unit, two ranging sensors, and an Arm-Cortex processor. Starting from the ranging sensors acquisitions, the staircase model is identified in real time, during the execution of a step. The proposed procedure is based on an extended recursive total least squares strategy, in order to fully exploit the computational capabilities of the Arm processor, and it is characterized by execution times smaller than 10 −3 s. The estimation algorithm has been tested on an actual exoskeleton and the resulting experimental outcomes are compared with the results obtained through alternative methods

An experimental synthetic aperture SONAR

Aperture synthesis is a mature technique that has been used with success in a number of remote sensing fields. Sonars can also potentially benefit from the technique, though to date the limitations of slow acoustic propagation and difficulty in maintaining a stable platform has hindered investigation. This thesis investigates aperture synthesis for high resolution underwater imaging. A prototype sonar is designed and fabricated for the study. The performance of the sonar is assessed in both tank and sea trials and the results presented in this thesis

Event Transformer+. A multi-purpose solution for efficient event data processing

Event cameras record sparse illumination changes with high temporal resolution and high dynamic range. Thanks to their sparse recording and low consumption, they are increasingly used in applications such as AR/VR and autonomous driving. Current top-performing methods often ignore specific event-data properties, leading to the development of generic but computationally expensive algorithms, while event-aware methods do not perform as well. We propose Event Transformer+, that improves our seminal work evtprev EvT with a refined patch-based event representation and a more robust backbone to achieve more accurate results, while still benefiting from event-data sparsity to increase its efficiency. Additionally, we show how our system can work with different data modalities and propose specific output heads, for event-stream predictions (i.e. action recognition) and per-pixel predictions (dense depth estimation). Evaluation results show better performance to the state-of-the-art while requiring minimal computation resources, both on GPU and CPU

Synthetic Aperture Techniques for Sonar Systems

Today a good percentage of our planet is known and well mapped. Synthetic aperture techniques used in space and airborne systems has greatly aided to obtain this information. Nevertheless our planet is mostly covered by water and the level of detail of knowledge about this segment is still very far away from that of the land segment

Real time correlation-based stereo: algorithm, implementations and applications

This paper describes some of the work on stereo that has been going on at INRIA in the last four years. The work has concentrated on obtaining dense, accurate and reliable range maps of the environment at rates compatible with the real-time constraints of such applications as the navigation of mobile vehicles in man-made or natural environments. The class of algorithms which has been selected among several is the class of algorithms which has been selected among several is the class of correlation-based stereo algorithms because they are the only ones that can produce sufficiently dense range maps with an algoritmic structure which lends itself nicely to fast implementations because of the simplicity of the underlying computation. We describe the various improvements that we have brought to the original idea, including validation and characterization of the quality of the matches, a recursive implementation of the score computation which makes the method independent of the size of the correlation window and a calibration method which does not require the use of a calibration pattern. We then describe two implementations of this algorithm on two very different pieces of hardware. The first implementation is on a board with four digital signal processors designed jointly with Matra MSII. This implementation can produce 64x64 range maps at rate varying between 200 and 400 ms, depending upon the range of disparities. The second implementation is on a board developed by DEC-PRL and can perform the cross-correlation of two 256X256 images in 140 ms. The first implementation has been integrated in the navigation system of the INRIA cart and used to correct for inertial and odometric errors in navigation experiments both indoors and outdoors on road. This is the first application of our correlation-based algorithm which is described in the paper. The second application has been done jointly with people from the french national space agence (CNES) to study the possibility of using stereo on a future planetary rover for the construction of digital elevation maps. We have shown that real time stereo is possible today at low-cost and can be applied in real applications. The algorithm that has been described is not the most sophisticated available but we have made it robust and reliable thanks to a number of improvements. Evan though each of these improvements is not earth-shattering from the pure research point of view, altogether they have allowed us to go beyond a very important threshold. This threshold measures the difference between a program that runs in the laboratory on a few images and one that works continuously for hours on a sequence of stereo pairs and produces results at such rates and of such quality that they can be used to guide a real vehicle or to produce discrete elevation maps. We believe that this threshold has only been reached in a very small number of cases

UAV or Drones for Remote Sensing Applications in GPS/GNSS Enabled and GPS/GNSS Denied Environments

The design of novel UAV systems and the use of UAV platforms integrated with robotic sensing and imaging techniques, as well as the development of processing workflows and the capacity of ultra-high temporal and spatial resolution data, have enabled a rapid uptake of UAVs and drones across several industries and application domains.This book provides a forum for high-quality peer-reviewed papers that broaden awareness and understanding of single- and multiple-UAV developments for remote sensing applications, and associated developments in sensor technology, data processing and communications, and UAV system design and sensing capabilities in GPS-enabled and, more broadly, Global Navigation Satellite System (GNSS)-enabled and GPS/GNSS-denied environments.Contributions include:UAV-based photogrammetry, laser scanning, multispectral imaging, hyperspectral imaging, and thermal imaging;UAV sensor applications; spatial ecology; pest detection; reef; forestry; volcanology; precision agriculture wildlife species tracking; search and rescue; target tracking; atmosphere monitoring; chemical, biological, and natural disaster phenomena; fire prevention, flood prevention; volcanic monitoring; pollution monitoring; microclimates; and land use;Wildlife and target detection and recognition from UAV imagery using deep learning and machine learning techniques;UAV-based change detection

Langattomien anturiverkkojen sotilas-, agroteknologia- ja energiatutkimussovelluksia

The physical quantities nowadays are widely measured by using electronic sensors. Wireless sensor networks (WSNs) are low-cost, low-power electronic devices capable of collecting data using their onboard sensors. Some wireless sensor nodes are equipped with actuators, providing the possibility to change the state of the physical world. The ability to change the state of a physical system means that WSNs can be used in control and automation applications. This research focuses on appropriate system design for four different wireless measurement and control cases. The first case provides a hardware and software solution for camera integration to a wireless sensor node. The images are captured and processed inside the sensor node using low power computational techniques. In the second application, two different wireless sensor networks function in cooperation to overcome seeding problems in agricultural machinery. The third case focuses on indoor deployment of the wireless sensor nodes into an area of urban crisis, where the nodes supply localization information to friendly assets such as soldiers, firefighters and medical personnel. The last application focuses on a feasibility study for energy harvesting from asphalt surfaces in the form of heat.Fysikaaliset suureet mitataan nykyisin elektronisten anturien avulla. Langattomat anturiverkot ovat kustannustasoltaan edullisia, matalan tehonkulutuksen elektronisia laitteita, jotka kykenevät suorittamaan mittauksia niissä olevilla antureilla. Langattomat anturinoodit voidaan myös liittää toimilaitteisiin, jolloin ne voivat vaikuttaa fyysiseen ympäristöönsä. Koska langattomilla anturi- ja toimilaiteverkoilla voidaan vaikuttaa niiden fysikaalisen ympäristön tilaan, niiden avulla voidaan toteuttaa säätö- ja automaatiosovelluksia. Tässä väitöskirjaty össä suunnitellaan ja toteutetaan neljä erilaista langattomien anturi- ja toimilaiteverkkojen automaatiosovellusta. Ensimmäisenä tapauksena toteutetaan elektroniikka- ja ohjelmistosovellus, jolla integroidaan kamera langattomaan anturinoodiin. Kuvat tallennetaan ja prosessoidaan anturinoodissa vähän energiaa kuluttavia laskentamenetelmiä käyttäen. Toisessa sovelluksessa kahdesta erilaisesta langattomasta anturiverkosta koostuvalla järjestelmällä valvotaan siementen syöttöä kylvökoneessa. Kolmannessa sovelluksessa levitetään kaupunkiympäristössä kriisitilanteessa rakennuksen sisätiloihin langaton anturiverkko. Sen anturinoodit välittävät paikkatietoa rakennuksessa operoiville omille joukoille, jotka voivat tilanteesta riippuen olla esimerkiksi sotilaita, palomiehiä tai lääkintähenkilökuntaa. Neljännessä sovelluksessa toteutetaan langaton anturiverkko, jonka keräämää mittausdataa käytetään arvioitaessa lämpöenergian keräämismahdollisuuksia asfalttipinnoilta.fi=vertaisarvioitu|en=peerReviewed

A Sensor Network with Embedded Data Processing and Data-to-Cloud Capabilities for Vibration-Based Real-Time SHM

This work describes a network of low power/low-cost microelectromechanical- (MEMS-) based three-axial acceleration sensors with local data processing and data-to-cloud capabilities. In particular, the developed sensor nodes are capable to acquire acceleration time series and extract their frequency spectrum peaks, which are autonomously sent through an ad hoc developed gateway device to an online database using a dedicated transfer protocol. The developed network minimizes the power consumption to monitor remotely and in real time the acceleration spectra peaks at each sensor node. An experimental setup in which a network of 5 sensor nodes is used to monitor a simply supported steel beam in free vibration conditions is considered to test the performance of the implemented circuitry. The total weight and energy consumption of the entire network are, respectively, less than 50 g and 300 mW in continuous monitoring conditions. Results show a very good agreement between the measured natural vibration frequencies of the beam and the theoretical values estimated according to the classical closed formula. As such, the proposed monitoring network can be considered ideal for the SHM of civil structures like long-span bridges