Attention and Anticipation in Fast Visual-Inertial Navigation

We study a Visual-Inertial Navigation (VIN) problem in which a robot needs to estimate its state using an on-board camera and an inertial sensor, without any prior knowledge of the external environment. We consider the case in which the robot can allocate limited resources to VIN, due to tight computational constraints. Therefore, we answer the following question: under limited resources, what are the most relevant visual cues to maximize the performance of visual-inertial navigation? Our approach has four key ingredients. First, it is task-driven, in that the selection of the visual cues is guided by a metric quantifying the VIN performance. Second, it exploits the notion of anticipation, since it uses a simplified model for forward-simulation of robot dynamics, predicting the utility of a set of visual cues over a future time horizon. Third, it is efficient and easy to implement, since it leads to a greedy algorithm for the selection of the most relevant visual cues. Fourth, it provides formal performance guarantees: we leverage submodularity to prove that the greedy selection cannot be far from the optimal (combinatorial) selection. Simulations and real experiments on agile drones show that our approach ensures state-of-the-art VIN performance while maintaining a lean processing time. In the easy scenarios, our approach outperforms appearance-based feature selection in terms of localization errors. In the most challenging scenarios, it enables accurate visual-inertial navigation while appearance-based feature selection fails to track robot's motion during aggressive maneuvers.Comment: 20 pages, 7 figures, 2 table

Distance Aware Relaying Energy-efficient: DARE to Monitor Patients in Multi-hop Body Area Sensor Networks

In recent years, interests in the applications of Wireless Body Area Sensor Network (WBASN) is noticeably developed. WBASN is playing a significant role to get the real time and precise data with reduced level of energy consumption. It comprises of tiny, lightweight and energy restricted sensors, placed in/on the human body, to monitor any ambiguity in body organs and measure various biomedical parameters. In this study, a protocol named Distance Aware Relaying Energy-efficient (DARE) to monitor patients in multi-hop Body Area Sensor Networks (BASNs) is proposed. The protocol operates by investigating the ward of a hospital comprising of eight patients, under different topologies by positioning the sink at different locations or making it static or mobile. Seven sensors are attached to each patient, measuring different parameters of Electrocardiogram (ECG), pulse rate, heart rate, temperature level, glucose level, toxins level and motion. To reduce the energy consumption, these sensors communicate with the sink via an on-body relay, affixed on the chest of each patient. The body relay possesses higher energy resources as compared to the body sensors as, they perform aggregation and relaying of data to the sink node. A comparison is also conducted conducted with another protocol of BAN named, Mobility-supporting Adaptive Threshold-based Thermal-aware Energy-efficient Multi-hop ProTocol (M-ATTEMPT). The simulation results show that, the proposed protocol achieves increased network lifetime and efficiently reduces the energy consumption, in relative to M-ATTEMPT protocol.Comment: IEEE 8th International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA'13), Compiegne, Franc

Event-based Vision: A Survey

Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of microseconds), very high dynamic range (140 dB vs. 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world

Design of an Elastic Actuation System for a Gait-Assistive Active Orthosis for Incomplete Spinal Cord Injured Subjects

A spinal cord injury severely reduces the quality of life of affected people. Following the injury, limitations of the ability to move may occur due to the disruption of the motor and sensory functions of the nervous system depending on the severity of the lesion. An active stance-control knee-ankle-foot orthosis was developed and tested in earlier works to aid incomplete SCI subjects by increasing their mobility and independence. This thesis aims at the incorporation of elastic actuation into the active orthosis to utilise advantages of the compliant system regarding efficiency and human-robot interaction as well as the reproduction of the phyisological compliance of the human joints. Therefore, a model-based procedure is adapted to the design of an elastic actuation system for a gait-assisitve active orthosis. A determination of the optimal structure and parameters is undertaken via optimisation of models representing compliant actuators with increasing level of detail. The minimisation of the energy calculated from the positive amount of power or from the absolute power of the actuator generating one human-like gait cycle yields an optimal series stiffness, which is similar to the physiological stiffness of the human knee during the stance phase. Including efficiency factors for components, especially the consideration of the electric model of an electric motor yields additional information. A human-like gait cycle contains high torque and low velocities in the stance phase and lower torque combined with high velocities during the swing. Hence, the efficiency of an electric motor with a gear unit is only high in one of the phases. This yields a conceptual design of a series elastic actuator with locking of the actuator position during the stance phase. The locked position combined with the series compliance allows a reproduction of the characteristics of the human gait cycle during the stance phase. Unlocking the actuator position for the swing phase enables the selection of an optimal gear ratio to maximise the recuperable energy. To evaluate the developed concept, a laboratory specimen based on an electric motor, a harmonic drive gearbox, a torsional series spring and an electromagnetic brake is designed and appropriate components are selected. A control strategy, based on impedance control, is investigated and extended with a finite state machine to activate the locking mechanism. The control scheme and the laboratory specimen are implemented at a test bench, modelling the foot and shank as a pendulum articulated at the knee. An identification of parameters yields high and nonlinear friction as a problem of the system, which reduces the energy efficiency of the system and requires appropriate compensation. A comparison between direct and elastic actuation shows similar results for both systems at the test bench, showing that the increased complexity due to the second degree of freedom and the elastic behaviour of the actuator is treated properly. The final proof of concept requires the implementation at the active orthosis to emulate uncertainties and variations occurring during the human gait