Efficient Configuration Space Construction and Optimization for Motion Planning

The configuration space is a fundamental concept that is widely used in algorithmic robotics. Many applications in robotics, computer-aided design, and related areas can be reduced to computational problems in terms of configuration spaces. In this paper, we survey some of our recent work on solving two important challenges related to configuration spaces

Reinforcement Learning With Temporal Logic Rewards

Reinforcement learning (RL) depends critically on the choice of reward functions used to capture the de- sired behavior and constraints of a robot. Usually, these are handcrafted by a expert designer and represent heuristics for relatively simple tasks. Real world applications typically involve more complex tasks with rich temporal and logical structure. In this paper we take advantage of the expressive power of temporal logic (TL) to specify complex rules the robot should follow, and incorporate domain knowledge into learning. We propose Truncated Linear Temporal Logic (TLTL) as specifications language, that is arguably well suited for the robotics applications, together with quantitative semantics, i.e., robustness degree. We propose a RL approach to learn tasks expressed as TLTL formulae that uses their associated robustness degree as reward functions, instead of the manually crafted heuristics trying to capture the same specifications. We show in simulated trials that learning is faster and policies obtained using the proposed approach outperform the ones learned using heuristic rewards in terms of the robustness degree, i.e., how well the tasks are satisfied. Furthermore, we demonstrate the proposed RL approach in a toast-placing task learned by a Baxter robot

knowledge_diffusion_with_complex_cognition

This paper aims to understand some of the mechanisms which dominate the phenomenon of knowledge diffusion in the process that is called ‘interactive learning’. We examine how knowledge spreads in a network in which agents interact by word of mouth. We define a social network structured as a graph consisting of agents (vertices) and connections (edges) and situated on a wrapped grid forming a torus. The target of this simulation is to test whether knowledge diffuses homogeneously or whether it follows some biased path, and its relation with the network architecture. We also investigate the impact of a modelled ICT platform on the knowledge diffusion process.Agent-based Knowledge Network Small world

Exploring bistatic scattering modeling for land surface applications using radio spectrum recycling in the Signal of Opportunity Coherent Bistatic Simulator

The potential for high spatio-temporal resolution microwave measurements has urged the adoption of the signals of opportunity (SoOp) passive radar technique for use in remote sensing. Recent trends in particular target highly complex remote sensing problems such as root-zone soil moisture and snow water equivalent. This dissertation explores the continued open-sourcing of the SoOp coherent bistatic scattering model (SCoBi) and its use in soil moisture sensing applications. Starting from ground-based applications, the feasibility of root-zone soil moisture remote sensing is assessed using available SoOp resources below L-band. A modularized, spaceborne model is then developed to simulate land-surface scattering and delay-Doppler maps over the available spectrum of SoOp resources. The simulation tools are intended to provide insights for future spaceborne modeling pursuits