711 research outputs found
Deep Reinforcement Learning based Continuous Control for Multicopter Systems
In this paper we apply deep reinforcement learning techniques on a multicopter for learning a stable hovering task in
a continuous action state environment. We present a framework based on OpenAI GYM, Gazebo and RotorS MAV simulator, utilized for successfully training different agents to perform various tasks. The deep reinforcement learning method used for the training is model-free, on-policy, actor-critic based algorithm called Trust Region Policy Optimization (TRPO). Two neural networks have been used as a nonlinear function approximators. Our experiments showed that such learning approach achieves successful results, and facilitates the process of controller design
The importance of using models in the teaching and learning process of the nature of light
Analysis of registered experiences on orienting a course –“the problem of light”- is presented with the aim at contributing to overcome failures related with wrong ideas both for teachers and students. Both the students and teachers are orientated in the study of the nature of light throughout the knowledge of the different models or theories explaining the light phenomena in order to have a significant learning and make a change both conceptual and methodological so it can be applied in their basic, medium or superior education work
Model predictive cooperative localization control of multiple UAVs using potential function sensor constraints: a workflow to create sensor constraint based potential functions for the control of cooperative localization scenarios with mobile robots.
The global localization of multiple mobile robots can be achieved cost efficiently by localizing one robot globally and the others in relation to it using local sensor data. However, the drawback of this cooperative localization is the requirement of continuous sensor information. Due to a limited sensor perception space, the tracking task to continuously maintain this sensor information is challenging. To address this problem, this contribution is presenting a model predictive control (MPC) approach for such cooperative localization scenarios. In particular, the present work shows a novel workflow to describe sensor limitations with the help of potential functions. In addition, a compact motion model for multi-rotor drones is introduced to achieve MPC real-time capability. The effectiveness of the presented approach is demonstrated in a numerical simulation, an experimental indoor scenario with two quadrotors as well as multiple indoor scenarios of a quadrotor obstacle evasion maneuver
Real-time graph-based SLAM in unknown environments using a small UAV
Autonomous navigation of small Unmanned Aerial Vehicles (UAVs) in cluttered environments is still a challenging problem. In this work, we present an approach based on graph slam and loop closure detection for online mapping of unknown outdoor environments using a small UAV. Here, we used an onboard front facing stereo camera as the primary sensor. The data extracted by the cameras are used by the graph-based slam algorithm to estimate the position and create the graph-nodes and construct the map. To avoid multiple detections of one object as different objects and to identify re-visited locations, a loop closure detection is applied with optimization algorithm using the g2o toolbox to minimize the error. Furthermore, 3D occupancy map is used to represent the environment. This technique is used to save memory and computational time for the online processing. Real experiments are conducted in outdoor cluttered and open field environments.The experiment results show that our presented approach works under real time constraints, with an average time to process the nodes of the 3D map is 17.79ms
Modeling and Control of Aerial Manipulation Vehicle with Visual sensor
Modeling and control of a Quadrotor with robotic arm which uses vision sensor
is discussed. A quadrotor model coupled with a two link manipulator is first developed and
then the integrated control mechanism is investigated. An Image Based Visual Servo system is
introduced and then used with the aerial manipulator to successfully perform specific tasks of
positioning and stabilization during manipulation
Evasive Maneuvering for UAVs: An MPC Approach
Flying autonomously in a workspace populated by obstacles is one of the main goals when working with Unmanned Aerial Vehicles (UAV). To address this challenge, this paper presents a model predictive flight controller that drives the UAV through collision-free trajectories to reach a given pose or follow a way-point path. The major advantage of this approach lies on the inclusion of three-dimensional obstacle avoidance in the control layer by adding ellipsoidal constraints to the optimal control problem. The obstacles can be added, moved and resized online, providing a way to perform waypoint navigation without the need of motion planning. In addition, the delays of the system are considered in the prediction by an experimental first order with delay model of the system. Successful experiments in 3D path tracking and obstacle avoidance validates its effectiveness for sense-and-avoid and surveillance applications presenting the proper structure
to extent its autonomy and applications
COMPARISON STUDY OF THE ACCURACY OF SLAM TECHNIQUES AND SENSOR SELECTION FOR LUNAR EXPLORATION
Robotics navigation on the lunar surface is crucial for future lunar prospection missions. Visual Simultaneous Localisation And Mapping (vSLAM) bears several advantages over traditional Simultaneous Localisation And Mapping (SLAM) methods, such as mitigating wheel slip and using sensors with space heritage. Still, extreme environments create challenges for optical sensors. This work proposes a qualitative analysis of which elements influence the performance of vSLAM for lunar environments through an experimental approach in an analogue lunar facility
Real time degradation identification of UAV using machine learning techniques
The usages and functionalities of Unmanned Aerial Vehicles (UAV) have grown rapidly during the last years. They are being engaged in many types of missions, ranging from military to agriculture passing by entertainment and rescue or even delivery. Nonetheless, for being able to perform such tasks, UAVs have to navigate safely in an often dynamic and partly unknown environment. This brings many challenges to overcome, some of which can lead to damages or degradations of different body parts. Thus, new tools and methods are required to allow the successful analysis and identification of the different threats that UAVs have to manage during their missions or flights. Various approaches, addressing this domain, have been proposed. However, most of them typically identify the changes in the UAVs behavior rather than the issue. This work presents an approach, which focuses not only on identifying degradations of UAVs during flights, but estimate the source of the failure as well
A real-time model predictive position control with collision avoidance for commercial low-cost quadrotors
Unmanned aerial vehicles (UAVs) are the future technology
for autonomous fast transportation of individual goods.
They have the advantage of being small, fast and not to be
limited to the local infrastructure. This is not only
interesting for delivery of private consumption goods up to
the doorstep, but also particularly for smart factories.
One drawback of autonomous drone technology is the high
development costs, that limit research and development to a
small audience. This work is introducing a position control
with collision avoidance as a first step to make low-cost
drones more accessible to the execution of autonomous
tasks. The paper introduces a semilinear state-space model
for a commercial quadrotor and its adaptation to the
commercially available AR.Drone 2 system. The position
control introduced in this paper is a model predictive
control (MPC) based on a condensed multiple-shooting
continuation generalized minimal residual method
(CMSCGMRES). The collision avoidance is implemented in the
MPC based on a sigmoid function. The real-time
applicability of the proposed methods is demonstrated in
two experiments with a real AR.Drone quadrotor, adressing
position tracking and collision avoidance. The experiments
show the computational efficiency of the proposed control
design with a measured maximum computation time of less
than 2ms
- …