Autonomous navigation of a wheeled mobile robot in farm settings

This research is mainly about autonomously navigation of an agricultural wheeled mobile robot in an unstructured outdoor setting. This project has four distinct phases defined as: (i) Navigation and control of a wheeled mobile robot for a point-to-point motion. (ii) Navigation and control of a wheeled mobile robot in following a given path (path following problem). (iii) Navigation and control of a mobile robot, keeping a constant proximity distance with the given paths or plant rows (proximity-following). (iv) Navigation of the mobile robot in rut following in farm fields. A rut is a long deep track formed by the repeated passage of wheeled vehicles in soft terrains such as mud, sand, and snow. To develop reliable navigation approaches to fulfill each part of this project, three main steps are accomplished: literature review, modeling and computer simulation of wheeled mobile robots, and actual experimental tests in outdoor settings. First, point-to-point motion planning of a mobile robot is studied; a fuzzy-logic based (FLB) approach is proposed for real-time autonomous path planning of the robot in unstructured environment. Simulation and experimental evaluations shows that FLB approach is able to cope with different dynamic and unforeseen situations by tuning a safety margin. Comparison of FLB results with vector field histogram (VFH) and preference-based fuzzy (PBF) approaches, reveals that FLB approach produces shorter and smoother paths toward the goal in almost all of the test cases examined. Then, a novel human-inspired method (HIM) is introduced. HIM is inspired by human behavior in navigation from one point to a specified goal point. A human-like reasoning ability about the situations to reach a predefined goal point while avoiding any static, moving and unforeseen obstacles are given to the robot by HIM. Comparison of HIM results with FLB suggests that HIM is more efficient and effective than FLB. Afterward, navigation strategies are built up for path following, rut following, and proximity-following control of a wheeled mobile robot in outdoor (farm) settings and off-road terrains. The proposed system is composed of different modules which are: sensor data analysis, obstacle detection, obstacle avoidance, goal seeking, and path tracking. The capabilities of the proposed navigation strategies are evaluated in variety of field experiments; the results show that the proposed approach is able to detect and follow rows of bushes robustly. This action is used for spraying plant rows in farm field. Finally, obstacle detection and obstacle avoidance modules are developed in navigation system. These modules enables the robot to detect holes or ground depressions (negative obstacles), that are inherent parts of farm settings, and also over ground level obstacles (positive obstacles) in real-time at a safe distance from the robot. Experimental tests are carried out on two mobile robots (PowerBot and Grizzly) in outdoor and real farm fields. Grizzly utilizes a 3D-laser range-finder to detect objects and perceive the environment, and a RTK-DGPS unit for localization. PowerBot uses sonar sensors and a laser range-finder for obstacle detection. The experiments demonstrate the capability of the proposed technique in successfully detecting and avoiding different types of obstacles both positive and negative in variety of scenarios

Online Mapping-Based Navigation System for Wheeled Mobile Robot in Road Following and Roundabout

A road mapping and feature extraction for mobile robot navigation in road roundabout and road following environments is presented in this chapter. In this work, the online mapping of mobile robot employing the utilization of sensor fusion technique is used to extract the road characteristics that will be used with path planning algorithm to enable the robot to move from a certain start position to predetermined goal, such as road curbs, road borders, and roundabout. The sensor fusion is performed using many sensors, namely, laser range finder, camera, and odometry, which are combined on a new wheeled mobile robot prototype to determine the best optimum path of the robot and localize it within its environments. The local maps are developed using an image’s preprocessing and processing algorithms and an artificial threshold of LRF signal processing to recognize the road environment parameters such as road curbs, width, and roundabout. The path planning in the road environments is accomplished using a novel approach so called Laser Simulator to find the trajectory in the local maps developed by sensor fusion. Results show the capability of the wheeled mobile robot to effectively recognize the road environments, build a local mapping, and find the path in both road following and roundabout

Unmanned Ground Vehicles for Smart Farms

Forecasts of world population increases in the coming decades demand new production processes that are more efficient, safer, and less destructive to the environment. Industries are working to fulfill this mission by developing the smart factory concept. The agriculture world should follow industry leadership and develop approaches to implement the smart farm concept. One of the most vital elements that must be configured to meet the requirements of the new smart farms is the unmanned ground vehicles (UGV). Thus, this chapter focuses on the characteristics that the UGVs must have to function efficiently in this type of future farm. Two main approaches are discussed: automating conventional vehicles and developing specifically designed mobile platforms. The latter includes both wheeled and wheel-legged robots and an analysis of their adaptability to terrain and crops

Map-based localization for urban service mobile robotics

Mobile robotics research is currently interested on exporting autonomous navigation results achieved in indoor environments, to more challenging environments, such as, for instance, urban pedestrian areas. Developing mobile robots with autonomous navigation capabilities in such urban environments supposes a basic requirement for a upperlevel service set that could be provided to an users community. However, exporting indoor techniques to outdoor urban pedestrian scenarios is not evident due to the larger size of the environment, the dynamism of the scene due to pedestrians and other moving obstacles, the sunlight conditions, and the high presence of three dimensional elements such as ramps, steps, curbs or holes. Moreover, GPS-based mobile robot localization has demonstrated insufficient performance for robust long-term navigation in urban environments. One of the key modules within autonomous navigation is localization. If localization supposes an a priori map, even if it is not a complete model of the environment, localization is called map-based. This assumption is realistic since current trends of city councils are on building precise maps of their cities, specially of the most interesting places such as city downtowns. Having robots localized within a map allows for a high-level planning and monitoring, so that robots can achieve goal points expressed on the map, by following in a deliberative way a previously planned route. This thesis deals with the mobile robot map-based localization issue in urban pedestrian areas. The thesis approach uses the particle filter algorithm, a well-known and widely used probabilistic and recursive method for data fusion and state estimation. The main contributions of the thesis are divided on four aspects: (1) long-term experiments of mobile robot 2D and 3D position tracking in real urban pedestrian scenarios within a full autonomous navigation framework, (2) developing a fast and accurate technique to compute on-line range observation models in 3D environments, a basic step required by the real-time performance of the developed particle filter, (3) formulation of a particle filter that integrates asynchronous data streams and (4) a theoretical proposal to solve the global localization problem in an active and cooperative way, defining cooperation as either information sharing among the robots or planning joint actions to solve a common goal.Actualment, la recerca en robòtica mòbil té un interés creixent en exportar els resultats de navegació autònoma aconseguits en entorns interiors cap a d'altres tipus d'entorns més exigents, com, per exemple, les àrees urbanes peatonals. Desenvolupar capacitats de navegació autònoma en aquests entorns urbans és un requisit bàsic per poder proporcionar un conjunt de serveis de més alt nivell a una comunitat d'usuaris. Malgrat tot, exportar les tècniques d'interiors cap a entorns exteriors peatonals no és evident, a causa de la major dimensió de l'entorn, del dinamisme de l'escena provocada pels peatons i per altres obstacles en moviment, de la resposta de certs sensors a la il.luminació natural, i de la constant presència d'elements tridimensionals tals com rampes, escales, voreres o forats. D'altra banda, la localització de robots mòbils basada en GPS ha demostrat uns resultats insuficients de cara a una navegació robusta i de llarga durada en entorns urbans. Una de les peces clau en la navegació autònoma és la localització. En el cas que la localització consideri un mapa conegut a priori, encara que no sigui un model complet de l'entorn, parlem d'una localització basada en un mapa. Aquesta assumpció és realista ja que la tendència actual de les administracions locals és de construir mapes precisos de les ciutats, especialment dels llocs d'interés tals com les zones més cèntriques. El fet de tenir els robots localitzats en un mapa permet una planificació i una monitorització d'alt nivell, i així els robots poden arribar a destinacions indicades sobre el mapa, tot seguint de forma deliberativa una ruta prèviament planificada. Aquesta tesi tracta el tema de la localització de robots mòbils, basada en un mapa i per entorns urbans peatonals. La proposta de la tesi utilitza el filtre de partícules, un mètode probabilístic i recursiu, ben conegut i àmpliament utilitzat per la fusió de dades i l'estimació d'estats. Les principals contribucions de la tesi queden dividides en quatre aspectes: (1) experimentació de llarga durada del seguiment de la posició, tant en 2D com en 3D, d'un robot mòbil en entorns urbans reals, en el context de la navegació autònoma, (2) desenvolupament d'una tècnica ràpida i precisa per calcular en temps d'execució els models d'observació de distàncies en entorns 3D, un requisit bàsic pel rendiment del filtre de partícules a temps real, (3) formulació d'un filtre de partícules que integra conjunts de dades asíncrones i (4) proposta teòrica per solucionar la localització global d'una manera activa i cooperativa, entenent la cooperació com el fet de compartir informació, o bé com el de planificar accions conjuntes per solucionar un objectiu comú

Implementation of nonlinear model predictive control on all terrain mobile robot

The objective of this thesis is to control a mobile robot with nonholonomic constraints to achieve two control objectives: point stabilization and trajectory tracking. This research adopts Nonlinear Model Predictive Control (NMPC) to achieve these control objectives. The mobile robot platform used in the research is Seekur Jr., which is a skid-steering all terrain mobile robot with nonholonomic constraints. In this study NMPC is developed and tested for both indoor and outdoor navigation. To address the indoor localization issues, two methods have been adopted. In the former approach for indoor localization, a map of the environment is generated using a laser range finder. This map, along with laser range finder, is used to determine the pose (position and orientation) of the mobile robot in the environment. In the second approach, OptiTrack motion capture system has been used, which gives the position data of the mobile robot in the environment and orientation is evaluated through this. For outdoor navigation, Global Positioning System (GPS) is used to obtain the localization. The implementation of NMPC involves solving a dynamic optimization control problem, which makes the evaluation of control command time consuming. Therefore, it is difficult to implement NMPC for mobile robots in real-time applications. To address this issue, an open source toolkit solving Optimal Control Problem (OCP) has been used to implement fast NMPC routine, which provides real-time applicability of the control strategy. Obstacle avoidance feature is also added to the controller to avoid static obstacles in the trajectory of the mobile robot. The proposed control strategy is evaluated on a number of simulations and experimental studies. The results validate the real-time applicability of the proposed approach in indoor and outdoor navigation

Combined visual odometry and visual compass for off-road mobile robots localization

In this paper, we present the work related to the application of a visual odometry approach to estimate the location of mobile robots operating in off-road conditions. The visual odometry approach is based on template matching, which deals with estimating the robot displacement through a matching process between two consecutive images. Standard visual odometry has been improved using visual compass method for orientation estimation. For this purpose, two consumer-grade monocular cameras have been employed. One camera is pointing at the ground under the robot, and the other is looking at the surrounding environment. Comparisons with popular localization approaches, through physical experiments in off-road conditions, have shown the satisfactory behavior of the proposed strateg

Interactive multiple model filtering for robotic navigation and tracking applications

The work contained in this thesis focuses on two main objectives. The first objective is to evaluate the Interactive Multiple Model (IMM) filter method for robotic applications including inertial navigation systems (INS) and computer vision tracking. The second objective is to design an experimental testbed for multi-model mobile robot state estimation research in the Intelligent Systems Laboratory (ISLAB) at Memorial University. An IMM estimator uses multiple filters that run simultaneously to produce a combined weighted estimation of an observed system’s states. The weights are functions of the likelihood of how well each individual filter matches the current behaviour exhibited by the system. The performance of IMM filtering is evaluated using two different strategies for augmenting the system’s filter banks. The first method uses multiple kinematic models (constant velocity and constant acceleration models) in a mean-shift-based computer vision tracking application. The results of this experiment indicate that the IMM improves tracking performance due to its ability to adapt to the continuously changing motion characteristics of 2D blobs in videos. The second approach uses the same kinematics for each filter; however, the process and sensor noise parameters are tuned differently for each model. This method is tested in INS applications for both an automobile and a skid-steer mobile robot (Seekur Jr). Results show that the method improves INS tracking over single model Extended Kalman Filter (EKF) designs. Furthermore, an augmented state-space model containing skid-steer instantaneous center of rotation (ICR) kinematics is presented for future testing on the Seekur Jr INS. The experimental testbed designed in this thesis work is an operational data acquisition system developed for use with the Seekur Jr robot. The Seekur Jr platform has been Robot Operating System (ROS) enabled with access to data streams from 2D Lidar, 3D nodding Lidar, inertial measurement unit, digital compass, wheel encoder, onboard Global Positioning System (GPS), real-time kinematic (RTK) differential global positioning system (DGPS) ground truth, and vision sensors. The physical setup and data networking aspects of the testbed have been used for validation of an IMM filter presented in this thesis and is fully configured for future multi-model localization experiments of the ISLAB

Multi sensor fusion framework for indoor-outdoor localization of limited resource mobile robots

This paper presents a sensor fusion framework that improves the localization of mobile robots with limited computational resources. It employs an event based Kalman Filter to combine the measurements of a global sensor and an inertial measurement unit (IMU) on an event based schedule, using fewer resources (execution time and bandwidth) but with similar performance when compared to the traditional methods. The event is defined to reflect the necessity of the global information, when the estimation error covariance exceeds a predefined limit. The proposed experimental platforms are based on the LEGO Mindstorm NXT, and consist of a differential wheel mobile robot navigating indoors with a zenithal camera as global sensor, and an Ackermann steering mobile robot navigating outdoors with a SBG Systems GPS accessed through an IGEP board that also serves as datalogger. The IMU in both robots is built using the NXT motor encoders along with one gyroscope, one compass and two accelerometers from Hitecnic, placed according to a particle based dynamic model of the robots. The tests performed reflect the correct performance and low execution time of the proposed framework. The robustness and stability is observed during a long walk test in both indoors and outdoors environments.This work has been partially funded by FEDER-CICYT projects with references DPI2011-28507-C02-01 and DPI2010-20814-C02-02, financed by Ministerio de Ciencia e Innovacion (Spain). Also, the financial support from the University of Costa Rica is greatly appreciated.Marín, L.; Vallés Miquel, M.; Soriano Vigueras, Á.; Valera Fernández, Á.; Albertos Pérez, P. (2013). Multi sensor fusion framework for indoor-outdoor localization of limited resource mobile robots. Sensors. 13(10):14133-14160. doi:10.3390/s131014133S14133141601310http://en.wikibooks.org/wiki/Cyberbotics'_Robot_Curriculumhttp://www.cs.un-c.edu/welch/kalman/kalmanIntro.htmlJulier, S., Uhlmann, J., & Durrant-Whyte, H. F. (2000). A new method for the nonlinear transformation of means and covariances in filters and estimators. IEEE Transactions on Automatic Control, 45(3), 477-482. doi:10.1109/9.847726Pioneer Robots Online Informationhttp://www.mobilerobots.com/ResearchRobots.aspxHakyoung Chung, Ojeda, L., & Borenstein, J. (2001). Accurate mobile robot dead-reckoning with a precision-calibrated fiber-optic gyroscope. IEEE Transactions on Robotics and Automation, 17(1), 80-84. doi:10.1109/70.917085Jingang Yi, Hongpeng Wang, Junjie Zhang, Dezhen Song, Jayasuriya, S., & Jingtai Liu. (2009). Kinematic Modeling and Analysis of Skid-Steered Mobile Robots With Applications to Low-Cost Inertial-Measurement-Unit-Based Motion Estimation. IEEE Transactions on Robotics, 25(5), 1087-1097. doi:10.1109/tro.2009.2026506Hyun, D., Yang, H. S., Park, H.-S., & Kim, H.-J. (2010). Dead-reckoning sensor system and tracking algorithm for 3-D pipeline mapping. Mechatronics, 20(2), 213-223. doi:10.1016/j.mechatronics.2009.11.009Losada, C., Mazo, M., Palazuelos, S., Pizarro, D., & Marrón, M. (2010). Multi-Camera Sensor System for 3D Segmentation and Localization of Multiple Mobile Robots. Sensors, 10(4), 3261-3279. doi:10.3390/s100403261Fuchs, C., Aschenbruck, N., Martini, P., & Wieneke, M. (2011). Indoor tracking for mission critical scenarios: A survey. Pervasive and Mobile Computing, 7(1), 1-15. doi:10.1016/j.pmcj.2010.07.001Skog, I., & Handel, P. (2009). In-Car Positioning and Navigation Technologies—A Survey. IEEE Transactions on Intelligent Transportation Systems, 10(1), 4-21. doi:10.1109/tits.2008.2011712Kim, S. J., & Kim, B. K. (2013). Dynamic Ultrasonic Hybrid Localization System for Indoor Mobile Robots. IEEE Transactions on Industrial Electronics, 60(10), 4562-4573. doi:10.1109/tie.2012.2216235Boccadoro, M., Martinelli, F., & Pagnottelli, S. (2010). Constrained and quantized Kalman filtering for an RFID robot localization problem. Autonomous Robots, 29(3-4), 235-251. doi:10.1007/s10514-010-9194-zMadhavan, R., Fregene, K., & Parker, L. E. (2004). Distributed Cooperative Outdoor Multirobot Localization and Mapping. Autonomous Robots, 17(1), 23-39. doi:10.1023/b:auro.0000032936.24187.41Yunchun Yang, & Farrell, J. A. (2003). Magnetometer and differential carrier phase GPS-aided INS for advanced vehicle control. IEEE Transactions on Robotics and Automation, 19(2), 269-282. doi:10.1109/tra.2003.809591Zhang, T., & Xu, X. (2012). A new method of seamless land navigation for GPS/INS integrated system. Measurement, 45(4), 691-701. doi:10.1016/j.measurement.2011.12.021Shen, Z., Georgy, J., Korenberg, M. J., & Noureldin, A. (2011). Low cost two dimension navigation using an augmented Kalman filter/Fast Orthogonal Search module for the integration of reduced inertial sensor system and Global Positioning System. Transportation Research Part C: Emerging Technologies, 19(6), 1111-1132. doi:10.1016/j.trc.2011.01.001Kotecha, J. H., & Djuric, P. M. (2003). Gaussian particle filtering. IEEE Transactions on Signal Processing, 51(10), 2592-2601. doi:10.1109/tsp.2003.816758Seyboth, G. S., Dimarogonas, D. V., & Johansson, K. H. (2013). Event-based broadcasting for multi-agent average consensus. Automatica, 49(1), 245-252. doi:10.1016/j.automatica.2012.08.042Guinaldo, M., Fábregas, E., Farias, G., Dormido-Canto, S., Chaos, D., Sánchez, J., & Dormido, S. (2013). A Mobile Robots Experimental Environment with Event-Based Wireless Communication. Sensors, 13(7), 9396-9413. doi:10.3390/s130709396Meng, X., & Chen, T. (2013). Event based agreement protocols for multi-agent networks. Automatica, 49(7), 2125-2132. doi:10.1016/j.automatica.2013.03.002Campion, G., Bastin, G., & Dandrea-Novel, B. (1996). Structural properties and classification of kinematic and dynamic models of wheeled mobile robots. IEEE Transactions on Robotics and Automation, 12(1), 47-62. doi:10.1109/70.481750Ward, C. C., & Iagnemma, K. (2008). A Dynamic-Model-Based Wheel Slip Detector for Mobile Robots on Outdoor Terrain. IEEE Transactions on Robotics, 24(4), 821-831. doi:10.1109/tro.2008.924945Zohar, I., Ailon, A., & Rabinovici, R. (2011). Mobile robot characterized by dynamic and kinematic equations and actuator dynamics: Trajectory tracking and related application. Robotics and Autonomous Systems, 59(6), 343-353. doi:10.1016/j.robot.2010.12.001De La Cruz, C., & Carelli, R. (2008). Dynamic model based formation control and obstacle avoidance of multi-robot systems. Robotica, 26(3), 345-356. doi:10.1017/s0263574707004092Attia, H. A. (2005). Dynamic model of multi-rigid-body systems based on particle dynamics with recursive approach. Journal of Applied Mathematics, 2005(4), 365-382. doi:10.1155/jam.2005.365LEGO NXT Mindsensorshttp://www.mindsensors.comLEGO NXT HiTechnic Sensorshttp://www.hitechnic.com/sensorsLEGO 9V Technic Motors Compared Characteristicshttp://wwwphilohome.com/motors/motorcomp.htmIG-500N: GPS Aided Miniature INShttp://www.sbg-systems.com/products/ig500n-miniature-ins-gpsIGEPv2 Boardhttp://www.isee.biz/products/igep-processor-boards/igepv2-dm3730EKF/UKF Toolbox for Matlab V1.3http://www.lce.hut.fi/research/mm/ekfukf