3D environment mapping using the Kinect V2 and path planning based on RRT algorithms

This paper describes a 3D path planning system that is able to provide a solution trajectory for the automatic control of a robot. The proposed system uses a point cloud obtained from the robot workspace, with a Kinect V2 sensor to identify the interest regions and the obstacles of the environment. Our proposal includes a collision-free path planner based on the Rapidly-exploring Random Trees variant (RRT*), for a safe and optimal navigation of robots in 3D spaces. Results on RGB-D segmentation and recognition, point cloud processing, and comparisons between different RRT* algorithms, are presented.Peer ReviewedPostprint (published version

Knowledge Representation for Robots through Human-Robot Interaction

The representation of the knowledge needed by a robot to perform complex tasks is restricted by the limitations of perception. One possible way of overcoming this situation and designing "knowledgeable" robots is to rely on the interaction with the user. We propose a multi-modal interaction framework that allows to effectively acquire knowledge about the environment where the robot operates. In particular, in this paper we present a rich representation framework that can be automatically built from the metric map annotated with the indications provided by the user. Such a representation, allows then the robot to ground complex referential expressions for motion commands and to devise topological navigation plans to achieve the target locations.Comment: Knowledge Representation and Reasoning in Robotics Workshop at ICLP 201

Design, Construction, Energy Modeling, and Navigation of a Six-Wheeled Differential Drive Robot to Deliver Medical Supplies inside Hospitals

Differential drive mobile robots have been the most ubiquitous kind of robots for the last few decades. As each of the wheels of a differential drive mobile robot can be controlled, it provides additional flexibility to the end-users in creating new applications. These applications include personal assistance, security, warehouse and distribution applications, ocean and space exploration, etc. In a clinic or hospital, the delivery of medicines and patients’ records are frequently needed activities. Medical personnel often find these activities repetitive and time-consuming. Our research was to design, construct, produce an energy model, and develop a navigation control method for a six-wheeled differential drive robot designed to deliver medical supplies inside the hospital. Such a robot is expected to lessen the workload of medical staff. Therefore, the design and implementation of a six-wheeled differential drive robot with a password-protected medicine carrier were presented. This password-protected medicine carrier ensures that only the authorized medical personnel can receive medical supplies. The low-cost robot base and the medicine carrier were built in real life. Besides the actual robot design and fabrication, a kinematic model for the robot was developed, and a navigation control algorithm to avoid obstacles was implemented using MATLAB/Simulink. The kinematic modeling is helpful for the robot to achieve better energy optimization. To develop the object avoidance algorithm, we investigated the use of the Robot Operating System (ROS) and the Simultaneous Localization and Mapping (SLAM) algorithm for the implementation of the mapping and navigation of a robotic platform named TurtleBot 2. Finally, using the Webot robot simulator, the navigation of the six-wheeled mobile robot was demonstrated in a hospital-like simulation environment

Autonomna navigacija za invalidska kolica s detekcijom prepreka u stvarnom vremenu korištenjem 3D senzora

Autonomous wheelchairs operating in dynamic environments need to sense its surrounding environment and adapt the control signal, in real-time, to avoid collisions and protect the user. In this paper we propose a robust, simple and real-time autonomous navigation module that drives a wheelchair toward a desired target, along with its capability to avoid obstacles in a 3D dynamic environment. To command the mobile robot to the target, we use a Fuzzy Logic Controller (FLC). For obstacle avoidance, we use the Kinect Xbox 360 to provide an actual map of the environment. The generated map is fed to the reactive obstacle avoidance control Deformable Virtual Zone (DVZ). Simulations and real world experiments results are reported to show the feasibility and the performance of the proposed control system.Autonomna invalidska kolica koja se kreću u dinamičkim okruženjima moraju biti sposobna detektirati prepreke u svojoj okolini, te prilagoditi upravljački signal u stvarnom vremenu kako bi se izbjegli sudari i zaštitio korisnik. U ovom radu predlaže se jednostavan, robustan modul za autonomnu navigaciju u stvarnom vremenu koji vodi invalidska kolica prema željenom odredištu, te omogućuje izbjegavanje prepreka u 3D okruženju. Za upravljanje koristi se regulator baziran na neizravnoj logici (FLC). Za izbjegavanje prepreka koristi se Kinect Xbox 360 senzor koji gradi kartu okoline. Generirana karta se predaje reaktivnoj kontroli za izbjegavanje prepreka Deformiranoj Virutalnoj Zoni (DVZ). Prikazani su rezultati simulacija i eksperimenata u stvarnom svijetu kako bi se pokazala izvedivost i kvaliteta izvođenja predloženog sustava upravljanja

Multi-Sensor Mobile Robot Localization For Diverse Environments

Mobile robot localization with different sensors and algorithms is a widely studied problem, and there have been many approaches proposed, with considerable degrees of success. However, every sensor and algorithm has limitations, due to which we believe no single localization algorithm can be “perfect,” or universally applicable to all situations. Laser rangefinders are commonly used for localization, and state-of-theart algorithms are capable of achieving sub-centimeter accuracy in environments with features observable by laser rangefinders. Unfortunately, in large scale environments, there are bound to be areas devoid of features visible by a laser rangefinder, like open atria or corridors with glass walls. In such situations, the error in localization estimates using laser rangefinders could grow in an unbounded manner. Localization algorithms that use depth cameras, like the Microsoft Kinect sensor, have similar characteristics. WiFi signal strength based algorithms, on the other hand, are applicable anywhere there is dense WiFi coverage, and have bounded errors. Although the minimum error of WiFi based localization may be greater than that of laser rangefinder or depth camera based localization, the maximum error of WiFi based localization is bounded and less than that of the other algorithms. Hence, in our work, we analyze the strengths of localization using all three sensors - using a laser rangefinder, a depth camera, and using WiFi. We identify sensors that are most accurate at localization for different locations on the map. The mobile robot could then, for example, rely on WiFi localization more in open areas or areas with glass walls, and laser rangefinder and depth camera based localization in corridor and office environments

Local Generating Map System Using Rviz ROS and Kinect Camera for Rescue Robot Application

This paper presents a model to generate a 3D model of a room, where room mapping is very necessary to find out the existing real conditions, where this modeling will be applied to the rescue robot. To solve this problem, researchers made a breakthrough by creating a 3D room mapping system. The mapping system and 3D model making carried out in this study are to utilize the camera Kinect and Rviz on the ROS. The camera takes a picture of the area around it, the imagery results are processed in the ROS system, the processing carried out includes several nodes and topics in the ROS which later the signal results are sent and displayed on the Rviz ROS. From the results of the tests that have been carried out, the designed system can create a 3D model from the Kinect camera capture by utilizing the Rviz function on the ROS. From this model later every corner of the room can be mapped and modeled in 3

Challenges and solutions for autonomous ground robot scene understanding and navigation in unstructured outdoor environments: A review

The capabilities of autonomous mobile robotic systems have been steadily improving due to recent advancements in computer science, engineering, and related disciplines such as cognitive science. In controlled environments, robots have achieved relatively high levels of autonomy. In more unstructured environments, however, the development of fully autonomous mobile robots remains challenging due to the complexity of understanding these environments. Many autonomous mobile robots use classical, learning-based or hybrid approaches for navigation. More recent learning-based methods may replace the complete navigation pipeline or selected stages of the classical approach. For effective deployment, autonomous robots must understand their external environments at a sophisticated level according to their intended applications. Therefore, in addition to robot perception, scene analysis and higher-level scene understanding (e.g., traversable/non-traversable, rough or smooth terrain, etc.) are required for autonomous robot navigation in unstructured outdoor environments. This paper provides a comprehensive review and critical analysis of these methods in the context of their applications to the problems of robot perception and scene understanding in unstructured environments and the related problems of localisation, environment mapping and path planning. State-of-the-art sensor fusion methods and multimodal scene understanding approaches are also discussed and evaluated within this context. The paper concludes with an in-depth discussion regarding the current state of the autonomous ground robot navigation challenge in unstructured outdoor environments and the most promising future research directions to overcome these challenges