DEVELOPMENT OF AN AUTONOMOUS NAVIGATION SYSTEM FOR THE SHUTTLE CAR IN UNDERGROUND ROOM & PILLAR COAL MINES

In recent years, autonomous solutions in the multi-disciplinary field of the mining engineering have been an extremely popular applied research topic. The growing demand for mineral supplies combined with the steady decline in the available surface reserves has driven the mining industry to mine deeper underground deposits. These deposits are difficult to access, and the environment may be hazardous to mine personnel (e.g., increased heat, difficult ventilation conditions, etc.). Moreover, current mining methods expose the miners to numerous occupational hazards such as working in the proximity of heavy mining equipment, possible roof falls, as well as noise and dust. As a result, the mining industry, in its efforts to modernize and advance its methods and techniques, is one of the many industries that has turned to autonomous systems. Vehicle automation in such complex working environments can play a critical role in improving worker safety and mine productivity. One of the most time-consuming tasks of the mining cycle is the transportation of the extracted ore from the face to the main haulage facility or to surface processing facilities. Although conveyor belts have long been the autonomous transportation means of choice, there are still many cases where a discrete transportation system is needed to transport materials from the face to the main haulage system. The current dissertation presents the development of a navigation system for an autonomous shuttle car (ASC) in underground room and pillar coal mines. By introducing autonomous shuttle cars, the operator can be relocated from the dusty, noisy, and potentially dangerous environment of the underground mine to the safer location of a control room. This dissertation focuses on the development and testing of an autonomous navigation system for an underground room and pillar coal mine. A simplified relative localization system which determines the location of the vehicle relatively to salient features derived from on-board 2D LiDAR scans was developed for a semi-autonomous laboratory-scale shuttle car prototype. This simplified relative localization system is heavily dependent on and at the same time leverages the room and pillar geometry. Instead of keeping track of a global position of the vehicle relatively to a fixed coordinates frame, the proposed custom localization technique requires information regarding only the immediate surroundings. The followed approach enables the prototype to navigate around the pillars in real-time using a deterministic Finite-State Machine which models the behavior of the vehicle in the room and pillar mine with only a few states. Also, a user centered GUI has been developed that allows for a human user to control and monitor the autonomous vehicle by implementing the proposed navigation system. Experimental tests have been conducted in a mock mine in order to evaluate the performance of the developed system. A number of different scenarios simulating common missions that a shuttle car needs to undertake in a room and pillar mine. The results show a minimum success ratio of 70%

Conflict-free dynamic route multi-AGV using dijkstra floyd-warshall hybrid algorithm with time windows

Autonomous Guided Vehicle is a mobile robot that can move autonomously on a route or lane in an indoor or outdoor environment while performing a series of tasks. Determination of the shortest route on an autonomous guided vehicle is one of the optimization problems in handling conflict-free routes that have an influence on the distribution of goods in the manufacturing industry's warehouse. Pickup and delivery processes in the distribution on AGV goods such as scheduling, shipping, and determining the route of vehicle with short mileage characteristics, is very possible to do simulations with three AGV units. There is a windows time limit on workstations that limits shipping. The problem of determining the route in this study is considered necessary as a multi-vehicle route problem with a time window. This study aims to describe the combination of algorithms written based on dynamic programming to overcome the problem of conflict-free AGV routes using time windows. The combined approach of the Dijkstra and Floyd-Warshall algorithm results in the optimization of the closest distance in overcoming conflict-free routes

Advances in Human-Robot Interaction

Rapid advances in the field of robotics have made it possible to use robots not just in industrial automation but also in entertainment, rehabilitation, and home service. Since robots will likely affect many aspects of human existence, fundamental questions of human-robot interaction must be formulated and, if at all possible, resolved. Some of these questions are addressed in this collection of papers by leading HRI researchers

Development of a vehicle dynamics controller for obstacle avoidance

As roads become busier and automotive technology improves, there is considerable potential for driver assistance systems to improve the safety of road users. Longitudinal collision warning and collision avoidance systems are starting to appear on production cars to assist drivers when required to stop in an emergency. Many luxury cars are also equipped with stability augmentation systems that prevent the car from spinning out of control during aggressive lateral manoeuvres. Combining these concepts, there is a natural progression to systems that could assist in aiding or performing lateral collision avoidance manoeuvres. A successful automatic lateral collision avoidance system would require convergent development of many fields of technology, from sensors and instrumentation to aid environmental awareness through to improvements in driver vehicle interfaces so that a degree of control can be smoothly and safely transferred between the driver and vehicle computer. A fundamental requirement of any collision avoidance system is determination of a feasible path that avoids obstacles and a means of causing the vehicle to follow that trajectory. This research focuses on feasible trajectory generation and development of an automatic obstacle avoidance controller that integrates steering and braking action. A controller is developed to cause a specially modified car (a Mercedes `S' class with steer-by-wire and brake-by-wire capability) to perform an ISO 3888-2 emergency obstacle avoidance manoeuvre. A nonlinear two-track vehicle model is developed and used to derive optimal controller parameters using a series of simulations. Feedforward and feedback control is used to track a feasible reference trajectory. The feedforward control loops use inverse models of the vehicle dynamics. The feedback control loops are implemented as linear proportional controllers with a force allocation matrix used to apportion braking effort between redundant actuators. Two trajectory generation routines are developed: a geometric method, for steering a vehicle at its physical limits; and an optimal method, which integrates steering and braking action to make full use of available traction. The optimal trajectory is obtained using a multi-stage convex optimisation procedure. The overall controller performance is validated by simulation using a complex proprietary model of the vehicle that is reported to have been validated and calibrated against experimental data over several years of use in an industrial environment

Trust-Based Control of (Semi)Autonomous Mobile Robotic Systems

Despite great achievements made in (semi)autonomous robotic systems, human participa-tion is still an essential part, especially for decision-making about the autonomy allocation of robots in complex and uncertain environments. However, human decisions may not be optimal due to limited cognitive capacities and subjective human factors. In human-robot interaction (HRI), trust is a major factor that determines humans use of autonomy. Over/under trust may lead to dispro-portionate autonomy allocation, resulting in decreased task performance and/or increased human workload. In this work, we develop automated decision-making aids utilizing computational trust models to help human operators achieve a more effective and unbiased allocation. Our proposed decision aids resemble the way that humans make an autonomy allocation decision, however, are unbiased and aim to reduce human workload, improve the overall performance, and result in higher acceptance by a human. We consider two types of autonomy control schemes for (semi)autonomous mobile robotic systems. The first type is a two-level control scheme which includes switches between either manual or autonomous control modes. For this type, we propose automated decision aids via a computational trust and self-confidence model. We provide analytical tools to investigate the steady-state effects of the proposed autonomy allocation scheme on robot performance and human workload. We also develop an autonomous decision pattern correction algorithm using a nonlinear model predictive control to help the human gradually adapt to a better allocation pattern. The second type is a mixed-initiative bilateral teleoperation control scheme which requires mixing of autonomous and manual control. For this type, we utilize computational two-way trust models. Here, mixed-initiative is enabled by scaling the manual and autonomous control inputs with a function of computational human-to-robot trust. The haptic force feedback cue sent by the robot is dynamically scaled with a function of computational robot-to-human trust to reduce humans physical workload. Using the proposed control schemes, our human-in-the-loop tests show that the trust-based automated decision aids generally improve the overall robot performance and reduce the operator workload compared to a manual allocation scheme. The proposed decision aids are also generally preferred and trusted by the participants. Finally, the trust-based control schemes are extended to the single-operator-multi-robot applications. A theoretical control framework is developed for these applications and the stability and convergence issues under the switching scheme between different robots are addressed via passivity based measures

Shared control strategies for automated vehicles

188 p.Los vehículos automatizados (AVs) han surgido como una solución tecnológica para compensar las deficiencias de la conducción manual. Sin embargo, esta tecnología aún no está lo suficientemente madura para reemplazar completamente al conductor, ya que esto plantea problemas técnicos, sociales y legales. Sin embargo, los accidentes siguen ocurriendo y se necesitan nuevas soluciones tecnológicas para mejorar la seguridad vial. En este contexto, el enfoque de control compartido, en el que el conductor permanece en el bucle de control y, junto con la automatización, forma un equipo bien coordinado que colabora continuamente en los niveles táctico y de control de la tarea de conducción, es una solución prometedora para mejorar el rendimiento de la conducción manual aprovechando los últimos avances en tecnología de conducción automatizada. Esta estrategia tiene como objetivo promover el desarrollo de sistemas de asistencia al conductor más avanzados y con mayor grade de cooperatición en comparación con los disponibles en los vehículos comerciales. En este sentido, los vehículos automatizados serán los supervisores que necesitan los conductores, y no al revés. La presente tesis aborda en profundidad el tema del control compartido en vehículos automatizados, tanto desde una perspectiva teórica como práctica. En primer lugar, se proporciona una revisión exhaustiva del estado del arte para brindar una descripción general de los conceptos y aplicaciones en los que los investigadores han estado trabajando durante lasúltimas dos décadas. Luego, se adopta un enfoque práctico mediante el desarrollo de un controlador para ayudar al conductor en el control lateral del vehículo. Este controlador y su sistema de toma de decisiones asociado (Módulo de Arbitraje) se integrarán en el marco general de conducción automatizada y se validarán en una plataforma de simulación con conductores reales. Finalmente, el controlador desarrollado se aplica a dos sistemas. El primero para asistir a un conductor distraído y el otro en la implementación de una función de seguridad para realizar maniobras de adelantamiento en carreteras de doble sentido. Al finalizar, se presentan las conclusiones más relevantes y las perspectivas de investigación futuras para el control compartido en la conducción automatizada

Aerial Human-Comfortable Collision-free Navigation in Dense Environments

With current overuse of the road transportation system and planned increase in traffic, inno- vative solutions that overcome environmental and financial cost of the current system should be assessed. A promising idea is the use of the third dimension for personal transportation. Therefore, the European project myCopter, funded under the 7th framework, aimed at en- abling the technologies for Personal Aerial Transportation Systems as breakthrough in 21st century transportation systems. This project was the starting point of this thesis. When multiple vehicles share a common part of the sky, the biggest challenge is the man- agement of the risk of collision. While optimal collision-free navigation strategies have been proposed for autonomous robots, trajectories and accelerations for Personal Aerial Vehicles (PAVs) should also take into account human comfort for their passengers, which has rarely been the focus of these studies. Comfort of the trajectories is a key factor in order for this new transportation mean to be accepted and adopted by everyday users. Existing strategies used to maximize human-comfort of trajectories are based on path planning strategies, which compute beforehand the whole trajectory, implementing comfort as an optimization criteria. Personal Aerial Transportation Systems will have a high density of vehicles, where the time to react to potential threats might decrease to a few seconds only. This might be insufficient to compute a new trajectory each time using these path planning strategies. Therefore, in this thesis, a reactive decentralized strategy is proposed, maximizing the comfort of the trajectories for humans traveling in a Personal Aerial Vehicle. To prove the feasibility of collision avoidance strategies, it is not sufficient anymore to validate them only in simulation, but, in addition, real-time tests in a realistic outdoor environment should be performed. Nowadays, single drones can be effectively controlled by a single operator on the ground. The challenge relies instead on an efficient management of a whole swarm of drone. In this thesis, a framework to perform outdoor drone experiment was developed in order to validate the proposed collision avoidance strategy. On the one hand, an autopilot framework was developed, tailored for multi-drone experiments, allowing fast and easy deployment and maintenance of a swarm of drones. On the other hand, a ground control interface is proposed in order to monitor, control and maintain safety in a flight with a swarm of drones. Using the autopilot framework together with the ground control interface, the proposed collision avoidance strategy was validated using 10 quadrotors flying autonomously outdoor in a challenging scenario

Parking lot monitoring system using an autonomous quadrotor UAV

The main goal of this thesis is to develop a drone-based parking lot monitoring system using low-cost hardware and open-source software. Similar to wall-mounted surveillance cameras, a drone-based system can monitor parking lots without affecting the flow of traffic while also offering the mobility of patrol vehicles. The Parrot AR Drone 2.0 is the quadrotor drone used in this work due to its modularity and cost efficiency. Video and navigation data (including GPS) are communicated to a host computer using a Wi-Fi connection. The host computer analyzes navigation data using a custom flight control loop to determine control commands to be sent to the drone. A new license plate recognition pipeline is used to identify license plates of vehicles from video received from the drone

Investigation of Sensorimotor Integration and Control in Parkinson’s Disease using Haptics-enabled Robotics and Machine Learning

Non-motor symptoms such as perceptual deficits and cognitive impairments, i.e., deficits in executive functions, presented at an early stage of Parkinson’s Disease (PD) substantially affect a PD patient’s quality of life and may contribute to motor impairments. Studies have emphasized the need to better understand these impairments and the abnormalities contributing to them as it provides a means to efficiently manage the disease. Further, due to the early onset of these deficits, the contributing abnormalities may be considered a potential biomarker for early diagnosis of PD. However, the impairments and the contributing abnormalities are not yet fully understood, leading to inadequate options to efficiently manage the disease. The Basal Ganglia, the region affected by PD, plays a vital role in Sensorimotor Integration (SMI) and Sensorimotor Control (SMC) functions – two fundamental processes involved in sensory perception and movement planning. The hypothesis is that the impairments in SMI and SMC contribute to deficits in perception and executive functions, leading to motor deficits and these impairments may be altered due to medication. The primary contribution of the thesis is the development of robotic tools for characterizing the SMI and SMC impairments in PD patients. The study’s results showed that PD patients suffer from an impaired SMI and SMC circuit that adversely affects multi-sensory integration, movement planning, online error correction, and execution of voluntary movements. Additionally, the findings have shown that dopaminergic medication significantly worsens SMI and SMC impairments. The secondary contribution is the development of a musculoskeletal model that can accurately estimate in-depth SMC features. The developed model may be used to guide and enhance the efficacy of PD-related therapies. The novel findings of the study contribute to advancing our knowledge about the disease and the effect of medication by characterizing the SMI and SMC impairments and demonstrating their contribution to deficits in perception, executive functions, and motor performance. The study’s results enable us to better target these deficits through efficient treatment optimization. Further, the thesis describes the development and validation of tools to effectively diagnose, monitor, and individualize the assessment of SMI, SMC, and, consequently, the corresponding non-motor impairments in PD