216 research outputs found

    Feasible, Robust and Reliable Automation and Control for Autonomous Systems

    Get PDF
    The Special Issue book focuses on highlighting current research and developments in the automation and control field for autonomous systems as well as showcasing state-of-the-art control strategy approaches for autonomous platforms. The book is co-edited by distinguished international control system experts currently based in Sweden, the United States of America, and the United Kingdom, with contributions from reputable researchers from China, Austria, France, the United States of America, Poland, and Hungary, among many others. The editors believe the ten articles published within this Special Issue will be highly appealing to control-systems-related researchers in applications typified in the fields of ground, aerial, maritime vehicles, and robotics as well as industrial audiences

    NeBula: Team CoSTAR's robotic autonomy solution that won phase II of DARPA Subterranean Challenge

    Get PDF
    This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved second and first place, respectively. We also discuss CoSTAR¿s demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping, (ii) a multi-modal positioning system, (iii) traversability analysis and local planning, (iv) global motion planning and exploration behavior, (v) risk-aware mission planning, (vi) networking and decentralized reasoning, and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g., wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.The work is partially supported by the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration (80NM0018D0004), and Defense Advanced Research Projects Agency (DARPA)

    Modeling Robotic Systems with Activity Flow Graphs

    Get PDF
    Autonomous robotic systems are becoming increasingly common in our society, with research efforts towards automated goods transportation, service robots and autonomous cars. These complex systems have to solve many different problems in order to function robustly. Two especially important areas of interest are perception and high level control. Intelligent systems have to perceive their surroundings in order to facilitate autonomy. With an understanding of the environment, they then can make their own decisions based on high level control policies defined by the developers. Robotic systems differ drastically in their sensory capabilities, their computational power, and their designated tasks. When developing algorithms, however, we need to have a common modeling framework that enables us to generalize and re-use existing solutions. A modular approach, which is coherent across different platforms, also allows faster prototyping of new systems. In this dissertation we develop a modeling framework based on data flow that achieves this goal. We first extend the existing Synchronous Data Flow (SDF) model and combine it with reactive programming ideas and finite-state machines. Together, these existing frameworks enable us to model many aspects of complex robotic systems. We apply this model to a robot in a warehouse scenario to demonstrate the viability of the approach. Using three disjoint formalisms to model a robotic system has many downsides. In a first unification step we merge SDF and reactive programming into Hybrid Flow Graphs (HFGs), where we explicitly model synchronous and asynchronous data flow. We then apply the HFG model to the perception system of an autonomous transportation robot. In a last step, we eliminate the need for separate finite-state machines by introducing the concept of activity into the data flow. We therefore unify the different aspects into a single and coherent framework which we call Activity Flow Graphs (AFGs). The flow of activity enables us to model high level state directly in the data flow graph. The result is a single computation graph that can express both perception and high level control aspects of any robotic system. We then demonstrate this with multiple high level robotic system models. Finally, we make use of the uniform AFG model to provide a single graphical user interface that allows a developer to rapidly prototype complete robotic systems. Since all aspects of a robot can be implemented using the same theoretical framework, there is no need to switch between different paradigms. The user interface is designed to give immediate feedback, which speeds up prototyping, testing and evaluation, as well as debugging when working with real robots.Autonome Roboter werden zunehmend zu einem wichtigen Bestandteil unserer Gesellschaft, in Bereichen wie dem automatisierten Gütertransport, in der Servicerobotik und bei autonomen Automobilen. Diese komplexen Systeme müssen viele Problem lösen, um robust zu funktionieren. Zwei sehr wichtige Anwendungsfelder sind die Umgebungswahrnehmung und die Ablaufplanung. Intelligente Systeme müssen ihre Umgebung wahrnehmen, um autonom agieren zu können. Mit einem Verständnis der Umwelt können sie Entscheidungen treffen, welche auf abstrakten Richtlinien der Entwickler basieren. Verschiedene Roboter weichen stark in ihren sensorischen Fähigkeiten, in ihrer Rechenleistung und in ihren zu lösenden Aufgaben voneinander ab. Bei der Entwicklung von Algorithmen wird jedoch ein einheitliches Modellierungssystem benötigt, welches die Wiederverwendung von existierenden Lösungen erlaubt. Ein modulares System, welches über mehrere Plattformen hinweg genutzt werden kann, ermöglicht eine schnellere Entwicklung von neuen Systemen. In dieser Dissertation wird ein auf Datenfluss basierendes Modell entwickelt, welches diese Anforderungen erfüllt. Zuerst wird das existierende Synchronous Data Flow (SDF) Modell erweitert und mit Elementen von reaktiver Programmierung und endlichen Zustandsautomaten kombiniert. Zusammen können so viele Aspekte von Robotern modelliert werden. Das Modell wird auf einen Roboter in einem Warenhausszenario angewandt, um den Ansatz zu validieren. Drei verschiedene Formalismen zur Modellierung von Robotern zu verwenden hat viele Nachteile. In einem ersten Vereinigungsschritt werden SDF und reaktive Programmierung zu hybriden Flussgraphen (HFG) kombiniert, bei denen synchroner und asynchroner Datenfluss explizit modelliert werden. Dann wird das HFG-Modell auf die Wahrnehmungsmodule eines autonomen Transportsystems angewandt. Anschließend wird der Bedarf eines Zustandsautomaten beseitigt, indem das Konzept der Aktivität in den Datenfluss eingeführt wird. Dadurch werden alle Aspekte in einem einzigen, schlüssigen System vereinigt, welches Aktivitätsflussgraph (AFG) genannt wird. Der Aktivitätsfluss ermöglicht es, den höheren Systemzustand direkt im Datenflussgraphen zu modellieren. Als Ergebnis erhalten wir einen einzigen Berechnungsgraphen, der sowohl zur Beschreibung der Umgebungswahrnehmung als auch zur Kontrolle der höheren Abläufe benutzt werden kann. Dies wird anhand mehrerer Robotersysteme demonstriert. Eine graphische Benutzerschnittstelle wird bereitgestellt, welche von dem einheitlichen Modell Gebrauch macht, um ein schnelles Prototyping von Robotern zu ermöglichen. Da alle Aspekte mit demselben System modelliert werden, muss nicht zwischen verschiedenen Paradigmen gewechselt werden. Die Nutzerschnittstelle erleichtert Entwicklung, Test und Validierung von Algorithmen sowie das Auffinden von Fehlern bei echten Robotern

    NeBula: TEAM CoSTAR’s robotic autonomy solution that won phase II of DARPA subterranean challenge

    Get PDF
    This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved second and first place, respectively. We also discuss CoSTAR’s demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping, (ii) a multi-modal positioning system, (iii) traversability analysis and local planning, (iv) global motion planning and exploration behavior, (v) risk-aware mission planning, (vi) networking and decentralized reasoning, and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g., wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.Peer ReviewedAgha, A., Otsu, K., Morrell, B., Fan, D. D., Thakker, R., Santamaria-Navarro, A., Kim, S.-K., Bouman, A., Lei, X., Edlund, J., Ginting, M. F., Ebadi, K., Anderson, M., Pailevanian, T., Terry, E., Wolf, M., Tagliabue, A., Vaquero, T. S., Palieri, M., Tepsuporn, S., Chang, Y., Kalantari, A., Chavez, F., Lopez, B., Funabiki, N., Miles, G., Touma, T., Buscicchio, A., Tordesillas, J., Alatur, N., Nash, J., Walsh, W., Jung, S., Lee, H., Kanellakis, C., Mayo, J., Harper, S., Kaufmann, M., Dixit, A., Correa, G. J., Lee, C., Gao, J., Merewether, G., Maldonado-Contreras, J., Salhotra, G., Da Silva, M. S., Ramtoula, B., Fakoorian, S., Hatteland, A., Kim, T., Bartlett, T., Stephens, A., Kim, L., Bergh, C., Heiden, E., Lew, T., Cauligi, A., Heywood, T., Kramer, A., Leopold, H. A., Melikyan, H., Choi, H. C., Daftry, S., Toupet, O., Wee, I., Thakur, A., Feras, M., Beltrame, G., Nikolakopoulos, G., Shim, D., Carlone, L., & Burdick, JPostprint (published version

    Design and validation of decision and control systems in automated driving

    Get PDF
    xxvi, 148 p.En la última década ha surgido una tendencia creciente hacia la automatización de los vehículos, generando un cambio significativo en la movilidad, que afectará profundamente el modo de vida de las personas, la logística de mercancías y otros sectores dependientes del transporte. En el desarrollo de la conducción automatizada en entornos estructurados, la seguridad y el confort, como parte de las nuevas funcionalidades de la conducción, aún no se describen de forma estandarizada. Dado que los métodos de prueba utilizan cada vez más las técnicas de simulación, los desarrollos existentes deben adaptarse a este proceso. Por ejemplo, dado que las tecnologías de seguimiento de trayectorias son habilitadores esenciales, se deben aplicar verificaciones exhaustivas en aplicaciones relacionadas como el control de movimiento del vehículo y la estimación de parámetros. Además, las tecnologías en el vehículo deben ser lo suficientemente robustas para cumplir con los requisitos de seguridad, mejorando la redundancia y respaldar una operación a prueba de fallos. Considerando las premisas mencionadas, esta Tesis Doctoral tiene como objetivo el diseño y la implementación de un marco para lograr Sistemas de Conducción Automatizados (ADS) considerando aspectos cruciales, como la ejecución en tiempo real, la robustez, el rango operativo y el ajuste sencillo de parámetros. Para desarrollar las aportaciones relacionadas con este trabajo, se lleva a cabo un estudio del estado del arte actual en tecnologías de alta automatización de conducción. Luego, se propone un método de dos pasos que aborda la validación de ambos modelos de vehículos de simulación y ADS. Se introducen nuevas formulaciones predictivas basadas en modelos para mejorar la seguridad y el confort en el proceso de seguimiento de trayectorias. Por último, se evalúan escenarios de mal funcionamiento para mejorar la seguridad en entornos urbanos, proponiendo una estrategia alternativa de estimación de posicionamiento para minimizar las condiciones de riesgo

    Modeling and Improving Teleoperation Performance of Semi-Autonomous Wheeled Robots

    Full text link
    Robotics and unmanned vehicles have allowed us to interact with environments in ways that were impossible decades ago. As perception, decision making, and control improve, it becomes possible to automate more parts of robot operation. However, humans will remain a critical part of robot control based on preference, ethical, and technical reasons. An ongoing question will be when and how to pair humans and automation to create semi-autonomous systems. The answer to this question depends on numerous factors such as the robot's task, platform, environment conditions, and the user. The work in this dissertation focuses on modeling the impact of these factors on performance and developing improved semi-autonomous control schemes, so that robot systems can be better designed. Experiments and analysis focus on wheeled robots, however the approach taken and many of the trends could be applied to a variety of platforms. Wheeled robots are often teleoperated over wireless communication networks. While this arrangement may be convenient, it introduces many challenges including time-varying delays and poor perception of the robot's environment that can lead to the robot colliding with objects or rolling over. With regards to semi-autonomous control, rollover prevention and obstacle avoidance behaviors are considered. In this area, two contributions are presented. The first is a rollover prevention method that uses an existing manipulator arm on-board a wheeled robot. The second is a method of approximating convex obstacle free regions for use in optimal control path planning problems. Teleoperation conditions, including communication delays, automation, and environment layout, are considered in modeling robot operation performance. From these considerations stem three contributions. The first is a method of relating driving performance among different communication delay distributions. The second parameterizes how driving through different arrangements of obstacles relates to performance. Lastly, based on user studies, teleoperation performance is related to different conditions of communication delay, automation level, and environment arrangement. The contributions of this dissertation will assist roboticists to implement better automation and understand when to use automation.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/136951/1/jgstorms_1.pd

    Locomotion system for ground mobile robots in uneven and unstructured environments

    Get PDF
    One of the technology domains with the greatest growth rates nowadays is service robots. The extensive use of ground mobile robots in environments that are unstructured or structured for humans is a promising challenge for the coming years, even though Automated Guided Vehicles (AGV) moving on flat and compact grounds are already commercially available and widely utilized to move components and products inside indoor industrial buildings. Agriculture, planetary exploration, military operations, demining, intervention in case of terrorist attacks, surveillance, and reconnaissance in hazardous conditions are important application domains. Due to the fact that it integrates the disciplines of locomotion, vision, cognition, and navigation, the design of a ground mobile robot is extremely interdisciplinary. In terms of mechanics, ground mobile robots, with the exception of those designed for particular surroundings and surfaces (such as slithering or sticky robots), can move on wheels (W), legs (L), tracks (T), or hybrids of these concepts (LW, LT, WT, LWT). In terms of maximum speed, obstacle crossing ability, step/stair climbing ability, slope climbing ability, walking capability on soft terrain, walking capability on uneven terrain, energy efficiency, mechanical complexity, control complexity, and technology readiness, a systematic comparison of these locomotion systems is provided in [1]. Based on the above-mentioned classification, in this thesis, we first introduce a small-scale hybrid locomotion robot for surveillance and inspection, WheTLHLoc, with two tracks, two revolving legs, two active wheels, and two passive omni wheels. The robot can move in several different ways, including using wheels on the flat, compact ground,[1] tracks on soft, yielding terrain, and a combination of tracks, legs, and wheels to navigate obstacles. In particular, static stability and non-slipping characteristics are considered while analyzing the process of climbing steps and stairs. The experimental test on the first prototype has proven the planned climbing maneuver’s efficacy and the WheTLHLoc robot's operational flexibility. Later we present another development of WheTLHLoc and introduce WheTLHLoc 2.0 with newly designed legs, enabling the robot to deal with bigger obstacles. Subsequently, a single-track bio-inspired ground mobile robot's conceptual and embodiment designs are presented. This robot is called SnakeTrack. It is designed for surveillance and inspection activities in unstructured environments with constrained areas. The vertebral column has two end modules and a variable number of vertebrae linked by compliant joints, and the surrounding track is its essential component. Four motors drive the robot: two control the track motion and two regulate the lateral flexion of the vertebral column for steering. The compliant joints enable limited passive torsion and retroflection of the vertebral column, which the robot can use to adapt to uneven terrain and increase traction. Eventually, the new version of SnakeTrack, called 'Porcospino', is introduced with the aim of allowing the robot to move in a wider variety of terrains. The novelty of this thesis lies in the development and presentation of three novel designs of small-scale mobile robots for surveillance and inspection in unstructured environments, and they employ hybrid locomotion systems that allow them to traverse a variety of terrains, including soft, yielding terrain and high obstacles. This thesis contributes to the field of mobile robotics by introducing new design concepts for hybrid locomotion systems that enable robots to navigate challenging environments. The robots presented in this thesis employ modular designs that allow their lengths to be adapted to suit specific tasks, and they are capable of restoring their correct position after falling over, making them highly adaptable and versatile. Furthermore, this thesis presents a detailed analysis of the robots' capabilities, including their step-climbing and motion planning abilities. In this thesis we also discuss possible refinements for the robots' designs to improve their performance and reliability. Overall, this thesis's contributions lie in the design and development of innovative mobile robots that address the challenges of surveillance and inspection in unstructured environments, and the analysis and evaluation of these robots' capabilities. The research presented in this thesis provides a foundation for further work in this field, and it may be of interest to researchers and practitioners in the areas of robotics, automation, and inspection. As a general note, the first robot, WheTLHLoc, is a hybrid locomotion robot capable of combining tracked locomotion on soft terrains, wheeled locomotion on flat and compact grounds, and high obstacle crossing capability. The second robot, SnakeTrack, is a small-size mono-track robot with a modular structure composed of a vertebral column and a single peripherical track revolving around it. The third robot, Porcospino, is an evolution of SnakeTrack and includes flexible spines on the track modules for improved traction on uneven but firm terrains, and refinements of the shape of the track guidance system. This thesis provides detailed descriptions of the design and prototyping of these robots and presents analytical and experimental results to verify their capabilities

    Design and validation of decision and control systems in automated driving

    Get PDF
    xxvi, 148 p.En la última década ha surgido una tendencia creciente hacia la automatización de los vehículos, generando un cambio significativo en la movilidad, que afectará profundamente el modo de vida de las personas, la logística de mercancías y otros sectores dependientes del transporte. En el desarrollo de la conducción automatizada en entornos estructurados, la seguridad y el confort, como parte de las nuevas funcionalidades de la conducción, aún no se describen de forma estandarizada. Dado que los métodos de prueba utilizan cada vez más las técnicas de simulación, los desarrollos existentes deben adaptarse a este proceso. Por ejemplo, dado que las tecnologías de seguimiento de trayectorias son habilitadores esenciales, se deben aplicar verificaciones exhaustivas en aplicaciones relacionadas como el control de movimiento del vehículo y la estimación de parámetros. Además, las tecnologías en el vehículo deben ser lo suficientemente robustas para cumplir con los requisitos de seguridad, mejorando la redundancia y respaldar una operación a prueba de fallos. Considerando las premisas mencionadas, esta Tesis Doctoral tiene como objetivo el diseño y la implementación de un marco para lograr Sistemas de Conducción Automatizados (ADS) considerando aspectos cruciales, como la ejecución en tiempo real, la robustez, el rango operativo y el ajuste sencillo de parámetros. Para desarrollar las aportaciones relacionadas con este trabajo, se lleva a cabo un estudio del estado del arte actual en tecnologías de alta automatización de conducción. Luego, se propone un método de dos pasos que aborda la validación de ambos modelos de vehículos de simulación y ADS. Se introducen nuevas formulaciones predictivas basadas en modelos para mejorar la seguridad y el confort en el proceso de seguimiento de trayectorias. Por último, se evalúan escenarios de mal funcionamiento para mejorar la seguridad en entornos urbanos, proponiendo una estrategia alternativa de estimación de posicionamiento para minimizar las condiciones de riesgo
    corecore