SoRTS: Learned Tree Search for Long Horizon Social Robot Navigation

The fast-growing demand for fully autonomous robots in shared spaces calls for the development of trustworthy agents that can safely and seamlessly navigate in crowded environments. Recent models for motion prediction show promise in characterizing social interactions in such environments. Still, adapting them for navigation is challenging as they often suffer from generalization failures. Prompted by this, we propose Social Robot Tree Search (SoRTS), an algorithm for safe robot navigation in social domains. SoRTS aims to augment existing socially aware motion prediction models for long-horizon navigation using Monte Carlo Tree Search. We use social navigation in general aviation as a case study to evaluate our approach and further the research in full-scale aerial autonomy. In doing so, we introduce XPlaneROS, a high-fidelity aerial simulator that enables human-robot interaction. We use XPlaneROS to conduct a first-of-its-kind user study where 26 FAA-certified pilots interact with a human pilot, our algorithm, and its ablation. Our results, supported by statistical evidence, show that SoRTS exhibits a comparable performance to competent human pilots, significantly outperforming its ablation. Finally, we complement these results with a broad set of self-play experiments to showcase our algorithm's performance in scenarios with increasing complexity.Comment: arXiv admin note: substantial text overlap with arXiv:2304.0142

深層強化学習を用いた動的環境下における事前知識不要なロボットナビゲーションに関する研究

Tohoku University博士（工学）thesi

Novelty-assisted Interactive Evolution Of Control Behaviors

The field of evolutionary computation is inspired by the achievements of natural evolution, in which there is no final objective. Yet the pursuit of objectives is ubiquitous in simulated evolution because evolutionary algorithms that can consistently achieve established benchmarks are lauded as successful, thus reinforcing this paradigm. A significant problem is that such objective approaches assume that intermediate stepping stones will increasingly resemble the final objective when in fact they often do not. The consequence is that while solutions may exist, searching for such objectives may not discover them. This problem with objectives is demonstrated through an experiment in this dissertation that compares how images discovered serendipitously during interactive evolution in an online system called Picbreeder cannot be rediscovered when they become the final objective of the very same algorithm that originally evolved them. This negative result demonstrates that pursuing an objective limits evolution by selecting offspring only based on the final objective. Furthermore, even when high fitness is achieved, the experimental results suggest that the resulting solutions are typically brittle, piecewise representations that only perform well by exploiting idiosyncratic features in the target. In response to this problem, the dissertation next highlights the importance of leveraging human insight during search as an alternative to articulating explicit objectives. In particular, a new approach called novelty-assisted interactive evolutionary computation (NA-IEC) combines human intuition with a method called novelty search for the first time to facilitate the serendipitous discovery of agent behaviors. iii In this approach, the human user directs evolution by selecting what is interesting from the on-screen population of behaviors. However, unlike in typical IEC, the user can then request that the next generation be filled with novel descendants, as opposed to only the direct descendants of typical IEC. The result of such an approach, unconstrained by a priori objectives, is that it traverses key stepping stones that ultimately accumulate meaningful domain knowledge. To establishes this new evolutionary approach based on the serendipitous discovery of key stepping stones during evolution, this dissertation consists of four key contributions: (1) The first contribution establishes the deleterious effects of a priori objectives on evolution. The second (2) introduces the NA-IEC approach as an alternative to traditional objective-based approaches. The third (3) is a proof-of-concept that demonstrates how combining human insight with novelty search finds solutions significantly faster and at lower genomic complexities than fully-automated processes, including pure novelty search, suggesting an important role for human users in the search for solutions. Finally, (4) the NA-IEC approach is applied in a challenge domain wherein leveraging human intuition and domain knowledge accelerates the evolution of solutions for the nontrivial octopus-arm control task. The culmination of these contributions demonstrates the importance of incorporating human insights into simulated evolution as a means to discovering better solutions more rapidly than traditional approaches

A two-stage design framework for optimal spatial packaging of interconnected fluid-thermal systems

Optimal spatial packaging of interconnected subsystems and components with coupled physical (thermal, hydraulic, or electromagnetic) interactions, or SPI2, plays a vital role in the functionality, operation, energy usage, and life cycle of practically all engineered systems, from chips to ships to aircraft. However, the highly nonlinear spatial packaging problem, governed by coupled physical phenomena transferring energy through highly complex and diverse geometric interconnects, has largely resisted automation and quickly exceeds human cognitive abilities at moderate complexity levels. The current state-of-the-art in defining an arrangement of these functionally heterogeneous artifacts still largely relies on human intuition and manual spatial placement, limiting system sophistication and extending design timelines. Spatial packaging involves packing and routing, which are separately challenging NP-hard problems. Therefore, solving the coupled packing and routing (PR) problem simultaneously will require disruptive methods to better address pressing related challenges, such as system volume reduction, interconnect length reduction, ensuring non-intersection, and physics considerations. This dissertation presents a novel automated two-stage sequential design framework to perform simultaneous physics-based packing and routing (PR) optimization of fluid-thermal systems. In Stage 1, unique spatially-feasible topologies (i.e., how interconnects and components pass around each other) are enumerated for given fluid-thermal system architecture. It is important to guarantee a feasible initial graph as lumped-parameter physics analyses may fail if components and/or routing paths intersect. Stage 2 begins with a spatially-feasible layout, and optimizes physics-based system performance with respect to component locations, interconnect paths, and other continuous component or system variables (such as sizing or control). A bar-based design representation enables the use of a differentiable geometric projection method (GPM), where gradient-based optimization is used with finite element analysis. In addition to geometric considerations, this method supports optimization based on system behavior by including physics-based (temperature, fluid pressure, head loss, etc.) objectives and constraints. In other words, stage 1 of the framework supports systematic navigation through discrete topology options utilized as initial designs that are then individually optimized in stage 2 using a continuous gradient-based topology optimization method. Thus, both the discrete and continuous design decisions are made sequentially in this framework. The design framework is successfully demonstrated using different 2D case studies such as a hybrid unmanned aerial vehicle (UAV) system, automotive fuel cell (AFC) packaging system, and other complex multi-loop systems. The 3D problem is significantly more challenging than the 2D problem due to vastly more expansive design space and potential features. A review of state-of-the-art methods, challenges, existing gaps, and opportunities are presented for the optimal design of the 3D PR problem. Stage 1 of the framework has been investigated thoroughly for 3D systems in this dissertation. An efficient design framework to represent and enumerate 3D system spatial topologies for a given system architecture is demonstrated using braid and spatial graph theories. After enumeration, the unique spatial topologies are identified by calculating the Yamada polynomials of all the generated spatial graphs. Spatial topologies that have the same Yamada polynomial are categorized together into equivalent classes. Finally, CAD-based 3D system models are generated from these unique topology classes. These 3D models can be utilized in stage 2 as initial designs for 3D multi-physics PR optimization. Current limitations and significantly impactful future directions for this work are outlined. In summary, this novel design automation framework integrates several elements together as a foundation toward a more comprehensive solution of 3D real-world packing and routing problems with both geometric and physics considerations

Evolutionary Computation

This book presents several recent advances on Evolutionary Computation, specially evolution-based optimization methods and hybrid algorithms for several applications, from optimization and learning to pattern recognition and bioinformatics. This book also presents new algorithms based on several analogies and metafores, where one of them is based on philosophy, specifically on the philosophy of praxis and dialectics. In this book it is also presented interesting applications on bioinformatics, specially the use of particle swarms to discover gene expression patterns in DNA microarrays. Therefore, this book features representative work on the field of evolutionary computation and applied sciences. The intended audience is graduate, undergraduate, researchers, and anyone who wishes to become familiar with the latest research work on this field