A hierarchic approach for path planning in virtual reality.

This work considers path-planning processes for manipu- lation tasks such as assembly, maintenance or disassem- bly in a virtual reality (VR) context. The approach con- sists in providing a collaborative system associating a user immersed in VR and an automatic path planning process. It is based on semantic, topological and geometric representations of the environment and the planning process is split in two phases: coarse and fine planning. The automatic planner suggests a path to the user and guides him trough a haptic device. The user can escape from the proposed solution if he wants to explore a possible better way. In this case, the interactive system detects the users intention and computes in real-time a new path starting from the users guess. Experiments illustrate the different aspects of the approach: multi-representation of the en- vironment, path planning process, users intent prediction and control sharing

A robot swarm assisting a human fire-fighter

Emergencies in industrial warehouses are a major concern for fire-fighters. The large dimensions, together with the development of dense smoke that drastically reduces visibility, represent major challenges. The GUARDIANS robot swarm is designed to assist fire-fighters in searching a large warehouse. In this paper we discuss the technology developed for a swarm of robots assisting fire-fighters. We explain the swarming algorithms that provide the functionality by which the robots react to and follow humans while no communication is required. Next we discuss the wireless communication system, which is a so-called mobile ad-hoc network. The communication network provides also the means to locate the robots and humans. Thus, the robot swarm is able to provide guidance information to the humans. Together with the fire-fighters we explored how the robot swarm should feed information back to the human fire-fighter. We have designed and experimented with interfaces for presenting swarm-based information to human beings

Overcoming barriers and increasing independence: service robots for elderly and disabled people

This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable

A multi-hierarchical symbolic model of the environment for improving mobile robot operation

El trabajo desarrollado en esta tesis se centra en el estudio y aplicación de estructuras multijerárquicas, que representan el entorno de un robot móvil, con el objetivo de mejorar su capacidad de realizar tareas complejas en escenarios humanos. Un robot móvil debe poseer una representación simbólica de su entorno para poder llevar a cabo operaciones deliberativas, por ejemplo planificar tareas. Sin embargo a la hora de representar simbólicamente entornos reales, dado su complejidad, es imprescindible contar con mecanismos capaces de organizar y facilitar el acceso a la ingente cantidad de información que de ellos se deriva. Aparte del inconveniente de tratar con grandes cantidades de información, existen otros problemas subyacentes de la representación simbólica de entornos reales, los cuales aún no han sido resueltos por completo en la literatura científica. Uno de ellos consiste en el mantenimiento de la representación simbólica optimizada con respecto a las tareas que el robot debe realizar, y coherente con el entorno en el que se desenvuelve. Otro problema, relacionado con el anterior es la creación/modificación de la información simbólica a partir de información meramente sensorial (este problema es conocido como symbol-grounding). Esta tesis estudia estos problemas y aporta soluciones mediante estructuras multijerárquicas. Estas estructuras simbólicas, basadas en el concepto de abstracción, imitan la forma en la que los humanos organizamos la información espacial y permite a un robot móvil mejorar sus habilidades en entornos complejos. Las principales contribuciones de este trabajo son: - Se ha formalizado matemáticamente un modelo simbólico basado en múltiples abstracciones (multijerarquías) mediante Teoría de Categorías. Se ha desarrollado un planificador de tareas eficiente que es capaz de aprovechar la organización jerárquica del modelo simbólico del entorno. Nuestro método ha sido validado matemáticamente y se han implementado y comparado dos variantes del mismo (HPWA-1 y HPWA-2). - Una instancia particular del modelo multijerárquico ha sido estudiada e implementada para organizar información simbólica con el objetivo de mejorar simultáneamente diferentes tareas a realizar por un robot móvil. - Se ha desarrollado un procedimiento que (1) construye un modelo jerárquico del entorno de un robot, (2) lo mantiene coherente y actualizado y (3) lo optimiza con el fin de mejorar las tareas realizadas por un robot móvil. - Finalmente, se ha implementado una arquitectura robótica que engloba todas las cuestiones anteriormente citadas. Se han realizado pruebas reales con una silla de ruedas robotizada que ponen de manifiesto la utilidad del uso de estructuras multijerárquicas en robótica móvil

Optimal Scene Graph Planning with Large Language Model Guidance

Recent advances in metric, semantic, and topological mapping have equipped autonomous robots with semantic concept grounding capabilities to interpret natural language tasks. This work aims to leverage these new capabilities with an efficient task planning algorithm for hierarchical metric-semantic models. We consider a scene graph representation of the environment and utilize a large language model (LLM) to convert a natural language task into a linear temporal logic (LTL) automaton. Our main contribution is to enable optimal hierarchical LTL planning with LLM guidance over scene graphs. To achieve efficiency, we construct a hierarchical planning domain that captures the attributes and connectivity of the scene graph and the task automaton, and provide semantic guidance via an LLM heuristic function. To guarantee optimality, we design an LTL heuristic function that is provably consistent and supplements the potentially inadmissible LLM guidance in multi-heuristic planning. We demonstrate efficient planning of complex natural language tasks in scene graphs of virtualized real environments