14,076 research outputs found
Contingent task and motion planning under uncertainty for human–robot interactions
Manipulation planning under incomplete information is a highly challenging task for mobile manipulators. Uncertainty can be resolved by robot perception modules or using human knowledge in the execution process. Human operators can also collaborate with robots for the execution of some difficult actions or as helpers in sharing the task knowledge. In this scope, a contingent-based task and motion planning is proposed taking into account robot uncertainty and human–robot interactions, resulting a tree-shaped set of geometrically feasible plans. Different sorts of geometric reasoning processes are embedded inside the planner to cope with task constraints like detecting occluding objects when a robot needs to grasp an object. The proposal has been evaluated with different challenging scenarios in simulation and a real environment.Postprint (published version
Multi-Arm Bin-Picking in Real-Time: A Combined Task and Motion Planning Approach
Automated bin-picking is a prerequisite for fully automated manufacturing and
warehouses. To successfully pick an item from an unstructured bin the robot
needs to first detect possible grasps for the objects, decide on the object to
remove and consequently plan and execute a feasible trajectory to retrieve the
chosen object. Over the last years significant progress has been made towards
solving these problems. However, when multiple robot arms are cooperating the
decision and planning problems become exponentially harder. We propose an
integrated multi-arm bin-picking pipeline (IMAPIP), and demonstrate that it is
able to reliably pick objects from a bin in real-time using multiple robot
arms. IMAPIP solves the multi-arm bin-picking task first at high-level using a
geometry-aware policy integrated in a combined task and motion planning
framework. We then plan motions consistent with this policy using the BIT*
algorithm on the motion planning level. We show that this integrated solution
enables robot arm cooperation. In our experiments, we show the proposed
geometry-aware policy outperforms a baseline by increasing bin-picking time by
28\% using two robot arms. The policy is robust to changes in the position of
the bin and number of objects. We also show that IMAPIP to successfully scale
up to four robot arms working in close proximity.Comment: 8 page
Automated sequence and motion planning for robotic spatial extrusion of 3D trusses
While robotic spatial extrusion has demonstrated a new and efficient means to
fabricate 3D truss structures in architectural scale, a major challenge remains
in automatically planning extrusion sequence and robotic motion for trusses
with unconstrained topologies. This paper presents the first attempt in the
field to rigorously formulate the extrusion sequence and motion planning (SAMP)
problem, using a CSP encoding. Furthermore, this research proposes a new
hierarchical planning framework to solve the extrusion SAMP problems that
usually have a long planning horizon and 3D configuration complexity. By
decoupling sequence and motion planning, the planning framework is able to
efficiently solve the extrusion sequence, end-effector poses, joint
configurations, and transition trajectories for spatial trusses with
nonstandard topologies. This paper also presents the first detailed computation
data to reveal the runtime bottleneck on solving SAMP problems, which provides
insight and comparing baseline for future algorithmic development. Together
with the algorithmic results, this paper also presents an open-source and
modularized software implementation called Choreo that is machine-agnostic. To
demonstrate the power of this algorithmic framework, three case studies,
including real fabrication and simulation results, are presented.Comment: 24 pages, 16 figure
NASA/NBS (National Aeronautics and Space Administration/National Bureau of Standards) standard reference model for telerobot control system architecture (NASREM)
The document describes the NASA Standard Reference Model (NASREM) Architecture for the Space Station Telerobot Control System. It defines the functional requirements and high level specifications of the control system for the NASA space Station document for the functional specification, and a guideline for the development of the control system architecture, of the 10C Flight Telerobot Servicer. The NASREM telerobot control system architecture defines a set of standard modules and interfaces which facilitates software design, development, validation, and test, and make possible the integration of telerobotics software from a wide variety of sources. Standard interfaces also provide the software hooks necessary to incrementally upgrade future Flight Telerobot Systems as new capabilities develop in computer science, robotics, and autonomous system control
A Constraint Programming Approach to Simultaneous Task Allocation and Motion Scheduling for Industrial Dual-Arm Manipulation Tasks
Modern lightweight dual-arm robots bring the physical capabilities to quickly
take over tasks at typical industrial workplaces designed for workers. In times
of mass-customization, low setup times including the instructing/specifying of
new tasks are crucial to stay competitive. We propose a constraint programming
approach to simultaneous task allocation and motion scheduling for such
industrial manipulation and assembly tasks. The proposed approach covers
dual-arm and even multi-arm robots as well as connected machines. The key
concept are Ordered Visiting Constraints, a descriptive and extensible model to
specify such tasks with their spatiotemporal requirements and task-specific
combinatorial or ordering constraints. Our solver integrates such task models
and robot motion models into constraint optimization problems and solves them
efficiently using various heuristics to produce makespan-optimized robot
programs. The proposed task model is robot independent and thus can easily be
deployed to other robotic platforms. Flexibility and portability of our
proposed model is validated through several experiments on different simulated
robot platforms. We benchmarked our search strategy against a general-purpose
heuristic. For large manipulation tasks with 200 objects, our solver
implemented using Google's Operations Research tools and ROS requires less than
a minute to compute usable plans.Comment: 8 pages, 8 figures, submitted to ICRA'1
Autonomy Infused Teleoperation with Application to BCI Manipulation
Robot teleoperation systems face a common set of challenges including
latency, low-dimensional user commands, and asymmetric control inputs. User
control with Brain-Computer Interfaces (BCIs) exacerbates these problems
through especially noisy and erratic low-dimensional motion commands due to the
difficulty in decoding neural activity. We introduce a general framework to
address these challenges through a combination of computer vision, user intent
inference, and arbitration between the human input and autonomous control
schemes. Adjustable levels of assistance allow the system to balance the
operator's capabilities and feelings of comfort and control while compensating
for a task's difficulty. We present experimental results demonstrating
significant performance improvement using the shared-control assistance
framework on adapted rehabilitation benchmarks with two subjects implanted with
intracortical brain-computer interfaces controlling a seven degree-of-freedom
robotic manipulator as a prosthetic. Our results further indicate that shared
assistance mitigates perceived user difficulty and even enables successful
performance on previously infeasible tasks. We showcase the extensibility of
our architecture with applications to quality-of-life tasks such as opening a
door, pouring liquids from containers, and manipulation with novel objects in
densely cluttered environments
Architecture for planning and execution of missions with fleets of unmanned vehicles
Esta tesis presenta contribuciones en el campo de la planificación automática y la
programación de tareas, la rama de la inteligencia artificial que se ocupa de la
realización de estrategias o secuencias de acciones tÃpicamente para su ejecución por
parte de vehÃculos no tripulados, robots autónomos y/o agentes inteligentes. Cuando se
intenta alcanzar un objetivo determinado, la cooperación puede ser un aspecto clave. La
complejidad de algunas tareas requiere la cooperación entre varios agentes. Mas aún,
incluso si una tarea es lo suficientemente simple para ser llevada a cabo por un único
agente, puede usarse la cooperación para reducir el coste total de la misma. Para realizar
tareas complejas que requieren interacción fÃsica con el mundo real, los vehÃculos no
tripulados pueden ser usados como agentes. En los últimos años se han creado y utilizado
una gran diversidad de plataformas no tripuladas, principalmente vehÃculos que pueden
ser dirigidos sin un humano a bordo, tanto en misiones civiles como militares.
En esta tesis se aborda la aplicación de planificación simbólica de redes jerárquicas
de tareas (HTN planning, por sus siglas en inglés) en la resolución de problemas de
enrutamiento de vehÃculos (VRP, por sus siglas en inglés) [18], en dominios que implican
múltiples vehÃculos no tripulados de capacidades heterogéneas que deben cooperar para
alcanzar una serie de objetivos especÃficos.
La planificación con redes jerárquicas de tareas describe dominios utilizando una
descripción que descompone conjuntos de tareas en subconjuntos más pequeños de
subtareas gradualmente, hasta obtener tareas del más bajo nivel que no pueden ser
descompuestas y se consideran directamente ejecutables. Esta jerarquÃa es similar al modo
en que los humanos razonan sobre los problemas, descomponiéndolos en subproblemas
según el contexto, y por lo tanto suelen ser fáciles de comprender y diseñar.
Los problemas de enrutamiento de vehÃculos son una generalización del problema del
viajante (TSP, por sus siglas en inglés). La resolución del problema del viajante consiste
en encontrar la ruta más corta posible que permite visitar una lista de ciudades, partiendo
y acabando en la misma ciudad. Su generalización, el problema de enrutamiento de
vehÃculos, consiste en encontrar el conjunto de rutas de longitud mÃnima que permite
cubrir todas las ciudades con un determinado número de vehÃculos. Ambos problemas
cuentan con una fuerte componente combinatoria para su resolución, especialmente en el caso del VRP, por lo que su presencia en dominios que van a ser tratados con un planificador
HTN clásico supone un gran reto.
Para la aplicación de un planificador HTN en la resolución de problemas de enrutamiento
de vehÃculos desarrollamos dos métodos. En el primero de ellos presentamos un sistema
de optimización de soluciones basado en puntuaciones, que nos permite una nueva forma
de conexión entre un software especializado en la resolución del VRP con el planificador
HTN. Llamamos a este modo de conexión el método desacoplado, puesto que resolvemos
la componente combinatoria del problema de enrutamiento de vehÃculos mediante un
solucionador especÃfico que se comunica con el planificador HTN y le suministra la
información necesaria para continuar con la descomposición de tareas. El segundo método
consiste en mejorar el planificador HTN utilizado para que sea capaz de resolver el
problema de enrutamiento de vehÃculos de la mejor forma posible sin tener que depender
de módulos de software externos. Llamamos a este modo el método acoplado. Con
este motivo hemos desarrollado un nuevo planificador HTN que utiliza un algoritmo de
búsqueda distinto del que se utiliza normalmente en planificadores de este tipo.
Esta tesis presenta nuevas contribuciones en el campo de la planificación con redes
jerárquicas de tareas para la resolución de problemas de enrutamiento de vehÃculos. Se
aplica una nueva forma de conexión entre dos planificadores independientes basada en
un sistema de cálculo de puntuaciones que les permite colaborar en la optimización de
soluciones, y se presenta un nuevo planificador HTN con un algoritmo de búsqueda distinto
al comúnmente utilizado. Se muestra la aplicación de estos dos métodos en misiones
civiles dentro del entorno de los Proyectos ARCAS y AEROARMS financiados por la
Comisión Europea y se presentan extensos resultados de simulación para comprobar la
validez de los dos métodos propuestos.This thesis presents contributions in the field of automated planning and scheduling,
the branch of artificial intelligence that concerns the realization of strategies or
action sequences typically for execution by unmanned vehicles, autonomous robots and/or
intelligent agents. When trying to achieve certain goal, cooperation may be a key aspect.
The complexity of some tasks requires the cooperation among several agents. Moreover,
even if the task is simple enough to be carried out by a single agent, cooperation can be
used to decrease the overall cost of the operation. To perform complex tasks that require
physical interaction with the real world, unmanned vehicles can be used as agents. In the
last years a great variety of unmanned platforms, mainly vehicles that can be driven without
a human on board, have been developed and used both in civil and military missions.
This thesis deals with the application of Hierarchical Task Network (HTN) planning
in the resolution of vehicle routing problems (VRP) [18] in domains involving multiple
heterogeneous unmanned vehicles that must cooperate to achieve specific goals.
HTN planning describes problem domains using a description that decomposes set of
tasks into subsets of smaller tasks and so on, obtaining low-level tasks that cannot be
further decomposed and are supposed to be executable. The hierarchy resembles the way
the humans reason about problems by decomposing them into sub-problems depending
on the context and therefore tend to be easy to understand and design.
Vehicle routing problems are a generalization of the travelling salesman problem (TSP).
The TSP consists on finding the shortest path that connects all the cities from a list, starting
and ending on the same city. The VRP consists on finding the set of minimal routes that
cover all cities by using a specific number of vehicles. Both problems have a combinatorial
nature, specially the VRP, that makes it very difficult to use a HTN planner in domains
where these problems are present.
Two approaches to use a HTN planner in domains involving the VRP have been tested.
The first approach consists on a score-based optimization system that allows us to apply a
new way of connecting a software specialized in the resolution of the VRP with the HTN
planner. We call this the decoupled approach, as we tackle the combinatorial nature of the
VRP by using a specialized solver that communicates with the HTN planner and provides
all the required information to do the task decomposition. The second approach consists on improving and enhancing the HTN planner to be capable of solving the VRP without
needing the use of an external software. We call this the coupled approach. For this reason,
a new HTN planner that uses a different search algorithm from these commonly used in
that type of planners has been developed and is presented in this work.
This thesis presents new contributions in the field of hierarchical task network planning
for the resolution of vehicle routing problem domains. A new way of connecting two
independent planning systems based on a score calculation system that lets them cooperate
in the optimization of the solutions is applied, and a new HTN planner that uses a different
search algorithm from that usually used in other HTN planners is presented. These two
methods are applied in civil missions in the framework of the ARCAS and AEROARMS
Projects funded by the European Commission. Extensive simulation results are presented
to test the validity of the two approaches
Multi-robot grasp planning for sequential assembly operations
This paper addresses the problem of finding robot configurations to grasp assembly parts during a sequence of collaborative assembly operations. We formulate the search for such configurations as a constraint satisfaction problem (CSP).Collision constraints in an operation and transfer constraints between operations determine the sets of feasible robot configurations. We show that solving the connected constraint graph with off-the-shelf CSP algorithms can quickly become infeasible even fora few sequential assembly operations. We present an algorithm which, through the assumption of feasible regrasps, divides the CSP into independent smaller problems that can be solved exponentially faster. The algorithm then uses local search techniques to improve this solution by removing a gradually increasing number of regrasps from the plan. The algorithm enables the user to stop the planner anytime and use the current best plan if the cost of removing regrasps from the plan exceeds the cost of executing those regrasps. We present simulation experiments to compare our algorithm’s performance toa naive algorithm which directly solves the connected constraint graph. We also present a physical robot system which uses the output of our planner to grasp and bring parts together in assembly configurations
Tele-Autonomous control involving contact
Object localization and its application in tele-autonomous systems are studied. Two object localization algorithms are presented together with the methods of extracting several important types of object features. The first algorithm is based on line-segment to line-segment matching. Line range sensors are used to extract line-segment features from an object. The extracted features are matched to corresponding model features to compute the location of the object. The inputs of the second algorithm are not limited only to the line features. Featured points (point to point matching) and featured unit direction vectors (vector to vector matching) can also be used as the inputs of the algorithm, and there is no upper limit on the number of the features inputed. The algorithm will allow the use of redundant features to find a better solution. The algorithm uses dual number quaternions to represent the position and orientation of an object and uses the least squares optimization method to find an optimal solution for the object's location. The advantage of using this representation is that the method solves for the location estimation by minimizing a single cost function associated with the sum of the orientation and position errors and thus has a better performance on the estimation, both in accuracy and speed, than that of other similar algorithms. The difficulties when the operator is controlling a remote robot to perform manipulation tasks are also discussed. The main problems facing the operator are time delays on the signal transmission and the uncertainties of the remote environment. How object localization techniques can be used together with other techniques such as predictor display and time desynchronization to help to overcome these difficulties are then discussed
- …