579 research outputs found
Graph-based 3D Collision-distance Estimation Network with Probabilistic Graph Rewiring
We aim to solve the problem of data-driven collision-distance estimation
given 3-dimensional (3D) geometries. Conventional algorithms suffer from low
accuracy due to their reliance on limited representations, such as point
clouds. In contrast, our previous graph-based model, GraphDistNet, achieves
high accuracy using edge information but incurs higher message-passing costs
with growing graph size, limiting its applicability to 3D geometries. To
overcome these challenges, we propose GDN-R, a novel 3D graph-based estimation
network.GDN-R employs a layer-wise probabilistic graph-rewiring algorithm
leveraging the differentiable Gumbel-top-K relaxation. Our method accurately
infers minimum distances through iterative graph rewiring and updating relevant
embeddings. The probabilistic rewiring enables fast and robust embedding with
respect to unforeseen categories of geometries. Through 41,412 random benchmark
tasks with 150 pairs of 3D objects, we show GDN-R outperforms state-of-the-art
baseline methods in terms of accuracy and generalizability. We also show that
the proposed rewiring improves the update performance reducing the size of the
estimation model. We finally show its batch prediction and auto-differentiation
capabilities for trajectory optimization in both simulated and real-world
scenarios.Comment: 7 pages, 6 figure
CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation
We address the important problem of generalizing robotic rearrangement to
clutter without any explicit object models. We first generate over 650K
cluttered scenes - orders of magnitude more than prior work - in diverse
everyday environments, such as cabinets and shelves. We render synthetic
partial point clouds from this data and use it to train our CabiNet model
architecture. CabiNet is a collision model that accepts object and scene point
clouds, captured from a single-view depth observation, and predicts collisions
for SE(3) object poses in the scene. Our representation has a fast inference
speed of 7 microseconds per query with nearly 20% higher performance than
baseline approaches in challenging environments. We use this collision model in
conjunction with a Model Predictive Path Integral (MPPI) planner to generate
collision-free trajectories for picking and placing in clutter. CabiNet also
predicts waypoints, computed from the scene's signed distance field (SDF), that
allows the robot to navigate tight spaces during rearrangement. This improves
rearrangement performance by nearly 35% compared to baselines. We
systematically evaluate our approach, procedurally generate simulated
experiments, and demonstrate that our approach directly transfers to the real
world, despite training exclusively in simulation. Robot experiment demos in
completely unknown scenes and objects can be found at this http
https://cabinet-object-rearrangement.github.i
Differentiable Robot Neural Distance Function for Adaptive Grasp Synthesis on a Unified Robotic Arm-Hand System
Grasping is a fundamental skill for robots to interact with their
environment. While grasp execution requires coordinated movement of the hand
and arm to achieve a collision-free and secure grip, many grasp synthesis
studies address arm and hand motion planning independently, leading to
potentially unreachable grasps in practical settings. The challenge of
determining integrated arm-hand configurations arises from its computational
complexity and high-dimensional nature. We address this challenge by presenting
a novel differentiable robot neural distance function. Our approach excels in
capturing intricate geometry across various joint configurations while
preserving differentiability. This innovative representation proves
instrumental in efficiently addressing downstream tasks with stringent contact
constraints. Leveraging this, we introduce an adaptive grasp synthesis
framework that exploits the full potential of the unified arm-hand system for
diverse grasping tasks. Our neural joint space distance function achieves an
84.7% error reduction compared to baseline methods. We validated our approaches
on a unified robotic arm-hand system that consists of a 7-DoF robot arm and a
16-DoF multi-fingered robotic hand. Results demonstrate that our approach
empowers this high-DoF system to generate and execute various arm-hand grasp
configurations that adapt to the size of the target objects while ensuring
whole-body movements to be collision-free.Comment: Under revie
Real-time Batched Distance Computation for Time-Optimal Safe Path Tracking
In human-robot collaboration, there has been a trade-off relationship between
the speed of collaborative robots and the safety of human workers. In our
previous paper, we introduced a time-optimal path tracking algorithm designed
to maximize speed while ensuring safety for human workers. This algorithm runs
in real-time and provides the safe and fastest control input for every cycle
with respect to ISO standards. However, true optimality has not been achieved
due to inaccurate distance computation resulting from conservative model
simplification. To attain true optimality, we require a method that can compute
distances 1. at many robot configurations to examine along a trajectory 2. in
real-time for online robot control 3. as precisely as possible for optimal
control. In this paper, we propose a batched, fast and precise distance
checking method based on precomputed link-local SDFs. Our method can check
distances for 500 waypoints along a trajectory within less than 1 millisecond
using a GPU at runtime, making it suited for time-critical robotic control.
Additionally, a neural approximation has been proposed to accelerate
preprocessing by a factor of 2. Finally, we experimentally demonstrate that our
method can navigate a 6-DoF robot earlier than a geometric-primitives-based
distance checker in a dynamic and collaborative environment
Graph Neural Network Based Method for Path Planning Problem
Sampling-based path planning is a widely used method in robotics,
particularly in high-dimensional state space. Among the whole process of the
path planning, collision detection is the most time-consuming operation. In
this paper, we propose a learning-based path planning method that aims to
reduce the number of collision detection. We develop an efficient neural
network model based on Graph Neural Networks (GNN) and use the environment map
as input. The model outputs weights for each neighbor based on the input and
current vertex information, which are used to guide the planner in avoiding
obstacles. We evaluate the proposed method's efficiency through simulated
random worlds and real-world experiments, respectively. The results demonstrate
that the proposed method significantly reduces the number of collision
detection and improves the path planning speed in high-dimensional
environments
- …