Table of Contents
Fetching ...

Diffeomorphic Obstacle Avoidance for Contractive Dynamical Systems via Implicit Representations

Ken-Joel Simmoteit, Philipp Schillinger, Leonel Rozo

TL;DR

The paper tackles safe and robust execution of learned robot skills under unknown and cluttered environments by fusing neural contractive dynamical systems with implicit geometric representations. It introduces the Signed Distance Field Diffeomorphic Transform (SDT), comprising a contractive base dynamics, an implicit distance field, a barrier, and two contraction-preserving diffeomorphic transforms (SDDC and SDC) to achieve obstacle avoidance without compromising contraction guarantees. It develops novel obstacle-avoidance metrics (RFC and VM) and validates the approach across LASA trajectories and real kitchen tasks, showing smooth, contraction-preserving modulation and competitive or superior performance against state-of-the-art baselines. Real-world experiments with a 7-DoF Panda demonstrate safety and robustness when interacting with objects like a dishwasher, including the need to extend the robot’s SDF with the grasped object. The work highlights practical implications for deploying contractive robot skills in dynamic, cluttered environments and outlines avenues for handling concave and dynamic obstacles, as well as potential integration with control barrier functions.

Abstract

Ensuring safety and robustness of robot skills is becoming crucial as robots are required to perform increasingly complex and dynamic tasks. The former is essential when performing tasks in cluttered environments, while the latter is relevant to overcome unseen task situations. This paper addresses the challenge of ensuring both safety and robustness in dynamic robot skills learned from demonstrations. Specifically, we build on neural contractive dynamical systems to provide robust extrapolation of the learned skills, while designing a full-body obstacle avoidance strategy that preserves contraction stability via diffeomorphic transforms. This is particularly crucial in complex environments where implicit scene representations, such as Signed Distance Fields (SDFs), are necessary. To this end, our framework called Signed Distance Field Diffeomorphic Transform, leverages SDFs and flow-based diffeomorphisms to achieve contraction-preserving obstacle avoidance. We thoroughly evaluate our framework on synthetic datasets and several real-world robotic tasks in a kitchen environment. Our results show that our approach locally adapts the learned contractive vector field while staying close to the learned dynamics and without introducing highly-curved motion paths, thus outperforming several state-of-the-art methods.

Diffeomorphic Obstacle Avoidance for Contractive Dynamical Systems via Implicit Representations

TL;DR

The paper tackles safe and robust execution of learned robot skills under unknown and cluttered environments by fusing neural contractive dynamical systems with implicit geometric representations. It introduces the Signed Distance Field Diffeomorphic Transform (SDT), comprising a contractive base dynamics, an implicit distance field, a barrier, and two contraction-preserving diffeomorphic transforms (SDDC and SDC) to achieve obstacle avoidance without compromising contraction guarantees. It develops novel obstacle-avoidance metrics (RFC and VM) and validates the approach across LASA trajectories and real kitchen tasks, showing smooth, contraction-preserving modulation and competitive or superior performance against state-of-the-art baselines. Real-world experiments with a 7-DoF Panda demonstrate safety and robustness when interacting with objects like a dishwasher, including the need to extend the robot’s SDF with the grasped object. The work highlights practical implications for deploying contractive robot skills in dynamic, cluttered environments and outlines avenues for handling concave and dynamic obstacles, as well as potential integration with control barrier functions.

Abstract

Ensuring safety and robustness of robot skills is becoming crucial as robots are required to perform increasingly complex and dynamic tasks. The former is essential when performing tasks in cluttered environments, while the latter is relevant to overcome unseen task situations. This paper addresses the challenge of ensuring both safety and robustness in dynamic robot skills learned from demonstrations. Specifically, we build on neural contractive dynamical systems to provide robust extrapolation of the learned skills, while designing a full-body obstacle avoidance strategy that preserves contraction stability via diffeomorphic transforms. This is particularly crucial in complex environments where implicit scene representations, such as Signed Distance Fields (SDFs), are necessary. To this end, our framework called Signed Distance Field Diffeomorphic Transform, leverages SDFs and flow-based diffeomorphisms to achieve contraction-preserving obstacle avoidance. We thoroughly evaluate our framework on synthetic datasets and several real-world robotic tasks in a kitchen environment. Our results show that our approach locally adapts the learned contractive vector field while staying close to the learned dynamics and without introducing highly-curved motion paths, thus outperforming several state-of-the-art methods.

Paper Structure

This paper contains 63 sections, 2 theorems, 58 equations, 13 figures, 6 tables, 2 algorithms.

Key Result

Theorem 1

If Definition def:contraction_stability is satisfied for a dynamical system, then it is preserved under the following transformations:

Figures (13)

  • Figure 1: Overview of the proposed Signed Distance Field Diffeomorphic Transform: (1) A neural contractive dynamical system; (2) A learned implicit distance function; (3) A barrier function, and (4) a contraction-preserving diffeomorphic transform.
  • Figure 2: Comparison of contraction-preserving obstacle avoidance using SDDC and SDC on an example of the LASA dataset. The vector field modulated by the SDDC is represented by a gray flow stream while the box-shaped obstacle is depicted by the red solid line. The bottom plots show the magnitude of the velocity profile along the trajectory.
  • Figure 3: Illustration of the obstacles SDF used in the 2D LASA dataset experiments. The contour lines represent the distance $\Gamma_\text{SDF}$ to the obstacle surface, depicted as a solid red line. Four simple obstacles are considered: Circle, Box, Triangle, Arc.
  • Figure 4: Obstacle avoidance with SDDC and SDC using a inverse barrier on a NCDS model trained on the LASA dataset. The arc-shaped obstacle is depicted by the red line. The velocity profile shows the absolute velocity value along the trajectory. The vector field modulated by the SDDC is represented by gray arrows.
  • Figure 5: Obstacle avoidance with SDC and SDDC using a inverse barrier on a NCDS trained on the Sine trajectories of the LASA dataset. The circle-shaped obstacle is depicted by the red line. The velocity profile shows the absolute velocity value along the trajectory. The vector field modulated by the SDDC is represented by gray arrows.
  • ...and 8 more figures

Theorems & Definitions (5)

  • Definition 1: Contraction stability LOHMILLER1998
  • Theorem 1: Invariance under coordinate change Manchester2017
  • Theorem 2: Contraction conditions Tsukamoto2021
  • proof
  • proof