Table of Contents
Fetching ...

A Task and Motion Planning Framework Using Iteratively Deepened AND/OR Graph Networks

Hossein Karami, Antony Thomas, Fulvio Mastrogiovanni

TL;DR

This work addresses the challenge of integrated task and motion planning when the number of sub-tasks is not known a priori and for multi-robot coordination. It proposes TMP-IDAN, which uses Iteratively Deepened Augmented AND/OR Graph Networks to grow problem structure on the fly and ground symbolic plans with continuous motions via an in-loop MoveIt/RRT-based planner. The approach provides probabilistic completeness for both the task and motion layers and demonstrates scalability across cluttered tabletop scenarios, the Tower of Hanoi, and a kitchen domain, including single- and multi-robot setups. The results indicate that task planning remains near-linear in network depth while motion planning dominates computation, supporting practical deployment for complex, real-world TAMP tasks with unknown sub-task counts and multiple agents.

Abstract

In this paper, we present an approach for integrated task and motion planning based on an AND/OR graph network, which is used to represent task-level states and actions, and we leverage it to implement different classes of task and motion planning problems (TAMP). Several problems that fall under task and motion planning do not have a predetermined number of sub-tasks to achieve a goal. For example, while retrieving a target object from a cluttered workspace, in principle the number of object re-arrangements required to finally grasp it cannot be known ahead of time. To address this challenge, and in contrast to traditional planners, also those based on AND/OR graphs, we grow the AND/OR graph at run-time by progressively adding sub-graphs until grasping the target object becomes feasible, which yields a network of AND/OR graphs. The approach is extended to enable multi-robot task and motion planning, and (i) it allows us to perform task allocation while coordinating the activity of a given number of robots, and (ii) can handle multi-robot tasks involving an a priori unknown number of sub-tasks. The approach is evaluated and validated both in simulation and with a real dual-arm robot manipulator, that is, Baxter from Rethink Robotics. In particular, for the single-robot task and motion planning, we validated our approach in three different TAMP domains. Furthermore, we also use three different robots for simulation, namely, Baxter, Franka Emika Panda manipulators, and a PR2 robot. Experiments show that our approach can be readily scaled to scenarios with many objects and robots, and is capable of handling different classes of TAMP problems.

A Task and Motion Planning Framework Using Iteratively Deepened AND/OR Graph Networks

TL;DR

This work addresses the challenge of integrated task and motion planning when the number of sub-tasks is not known a priori and for multi-robot coordination. It proposes TMP-IDAN, which uses Iteratively Deepened Augmented AND/OR Graph Networks to grow problem structure on the fly and ground symbolic plans with continuous motions via an in-loop MoveIt/RRT-based planner. The approach provides probabilistic completeness for both the task and motion layers and demonstrates scalability across cluttered tabletop scenarios, the Tower of Hanoi, and a kitchen domain, including single- and multi-robot setups. The results indicate that task planning remains near-linear in network depth while motion planning dominates computation, supporting practical deployment for complex, real-world TAMP tasks with unknown sub-task counts and multiple agents.

Abstract

In this paper, we present an approach for integrated task and motion planning based on an AND/OR graph network, which is used to represent task-level states and actions, and we leverage it to implement different classes of task and motion planning problems (TAMP). Several problems that fall under task and motion planning do not have a predetermined number of sub-tasks to achieve a goal. For example, while retrieving a target object from a cluttered workspace, in principle the number of object re-arrangements required to finally grasp it cannot be known ahead of time. To address this challenge, and in contrast to traditional planners, also those based on AND/OR graphs, we grow the AND/OR graph at run-time by progressively adding sub-graphs until grasping the target object becomes feasible, which yields a network of AND/OR graphs. The approach is extended to enable multi-robot task and motion planning, and (i) it allows us to perform task allocation while coordinating the activity of a given number of robots, and (ii) can handle multi-robot tasks involving an a priori unknown number of sub-tasks. The approach is evaluated and validated both in simulation and with a real dual-arm robot manipulator, that is, Baxter from Rethink Robotics. In particular, for the single-robot task and motion planning, we validated our approach in three different TAMP domains. Furthermore, we also use three different robots for simulation, namely, Baxter, Franka Emika Panda manipulators, and a PR2 robot. Experiments show that our approach can be readily scaled to scenarios with many objects and robots, and is capable of handling different classes of TAMP problems.

Paper Structure

This paper contains 22 sections, 1 theorem, 9 equations, 12 figures, 9 tables, 1 algorithm.

Key Result

Lemma 1

TMP-IDAN is probabilistically complete.

Figures (12)

  • Figure 1: (a) The robot needs to pick the purple cube. If only side grasps were allowed, then the robot would go through a sequence of pick-and-place actions to de-clutter the area. (b) Cluttered table-top with two target objects (in black) and other objects (in red). The multi-robot system consists of two manipulators.
  • Figure 2: A possible AND/OR graph network for the pick-and-place scenario shown in Fig. \ref{['fig:toy']}.
  • Figure 3: System's architecture of the TMP-IDAN framework.
  • Figure 4: TMP-IDAN in a real-world use (top-left), and in simulation (bottom-left). An AND/OR graph network of depth 2 for the corresponding cluttered scenario (right), where we do not label hyper-arcs.
  • Figure 5: Illustration of the obstacles identification method: (a) a cluttered table-top scenario with two robots, R1 (right) and R2 (left), and the target objects in black; (b) a valid grasping angle range is computed by discretizing a fixed grasping angle range from $-\frac{\pi}{2}$ to $\frac{\pi}{2}$; the objects falling within the grasping angle range of R1 (one target) are shown in blue; (c) blue objects within the grasping angle range of R1, considering both targets; (d) objects within the grasping range of both R1 (blue) and R2 (green), considering both the targets for each robot.
  • ...and 7 more figures

Theorems & Definitions (11)

  • Definition 1
  • Definition 2
  • Definition 3
  • Definition 4
  • Definition 5
  • Definition 6
  • Definition 7
  • Definition 8
  • Definition 9
  • Lemma 1
  • ...and 1 more