Vision-guided Unified Task and Motion Planning for Multiple Robots in Cluttered Environments

Efficient coordination of multiple mobile and fixed base robot arms to perform independent or cooperative tasks in a shared workspace while avoiding collisions is a challenging research problem that has been studied across various robotic fields. Although robotic systems are commonly used in industrial applications such as automotive production, they typically operate independently with limited collaboration between two or more units. In this study, we propose a unified methodology for motion and task planning for multiple robot arm systems with high degrees of freedom that are simultaneously performing different tasks in a shared workspace. Our methodology introduces an integration module between the high-level task planning module and low-level motion planning module to achieve reliable and collision-free execution of tasks. We also introduce the concept of a dynamic shared space graph (D-SSG) to assess the cooperation between arm pairs that share certain parts of the workspace, which is essential for selecting arm sequences and scheduling each arm to perform a task or sub-task.