A Multi-User Multi-Robot Collaboration through Augmented Reality

Current industrial environments have multiple robots working alongside humans, thus providing an operator the ability to perceive the robot’s workspace correctly and to anticipate its intentions and movements through the visualization of the robot’s digital twin is of utmost importance for safe and productive human-robot collaboration scenarios. Much has been studied regarding single human-single robot collaborative scenarios, but few address multi-user multi-robot scenarios. To this end, this paper presents a multi-robot multi-operator architecture, where the users’ awareness is enhanced through an augmented reality head-mounted display. A multi-robot, multi-user collaborative scenario is presented in a laboratory environment with two industrial robots. Besides being able to interact with both robots in the system, each user becomes more aware of the robot’s workspace and its pre-defined trajectories. Furthermore, it presents how fiducial markers can help to establish the relation between the different coordinate frames.