“You are Green”: a Touch-to-Name Interaction in an Integrated Multi-Modal Multi-Robot HRI System

We present a multi-modal multi-robot interaction whereby a user can identify an individual or a group of robots using haptic stimuli, and name them using a voice command (e.g. “You two are green”). Subsequent commands can be addressed to the same robot(s) by name (e.g. “Green! Take off!”). We demonstrate this as part of a real-world integrated system in which a user commands teams of autonomous robots in a coordinated exploration task.