Virtual Reality-Driven Human Multi-Robot Formation Using Machine Learning

This paper implements the human multi-robot collaboration using virtual reality and machine learning approaches. Leader-follower formation control is considered to be a robot collaboration. Virtual reality is considered the tool that a human uses to control the formation and bring human-robot interaction to the whole mission. The Raspberry PI-equipped mobile robots are implemented and equipped with sensors to collaborate effectively while keeping autonomy like preventing collisions between themselves and other obstacles in the environment. The human has control over the leader robot using virtual reality and sends commands to the leader via a WiFi communication protocol. There is no direct interaction between the human and the follower robot. The follower robot is equipped with a high-quality stereo camera along with customized machine-learning algorithms to detect and follow the leader while keeping a certain distance. The proposed approach has extensive application in different industries especially in areas the area of expediting the speed of nuclear waste disposal.