Vision-based leader-follower formations with limited information

This paper presents a new vision-based leader-follower formation algorithm where the leader's trajectory is unknown to the robots which are following. Formation schemes in straight lines and diagonal formations are introduced which are both stable and observable in the presence of limited views. The algorithms are novel since they only use local image measurements through a pinhole camera to estimate the leader's position. This approach does not require specialized markings nor extensive robot communications. The algorithms are also decentralized. We apply an input-output feedback linearization for system stability and utilize an Extended Kalman Filter (EKF) for estimation. Simulations illustrate how the proposed formation controls work. Real experiments utilizing multiple miniature robots are also presented and illustrate the challenges associated with noisy images in real-world applications.