Adaptive Vision-Based Leader–Follower Formation Control of Mobile Robots

This paper focuses on the problem of vision-based leader-follower formation control of mobile robots. The proposed adaptive controller only requires the image information from an uncalibrated perspective camera mounted at any position and orientation (attitude) on the follower robot. Furthermore, the approach does not depend on the relative position measurement and communication between the leader and follower. First, a new real-time observer is developed to estimate the unknown intrinsic and extrinsic camera parameters as well as the unknown coefficients of the plane where the feature point moves relative to the camera frame. Second, the Lyapunov method is employed to prove the stability of the closed-loop system, where it is shown that convergence of the image error is guaranteed. Finally, the performance of the approach is demonstrated through physical experiments and experimental results.