The Realization of Intelligent Robot System for Milk Tea Production

At present, there are many challenges for robotic systems to grasp in a dynamic and unstructured environment. The Robotic Grasping and Manipulation Competition (RGMC) aims to encourage researchers to focus on these challenges. The solution proposed in this letter was used to compete in the 2019 and 2020 RGMC and achieved first prize and second prize, respectively. The solution included the design of a new type of modular gripper to complete the task of making milk tea in the competition. This solution is based on the Rethink Sawyer robot platform and the use of machine vision and force control to complete the precise identification and dexterous control of dynamic objects in the competition task.