Research on Robot Power Distribution Cabinet Operation Based on Machine Vision

In recent years, the field of machine vision has developed rapidly, enabling the extraction of increasingly detailed information from images. At the same time, robotics technology has also advanced swiftly, with robots being widely applied in daily life. In our research, we combined machine vision technology with robotics to study operations for power distribution cabinets. Our system is based on a six-degree-of-freedom robotic arm, with the robot's end effector using a two-finger parallel electric gripper and an RGB-D camera for visual data acquisition. We also proposed a vision processing method to identify the status of the power distribution cabinet and to recognize and calculate the rotation angle of knobs. The system, utilizing these methods, was integrated into a power distribution cabinet platform for experimental testing. The robot was then controlled to perform the corresponding tasks, achieving success rates of 100%, 80%, and 70% respectively. Therefore, our proposed vision processing method effectively identifies and calculates the position and angle of buttons and knobs, and the integrated system successfully completed the corresponding tasks.