Shadow Dexterous Hand: Optimizing Pick-and-Place with Depth Cameras

This paper investigates the integration of a Shadow Dexterous Hand with depth cameras for precise pick-and-place tasks in a smart factory setting. By leveraging the capabilities of ZED and RealSense depth cameras, the system aims to enhance object perception and manipulation. The proposed solution was proven to be effective in practical tests within a FESTO Modular Production System, automating component transfer from the production line’s end back to its beginning. The paper details the system’s architecture, implementation, and experimental results, demonstrating the accuracy and efficiency of the pick-and-place process. The findings contribute to advancing robotic manipulation capabilities and the realisation of fully autonomous production environments.