Modeling and simulation of hand based on opensim and leap motion

In the modern industry, human-robot collaboration is becoming more and more important. With the quick development of the small production, the demand of flexibility is growing heavily. Gesture recognition is important for the collaborative work of humans and robots. In industrial applications, the performance of such systems affects the safety of human workers and their manufacturing efficiency. In this paper, we create a realistic human model in OpenSim, and use the Leap Motion to identify the action of a man's hand. Through the transmission of data measured by the Leap Motion, the model we have created in the OpenSim will correctly track the hand's movement, and make the corresponding motion. The experimental results show that the performance of this method is satisfactory. With the help of this method, we can simulate the precise movements of human hands in real time.