Real-Time Hand Gesture Replication System using 3D Modelling Software

This article proposes a method to replicate the realtime hand gesture movements on a 3-D simulation software called Blender 3D. It is a gaming engine simulation software that is also used for simulation of 3D models. A special glove is designed for this purpose, and each finger on the glove is fitted with a flex sensor. Flex sensors (or bend sensors) are two-terminal sensors and work just like a variable resistor in which resistance changes upon bending. The voltage drop across the flex sensor is passed through a microcontroller (Arduino used here) into the Blender-3D. A 3D model of a human hand is also needed to be designed in the Blender- 3D. This model will be used to observe our hand movements on the software. Python code and Arduino code is to be written to guide the hand movement based on the flex sensor values. The project can be used in numerous ways, like helping especially abled people replace their hands with bionic hands which can be suited for their personal hand structure or designing games that can be played with gesture movements of the finger.