Trilingual 3D Script Identification and Recognition using Leap Motion Sensor

Recently, the development of depth sensing technologies such as Leap motion and Microsoft Kinect sensors facilitate a touch-less environment to interact with computers and mobile devices. Several research have been carried out for the air-written text recognition with the help of these devices. However, there are several countries (like India) where multiple scripts are used to write official languages. Therefore, for the development of an effective text recognition system, the script of the text has to be identified first. The task becomes more challenging when it comes to 3D handwriting. Since, the 3D text written in air is consists of single stoke only. This paper presents a 3D script identification and recognition system written in three languages, namely, Hindi, English and Punjabi using Leap motion sensor. In the first stage, script identification was carried out in one of the three language. Next, Hidden Markov Model (HMM) was used to recognize the words. An accuracy of 96.4% was recorded in script identification whereas accuracies of 72.99%, 73.25% and 60.5% were recorded in script identification of Hindi, English and Punjabi scripts, respectively.