By Topic

Real-time hand-writing tracking and recognition by integrated micro motion and vision sensors platform

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

5 Author(s)

A real-time 2D gesture tracking and recognition system based on micro motion and vision sensors fusion is presented in this paper. The 100 Hz inertial data from MEMS sensors and 5 Hz visual data from a CMOS camera (a small webcam) are fused by using extended Kalman filter (EKF). To synchronize data from the two sensing components (i.e., inertial sensor and vision sensor) and filter out high frequency noise, the inertial data are processed by passing it through a moving average filter in the data preprocessing stage. Moreover, features of a checkerboard image are extracted by using the Harris corner extraction algorithm, and the pose the webcam relative to the world coordinate could be thus estimated by using direct linear transform (DLT). In order to avoid the gimbal lock problem, rotation quaternion is preferred to represent the orientation of the overall system. For trajectory feature extraction, the obtained trajectories are first normalized to a 0.5×0.5 area through a linear normalization, and then the features are extracted by using a linear Discrete Cosine Transform (DCT). The extracted data are subsequently sent to a dynamic time warping (DTW) algorithm for recognition. The experimental results show that 92.3% accuracy can be achieved for recognizing hand written numbers from 0 to 9, where ~100ms is required for recognition if hand writing speed is ~137 mm/s.

Published in:

Robotics and Biomimetics (ROBIO), 2012 IEEE International Conference on

Date of Conference:

11-14 Dec. 2012