Finger gesture-based mobile user interface using a rear-facing camera

We propose finger gesture-based user interaction on mobile devices, focusing on mobile phones equipped with rear-facing cameras. A user interacts with a mobile application by using finger gestures with the hand that holds the mobile phone, which is detected by video taken with the rear-facing camera. A preprocessing method uses skin-color segmentation, morphological operation and skeletonization for finger tracking. Our system generates mouse events and other commands reacting to finger gestures.