Facial Movement Interface for Mobile Devices Using Depth-sensing Camera

In this work, we present a facial based interface as a possible alternative way to control mobile devices applications. The 3D facial movements are obtained using a depth-sensing camera available on many mobile devices. These 3D animation data are analyzed into the form of blend shapes and face direction to determine input actions. These input actions are the conventional touch input actions such as tap, drag, pinch-in, and pinch-out. For this reason, our proposed facial based input methods can be integrated into the existing mobile applications that used touch interface. Through our user studies, we conducted experiments with several subjects on the practical usability of facial movement interface for mobile applications.