Large-Screen Interactive Technology With 3D Sensor Based on Clustering Filtering Method and Unscented Kalman Filter

In this paper, a large screen interactive 3D sensor technology with clustering filtering method and unscented Kalman filter has been addressed. The surface and interactive area with the screen is mapped together using image processing and machine vision processing of 3D sensor. Then, the predictable and accurate multi-point interaction can be obtained. Also some operations can be achieved such as zooming, panning, selecting and moving image components, etc. Vision method, infrared induction, dynamic capture, image processing and other mixed technologies have been simultaneously utilized to recognize human gestures and simulate mouse event which can give participants a fully interactive experience. Experimental results show that this large-screen interactive technology with 3D sensor can achieve accurate multi-point interaction and gesture control, and have good human-machine interaction effect.