A Multitouchless Interface: Expanding User Interaction

A proposed multitouchless interface accurately tracks users' hands and fingers in 3D, using a Microsoft Kinect sensor. The system tracks up to four hands simultaneously on a standard desktop computer at 30 fps, with approximately 5-mm accuracy. From this basic tracking, the system identifies gestures and uses them for interaction. The Making Sense demonstrator applied this technology to let users quickly summarize and explore complex multimedia data taken from hard drives.