By Topic

Multimodal natural user interaction for multiple applications: The gesture — Voice example

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Vidakis, N. ; Appl. Inf. & Multimedia, Technol. Educ. Inst. of Crete, Heraklion, Greece ; Syntychakis, M. ; Triantafyllidis, G. ; Akoumianakis, D.

In this paper we present a natural user interface system. The device utilized for achieving natural interaction is the MS-Kinect which provides RGB, depth & audio signal. Our system is based on the theory of multimodal interaction and provides the ability to the user to interact simultaneously with different applications using vocal commands and gesture in conjunction. The difference of our system from other similar efforts is that it uses a multimodal interaction approach to manipulate multi-applications by employing a generic container, which runs at the background and serves as an intermediate between multimodal input and active applications running on a computer. We describe the architecture of the system based on multimodal interaction and its representative example using two PC applications.

Published in:

Telecommunications and Multimedia (TEMU), 2012 International Conference on

Date of Conference:

July 30 2012-Aug. 1 2012