Multimodal interaction in multimedia applications

Multimedia utilizes may different channels to convey information to a user. For an optimum interaction these channels must be coordinated in a clear and informative way. Research has produced several rules-of-thumb which facilitate this process. The paper outlines two software applications, AudioScript and WebSpy, which use these guidelines to investigate multimodal integration in multimedia applications.