Multi modal presentation in virtual telemedical environments

Summary form only given, as follows. Telemedicine can be used to create virtual environments for the collaboration of patients, physicians and medical staff. Multimodal presentation is increasingly used to improve the human-computer interface. In this paper, we present a multimodal interactive environment for EEG/MEG data presentation based on Internet technologies and a virtual reality user interface (VRUI). In addition to visualization, the VRUI takes advantage of other input/output modalities, such as audio. Animation of the 3D models is used to give insight into spatio-temporal patterns of activity. In addition, sonification is applied to emphasize the temporal dimension of the selected visualised scores. Our proposed approach requires only a standard Web browser to run the multimodal viewer, which presents 3D EEG topographic maps using a VRML head model which is animated with Java applets.