Immersive Teleconferencing System Based on Video-Avatar for Distance Learning

Teleconference is an important means of communication to lectures in distance learning courses. Unlike other technologies used in education, the technology which enables virtual conferencing has changed little since it began to be used. Even the transition from analogical to digital technology and the adoption of IP technology changed little the communication characteristics of this media, basically the same of a 2D video. The project presented here is part of a new field of research, called immersive telecommunication, aiming to increase the sense of immersion and presence of the participants. Thus was developed a videoconferencing system that allows the presenter to immerse yourself in a 3D virtual environment, through his/her video-avatar, and be assisted remotely in the form of 3D video. This system integrates several sub-projects, involving the capture and rendering of video-avatar, background removal, gesture recognition, interaction design, among others. The aim of this paper is to present the system architecture and an overview of its modules, key challenges and solutions adopted.