I-see-3D ! An interactive and immersive system that dynamically adapts 2D projections to the location of a user's eyes

This paper presents a non-intrusive system that gives the illusion of a 3D immersive and interactive environment with 2D projectors. The user does not need to wear glasses, nor to watch a (limited) screen. The virtual world is all around him, drawn on the floor. As the user is himself immersed in the virtual world, there is no need for a proxy like an avatar; he can move inside the virtual environment freely. Moreover, the I-see-3D system allows a user to manipulate virtual objects with his own body, making interactions with the virtual world very intuitive. Giving the illusion of 3D requires to render images in such a way that the deformation of the image projected on the floor is taken into account, as well as the position of the user's “eye” in its virtual world. The resulting projection is neither perspective nor orthographic. Nevertheless, we describe how this can be implemented with the standard OpenGL pipeline, without any shader. Our experiments demonstrate that our system is effective in giving the illusion of 3D. Videos showing the results obtained with our I-see-3D system are available on our website http://www.ulg.ac.be/telecom/projector.