Turning a Messy Room into a Fully Immersive VR Playground

In this study, to enable a VR experience with an HMD even in a space with obstacles, we developed a real-time construction system of a reality-based VR space that does not impair the atmosphere of the virtual world. In addition, we aim to construct a VR space that is easier to recognize its structure by classifying "objects that are boundaries of space" and "ordinary obstacles" using a deep learning network and superimposing virtual objects corresponding to each type of real object. We implemented a real-time construction system for a VR space that reflects the distribution of objects in a real space using two depth cameras mounted on HMD, and created guidelines and applications for using the proposed system.