Building-Scale Virtual Reality: Another Way to Extend Real World

We propose building-scale virtual reality (VR), a real-world extension method different from augmented reality (AR), that uses automatically generated indoor 3D point cloud maps. To make the entire indoor area a pose tracking area, we attach an RGB-D camera to a VR headset, collect data with it, and use deep learning to build a model learned from the data. This method is more accurate than the conventional RGB-D SLAM method. Furthermore, to modify the VR space according to the purpose, segmentation and replacement of the 3D point cloud are performed. This is hard to do in AR, but it is essential technology for VR to be used in actual real-world work. We describe a disaster simulation including virtual evacuation drills and virtual work environments as application examples.