3D Point Cloud-Based Interaction System Bridging Physical Spaces in Virtual Environments

Thanks to advancement of IT technologies, VR technologies and VR interfaces have been proposed to enhance interaction in virtual spaces. Conventional interaction systems using 3D images are limited to communicating in a static space, reproduced in advance in a virtual space. For more realistic interaction, it is important to capture the physical space around the participants and reproduce it in the virtual space. However, such new interaction methods trigger new privacy concerns. This study aims to develop an immersive spatial sharing system based on point cloud technologies. A prototype system incorporating LiDAR cameras and a mechanism to hide private objects was tested with 41 participants using VR headsets. The study gathered 16 family responses, indicating the system’s utility and the variation in privacy concerns based on gender, IT familiarity, and age. These insights are crucial for developing privacy filters in spatial sharing systems, especially for Metaverse interactions. We demonstrate our proposed system enhancing spatial sharing communication with 3D point clouds. The system integrates distant spaces, such as the venue and laboratory, in a virtual world. Participants can experience interactions along the scenario of a remote cooking class using the privacy-aware spatial sharing system through VR headsets.