SpatialPrivacy: Spatial Sharing for Remote Collaboration in Mixed Reality

Mixed Reality (MR) offers opportunities to greatly improve remote collaboration, given its ability to understand and reason about the spatial environment and to output multi-sensory feedback. Passthrough camera access, which is essential for MR applications to reason about the surrounding, is now available on major MR devices such as Microsoft’s HoloLens 2 and Apple’s Vision Pro. However, how to comfortably share our spatial environment to MR applications becomes an ever-more important question to address, given the wide variety of sensitive visual information it contains. In this paper, we present SpatialPrivacy, a framework that offers spatial control through indoor localization techniques and access control policies configured over digital replicas of the real-world space.