Magical Projector: Virtual Object Sharing Method among Multiple Users in a Mixed Reality Space

This paper proposes a method to convey virtual objects to other users and share them for enabling collaborative game in a mixed reality space. The use of mixed reality has gained prominence for collaborative game with multiple people in recent years, it, however, is difficult to grasp users each other's operations. In addition, it is difficult to instruct specific virtual objects to the opponents. These problems arise from the collaboration using mixed reality contents through head mount displays and tablet-type devices; These devices can not present the virtual objects coherently because the devices do not recognize the common coordinates, hence it prevents to share the virtual objects. Our proposed method intends to solve the problem by projecting a pointer to the real space using a handy projector. The projected pointer can be used as a clue for establishing the common coordinates. As an example of the method, we implemented a system that can overlaid arbitrary virtual objects at the intended positions and manipulate them using gestures by using projected pointers as markers for mixed reality using head mount display.