Manipulating Virtual World with Props in Real-world

In order for a real-world tool and virtual space to interact naturally, we propose a new approach to provide the user with a sense of operation close to reality. Not only tactile feedback but also visual feedback is important for the interaction, and we have to create special devices. In this research, we present a system that makes it possible to use familiar hand-held tools as an operational interface. For example, painting on the surface of a virtual object with an actual spray, turning a virtual object with an actual screwdriver.