Effects of Virtual Hand Representation on Interaction and Embodiment in HMD-based Virtual Environments Using Controllers

Many studies have been conducted in the past few years that focus on interaction and embodiment in the field of virtual reality. However, despite the recent widespread use and continuing rise of controller-based head-mounted display (HMD) hardware for VR, there is little research on the use of handheld controllers in this context. We explore the effects of different virtual hand representations on interaction and the user’s sense of embodiment, extending the work of Argelaguet et al. in 2016, in this case using controllers. We designed an experiment where users perform the task of selecting and moving a cube from and to specific positions on a table inside an immersive virtual environment, interacting with three representations: the abstract shape of a Sphere, the 3D model of the Controller, and a realistic human-looking Hand. For each representation, users were asked to perform the same task with and without obstacles (Brick Wall, Barbed Wire, Electric Current). Statistical analysis of the results show that although no significant differences were identified in the sense of agency, the users’ performance with the Sphere was significantly worse compared to the other two, and in the case of the positioning task the Controller outperformed the others. Additionally, the Hand generated the strongest sense of ownership, and it was the favorite representation.