An Extended Virtual Proxy Haptic Algorithm for Dexterous Manipulation in Virtual Environments

With the evolution of hand-based haptic interfaces, novel forms of controlled force feedback arise allowing multipoint interaction between virtual objects and the hand’s digits. With these advances, there must be an effective force display coupled with an intuitive visualization of the hand at its points of high manipulability. This is the basis for dexterous manipulation immersion in virtual environments. Still, there are challenges due to the complexity of force interaction, bandwidth limitations, and redundant visual configurations. In this paper, we present an extended proxy algorithm for digit-based interactions, which through configuration-based optimization, provides an efficient, robust, and visually plausible way to interact with virtual objects with a virtual hand. Additionally, we revisit a seldom-seen modality of haptic rendering, whole-hand kinesthetic feedback, with the Maestro exoskeleton in the implementation of our algorithm. We unify these methods and develop a CHAI3D module in a comprehensive visuo-haptic framework that was evaluated through demonstrations of joint-level haptic force data during interaction with static and dynamic objects alike. Our computationally-efficient approach sets the foundation for the visual display of in-hand virtual object manipulation with the effective rendering of stable haptic interactions under complex tasks.