Video2Force: Experiencing Object Motion in Video with Dynamic Force Feedback based on Bio-Inspired Sensing and Processing

In this work, we propose Video2Force, a framework that can estimate the video object motion and its resulting “force” by leveraging the emerging bio-inspired vision sensors for low-complexity and low-latency visual information processing. While the user watches video, the estimated force is “delivered” to the user's sensation with dynamic force feedback via emerging haptic gloves, synchronized with the video content. Consequently, the user is enabled to experience the “virtual existence” of the video object and its motion. Preliminary experimental results demonstrate that Video2Force is feasible and can enhance the users’ presence in video experience.