Interacting Automultiscopic 3D With Haptic Paint Brush in Immersive Room

In this paper, we propose an interactive artwork system with automultiscopic 3D and haptic paint brush in an immersive room. Our system consists of a 81-view automultiscopic display, a handheld haptic paint brush, and a large-scale color palette station in a CAVE-like cubic room filled with the visual scene of the artwork. The 81-view rendering and multiplexing technology is applied by setting up the virtual cameras in the off-axis layout. The haptic paint brush is designed and implemented using a 2D array of multiple piezoelectric actuators. It provides the tactile feedback of spatial distance information between a virtual brush and a distal 3D object displayed on the automultiscopic display for the precise control of the brush when it is interacting with automultiscopic 3D. We demonstrate a proof-of-concept system that integrates a classic artwork into an innovative interactive system using novel multimedia and interactive technologies and evaluate our system using the handheld haptic brush for its performance and usability to enhance the user experiences.