A novel true three-dimension display multi-touch system

In this paper, we present a novel human-computer interaction method based on the true three-dimension display, design a true three-dimension display multi-touch system based on Perspecta 3D display system, and realize the software algorithm. Vision-based Frustrated Total Internal Reflection (FTIR) multi-touch technique is used to get the positions where the users touch the domed acrylic of the true 3D display. And then, the system analyzes the finger movements to determine the specific gestures including zoom, move, rotation, etc. The analyzed interactive data is imported into the true 3D rendering algorithm module. After that, the rendering module based on SpatialGL framework realizes the real-time interaction with the virtual 3D objects.