Simultaneous High-speed Depth Measurement and Video Presentation using a Video-rate Projector

This paper proposes a method to simultaneously realize video presentation and high-speed depth measurement using a single projector-camera system with a general videorate projector. Some applications in the XR field require real-time depth measurement at high frame rates along with video projection. However, the quality of the video presentation will be degraded and depth measurement will be low speed when a video-rate projector is used as it is for both purposes at the same time. On the other hand, since the driving frequency of the DMD of a general DLP projector far exceeds the video rate, it has the potential to achieve high-speed depth measurement while presenting images by using a specialized projection strategy. We propose a method to decompose a target image into lowbit images and demonstrate that an actual system using the proposed method can perform depth measurement at $1,000 \mathrm{fps}$ while projecting images at the video rate.