Full-Scale Visualization of a Person on a Movable Transparent Screen

We propose to visualize pre-recorded activity of a person on a movable transparent screen for in-situ reviewing of his/her activity in augmented reality fashion. Activity of the target person was taken as a video by a surveillance camera. Viewers can watch the activity in the scene as if it happened there because segmented image of the target person was projected onto a human-size transparent screen and other static objects around the target person can be visible throughout the transparent screen. Our final goal is to move the transparent screen by mounting it on a small robot and moves the robot to follow the target person in the video. On the way to the final goal, we currently assume that the viewers move the screen manually so as to pose the screen at the same location of the target person in the video. A tracking method of the transparent screen in the scene is devised by utilizing projector-camera calibration and simple infrared marker tracking.