New Interface Using Palm and Fingertip without Marker for Ubiquitous Environment

We developed new interactive display system called the palm display. Our prototype system shows the image of graphical user interface on the palm and allows the user to have interaction with it using fingertip as they manipulate a common mobile device with stylus pen. We implemented this system using image processing technology and employed common projector and a networked PTZ camera. The feature of our prototype is that the system does not require user to wear any specific marker and not ask user to use additional device. In this paper, we describe the details of the palm display system and explain several issues regarding challenges in implementation and show the result of our preliminary user test.