Collaborative Guidance System Using Multi-gaze History and Shared Photograph Collection

In this paper, we propose a collaborative guidance system which provides information extracted from a shared photo collection based on a user's context. The user's gaze history is used to determine the user's situation in the real world. In our proposed system, we use a photograph viewpoint logging (PVL) system, which was previously developed to record the real world as photographs with viewpoint information (based on the photographer's position and direction of gaze). In the prototype of the PVL system, a user terminal consisting of a mobile phone with an attached motion sensor, a GPS sensor, and a notebook PC is used for logging the position and orientation of the mobile phone. Based on the PVL system, we design the collaborative guidance system by using a multi-gaze history and the shared photograph collection. After a user takes two or three photographs consecutively, the collaborative guidance system provides useful and well-processed content based on the user situation.