A real-time collaboration-enabled Mobile Augmented Reality system with semantic multimedia

Mobile Augmented Reality (MAR) enables overlays of semantically-enriched multimedia on video streams of smart phone cameras. These new ways to interact with digital objects via position and 3D movement can be helpful for on-site professional communities. However, current MAR applications lack real-time collaborative features. Moreover, blending multimedia semantics in collaborative MAR is still challenging. In this paper, we present a mobile real-time semantic multimedia-based collaborative system with augmented reality features based on open standards like XMPP and MPEG-7. The prototype system is evaluated in the digital documentation of historical sites for cultural heritage management. The evaluation results indicate increased productivity and awareness within on-site professional communities.