Framework and applications for mobile networks using synthetic multimedia

This paper describes a framework for the delivery of customised infotainment, including location-based services to mobile devices and tools for the creation of real-time interactive scalable synthetic multimedia content. Dead reckoning techniques are used to determine user positions within the multi-user environment, and potential visibility culling is used to determine what each user device must display. Within this environment, several areas of personalisation have been identified and applications are being developed to target these areas through the use of an individual's complete multimedia profile. The profiles are encoded, based on the MPEG-7 schema, and contain photo-realistic 3D models created using voxel-based or model-based techniques. To enhance the profile, methods are being developed for face localisation and extraction from images to be used in the profiles. Initial results show how aspects of the personalised profiles are used within the virtual environment.