A temporal reference framework for multimedia synchronization

The synchronization problem for audio/visual reproduction has consumed engineers time since the advent of recorded audio and images and the first multimedia productions. As computers have evolved to support programmed reproduction of multimedia information, the complexity but not the character or interest have changed. In the digital domain, synchronization problems exist due to data distribution and communications, random events caused by human-computer interaction, and general computer and communications performance limitations. This rich research domain has led to numerous approaches to the modeling and execution of multimedia synchronization scenarios. Unfortunately, these approaches are difficult to compare and evaluate due to their varied theoretical bases and modeling techniques. We develop a uniform, theoretical foundation for discussing multimedia synchronization and temporal specification. We propose a temporal reference framework and use it to compare existing temporal specification schemes and their relationships to multimedia synchronization. The ensuing comparison of existing specification and synchronization techniques demonstrates the utility of the framework.