Statistical multiplexing of H.264 programs

The advent of H.264/AVC is going to change the way digital television programs are broadcast. Each program can be independently encoded or jointly encoded resulting thus in a more efficient way to distribute the available channel bandwidth. This paper presents a combined coding scheme for multi-program video transmission in which the channel capacity is distributed among the programs according to the program complexities. A complexity bit rate control algorithm based on the structural similarity index (SSIM) is proposed. SSIM metric is presented under the hypothesis that the human visual system (HSV) is very specialized in extracting structural information from a video sequence but not in extracting the errors. Thus, a measurement on structural distortion should give a better correlation to the subjective impression. Current simulations have demonstrated very promising results showing that the algorithm can effectively control the complexity of the multi-program encoding process whilst improving overall subjective.