Low bit-rate video compression with neural networks and temporal subsampling

In this paper we describe a novel neural network technique for video compression, using a "point-process" type neural network model we have developed which is closer to biophysical reality and is mathematically much more tractable than standard models. Our algorithm uses an adaptive approach based upon the users' desired video quality Q, and achieves compression ratios of up to 500:1 for moving gray-scale images, based on a combination of motion detection, compression, and temporal subsampling of frames. This leads to a compression ratio of over 1000:1 for full-color video sequences with the addition of the standard 4:1:1 spatial subsampling ratios in the chrominance images. The signal-to-noise ratio ranges from 29 dB to over 34 dB. Compression is performed using a combination of motion detection, neural networks, and temporal subsampling of frames. A set of neural networks is used to adaptively select the desired compression of each picture block as a function of the reconstruction quality. The motion detection process separates out regions of the frame which need to be retransmitted. Temporal subsampling of frames, along with reconstruction techniques, lead to the high compression ratios.