Video Coding for Machines using Object Analysis and Standard Video Codecs

The paper presents a brief review of the current standardization activities in Video Coding for Machines (VCM), including the MPEG 2022 Call for Proposals for VCM. These activities and the conditions defined for this call are the background of the proposed technology for VCM. In this technology, a search for Regions of Interest (RoIs) is implemented in the encoder in order to find the areas where the objects are possibly located. The background (the areas outside RoIs) is simplified and retargeting is executed before the video is compressed. For low bitrates, the experimental results demonstrate significant improvements of the results for object detection, instant segmentation and object tracking as compared to the state-of-the-art VVC coding.