Encoder Optimization Information SEI Message for Identifying Optimization Objectives and Methods

This paper presents the Encoder Optimization Information (EOI) SEI message, which was recently included in the Versatile Supplemental Enhancement Information (VSEI) version 4 draft standard and is ongoing work within the Joint Video Experts Team (JVET) group. As the use of video content diversifies, there is an increasing need to apply preprocessing/task-driven encoding to optimize the coded bitstream for its intended use. Such optimization may be targeted for human viewing, machine analysis tasks, or both. Additionally, for better utilization of the coded bitstream, tailoring optimization for intended uses allows for the exclusion of unnecessary information, potentially reducing bitrate and enhancing compression efficiency. The EOI SEI message is designed to contain information about the optimization applied during the video encoding process and the intended usages of such optimization. Decoders may utilize the information provided by the EOI SEI message to effectively use video content that best fits their specific requirements and conditions.