Feedback Control System for Exposure Optimization in High-Dynamic-Range Multimedia Sensing

We introduce the concept of coupled dynamic dynamic-range (D2R) compositing - that is, assembling sensor information, such as images or audio, from multiple dynamic-ranges that are allowed to move and change over time, as lighting conditions or sound conditions change over time in their amplitude-domain properties. We propose a feedback-control method to automatically adjust multiple exposure-value settings for HDR compositing, to increase the dynamic range of a sensory process, such as video capture. The method uses a cost function to express measurement uncertainty, and a "cross-uncertainty" metric between different exposures, fed into a dynamic control system. The system is designed to asymptotically approach an optimal distribution of camera exposure control settings, under varying lighting conditions and motion, to capture an extremely high dynamic range for HDR compositing.