Processing math: 0%
AQuA: Analytical Quality Assessment for Optimizing Video Analytics Systems | IEEE Conference Publication | IEEE Xplore

AQuA: Analytical Quality Assessment for Optimizing Video Analytics Systems


Abstract:

Millions of cameras at edge are being deployed to power a variety of different deep learning applications. However, the frames captured by these cameras are not always pr...Show More

Abstract:

Millions of cameras at edge are being deployed to power a variety of different deep learning applications. However, the frames captured by these cameras are not always pristine - they can be distorted due to lighting issues, sensor noise, compression etc. Such distortions not only deteriorate visual quality, they impact the accuracy of deep learning applications that process such video streams. In this work, we introduce AQuA, to protect application accuracy against such distorted frames by scoring the level of distortion in the frames. It takes into account the analytical quality of frames, not the visual quality, by learning a novel metric, classifier opinion score, and uses a lightweight, CNN-based, object-independent feature extractor. AQuA accurately scores distortion levels of frames and generalizes to multiple different deep learning applications. When used for filtering poor quality frames at edge, it reduces high-confidence errors for analytics applications by 17%. Through filtering, and due to its low overhead (14ms), AQuA can also reduce computation time and average bandwidth usage by 25%.
Date of Conference: 14-17 December 2021
Date Added to IEEE Xplore: 16 February 2022
ISBN Information:
Conference Location: San Jose, CA, USA
No metrics found for this document.

1 Introduction

Video camera deployments are increasing rapidly, powering applications like city-scale traffic analytics, security and retail analytics. A recent report estimated the market size of video analytics to be 4.10 billion in 2020, and 20.80 billion by 2027 [43]. A CNBC study reported that by 2021, about one billion surveillance cameras will be ensuring our safety and security [8]. Figure 1 illustrates how such cameras can continuously capture high-resolution video of the real world and transmit it to application services running on nearby edge computing nodes or on the cloud. The exponential growth of camera deployments and video analytics applications can be attributed to two main reasons - deep learning, which is enabling accurate computer vision applications [36], and 5G, which is making low-latency and high-bandwidth communication possible [9], [54].

Work mostly done as an intern at NEC Laboratories America.

Work done when Utsav Drolia was a Researcher at NEC Laboratories America.

No metrics found for this document.

Contact IEEE to Subscribe

References

References is not available for this document.