Search-and-Attack: Temporally Sparse Adversarial Perturbations on Videos | IEEE Journals & Magazine | IEEE Xplore

Search-and-Attack: Temporally Sparse Adversarial Perturbations on Videos


Visualization of Section Search Algorithm. For each section, only one frame is chosen based on the surrogate loss J. This visualization is an example of T/N = 8.

Abstract:

Modern neural networks are known to be vulnerable to adversarial attacks in various domains. Although most attack methods usually densely change the input values, recent ...Show More

Abstract:

Modern neural networks are known to be vulnerable to adversarial attacks in various domains. Although most attack methods usually densely change the input values, recent works have shown that deep neural networks (DNNs) are also vulnerable to sparse perturbations. Spatially sparse attacks on images or frames of a video are proven effective but the temporally sparse perturbations on videos have been less explored. In this paper, we present a novel framework to generate a temporally sparse adversarial attack, called Search-and-Attack scheme, on videos. The Search-and-Attack scheme first retrieves the most vulnerable frames and then attacks only those frames. Since identifying the most vulnerable set of frames involves an expensive combinatorial optimization problem, we introduce alternative definitions or surrogate objective functions: Magnitude of the Gradients (MoG) and Frame-wise Robustness Intensity (FRI). Combining them with iterative search schemes, extensive experiments on three public benchmark datasets (UCF, HMDB, and Kinetics) show that the proposed method achieves comparable performance to state-of-the-art dense attack methods.
Visualization of Section Search Algorithm. For each section, only one frame is chosen based on the surrogate loss J. This visualization is an example of T/N = 8.
Published in: IEEE Access ( Volume: 9)
Page(s): 146938 - 146947
Date of Publication: 28 October 2021
Electronic ISSN: 2169-3536

Funding Agency:


References

References is not available for this document.