Empowering Semantic Segmentation With Selective Frequency Enhancement and Attention Mechanism for Tampering Detection

Nowadays, massive amounts of multimedia contents are exchanged in our daily life, while tampered images are also flooding the social networks. Tampering detection is therefore becoming increasingly important for multimedia integrity, and it is generally realized by designing specific convolutional neural networks. From a new perspective, this article proposes two pluggable modules for empowering existing semantic segmentation models for tampering detection. First, a selective frequency enhancement (SFE) module is developed to suppress the semantic information and selectively enhance the tamper information. Second, a boundary enhanced attention (BEA) module is designed to highlight the edge information of tempered area. Our SFE and BEA modules are combined with five mainstream semantic segmentation networks for performance evaluation. The experiment results demonstrate that our modules are able to empower the semantic segmentation networks for tampering detection, and their combinations even perform better than state-of-the-art algorithms in certain datasets.