Joint learning of local fingerprint and content modulation

This paper proposes learning a linear map with local content modulation for robust content fingerprinting. The goal is to estimate a data adapted linear map that provides bounded modulation distortion and features with targeted properties. A novel problem formulation is presented that jointly addresses the fingerprint learning and the content modulation. A solution by iterative alternating algorithm is proposed. The algorithm alternates between liner map update step and linear modulation estimate step. Global optimal solutions for the respective iterative steps are proposed, resulting in convergent algorithm with locally optimal solution. A computer simulation using local image patches, extracted from publicly available data set is provided. The advantages under additive white Gaussian noise (AWGN), lossy JPEG compression and projective geometrical transform distortions are demonstrated.