Label Correlation Guided Deep Multi-View Image Annotation

Automatic image annotation is an important technique which has been widely applied in many fields such as social network image analysis and retrieval, face recognition and so on. Multi-view image annotation aims to utilize multi-view complementary information to achieve more effective annotation results. However, the existing multi-view image annotation methods cannot well handle the complex and diversified multi-view feature, and the label correlation is also ignored. In this paper, we propose an image annotation method by integrating deep multi-view latent space learning and label correlation guided image annotation into a unified framework, which is termed as Label Correlation guided Deep Multi-view image annotation (LCDM) method. LCDM first learns a consistent multi-view representation via deep matrix factorization, which well captures multi-view complementary information. Then, label correlation is exploited to improve the discriminating power of the classifiers. We propose a unified objective function so that multi-view data representation and classifiers can be jointly learned. Extensive experimental results on various image datasets demonstrate the effectiveness of our method.