Generative Zero-shot Image Classification based on Generative Feature Constraint

Zero-shot learning (ZSL) utilizes semantic information that is auxiliary information to transfer knowledge from seen classes to unseen classes, thereby realizing the recognition of unseen classes. The generative methods train the model to generate pseudo image features for the unseen classes, thus transforming ZSL into a supervised learning problem. However, the classification performances of these methods still suffer from weak generalization. To address this issue, the paper proposes a novel Generative Adversarial Network based on Generative Feature Constraint (GFCGAN). First, based on the LsrGAN [1], a semantic constraint module is added to restrict the generated image features by keeping the semantic information consistent. Then, in the case of keeping the semantic relationships between classes consistent, the generated image features of unseen classes are farther away from the feature prototypes of their most similar classes in both semantic and feature space so as to train the generative model and generate high-quality pseudo image features. Finally, the trained classifier is used to classify images of unseen classes. Experiments on standard datasets verify the effectiveness of our model and achieve good results.