One Shot Face Image Style Transfer Method Based on GAN

Style transformation on face images has traditionally been a popular research area in the field of computer vision, and its applications are quite extensive. Currently, the more mainstream schemes include Generative Adversarial Network (GAN)-based image generation as well as style transformation and Stable diffusion method. In 2019, the NVIDIA team proposed StyleGAN, which is a relatively mature scheme for generating real faces as well as face feature blending. The whole StyleGAN model is trained based on the Flickr-Faces-HQ Dataset (FFHQ) dataset, the This is a large dataset, so the model takes a long time to train. My aim is to form a One-shot stylized face image generator, which means that only one reference face and one stylized face need to be input, and a brand-new face with a mixture of features can be generated in a short training time. This is inspired by the existing research result JoJoGAN, which learns a style mapper from a single example of the style. JoJoGAN uses a GAN inversion procedure and StyleGAN's style-mixing property to produce a substantial paired dataset from a single example of the style. This paper will make improvements to JoJoGAN, including improving the encoder that utilizes the GAN Inversion method to generate latent codes for image features, and the random mixing of latent codes to produce a more refined paired dataset.