Dunhuang murals image inpainting method based on fusion classification pre-training model

Murals are an important part of China’s cultural heritage. Because of their age, Dunhuang murals have suffered from discoloration, fading and damage. With the development of computer image restoration technology, digital image processing provides strong support for mural restoration. Although there are many research results in the field of ancient mural images, there is no pre-trained model based on ancient mural images available for migration. There is a method for Dunhuang murals image restoration based on Generative Adversarial Network (GAN) with improved ResNet50 structure as an encoder in the generator. This research result proposes a generative adversarial network model with a parallel double convolutional extraction of deep features for the generator, combined with a ternary heterogeneous joint discriminator. On this basis, this paper proposes a binary classification task to distinguish ancient mural images from modern natural style images, so that the model pre-learns features such as color, texture, and structure of mural images, which are inputted into the restoration network as a priori information, in order to achieve the effect of reducing the probability of incomplete restoration of the model, and better generalization ability. The experimental results show that the method proposed in this paper has an overall improvement in the evaluation indexes such as Peak Signal to Noise Ratio(PSNR) and Structural Similarities(SSIM) when compared with other methods, and the restored images are more in line with human subjective vision, which proves the validity of the method.