Generative Adversarial Networks with Radiomics Supervision for Lung Lesion Generation

Data-driven methods for lesion generation are quickly emerging due to the need for realistic imaging targets for image quality assessment and virtual clinical trials. We proposed a generative adversarial network (GAN) architecture for conditional generation of lung lesions based on user-specified classes of lesion size and solidity. The network consists of two discriminators, one for volumetric lesion data, and one for radiomics features derived from the lesion volume. A Wasserstein loss with gradient penalty was adopted for each discriminator. Training data were drawn from contoured and annotated lesions from a public lung CT database. Four quantitative evaluation methods were devised to assess the network performance: 1) overfitting (similarity between generated and real lesions), 2) diversity (similarity among generated lesions), 3) conditional consistency (capability of generating lesions according to user-specified classes), and 4) similarity in distributions of various lesion properties between the generated and real lesions. Ablation studies were also performed to investigate the importance of individual network component. The proposed network was found to generate lesions that resemble real lesions by visual inspection. Solid lesions are distinct from non-solid ones, and lesion sizes largely correspond to their specified classes. With a classifier trained on real lesions, the classification accuracies of generated and real lesions in both solid and non-solid classes are similar. Radiomics features of generated and real lesions were found to have similar distributions, indicated by the relatively low Kullback–Leibler (KL) divergence values. Furthermore, the correlations between pairwise radiomics features in generated lesions were comparable to those of real lesions. The proposed network presents a promising approach for generating realistic lesions with clinically relevant features crucial for the comprehensive assessment of medical imaging systems.