3D Image Generation from X-Ray Projections Using Generative Adversarial Networks

The human brain can effortlessly imagine a 3D image from only 2D images with a little expertise and imagination, but for machines, this is not a trivial task. Because of this, reconstructing 3D images from 2D ones is a hot topic and has many applications. In this paper, we propose a Generative Adversarial Network (GAN)-based approach that generates CT-like images using pairs of orthogonal X-ray projections taken from different angles. In this work, a variety of orthogonal pairs from different angles, ranging from 0°&90° to 60°&150°, were considered as input to the 3D image generation model. The effectiveness of the proposed method was assessed by measuring the Structural Similarity Index (SSIM) and Peak Signal-to-Noise Ratio (PSNR), which resulted in values of 0.641 and 29.21, respectively. Furthermore, the model's ability to capture the respiratory motion in the input projections and reflect it in the generated images was also assessed. This work demonstrated the feasibility of generating CT-like images from X-ray projections captured from different orthogonal angles taking into consideration the respiratory motion exhibited in these projections.