Image Imputation with conditional generative adversarial networks captures clinically relevant imaging features on computed tomography

Abstract

Kidney cancer is among the top 10 most common malignancies in adults, and is commonly evaluated with four-phase computed tomography (CT) imaging. However, the presence of missing or corrupted images remains a significant problem in medical imaging that impairs the detection, diagnosis, and treatment planning of kidney cancer. Deep learning approaches through conditional generative adversarial networks (cGANs) have recently shown technical promise in the task of imputing missing imaging data from these four-phase studies. In this study, we explored the clinical utility of these imputed images. We utilized a cGAN trained on 333 patients, with the task of the cGAN being to impute the image of any phase given the other three phases. We tested the clinical utility on the imputed images of the 37 patients in the test set by manually extracting 21 clinically relevant imaging features and comparing them to their ground truth counterpart. All 13 categorical clinical features had greater than 85% agreement rate between true images and their imputed counterparts. This high accuracy is maintained when stratifying across imaging phases. Imputed images also show good agreement with true images in select radiomic features including mean intensity and enhancement. Imputed images possess the features characteristic of benign or malignant diagnosis at an equivalent rate to true images. In conclusion, imputed images from cGANs have large potential for clinical use due to their ability to retain clinically relevant qualitative and quantitative features.

Files

Additional details