
2023 · Journal of Orthopaedic Research
Can synthetic X-rays reproduce osteoarthritis features?
StyleGAN2-ADA had FID 2.96 against real images. Experts' real-versus-generated discrimination accuracies were 34%, 43%, 44%, 57% and 50%.
Results explained with study numbers
Enlarge FigureReal-versus-synthetic image discrimination accuracy for five experts.
Journal of Orthopaedic Research (2023). DOI: 10.1002/jor.25325 · Original explanatory chart based on reported data
The research question
Participants and Methods
Main Findings
Implications for clinical and surgical practice
Limitations
Let's put it briefly.
Which clinical question does this address?
The work addresses research-image scarcity and class imbalance. Synthetic images should remain separate from patient results, with quality and bias assessed against original data.
Keywords
- diagnostic imaging
- knee
- Artificial Intelligence
- Arthritis
- Retrospective Studies
- Knee Joint
- Radiography
- AI
Abstract · Original text
Gun Ahn, Byung Sun Choi, Sunho Ko, Changwung Jo, Hyuk-Soo Han, Myung Chul Lee, Du Hyun Ro. High-resolution knee plain radiography image synthesis using style generative adversarial network adaptive discriminator augmentation. Journal of orthopaedic research : official publication of the Orthopaedic Research Society. 2023;41(1):84-93. doi:10.1002/jor.25325.
In this retrospective study, 10,000 anteroposterior (AP) radiography of the knee from a single institution was used to create medical data set that are more balanced and cheaper to create. Two types of convolutional networks were used, deep convolutional GAN (DCGAN) and Style GAN Adaptive Discriminator Augmentation (StyleGAN2-ADA). To verify the quality of generated images from StyleGAN2-ADA compared to real ones, the Visual Turing test was conducted by two computer vision experts, two orthopedic surgeons, and a musculoskeletal radiologist. For quantitative analysis, the Fréchet inception distance (FID), and principal component analysis (PCA) were used. Generated images reproduced the features of osteophytes, joint space narrowing, and sclerosis. Classification accuracy of the experts was 34%, 43%, 44%, 57%, and 50%. FID between the generated images and real ones was 2.96, which is significantly smaller than another medical data set (BreCaHAD = 15.1). PCA showed that no significant difference existed between the PCs of the real and generated images (p > 0.05). At least 2000 images were required to make reliable images optimally. By performing PCA in latent space, we were able to control the desired PC that show a progression of arthritis. Using a GAN, we were able to generate knee X-ray images that accurately reflected the characteristics of the arthritis progression stage, which neither human experts nor artificial intelligence could discern apart from the real images. In summary, our research opens up the potential to adopt a generative model to synthesize realistic anonymous images that can also solve data scarcity and class inequalities.
The original paper.
High-resolution knee plain radiography image synthesis using style generative adversarial network adaptive discriminator augmentation
Gun Ahn, Byung Sun Choi, Sunho Ko, Changwung Jo, Hyuk-Soo Han, Myung Chul Lee, Du Hyun Ro
Journal of Orthopaedic Research · 2023