JAMIA Open. 2024 May 2;7(2):ooae035. doi: 10.1093/jamiaopen/ooae035. eCollection 2024 Jul.

ABSTRACT

OBJECTIVE: Machine learning (ML) will have a large impact on medicine and accessibility is important. This study’s model was used to explore various concepts including how varying features of a model impacted behavior.

MATERIALS AND METHODS: This study built an ML model that classified chest X-rays as normal or abnormal by using ResNet50 as a base with transfer learning. A contrast enhancement mechanism was implemented to improve performance. After training with a dataset of publicly available chest radiographs, performance metrics were determined with a test set. The ResNet50 base was substituted with deeper architectures (ResNet101/152) and visualization methods used to help determine patterns of inference.

RESULTS: Performance metrics were an accuracy of 79%, recall 69%, precision 96%, and area under the curve of 0.9023. Accuracy improved to 82% and recall to 74% with contrast enhancement. When visualization methods were applied and the ratio of pixels used for inference measured, deeper architectures resulted in the model using larger portions of the image for inference as compared to ResNet50.

DISCUSSION: The model performed on par with many existing models despite consumer-grade hardware and smaller datasets. Individual models vary thus a single model’s explainability may not be generalizable. Therefore, this study varied architecture and studied patterns of inference. With deeper ResNet architectures, the machine used larger portions of the image to make decisions.

CONCLUSION: An example using a custom model showed that AI (Artificial Intelligence) can be accessible on consumer-grade hardware, and it also demonstrated an example of studying themes of ML explainability by varying ResNet architectures.

PMID:38699648 | PMC:PMC11064095 | DOI:10.1093/jamiaopen/ooae035