Performance Evaluation and Comparison of Transfer Learning Models in Chest X-Ray Image Classification Using Deep Neural Networks
Keywords:
X-ray image classification, Learning transfer, ResNet50, MobileNetV2,, VGG16, Deep Neural NetworkAbstract
Detection of pulmonary diseases from X-ray images is one of the most significant challenges in medicine and deep learning. Traditional image analysis techniques are not efficient enough due to their reliance on manual features and functional limitations. Recent years have seen tremendous advancements in this area in deep neural networks (DNNs) and transfer learning models. This study aims to compare the performance of three popular chest (lung) X-ray (CXR) image classification models: ResNet50, MobileNetV2, and VGG16. Therefore, a dataset containing CXR images was initially prepared and preprocessed (normalized) by ImageDataGenerator. The dataset was then split into two sets: training (80%) and validation (20%). Then, the abovementioned transfer learning models were individually implemented and trained using this data[set]. The model performance was evaluated based on the following criteria: accuracy, confusion matrix, and classification report(s). The experimental results indicated all three models had acceptable image classification performance. ResNet50 exhibited higher accuracy in the validation dataset and consequently outperformed the other models. Also, MobileNetV2 was a suitable option for real-time applications due to its higher speed and smaller volume. On the contrary, VGG16 showed lower accuracy due to its older structure and lower complexity. Based on the results, the pulmonary disease diagnosis process could be effectively accelerated and its accuracy could be increased by adopting transfer learning models. Future research is recommended to employ hybrid models and more modern techniques like Transformers to enhance the results.
References
A. A. Reshi et al., "An efficient CNN model for COVID‐19 disease detection based on x‐ray image classification," Complexity, vol. 2021, no. 1, p. 6621607, 2021. [Online]. Available: https://doi.org/10.1155/2021/6621607.
J. Fachrel, A. A. Pravitasari, I. N. Yulita, M. N. Ardhisasmita, and F. Indrayatna, "Enhancing an imbalanced lung disease x-ray image classification with the CNN-LSTM model," Applied Sciences, vol. 13, no. 14, p. 8227, 2023. [Online]. Available: https://doi.org/10.3390/app13148227.
E. Choi et al., "Quantum machine learning for additive manufacturing process monitoring," Manufacturing Letters, vol. 41, pp. 1415-1422, 2024/10/1/ 2024, doi: 10.1016/j.mfglet.2024.09.168.
M. Gupta, K. Rajnish, and V. Bhattacharya, "Effectiveness of Ensemble Classifier Over State-Of-Art Machine Learning Classifiers for Predicting Software Faults in Software Modules," in Machine Learning, Image Processing, Network Security and Data Sciences: Select Proceedings of 3rd International Conference on MIND 2021, January 2023, pp. 77-88, doi: 10.1007/978-981-19-5868-7_7.
T. Hussain, J. Hong, and J. Seok, "A Hybrid Deep Learning and Machine Learning-Based Approach to Classify Defects in Hot Rolled Steel Strips for Smart Manufacturing," Computers, Materials and Continua, vol. 80, no. 2, pp. 2099-2119, 2024/8/15/ 2024, doi: 10.32604/cmc.2024.050884.
A. Yang, Y. Bai, T. Xue, Y. Li, and J. Li, "A novel image steganography algorithm based on hybrid machine learning and its application in cyberspace security," Future Generation Computer Systems, vol. 145, pp. 293-302, 2023, doi: https://doi.org/10.1016/j.future.2023.03.035.
G. M. M. Alshmrani, Q. Ni, R. Jiang, H. Pervaiz, and N. M. Elshennawy, "A deep learning architecture for multi-class lung diseases classification using chest X-ray (CXR) images," Alexandria Engineering Journal, vol. 64, pp. 923-935, 2023. [Online]. Available: https://doi.org/10.1016/j.aej.2022.10.053.
H. Moujahid, B. Cherradi, O. E. Gannour, L. Bahatti, O. Terrada, and S. Hamida, "Convolutional neural network based classification of patients with pneumonia using X-ray lung images," Advances in Science, Technology and Engineering Systems Journal, vol. 5, no. 5, pp. 167-175, 2020. [Online]. Available: https://doi.org/10.25046/aj050522.
V. Thamilarasi and R. Roselin, "Automatic classification and accuracy by deep learning using cnn methods in lung chest X-ray images," in In IOP Conference Series: Materials Science and Engineering, February 2021, vol. 1055, 1 ed., p. 012099. [Online]. Available: https://doi.org/10.1088/1757-899X/1055/1/012099.
A. Gopatoti and P. Vijayalakshmi, "CXGNet: A tri-phase chest X-ray image classification for COVID-19 diagnosis using deep CNN with enhanced grey-wolf optimizer," Biomedical Signal Processing and Control, vol. 77, p. 103860, 2022. [Online]. Available: https://doi.org/10.1016/j.bspc.2022.103860.
M. Nahiduzzaman et al., "Parallel CNN-ELM: A multiclass classification of chest X-ray images to identify seventeen lung diseases including COVID-19," Expert Systems with Applications, vol. 229, p. 120528, 2023. [Online]. Available: https://doi.org/10.1016/j.eswa.2023.120528.
H. Louati, S. Bechikh, A. Louati, A. Aldaej, and L. B. Said, "Evolutionary optimization for CNN compression using thoracic X-ray image classification," in In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, July 2022: Cham: Springer International Publishing, pp. 112-123. [Online]. Available: https://doi.org/10.1007/978-3-031-08530-7_10.
F. Hussein et al., "Hybrid clahe-cnn deep neural networks for classifying lung diseases from x-ray acquisitions," Electronics, vol. 11, no. 19, p. 3075, 2022. [Online]. Available: https://doi.org/10.3390/electronics11193075.
T. Gao and G. Wang, "Chest X-ray image analysis and classification for COVID-19 pneumonia detection using Deep CNN," medRxiv, 2020-08 2020. [Online]. Available: https://doi.org/10.21203/rs.3.rs-64537/v2https://doi.org/10.21203/rs.3.rs-64537/v1https://doi.org/10.1101/2020.08.20.20178913.
T. Rahman et al., "Transfer learning with deep convolutional neural network (CNN) for pneumonia detection using chest X-ray," Applied Sciences, vol. 10, no. 9, p. 3233, 2020. [Online]. Available: https://doi.org/10.3390/app10093233.
A. Giełczyk, A. Marciniak, M. Tarczewska, and Z. Lutowski, "Pre-processing methods in chest X-ray image classification," PLOS ONE, vol. 17, no. 4, p. e0265949, 2022. [Online]. Available: https://doi.org/10.1371/journal.pone.0265949.
M. Sorić, D. Pongrac, and I. Inza, "Using convolutional neural network for chest X-ray image classification," in In 2020 43rd International Convention on Information, Communication and Electronic Technology (MIPRO), September 2020: IEEE, pp. 1771-1776. [Online]. Available: https://doi.org/10.23919/MIPRO48935.2020.9245376.
