Automated detection of COVID-19 using chest X-ray images and CT scans through multilayer- spatial convolutional neural networks

  1. Muhammad Irfan Khattak 1
  2. Mu’ath Al-Hasan 2
  3. Atif Jan 1
  4. Nasir Saleem 3
  5. Elena Verdú
  6. Numan Khurshid 4
  1. 1 University of Engineering & Technology, Peshawar
  2. 2 Al Ain University, United Arab Emirates
  3. 3 Gomal University
    info

    Gomal University

    Dera Ismāīl Khān, Pakistán

    ROR https://ror.org/0241b8f19

  4. 4 National Center of Artificial Intelligence UET-Peshawar
Revista:
IJIMAI

ISSN: 1989-1660

Año de publicación: 2021

Volumen: 6

Número: 6

Páginas: 15-24

Tipo: Artículo

DOI: 10.9781/IJIMAI.2021.04.002 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: IJIMAI

Objetivos de desarrollo sostenible

Resumen

The novel coronavirus-2019 (Covid-19), a contagious disease became a pandemic and has caused overwhelming effects on the human lives and world economy. The detection of the contagious disease is vital to avert further spread and to promptly treat the infected people. The need of automated scientific assisting diagnostic methods to identify Covid-19 in the infected people has increased since less accurate automated diagnostic methods are available. Recent studies based on the radiology imaging suggested that the imaging patterns on X-ray images and Computed Tomography (CT) scans contain leading information about Covid-19 and is considered as a potential automated diagnosis method. Machine learning and deep learning techniques combined with radiology imaging can be helpful for accurate detection of the disease. A deep learning approach based on the multilayer-Spatial Convolutional Neural Network for automatic detection of Covid-19 using chest X-ray images and CT scans is proposed in this paper. The proposed model, named as the Multilayer Spatial Covid Convolutional Neural Network (MSCovCNN), provides an automated accurate diagnostics for Covid-19 detection. The proposed model showed 93.63% detection accuracy and 97.88% AUC (Area Under Curve) for chest x-ray images and 91.44% detection accuracy and 95.92% AUC for chest CT scans, respectively. We have used 5-tiered 2D-CNN frameworks followed by the Artificial Neural Network (ANN) and softmax classifier. In the CNN each convolution layer is followed by an activation function and a Maxpooling layer. The proposed model can be used to assist the radiologists in detecting the Covid-19 and confirming their initial screening.

Referencias bibliográficas

  • H. Lau, V. Khosrawipour, P. Kocbach, A. Mikolajczyk, H. Ichii, J. Schubert, T. Khosrawipour, “Internationally lost COVID-19 cases,” Journal of Microbiology, Immunology and Infection, vol. 53, no. 3, 2020.
  • J. F. Zhang, K. Yan, H. H. Ye, J. Lin, J. J. Zheng, T. Cai, “SARS-CoV-2 turned positive in a discharged patient with COVID-19 arouses concern regarding the present standard for discharge,” International Journal of Infectious Diseases, vol. 97, pp. 212-214, 2020.
  • M. Dur-e-Ahmad, M. Imran, “Transmission Dynamics Model of Coronavirus COVID-19 for the Outbreak in Most Affected Countries of the World,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 2, pp. 7-10, 2020.
  • T. Singhal, “A review of coronavirus disease-2019 (COVID-19),” The Indian Journal of Pediatrics, vol. 87, no. 4, pp. 1-6, 2020.
  • C. C. Lai, T.P. Shih, W.C. Ko, H.J. Tang, P.R. Hsueh, “Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and corona virus disease-2019 (COVID-19): the epidemic and the challenges,” International journal of antimicrobial agents, vol. 55, no. 3, 105924, 2020.
  • J. Li, J.J. Li, X. Xie, X. Cai, J. Huang, X. Tian, H. Zhu, Game consumption and the 2019 novel coronavirus, The Lancet Infectious Diseases, vol. 20, no. 3, pp. 275-276, 2020.
  • J. M. Sharfstein, S.J. Becker, M.M. Mello, “Diagnostic testing for the novel coronavirus,” Jama, vol. 323, no. 15, pp. 1437-1438, 2020.
  • L. Chang, Y. Yan, L. Wang, “Coronavirus disease 2019: coronaviruses and blood safety,” Transfusion medicine reviews, vol. 34, no. 2, pp. 85-80, 2020.
  • M. A. Shereen, S. Khan, A. Kazmi, N. Bashir, R. Siddique. “COVID-19 infection: Origin, transmission, and characteristics of human coronaviruses,” Journal of Advanced Research, vol. 24, pp. 91-98, 2020.
  • F. A. Rabi, M. S. Al Zoubi, G.A. Kasasbeh, D.M. Salameh, A.D. Al-Nasser, “SARS-CoV-2 and coronavirus disease 2019: what we know so far,” Pathogens, vol. 9, no. 3, 231, 2020.
  • A. York, “Novel coronavirus takes flight from bats?,” Nature Reviews Microbiology, vol. 18, no. 4, pp. 191-191, 2020.
  • T. T. Y. Lam, M. H. H. Shum, H. C. Zhu, Y. G. Tong, X. B. Ni, Y.S. Liao,... G.M. Leung, “Identifying SARS-CoV-2 related coronaviruses in Malayan pangolins,” Nature, vol. 583, no. 7815, pp. 282-285, 2020.
  • M. Giovanetti, D. Benvenuto, S. Angeletti, M. Ciccozzi, “The first two cases of 2019‐nCoV in Italy: Where they come from?,” Journal of medical virology, vol. 92, no. 5, pp. 518-521, 2020.
  • M. L. Holshue, C. DeBolt, S. Lindquist, K. H. Lofy, J. Wiesman, H. Bruce, G. Diaz, “First case of 2019 novel coronavirus in the United States,” New England Journal of Medicine, vol. 382, pp. 929-936, 2020.
  • A. Bastola, R. Sah, A.J. Rodriguez-Morales, B.K. Lal, R. Jha, H.C. Ojha,... K. Morita, “The first 2019 novel coronavirus case in Nepal,” The Lancet Infectious Diseases, vol. 20, no. 3, pp. 279-280, 2020.
  • C. Rothe, M. Schunk, P. Sothmann, G. Bretzel, G. Froeschl, C. Wallrauch, M. Seilmaier, “Transmission of 2019-nCoV infection from an asymptomatic contact in Germany,” New England Journal of Medicine, vol. 382, no. 10, pp. 970-971, 2020.
  • L. T. Phan, T. V. Nguyen, Q.C. Luong, T.V. Nguyen, H.T. Nguyen, H.Q. Le, Q.D. Pham, “Importation and human-to-human transmission of a novel coronavirus in Vietnam,” New England Journal of Medicine, vol. 382, no. 9, pp. 872-874, 2020.
  • Coronavirus (COVID-19) Map. Available online: https://www.who.int/ (accessed on 6 June 2020).
  • World Health Organization; Coronavirus disease (COVID-19) advice for the public. Accessed on: April 11, 2020, https://www.who.int/ emergencies/diseases/novel-coronavirus-2019/advice-for-public
  • Centers for Disease Control and Prevention; 2019 Novel Coronavirus (2019-nCoV). Accessed on: April 11, 2020, https://www.cdc.gov/ coronavirus/2019-ncov/index.html
  • H. Shi, X. Han, N. Jiang, Y. Cao, O. Alwalid, J. Gu ... C. Zheng, “Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study,” The Lancet Infectious Diseases, vol. 20, no. 4, pp. 424- 434, 2020.
  • C. Huang, Y. Wang, X. Li, L. Ren, J. Zhao, Y. Hu, ... Z. Cheng, “Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China,” The lancet, vol. 395, no. 10223, pp. 497-506, 2020.
  • T. Lupia, S. Scabini, S. M. Pinna, G. Di Perri, F.G. De Rosa, S. Corcione, “2019-novel coronavirus outbreak: A new challenge,” Journal of Global Antimicrobial Resistance, vol. 21, pp. 22-27, 2020.
  • T, Rahmat, A. Ismail, S. Aliman, “Chest X-Rays Image Classification in Medical Image Analysis,” Applied Medical Informatics, vol. 40, no. 3-4, pp. 63-73, 2018.
  • I. M. Baltruschat, H. Nickisch, M. Grass, T. Knopp, A. Saalbach, “Comparison of deep learning approaches for multi-label chest X-ray classification,” Scientific reports, vol. 9, no.1, pp. 1-10, 2019.
  • M. Farooq, A. Hafeez, “Covid-resnet: A deep learning framework for screening of covid19 from radiographs,” arXiv preprint arXiv:2003.14395, 2020.
  • L. Wang, A. Wong, “COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images,” arXiv, arXiv-2003, 2020.
  • L. Li, L. Qin, Z. Xu, Y. Yin, X. Wang, B. Kong ... K. Cao, “Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT,” Radiology, vol. 296, no. 2, 200905, 2020.
  • T. Ai, Z. Yang, H. Hou, C. Zhan, C. Chen, C., W. Lv, ... L. Xia, “Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases,” Radiology, vol. 296, no. 2, pp. E32-E40, 2020.
  • S. Wang, B. Kang, J. Ma, X. Zeng, M. Xiao, J. Guo, ... B. Xu, “A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19),” MedRxiv.2020.
  • Y. Song, S. Zheng, L. Li, X. Zhang, X. Zhang, Z. Huang, ... Y. Chong, “Deep learning enables accurate diagnosis of novel coronavirus (COVID-19) with CT images,” medRxiv, 2020.
  • P.K. Sethy, S.K. Behera, “Detection of coronavirus disease (covid-19) based on deep features,” Preprints, 2020030300, 2020.
  • A. Narin, C. Kaya, Z. Pamuk, “Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks,” arXiv preprint arXiv:2003.10849, 2020.
  • F.A. Saiz, I. Barandiaran, “COVID-19 Detection in Chest X-ray Images using a Deep Learning Approach,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 2, pp. 11-14, 2020.
  • Y. Li, L. Xia, “Coronavirus disease 2019 (COVID-19): role of chest CT in diagnosis and management,” American Journal of Roentgenology, vol. 214, no. 6, pp. 1280-1286, 2020.
  • X. Xu, X. Jiang, C. Ma, P. Du, X. Li, S. Lv, L. Yu, ... L. Li, “A Deep Learning System to Screen Novel Coronavirus Disease 2019 Pneumonia,” Engineering, vol. 6, no. 10, pp. 1122-1129, 2020.
  • A. Abbas, M.M. Abdelsamea, M. M. Gaber, “Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network,” arXiv preprint arXiv:2003.13815, 2020.
  • R. Kumar, R. Arora, V. Bansal, V.J. Sahayasheela, H. Buckchash, J. Imran, ... B. Raman, “Accurate Prediction of COVID-19 using Chest X-Ray Images through Deep Feature Learning model with SMOTE and Machine Learning Classifiers,” medRxiv. 2020.
  • T. Tuncer, S. Dogan, F. Ozyurt, “An automated Residual Exemplar Local Binary Pattern and iterative ReliefF based corona detection method using lung X-ray image,” Chemometrics and Intelligent Laboratory Systems, vol. 203, 104054, 2020.
  • W. Zhao, Z. Zhong, X. Xie, Q. Yu, J. Liu, “Relation between chest CT findings and clinical conditions of coronavirus disease (COVID-19) pneumonia: a multicenter study,” American Journal of Roentgenology, vol. 214, no. 5, pp. 1072-1077, 2020.
  • J.P. Kanne, B.P. Little, J. H. Chung, B.M. Elicker, L.H. Ketai, “Essentials for radiologists on COVID-19: an update—radiology scientific expert panel,” Radiology, vol. 296, no. 2, 2020.
  • W. Kong, P.P. Agarwal, “Chest imaging appearance of COVID-19 infection,” Radiology: Cardiothoracic Imaging, vol. 2, no. 1, e200028, 2020.
  • Z. Y. Zu, M. D. Jiang, P.P. Xu, W. Chen, Q.Q. Ni, G.M. Lu, L.J. Zhang, “Coronavirus disease 2019 (COVID-19): a perspective from China,” Radiology, vol. 296, no. 2, pp. E15-E25, 2020.
  • P. N. Druzhkov, V.D. Kustikova, “A survey of deep learning methods and software tools for image classification and object detection,” Pattern Recognition and Image Analysis, vol. 26, no. 1, pp. 9-15, 2016.
  • X. Zhou, W. Gong, W. Fu, F. Du, “Application of deep learning in object detection,” in 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS), IEEE, May 2017, pp. 631-634.
  • K. Nguyen, C. Fookes, A. Ross, S. Sridharan, “Iris recognition with offthe-shelf CNN features: A deep learning perspective,” IEEE Access, vol. 6, no. 18848-18855, 2017
  • S. Milyaev, I. Laptev, “Towards reliable object detection in noisy images,” Pattern Recognition and Image Analysis, vol. 27, no. 4, pp. 713-722, 2017.
  • R. Ranjan, S. Sankaranarayanan, A. Bansal, N. Bodla, J.C. Chen, V.M. Patel, ... R. Chellappa, “Deep learning for understanding faces: Machines may be just as good, or better, than humans,” IEEE Signal Processing Magazine, vol. 35, no. 1, pp. 66-83, 2018.
  • M. Papakostas, T. Giannakopoulos, F. Makedon, V. Karkaletsis, “Shortterm recognition of human activities using convolutional neural networks,” in 2016 12th international conference on signal-image technology & internet-based systems (SITIS), IEEE, January 2016, pp. 302-307.
  • N. Yudistira, T. Kurita, “Gated spatio and temporal convolutional neural network for activity recognition: towards gated multimodal deep learning,” EURASIP Journal on Image and Video Processing, vol. 2017, 85, 2017.
  • J.P. Cohen, P. Morrison, L. Dao, K. Roth, T.Q. Duong, M. Ghassemi, “COVID-19 Image Data Collection: Prospective Predictions Are the Future,” arXiv:2006.11988, https://github.com/ieee8023/COVIDchestxray-dataset/
  • https://github.com/ieee8023/covid-chestxray-dataset
  • T. Rahman, M. Chowdhury, A. Khandakar, “COVID-19 Radiography Database,” https://www.kaggle.com/tawsifurrahman/covid19- radiography-database
  • J. Zhao, Y. Zhang, X. He, P. Xie, “COVID-CT-Dataset: a CT scan dataset about COVID-19,” arXiv preprint arXiv:2003.13865, 2020, https://github. com/UCSD-AI4H/COVID-CT
  • E. Soares, P. Angelov, S. Biaso, M.H. Froes, D.K. Abe, “SARS-CoV-2 CTscan dataset: A large dataset of real patients CT scans for SARS-CoV-2 identification,” medRxiv, 2020.
  • Y. Heryadi, H.L.H.S. Warnars, “Learning temporal representation of transaction amount for fraudulent transaction recognition using CNN, Stacked LSTM, and CNN-LSTM,” in 2017 IEEE International Conference on Cybernetics and Computational Intelligence (CyberneticsCom), Phuket, 2017, pp. 84-89.
  • C. Alippi, S. Disabato, M. Roveri, “Moving convolutional neural networks to embedded systems: the alexnet and VGG-16 case,” in 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), 2018, pp. 212-223.
  • P. Ballester, R.M. Araujo, “On the performance of GoogLeNet and AlexNet applied to sketches,” in Thirtieth AAAI Conference on Artificial Intelligence, 2016, pp. 1124-1128.
  • M. A. Friedl, C. E. Brodley, “Decision tree classification of land cover from remotely sensed data,” Remote sensing of environment, vol. 61, no. 3, pp. 399-409, 1997.
  • T. Hastie, S. Rosset, J. Zhu, H. Zou, “Multi-class adaboost. Statistics and its Interface,” vol. 2, no. 3, pp. 349-360, 2009.
  • S. J. Fong, G. Li, N. Dey, R.G. Crespo, E. Herrera-Viedma, “Finding an accurate early forecasting model from small dataset: A case of 2019- ncov novel coronavirus outbreak,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 1, pp. 132-140, 2020.
  • N. M. Nawi, W.H. Atomi, M.Z. Rehman, “The effect of data pre-processing on optimized training of artificial neural networks,” vol. 11, pp. 32-39, 2013.