Thoracic diseases pose significant risks to an individual's chest health and are among the most perilous medical diseases. They can impact either one or both lungs, which leads to a severe impairment of a person’s ability to breathe normally. Some notable examples of such diseases encompass pneumonia, lung cancer, coronavirus disease 2019 (COVID-19), tuberculosis, and chronic obstructive pulmonary disease (COPD). Consequently, early and precise detection of these diseases is paramount during the diagnostic process. Traditionally, the primary methods employed for the detection involve the use of X-ray imaging or computed tomography (CT) scans. Nevertheless, due to the scarcity of proficient radiologists and the inherent similarities between these diseases, the accuracy of detection can be compromised, leading to imprecise or erroneous results. To address this challenge, scientists have turned to computer-based solutions, aiming for swift and accurate diagnoses. The primary objective of this study is to develop two machine learning models, utilizing single-task and multi-task learning frameworks, to enhance classification accuracy. Within the multi-task learning architecture, two principal approaches exist soft parameter sharing and hard parameter sharing. Consequently, this research adopts a multi-task deep learning approach that leverages CNNs to achieve improved classification performance for the specified tasks. These tasks, focusing on pneumonia and COVID-19, are processed and learned simultaneously within a multi-task model. To assess the effectiveness of the trained model, it is rigorously validated using three different real-world datasets for training and testing.
References
[1]
Guendel, S., Ghesu, F.C., Grbic, S., Gibson, E., Georgescu, B., Maier, A. and Comaniciu, D. (2019) Multi-Task Learning for Chest X-Ray Abnormality Classification on Noisy Labels.
[2]
Alom, M.Z., Rahman, M., Nasrin, M.S., Taha, T.M. and Asari, V.K. (2020) COVID_ MTNet: COVID-19 Detection with Multi-Task Deep Learning Approaches. https://arxiv.org/abs/2004.03747
[3]
Farag, A.T., Abd El-Wahab, A.R., Nada, M., Abd El-Hakeem, M.Y., Mahmoud, O.S., Rashwan, R.K. and El Sallab, A. (2020) MultiCheXNet: A Multi-Task Learning Deep Network for Pneumonia-Like Diseases Diagnosis from X-Ray Scans. https://arxiv.org/abs/2008.01973
[4]
Haque, P., Wang, A. and Terzopoulos, D. (2021) Multimix: Sparingly-Supervised, Extreme Multitask Learning from Medical Images. IEEE 18th International Symposium on Biomedical Imaging (ISBI), Nice, 13-16 April 2021, 693-696. https://doi.org/10.1109/ISBI48211.2021.9434167
[5]
Varela-Santos, S. and Melin, P. (2020) Classification of X-Ray Images for Pneumonia Detection Using Texture Features and Neural Networks. In: Castillo, O., Melin, P. and Kacprzyk, J., Eds., Intuitionistic Type-2 Fuzzy Logic Enhancements in Neural Optimization Algorithms: Theory Applications, Springer, Berlin, 237-253. https://doi.org/10.1007/978-3-030-35445-9_20
[6]
Tuncer, T., Ozyurt, F., Dogan, S. and Subasi, A. (2021) A Novel COVID-19 and Pneumonia Classification Method Based on F-Transform. Chemometrics Intelligent Laboratory Systems, 210, Article ID: 104256. https://doi.org/10.1016/j.chemolab.2021.104256
[7]
Sharma, H., Jain, J.S., Bansal, P. and Gupta, S. (2020) Feature Extraction and Classification of Chest X-Ray Images Using CNN to Detect Pneumonia. 10th International Conference on Cloud Computing, Data Science & Engineering, Noida, 29-31 January 2020, 227-231. https://doi.org/10.1109/Confluence47617.2020.9057809
[8]
Danilov, V., et al. (2021) COVID-19/Pneumonia Classification Based on Guided Attention. https://doi.org/10.21203/rs.3.rs-149472/v1
[9]
Luz, V., et al. (2021) Towards an Effective and Efficient Deep Learning Model for COVID-19 Patterns Detection in X-Ray Images. Research on Biomedical Engineering, 38, 149-162. https://doi.org/10.1007/s42600-021-00151-6
[10]
Haghanifar, A., Majdabadi, M.M., Choi, Y., Deivalakshmi, S. and Ko, S. (2022) Covid-Cxnet: Detecting COVID-19 in Frontal Chest X-Ray Images Using Deep Learning. Multimedia Tools Applications, 81, 30615-30645. https://doi.org/10.1007/s11042-022-12156-z
[11]
Bhattacharyya, A., Bhaik, D., Kumar, S., Thakur, P., Sharma, R. and Pachori, R.B. (2022) A Deep Learning-Based Approach for Automatic Detection of COVID-19 Cases Using Chest X-Ray Images.Biomedical Signal Processing and Control, 71, Article ID: 103182. https://doi.org/10.1016/j.bspc.2021.103182
[12]
Crawshaw, M. (2020) Multi-Task Learning with Deep Neural Networks: A Survey. https://arxiv.org/abs/2009.09796
[13]
Khobragade, S., Tiwari, A., Patil, C. and Narke, V. (2016) Automatic Detection of Major Lung Diseases Using Chest Radiographs and Classification by the Feed-Forward Artificial Neural Network. IEEE 1stInternationalConference on Power Electronics, Intelligent Control and Energy Systems (ICPEICES), Delhi, 4-6 July 2016, 1-5. https://doi.org/10.1109/ICPEICES.2016.7853683
[14]
Guan, Q., Huang, Y., Zhong, Z., Zheng, Z., Zheng, L. and Yang, Y. (2018) Diagnose Like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification. https://arxiv.org/abs/1801.09927
[15]
Rajpurkar, P., Irvin, J., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., Langlotz, C., Shpanskaya, K., Lungren, M.P. and Andrew, Y.N. (2017) Chexnet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning. https://arxiv.org/abs/1711.05225
[16]
Vandenhende, S., Georgoulis, S., Gansbeke, W.V., Proesmans, M., Dai, D. and Gool, L.V. (2021) Multi-Task Learning for Dense Prediction Tasks: A Survey. Computer Vision and Pattern Recognition, 44, 3614-3633. https://doi.org/10.1109/TPAMI.2021.3054719
[17]
Udeshani, K.A.G., Meegama, G. and Fernando, T.G.I. (2011) Statistical Feature-Based Neural Network Approach for the Detection of Lung Cancer in Chest X-Ray Images. International Journal of Image Processing, 5, 425-434.
[18]
Aledhari, M., Joji, S., Hefeida, M. and Saeed, F. (2019) Optimized CNN-Based Diagnosis System to Detect Pneumonia from Chest Radiographs. IEEE International Conference on Bioinformatics and Biomedicine (BIBM), San Diego, 18-21 November 2019, 2405-2412. https://doi.org/10.1109/BIBM47256.2019.8983114
[19]
Liu, P., Qiu, X. and Huang, X. (2017) Adversarial Multi-Task Learning for Text Classification. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, 30 July-4 August 2017, 1-10. https://doi.org/10.18653/v1/P17-1001
[20]
Maninis, K.K., Radosavovic, I. and Kokkinos, I. (2019) Attentive Single-Tasking of Multiple Tasks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, 15-20 June 2019, 1851-1860. https://doi.org/10.1109/CVPR.2019.00195
[21]
Sinha, A., Chen, Z., Badrinarayanan, V. and Rabinovich, A.J. (2018) Gradient Adversarial Training of Neural Networks. https://arxiv.org/abs/1806.08028
[22]
Hemdan, E.E.-D., Shouman, M.A. and Karar, M.E. (2020) Covidx-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images. https://arxiv.org/abs/2003.11055
[23]
Tang, Y., Wang, X., Harrison, A.P., Lu, L., Xiao, J. and Summers, R.M. (2018) Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographs. In: Shi, Y., Suk, H.I. and Liu, M., Eds., Machine Learning in Medical Imaging. MLMI 2018. Lecture Notes in Computer Science, Springer, Cham. https://doi.org/10.1007/978-3-030-00919-9_29
[24]
Liu, H., et al. (2019) SDFN: Segmentation-Based Deep Fusion Network for Thoracic Disease Classification in Chest X-Ray Images. Computerized Medical Imaging and Graphics, 75, 66-73. https://doi.org/10.1016/j.compmedimag.2019.05.005
[25]
Varshni, D., Thakral, K., Agarwal, L., Nijhawan, R. and Mittal, A. (2019) Pneumonia Detection Using CNN-Based Feature Extraction. IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), Coimbatore, 20-22 February 2019, 1-7. https://doi.org/10.1109/ICECCT.2019.8869364
[26]
Wesley, O., Haddad, R.J. and Moore, D.L. (2019) Pneumonia Radiograph Diagnosis Utilizing Deep Learning Network. 2nd International Conference on Electronic Information and Communication Technology (ICEICT), Harbin, 20-22 January 2019, 763-767.
[27]
Zhang, X., Han, L., Sobeih, T., Han, L., Dempsey, N., Lechareas, S., Tridente, A., Chen, H. and White, S. (2021) CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 Pneumonia with Chest X-Ray Images. https://arxiv.org/abs/2110.10813
[28]
Ibrahim, D.M., Elshennawy, N.M. and Sarhan, A.M. (2021) Deep-Chest: Multi-Classification Deep Learning Model for Diagnosing COVID-19, Pneumonia, and Lung Cancer Chest Diseases. Computers in Biology and Medicine, 132, Article ID: 104348. https://doi.org/10.1016/j.compbiomed.2021.104348
[29]
Goncharov, M., Pisov, M., Shevtsov, A., Shirokikh, B., Kurmukov, A., Blokhinc, I., Cherninac, V., Solovev, A. Gombolevskiy, V., Morozov, S. and Belyaev, M. (2021) CT-Based COVID-19 Triage: Deep Multitask Learning Improves Joint Identification and Severity Quantification. Medical Image Analysis,71, Article ID: 102054. https://doi.org/10.1016/j.media.2021.102054
[30]
Mooney, P. (2018) Kaggle Chest X-Ray Images (Pneumonia) Dataset. https://www.kaggle.com/datasets/paultimothymooney/chest-xray-pneumonia
[31]
Guo, P., Lee, C.Y. and Ulbricht, D. (2020) Learning to Branch for Multi-Task Learning. Proceedings of the 37th International Conference on Machine Learning, 13-18 July 2020, PMLR 119.
[32]
Baxter, J. (1997) A Bayesian/Information-Theoretic Model of Learning to Learn via Multiple-Task Sampling. Machine Learning, 28, 7-39. https://doi.org/10.1023/A:1007327622663
[33]
Jain, R., Nagrath, P., Kataria, G., Kaushik, V.S. and Hemanth, D.J. (2020) Pneumonia Detection in Chest X-Ray Images Using Convolutional Neural Networks and Transfer Learning. Measurement, 165, Article ID: 108046. https://doi.org/10.1016/j.measurement.2020.108046
[34]
Dey, N., Zhang, Y.-D., Rajinikanth, V., Pugalenthi, R. and Raja, N. (2021) Customized VGG19 Architecture for Pneumonia Detection in Chest X-Rays. Pattern Recognition Letters, 143, 67-74. https://doi.org/10.1016/j.patrec.2020.12.010
[35]
Jahan, N., Anower, M.S. and Hassan, R. (2021) Automated Diagnosis of Pneumonia from the Classification of Chest X-Ray Images Using the Efficientnet. International Conference on Information and Communication Technology for Sustainable Development (ICICT4SD), Dhaka, 27-28 February 2021, 235-239. https://doi.org/10.1109/ICICT4SD50815.2021.9397055
[36]
Chatterjee, R., Chatterjee, A. and Halder, R. (2021) An Efficient Pneumonia Detection from the Chest X-Ray Images. In: Prateek, M., et al., Eds., Proceedings of International Conference on Machine Intelligence and Data Science Applications: MIDAS 2020, Springer, Berlin, 779-789. https://doi.org/10.1007/978-981-33-4087-9_63
[37]
Zhang, J., Chng, C.B., Chen, X., Wu, C., Zhang, M., Xue, Y. and Jiang, J. (2020) Detection and Classification of Pneumonia from Lung Ultrasound Images. 5thInternational Conference on Communication, Image and Signal Processing (CCISP), Chengdu, 13-15 November 2020, 294-298. https://doi.org/10.1109/CCISP51026.2020.9273469
[38]
Chaudhary, S., Sadbhawna, S., Jakhetiya, V., Subudhi, B.N., Baid, U. and Guntuku, S.C. (2021) Detecting COVID-19 and Community-Acquired Pneumonia Using Chest CT Scan Images with Deep Learning. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, 6-11 June 2021, 8583-8587. https://doi.org/10.1109/ICASSP39728.2021.9414007
[39]
Ko, H., Chung, H., Kim, K.W., Shin, Y.S., Kang, S.J., Lee, J.H., Kim, Y.J., Kim, N.Y., Jung, H.S., Kang, W.S. and Lee, J. (2020) COVID-19 Pneumonia Diagnosis Using a Simple 2D Deep Learning Framework with a Single Chest CT Image: Model Development and Validation. Journal of Medical Internet Research, 22, e19569. https://doi.org/10.2196/19569
[40]
Chaudhary, Y., Mehta, M., Sharma, R., Gupta, D., Khanna, A. and Rodrigues, J.J. (2020) Efficient-CovidNet: Deep Learning-Based COVID-19 Detection from Chest X-Ray Images. IEEEInternational Conference on E-Health Networking, Application &Services (HEALTHCOM), Shenzhen, 1-2 March 2020, 1-6.
[41]
Nishio, M., Noguchi, S., Matsuo, H. and Murakami, T.J. (2020) Automatic Classification between COVID-19 Pneumonia, Non-COVID-19 Pneumonia, and the Healthy on Chest X-Ray Image: A Combination of Data Augmentation Methods. Scientific Reports, 10, Article No. 17532. https://doi.org/10.1038/s41598-020-74539-2
[42]
Monshi, M.M.A., Poon, J., Chung, V. and Monshi, F.M. (2021) CovidXrayNet: Optimizing Data Augmentation and CNN Hyperparameters for Improved COVID-19 Detection from CXR. Computers in Biology and Medicine, 133, Article ID: 104375. https://doi.org/10.1016/j.compbiomed.2021.104375
[43]
Al-Zahrani, N.N. and Hedjar, R. (2022) Comparison Study of Deep-Learning Architectures for Classification of Thoracic Pathology. 13th International Conference on Information and Communication Systems (ICICS), Irbid, 21-23 June 2022, 192-198. https://doi.org/10.1109/ICICS55353.2022.9811150
[44]
Bao, G., Chen, H., Liua, T., Gong, G., Yin, Y., Wang, L. and Wang, X. (2022) COVID-MTL: Multitask Learning with Shift3D and Random-Weighted Loss for COVID-19 Diagnosis and Severity Assessment. Pattern Recognition, 124, Article ID: 108499. https://doi.org/10.1016/j.patcog.2021.108499
[45]
Rahman, T., Chowdhury, M.E.H., Khandakar, A., Islam, K.R., Islam, K.F., Mahbub, Z.B., Kadir, M.A. and Kashem, S. (2022) Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection Using Chest X-Ray. Applied Sciences, 10, Article No. 3233. https://doi.org/10.3390/app10093233
