This study explores an automated framework to assist the recognition of hemorrhage traces and bleeding lesions in video streams of small bowel capsule endoscopy (SBCE). The proposed methodology aims to achieve fast image control (<10 minutes), save valuable time of the physicians, and enable high performance diagnosis. A specialized elimination algorithm excludes all identical consecutive frames by utilizing the difference of gray levels in pixel luminance. An image filtering algorithm is proposed based on an experimentally calculated bleeding index and blood-color chart, which inspects all remaining frames of the footage and identifies pixels that reflect active or potential hemorrhage in color. The bleeding index and blood-color chart are estimated of the chromatic thresholds in RGB and HSV color spaces, and have been extracted after experimenting with more than 3200 training images, derived from 99 videos of a pool of 138 patients. The dataset has been provided by a team of expert gastroenterologist surgeons, who have also evaluated the results. The proposed algorithms are tested on a set of more than 1000 selected frame samples from the entire 39 testing videos, to a prevalence of 50% pathologic frames (balanced dataset). The frame elimination of identical and consecutive frames achieved a reduction of 36% of total frames. The best statistical performance for diagnosis of positive pathological frames from a video stream is achieved by utilizing masks in the HSV color model, with sensitivity up to 99%, precision 94.41% to a prevalence of 50%, accuracy up to 96.1%, FNR 1%, FPR 6.8%. The estimated blood-color chart will be clinically validated and used in feature extraction schemes supporting machine learning ML algorithms to improve the localization potential.
References
[1]
Liu, J. and Yuan, X. (2008) Obscure Bleeding Detection in Endoscopy Images Using Support Vector Machines. Optimization and Engineering, 10, 289-299. https://doi.org/10.1007/s11081-008-9066-y
[2]
Yuan, Y., Li, B. and Meng, M.Q.-H. (2016) Bleeding Frame and Region Detection in the Wireless Capsule Endoscopy Video. IEEE Journal of Biomedical and Health Informatics, 20, 624-630.
https://doi.org/10.1109/JBHI.2015.2399502
[3]
Ghosh, T., Fattah, S.A. and Wahid, K.A. (2018) Color Histogram of Block Statistics for Automatic Bleeding Detection in Wireless Capsule Endoscopy Video. IEEE Journal of Translational Engineering in Health and Medicine, 6, Article ID: 1800112, 12 p. https://doi.org/10.1109/JTEHM.2017.2756034
[4]
Hill, B.,, Roger, T. and Vorhagen, F.W. (1997) Comparative Analysis of the Quantization of Color Spaces on the Basis of the CIELAB Color-Difference Formula. ACM Transactions on Graphics (TOG), 16, 109-154.
https://doi.org/10.1145/248210.248212
[5]
Boal Cavalho, P., Magalhaes, J., Dias de Caste, F., Monteiro, S., Rosa, B., Moreira, M.J. and Cotter, J. (2017) Suspected Blood Indicator in Capsule Endoscopy: A Valuable Tool for Gastrointestinal Bleeding Diagnosis. Arquivos de Gastroenterologia, 54, 16-20. https://doi.org/10.1590/s0004-2803.2017v54n1-03
[6]
Boreczky, J.S. and Rowe, L.A. (1996) Comparison of Video Shot Boundary Detection Techniques. Journal of Electronic Imaging, 5, 122–128. https://doi.org/10.1117/12.238675
[7]
Li, B. and Meng, M.Q.-H. (2009) Computer-Aided Detection of Bleeding Regions for Capsule Endoscopy Images. IEEE Transactions on Biomedical Engineering, 56, 1032-1039.
https://doi.org/10.1109/TBME.2008.2010526
[8]
Sainju, S., Bui, F.M. and Wahid, K. (2013) Bleeding Detection in Wireless Capsule Endoscopy Based on Color Features from Histogram Probability. 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), Regina, 5-8 May 2013, 1-4. https://doi.org/10.1109/CCECE.2013.6567779
[9]
Ghosh, T., Fattah, S.A., Shahnaz, C. and Wahid, K.A. (2014) An Automatic Bleeding Detection Scheme in Wireless Capsule Endoscopy Based on Histogram of an RGB-Indexed Image. 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, 26-30 August 2014, 4683-4686.
https://doi.org/10.1109/EMBC.2014.6944669
[10]
Ghosh, T., Bashar, S.K., Fattah, S.A., Shahnaz, C. and Wahid, K.A. (2014) A Feature Extraction Scheme from Region of Interest of Wireless Capsule Endoscopy Images for Automatic Bleeding Detection. 2014 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Noida, 15-17 December 2014, 000256-000260. https://doi.org/10.1109/ISSPIT.2014.7300597