An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy

Journal article


Ali, S., Zhou, F., Braden, B., Bailey, A., Yang, S., Cheng, G., Zhang, P., Li, X., Kayser, M., Soberanis-Mukul, R., Albarqouni, S., Wang, X., Wang, C., Watanabe, S., Oksuz, I., Ning, Q., Yang, S., Khan, M.A., Gao, X., Realdon, S., Loshchenov, M., Schnabel, J., East, J., Wagnieres, G., Loschenov, V., Grisan, E., Daul, C., Blondel, W. and Rittscher, J. (2020). An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy. Scientific Reports. 10, p. 2748.
AuthorsAli, S., Zhou, F., Braden, B., Bailey, A., Yang, S., Cheng, G., Zhang, P., Li, X., Kayser, M., Soberanis-Mukul, R., Albarqouni, S., Wang, X., Wang, C., Watanabe, S., Oksuz, I., Ning, Q., Yang, S., Khan, M.A., Gao, X., Realdon, S., Loshchenov, M., Schnabel, J., East, J., Wagnieres, G., Loschenov, V., Grisan, E., Daul, C., Blondel, W. and Rittscher, J.
Abstract

We present a comprehensive analysis of the submissions to the first edition of the Endoscopy Artefact Detection challenge (EAD). Using crowd-sourcing, this initiative is a step towards understanding the limitations of existing state-of-the-art computer vision methods applied to endoscopy and promoting the development of new approaches suitable for clinical translation.
Endoscopy is a routine imaging technique for the detection, diagnosis and treatment of diseases in hollow-organs; the esophagus, stomach, colon, uterus and the bladder. However the nature of these organs prevent imaged tissues to be free of imaging artefacts such as bubbles, pixel saturation, organ specularity and debris, all of which pose substantial challenges for any quantitative analysis. Consequently, the potential for improved clinical outcomes through quantitative assessment of
abnormal mucosal surface observed in endoscopy videos is presently not realized accurately. The EAD challenge promotes awareness of and addresses this key bottleneck problem by investigating methods that can accurately classify, localize and segment artefacts in endoscopy frames as critical prerequisite tasks. Using a diverse curated multi-institutional, multi-modality, multi-organ dataset of video frames, the accuracy and performance of 23 algorithms were objectively ranked for artefact
detection and segmentation. The ability of methods to generalize to unseen datasets was also evaluated. The best performing methods (top 15%) propose deep learning strategies to reconcile variabilities in artefact appearance with respect to size, modality, occurrence and organ type. However, no single method outperformed across all tasks. Detailed analyses reveal the shortcomings of current training strategies and highlight the need for developing new optimal metrics to accurately quantify the clinical applicability of methods.

Year2020
JournalScientific Reports
Journal citation10, p. 2748
PublisherNature Research (part of Springer Nature)
ISSN2045-2322
Digital Object Identifier (DOI)doi:10.1038/s41598-020-59413-5
Web address (URL)https://doi.org/10.1038/s41598-020-59413-5
Publication dates
Print17 Feb 2020
Publication process dates
Accepted28 Jan 2020
Deposited29 Jan 2020
Accepted author manuscript
License
CC BY 4.0
File Access Level
Open
Page range1-21
Permalink -

https://openresearch.lsbu.ac.uk/item/88y91

Download files

Accepted author manuscript
301394_2_merged_1578520717_black.pdf
License: CC BY 4.0
File access level: Open

  • 85
    total views
  • 10
    total downloads
  • 0
    views this month
  • 1
    downloads this month

Export as

Related outputs

Preface to: EndoCV2020Computer Vision in Endoscopy
Ali, S, Daul, C, Rittscher, J, Stoyanov, D and Grisan, E (2020). Preface to: EndoCV2020Computer Vision in Endoscopy. CEUR Workshop Proceedings. 2595.
An assay system to evaluate riboflavin/UV-A corneal phototherapy efficacy in a porcine corneal organ culture model
Perazzi, A, Gomiero, C, Corain, Livio, Iacopetti, Ilaria, Grisan, Enrico, Lombardo, Marco, Lombardo, Giuseppe, Salvalaio, Gianni, Contin, Roberta, Patruno, Marco, Martinello, Tiziana and Peruffo, Antonella (2020). An assay system to evaluate riboflavin/UV-A corneal phototherapy efficacy in a porcine corneal organ culture model. Animals. 10, pp. 1-16.
In-vivo Barretts esophagus digital pathology stage classification through feature enhancement of confocal laser endomicroscopy
Ghatwary, N, Ahmed, A, Grisan, E, Jalab, H, Bidaut, L and Ye, X (2019). In-vivo Barretts esophagus digital pathology stage classification through feature enhancement of confocal laser endomicroscopy. J Med Imaging (Bellingham). 6 (1).
Real-time diameter of the fetal aorta from ultrasound
Savioli, Nicolò, Grisan, Enrico, Visentin, Silvia, Cosmi, Erich, Montana, Giovanni and Lamata, Pablo (2019). Real-time diameter of the fetal aorta from ultrasound. Neural Computing and Applications.
Does Quantification of Carotid Plaque Surface Irregularities Better Detect Symptomatic Plaques Compared to the Subjective Classification?
Rafailidis, V., Chryssogonidis, I., Grisan, E., Xerras, C., Cheimariotis, G-A., Tegos, T., Rafailidis, D., Sidhu, P. and Charitanti-Kouridou, A. (2019). Does Quantification of Carotid Plaque Surface Irregularities Better Detect Symptomatic Plaques Compared to the Subjective Classification? Journal of Ultrasound in Medicine. 38 (12), pp. 3163-3171.
An ultrasonographic multiparametric carotid plaque risk index associated with cerebrovascular symptomatology: A study comparing color Doppler imaging and contrast-enhanced ultrasonography
Rafailidis, V., Chryssogonidis, I., Xerras, C., Grisan, E., Cheimariotis, G-A., Tegos, T., Rafailidis, P.S., Sidhu, P.S. and Charitanti-Kouridou, A. (2019). An ultrasonographic multiparametric carotid plaque risk index associated with cerebrovascular symptomatology: A study comparing color Doppler imaging and contrast-enhanced ultrasonography. American Journal of Neuroradiology. 40 (6), pp. 1022-1028.
The motor cortex of the sheep: laminar organization, projections and diffusion tensor imaging of the intracranial pyramidal and extrapyramidal tracts
Peruffo, A., Corain, L., Bombardi, C., Centelleghe, C., Grisan, E., Graïc, J-M, Bontempi, P., Grandis, A. and Cozzi, B. (2019). The motor cortex of the sheep: laminar organization, projections and diffusion tensor imaging of the intracranial pyramidal and extrapyramidal tracts. Brain Structure and Function. 224 (5), pp. 1933-1946.
Building a reduced dictionary of relevant perfusion patterns from CEUS data for the classification of testis lesions
Favaron, T., Huang, D.Y., Christensen-Jeffries, K., Eckersley, R., Sidhu, P.S. and Grisan, E. (2019). Building a reduced dictionary of relevant perfusion patterns from CEUS data for the classification of testis lesions. 2019 IEEE 16th International Symposium on Biomedical Imaging. Venice, Italy 08 - 11 Apr 2019 Institute of Electrical and Electronics Engineers (IEEE). doi:10.1109/ISBI.2019.8759528
Deep Convolutional Neural Network for Survival Estimation of Amyotrophic Lateral Sclerosis patients
Grisan, E., Zandon`a, A. and Di Camillo, B. (2019). Deep Convolutional Neural Network for Survival Estimation of Amyotrophic Lateral Sclerosis patients. European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. Bruges, Belgium 24 - 26 Apr 2019 i6doc.
Prediction of Adverse Glycemic Events from Continuous Glucose Monitoring Signal
Gadaleta, M., Facchinetti, A., Grisan, E. and Rossi, M. (2019). Prediction of Adverse Glycemic Events from Continuous Glucose Monitoring Signal. IEEE Journal of Biomedical and Health Informatics. 23 (2).
Sparse Image Reconstruction for Contrast Enhanced Cardiac Ultrasound using Diverging Waves
Stanziola, A., Toulemonde, M., Papadopoulou, V., Corbett, R., Duncan, N., Grisan, E. and Tang, M-X. (2019). Sparse Image Reconstruction for Contrast Enhanced Cardiac Ultrasound using Diverging Waves. IEEE International Ultrasonics Symposium 2019. Glasgow 09 2009 - 06 Oct 2019 Institute of Electrical and Electronics Engineers (IEEE).
Super resolution ultrasound image filtering with machine learning to reduce the localization error
Harput, S., Fong, L.H., Stanziola, A., Zhang, G., Toulemonde, M., Zhou, J., Christensen-Jeffries, K., Brown, J., Eckersley, R., Grisan, E., Dunsby, C. and Tang, M. (2019). Super resolution ultrasound image filtering with machine learning to reduce the localization error. IEEE International Ultrasonics Symposium 2019. Glasgow 09 2009 - 06 Oct 2019 Institute of Electrical and Electronics Engineers (IEEE).
Temporal Convolution Networks for Real-Time Abdominal Fetal Aorta Analysis with Ultrasound
Savioli, N., Visentin, S., Cosmi, E., Grisan, E., Lamata, P. and Montana, G. (2018). Temporal Convolution Networks for Real-Time Abdominal Fetal Aorta Analysis with Ultrasound. Artificial Neural Networks and Machine Learning – ICANN 2018. Rhodes, Greece 04 - 07 Oct 2018 Springer. doi:10.1007/978-3-030-01421-6_15
Quantitative imaging by pixel-based contrast-enhanced ultrasound reveals a linear relationship between synovial vascular perfusion and the recruitment of pathogenic IL-17A-F+IL-23+ CD161+ CD4+ T helper cells in psoriatic arthritis joints
Fiocco, U, Stramare, R, Martini, V, Coran, A, Caso, F, Costa, L, Felicetti, M, Rizzo, G, Tonietto, M, Scanu, A, Oliviero, F, Raffeiner, B, Vezzù, M, Lunardi, F, Scarpa, R, Sacerdoti, D, Rubaltelli, L, Punzi, L, Doria, A and Grisan, E (2017). Quantitative imaging by pixel-based contrast-enhanced ultrasound reveals a linear relationship between synovial vascular perfusion and the recruitment of pathogenic IL-17A-F+IL-23+ CD161+ CD4+ T helper cells in psoriatic arthritis joints. Clinical Rheumatology. 36 (2), pp. 391-399.
Boosting the Battery Life of Wearables for Health Monitoring Through the Compression of Biosignals
Hooshmand, M, Zordan, D, Del Testa, D, Grisan, E and Rossi, M (2017). Boosting the Battery Life of Wearables for Health Monitoring Through the Compression of Biosignals. IEEE Internet of Things Journal. 4, pp. 1647-1662.
Detection of a slow-flow component in contrast-enhanced ultrasound of the synovia for the differential diagnosis of arthritis
Rizzo, G, Tonietto, M, Castellaro, M, Raffeiner, B, Coran, A, Fiocco, U, Stramare, R and Grisan, E (2017). Detection of a slow-flow component in contrast-enhanced ultrasound of the synovia for the differential diagnosis of arthritis. SPIE Medical Imaging. Orlando, FL, USA 11 - 16 Feb 2017 SPIE. doi:10.1117/12.2250818
Improving the quantification of contrast enhanced ultrasound using a Bayesian approach
Rizzo, G, Tonietto, M, Castellaro, M, Raffeiner, B, Coran, A, Fiocco, U, Stramare, R and Grisan, E (2017). Improving the quantification of contrast enhanced ultrasound using a Bayesian approach. SPIE Medical Imaging. Orlando, FL , USA 16 2016 - 11 Feb 2017 SPIE. doi:10.1117/12.2250195
Superpixel-based classification of gastric chromoendoscopy images
Boschetto, D and Grisan, E (2017). Superpixel-based classification of gastric chromoendoscopy images. SPIE Medical Imaging. Orlando, FL, USA 11 - 16 Feb 2017 SPIE. doi:10.1117/12.2254187
Boosted learned kernels for data-driven vesselness measure
Grisan, E (2017). Boosted learned kernels for data-driven vesselness measure. Proceedings Volume 10137, Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging; 101370Z (2017). Orlando, FL, USA 11 - 16 Feb 2017 SPIE. doi:10.1117/12.2250370
Cortical Thickness variability in Multiple Sclerosis: The role of lesion segmentation and filling
Palombit, A, Castellaro, M, Calabrese, M, Romualdi, C, Pizzini, FB, Montemezzi, S, Grisan, E and Bertoldo, A (2017). Cortical Thickness variability in Multiple Sclerosis: The role of lesion segmentation and filling. 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017). Melbourne, VIC, Australia 18 - 21 Apr 2017 pp. 792-795 doi:10.1109/ISBI.2017.7950637
From macro to nano: Linking quantitative CEUS perfusion parameters to CD4+ T cells subtypes in spondyloarthtitis
Grisan, E, Rizzo, G, Tonietto, M, Coran, A, Raffeiner, B, Scanu, A, Martini, V, Stramare, R and Fiocco, U (2017). From macro to nano: Linking quantitative CEUS perfusion parameters to CD4+ T cells subtypes in spondyloarthtitis. 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017). Melbourne, VIC, Australia 17 - 21 Apr 2017 IEEE. pp. 899-902 doi:10.1109/ISBI.2017.7950661
Grade and location of power doppler are predictive of damage progression in rheumatoid arthritis patients in clinical remission by anti-tumour necrosis factor α
Raffeiner, B, Grisan, E, Botsios, C, Stramare, R, Rizzo, G, Bernardi, L, Punzi, L, Ometto, F and Doria, A (2017). Grade and location of power doppler are predictive of damage progression in rheumatoid arthritis patients in clinical remission by anti-tumour necrosis factor α. Rheumatology (United Kingdom). 56, pp. 1320-1325.
Bayesian Quantification of Contrast-Enhanced Ultrasound Images with Adaptive Inclusion of an Irreversible Component
Rizzo, G, Tonietto, M, Castellaro, M, Raffeiner, B, Coran, A, Fiocco, U, Stramare, R and Grisan, E (2017). Bayesian Quantification of Contrast-Enhanced Ultrasound Images with Adaptive Inclusion of an Irreversible Component. IEEE Transactions on Medical Imaging. 36, pp. 1027-1036.
Tcf7l2 plays pleiotropic roles in the control of glucose homeostasis, pancreas morphology, vascularization and regeneration
Facchinello, N, Tarifeño-Saldivia, E, Grisan, E, Schiavone, M, Peron, M, Mongera, A, Ek, O, Schmitner, N, Meyer, D, Peers, B, Tiso, N and Argenton, F (2017). Tcf7l2 plays pleiotropic roles in the control of glucose homeostasis, pancreas morphology, vascularization and regeneration. Scientific Reports. 7.
Growth abnormalities of fetuses and infants
Cosmi, E, Grisan, E, Fanos, V, Rizzo, G, Sivanandam, S and Visentin, S (2017). Growth abnormalities of fetuses and infants. BioMed Research International. 2017.
A possible new approach in the prediction of late gestational hypertension: The role of the fetal aortic intima-media thickness
Visentin, S, Londero, AP, Camerin, M, Grisan, E and Cosmi, E (2017). A possible new approach in the prediction of late gestational hypertension: The role of the fetal aortic intima-media thickness. Medicine (United States). 96.
Automatic classification of small bowel mucosa alterations in celiac disease for confocal laser endomicroscopy
Boschetto, D, Di Claudio, G, Mirzaei, H, Leong, R and Grisan, E (2016). Automatic classification of small bowel mucosa alterations in celiac disease for confocal laser endomicroscopy. Medical Imaging 2016: Biomedical Applications in Molecular, Structural, and Functional Imaging. San Diego, United States 27 Feb - 03 Mar 2016 SPIE. doi:10.1117/12.2217183
Automatic classification of endoscopic images for premalignant conditions of the esophagus
Boschetto, D, Gambaretto, G and Grisan, E (2016). Automatic classification of endoscopic images for premalignant conditions of the esophagus. Medical Imaging 2016: Biomedical Applications in Molecular, Structural, and Functional Imaging. San Diego, United States 27 Feb - 03 Mar 2016 doi:10.1117/12.2216826
Superpixel-based automatic segmentation of villi in confocal endomicroscopy
Boschetto, D, Mirzaei, H, Leong, RWL and Grisan, E (2016). Superpixel-based automatic segmentation of villi in confocal endomicroscopy. 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI). Las Vegas, NV, USA 24 - 27 Feb 2016 pp. 168-171 doi:10.1109/BHI.2016.7455861