Skip to main content

2024 | OriginalPaper | Buchkapitel

Dsmk-DcSeg-Lap, a Generative Adversarial Network Guided by Dark-Chanel and Segmentation to Smoke Removal in Laparoscopic Images

verfasst von : Hugo Moreno, Sebastián Salazar-Colores, Luis M. Valentín, Gerardo Flores

Erschienen in: Applications of Generative AI

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this chapter, a computational approach is proposed to address the challenge of degraded visibility caused by smoke during laparoscopic surgery. The visualization of organs and tissues is hindered by the presence of smoke, which results from dissection tools. This, in turn, leads to potential errors and increased surgical duration, ultimately impacting patient outcomes. To overcome this issue, a novel neural architecture is introduced, which consists of two autoencoders trained using the generative neural network paradigm. The image segmentation on the laparoscopic image is performed by the first autoencoder, while the second autoencoder incorporates this segmented image as an additional fifth channel. To evaluate the effectiveness of the approach, comprehensive quantitative assessments are conducted, and the results are compared with state-of-the-art desmoking and dehazing techniques. Performance evaluation is carried out using commonly used metrics in the field. The superiority of the proposed method over existing approaches is demonstrated by the obtained results. This makes the method highly suitable for integration into medical systems using embedded devices.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rizzo, G., Cuccurullo, D., Iacobelli, G., & et al. (2019). Smoke evacuation systems in laparoscopic surgery: A systematic review and meta-analysis. Surgical Endoscopy, 33(11), 4507–4516. Rizzo, G., Cuccurullo, D., Iacobelli, G., & et al. (2019). Smoke evacuation systems in laparoscopic surgery: A systematic review and meta-analysis. Surgical Endoscopy, 33(11), 4507–4516.
2.
Zurück zum Zitat Bhatia, S., Singh, N., Kaur, S., & et al. (2020). Smoke management in laparoscopy: a comprehensive review. Journal of Minimal Access Surgery, 16(1), 18. Bhatia, S., Singh, N., Kaur, S., & et al. (2020). Smoke management in laparoscopy: a comprehensive review. Journal of Minimal Access Surgery, 16(1), 18.
3.
Zurück zum Zitat Fernandez-Ruiz, J., Perez-de Luque, A., Perez-Castellanos, J. L., & et al. (2021). Novel smoke evacuation systems for laparoscopy: A systematic review. Journal of Laparoendoscopic and Advanced Surgical Techniques, 31(1), 1–10. Fernandez-Ruiz, J., Perez-de Luque, A., Perez-Castellanos, J. L., & et al. (2021). Novel smoke evacuation systems for laparoscopy: A systematic review. Journal of Laparoendoscopic and Advanced Surgical Techniques, 31(1), 1–10.
4.
Zurück zum Zitat Smith, J., & Johnson, A. (2010). Smoke removal from images using adaptive filtering. IEEE Transactions on Image Processing, 19(5), 1125–1133. Smith, J., & Johnson, A. (2010). Smoke removal from images using adaptive filtering. IEEE Transactions on Image Processing, 19(5), 1125–1133.
5.
Zurück zum Zitat Johnson, R., & Lee, H. (2012). Image dehazing using non-linear techniques. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1674–1681). IEEE. Johnson, R., & Lee, H. (2012). Image dehazing using non-linear techniques. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1674–1681). IEEE.
6.
Zurück zum Zitat Brown, M. S. (2015). Multi-spectral deep learning for smoke detection in video. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2793–2801). IEEE. Brown, M. S. (2015). Multi-spectral deep learning for smoke detection in video. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2793–2801). IEEE.
7.
Zurück zum Zitat Bengio, Y., Courville, A., & Vincent, P. (2013). Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8), 1798–1828.CrossRef Bengio, Y., Courville, A., & Vincent, P. (2013). Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8), 1798–1828.CrossRef
8.
Zurück zum Zitat LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444.CrossRef LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444.CrossRef
9.
Zurück zum Zitat Goodfellow, I., & et al. (2014). Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS), 2672–2680. Goodfellow, I., & et al. (2014). Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS), 2672–2680.
10.
Zurück zum Zitat Smith, J., & Johnson, E. (2018). Physics-based smoke removal using deep neural networks. IEEE Transactions on Image Processing, 27(3), 1340–1353. Smith, J., & Johnson, E. (2018). Physics-based smoke removal using deep neural networks. IEEE Transactions on Image Processing, 27(3), 1340–1353.
11.
Zurück zum Zitat Lee, C., & et al. (2020). Image dehazing using domain adaptation. In Proceedings of the IEEE international conference on computer vision (ICCV) (pp. 1122–1130). IEEE. Lee, C., & et al. (2020). Image dehazing using domain adaptation. In Proceedings of the IEEE international conference on computer vision (ICCV) (pp. 1122–1130). IEEE.
12.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324.CrossRef LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324.CrossRef
13.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 1097–1105. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 1097–1105.
14.
Zurück zum Zitat Nair, V., & Hinton, G. E. (2010). Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (ICML-10) (pp. 807–814). Nair, V., & Hinton, G. E. (2010). Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (ICML-10) (pp. 807–814).
15.
Zurück zum Zitat Boureau, Y. -L., Ponce, J., & LeCun, Y. (2010). Theoretical analysis of feature pooling in visual recognition. In Proceedings of the 27th international conference on machine learning (ICML-10) (pp. 111–118). Boureau, Y. -L., Ponce, J., & LeCun, Y. (2010). Theoretical analysis of feature pooling in visual recognition. In Proceedings of the 27th international conference on machine learning (ICML-10) (pp. 111–118).
16.
Zurück zum Zitat Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In International conference on medical image computing and computer-assisted intervention (pp. 234–241). Springer. Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In International conference on medical image computing and computer-assisted intervention (pp. 234–241). Springer.
18.
Zurück zum Zitat Isola, P., Zhu, J. -Y., Zhou, T., & Efros, A. A. (2017). Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1125–1134). Isola, P., Zhu, J. -Y., Zhou, T., & Efros, A. A. (2017). Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1125–1134).
19.
Zurück zum Zitat Lee, S., Yun, S., Nam, J.-H., Won, C. S., & Jung, S.-W. (2016). A review on dark channel prior based image dehazing algorithms. EURASIP Journal on Image and Video Processing, 2016, 1–23.CrossRef Lee, S., Yun, S., Nam, J.-H., Won, C. S., & Jung, S.-W. (2016). A review on dark channel prior based image dehazing algorithms. EURASIP Journal on Image and Video Processing, 2016, 1–23.CrossRef
20.
Zurück zum Zitat Zhang, N., Zhang, L., & Cheng, Z. (2017). Towards simulating foggy and hazy images and evaluating their authenticity. In International conference on neural information processing (pp. 405–415). Springer. Zhang, N., Zhang, L., & Cheng, Z. (2017). Towards simulating foggy and hazy images and evaluating their authenticity. In International conference on neural information processing (pp. 405–415). Springer.
21.
Zurück zum Zitat He, K., Sun, J., & Tang, X. (2010). Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(12), 2341–2353. He, K., Sun, J., & Tang, X. (2010). Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(12), 2341–2353.
22.
Zurück zum Zitat Chandra, A., Singh, A., Kumar, R., & Dey, N. (2018). Dehazing of aerial images by dark channel and gamma correction. In 2018 3rd International conference and workshops on recent advances and innovations in engineering (ICRAIE) (pp. 1–7). IEEE. Chandra, A., Singh, A., Kumar, R., & Dey, N. (2018). Dehazing of aerial images by dark channel and gamma correction. In 2018 3rd International conference and workshops on recent advances and innovations in engineering (ICRAIE) (pp. 1–7). IEEE.
23.
Zurück zum Zitat He, K., Sun, J., & Tang, X. (2010). Guided image filtering. In K. Daniilidis, P. Maragos, & N. Paragios (Eds.), Computer vision—ECCV 2010 (pp. 1–14). Springer. He, K., Sun, J., & Tang, X. (2010). Guided image filtering. In K. Daniilidis, P. Maragos, & N. Paragios (Eds.), Computer vision—ECCV 2010 (pp. 1–14). Springer.
24.
Zurück zum Zitat Salazar-Colores, S., Jiménez, H. M., Ortiz-Echeverri, C. J., & Flores, G. (2020). Desmoking laparoscopy surgery images using an image-to-image translation guided by an embedded dark channel. IEEE Access, 8, 208898–208909.CrossRef Salazar-Colores, S., Jiménez, H. M., Ortiz-Echeverri, C. J., & Flores, G. (2020). Desmoking laparoscopy surgery images using an image-to-image translation guided by an embedded dark channel. IEEE Access, 8, 208898–208909.CrossRef
25.
Zurück zum Zitat Pfeiffer, M., Funke, I., Robu, M. R., Bodenstedt, S., Strenger, L., Engelhardt, S., Roß, T., Clarkson, M. J., Gurusamy, K., Davidson, B. R., & et al. (2019). Generating large labeled data sets for laparoscopic image processing tasks using unpaired image-to-image translation. In Proceedings of the 22nd international conference on medical image computing and computer assisted intervention–MICCAI 2019 (pp. 119–127), Shenzhen, China, October 13–17, 2019, Part V 22. Springer. Pfeiffer, M., Funke, I., Robu, M. R., Bodenstedt, S., Strenger, L., Engelhardt, S., Roß, T., Clarkson, M. J., Gurusamy, K., Davidson, B. R., & et al. (2019). Generating large labeled data sets for laparoscopic image processing tasks using unpaired image-to-image translation. In Proceedings of the 22nd international conference on medical image computing and computer assisted intervention–MICCAI 2019 (pp. 119–127), Shenzhen, China, October 13–17, 2019, Part V 22. Springer.
26.
Zurück zum Zitat Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012). No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21(12), 4695–4708.MathSciNetCrossRef Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012). No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21(12), 4695–4708.MathSciNetCrossRef
27.
Zurück zum Zitat Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012). Making a “completely blind’’ image quality analyzer. IEEE Signal Processing Letters, 20(3), 209–212.CrossRef Mittal, A., Moorthy, A. K., & Bovik, A. C. (2012). Making a “completely blind’’ image quality analyzer. IEEE Signal Processing Letters, 20(3), 209–212.CrossRef
28.
Zurück zum Zitat Moorthy, A. K., & Bovik, A. C. (2010). Perceptual image quality assessment using a representative set of images. IEEE Transactions on Image Processing, 19(8), 2368–2382. Moorthy, A. K., & Bovik, A. C. (2010). Perceptual image quality assessment using a representative set of images. IEEE Transactions on Image Processing, 19(8), 2368–2382.
29.
Zurück zum Zitat Saad, M. H., Bovik, A. C., & Charrier, C. (2012). Blind image quality assessment: A natural scene statistics approach in the DCT domain. In 2012 19th IEEE International conference on image processing (pp. 717–720). IEEE. Saad, M. H., Bovik, A. C., & Charrier, C. (2012). Blind image quality assessment: A natural scene statistics approach in the DCT domain. In 2012 19th IEEE International conference on image processing (pp. 717–720). IEEE.
30.
Zurück zum Zitat Zhu, J. -Y., Park, T., Isola, P., & Efros, A. A. (2017). Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision (pp. 2223–2232). Zhu, J. -Y., Park, T., Isola, P., & Efros, A. A. (2017). Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision (pp. 2223–2232).
31.
Zurück zum Zitat Park, T., Efros, A. A., Zhang, R., & Zhu, J. -Y. (2020). Contrastive learning for unpaired image-to-image translation. In Proceedings of the 16th European conference on Computer vision–ECCV 2020 (pp. 319–345), Glasgow, UK, August 23–28, 2020, Part IX 16. Springer. Park, T., Efros, A. A., Zhang, R., & Zhu, J. -Y. (2020). Contrastive learning for unpaired image-to-image translation. In Proceedings of the 16th European conference on Computer vision–ECCV 2020 (pp. 319–345), Glasgow, UK, August 23–28, 2020, Part IX 16. Springer.
32.
Zurück zum Zitat Engin, D., Genç, A., & Kemal Ekenel, H. (2018). Cycle-dehaze: Enhanced cyclegan for single image dehazing. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops (pp. 825–833). Engin, D., Genç, A., & Kemal Ekenel, H. (2018). Cycle-dehaze: Enhanced cyclegan for single image dehazing. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops (pp. 825–833).
33.
Zurück zum Zitat Pan, Y., Bano, S., Vasconcelos, F., Park, H., Jeong, T. T., & Stoyanov, D. (2022). DeSmoke-LAP: improved unpaired image-to-image translation for DeSmoking in laparoscopic surgery. International Journal of Computer Assisted Radiology and Surgery, 17(5), 885–893.CrossRef Pan, Y., Bano, S., Vasconcelos, F., Park, H., Jeong, T. T., & Stoyanov, D. (2022). DeSmoke-LAP: improved unpaired image-to-image translation for DeSmoking in laparoscopic surgery. International Journal of Computer Assisted Radiology and Surgery, 17(5), 885–893.CrossRef
Metadaten
Titel
Dsmk-DcSeg-Lap, a Generative Adversarial Network Guided by Dark-Chanel and Segmentation to Smoke Removal in Laparoscopic Images
verfasst von
Hugo Moreno
Sebastián Salazar-Colores
Luis M. Valentín
Gerardo Flores
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-46238-2_7

Premium Partner