completed2024 – 2025

Robust surgical tool segmentation with state-space vision models

This exploratory collaboration investigated state-space vision models for robust surgical tool segmentation under realistic visual corruptions.

Project teaser
Laparoscopic scene from a CC BY figure; the smoke and the instrument mask are illustrative. Images: Haitao Li et al., Wikimedia Commons, CC BY 4.0.

Abstract

This exploratory collaboration investigated state-space vision models for robust surgical tool segmentation under realistic visual corruptions. In collaboration with Kyung Hee University, we participated in the MICCAI EndoVis 2024 SegSTRONG-C challenge, benchmarking robustness to non-adversarial corruptions such as smoke, bleeding, and illumination changes. The proposed Vision Mamba–UNet approach achieved competitive performance across corruption types and ranked 7th overall among international submissions.

Perspective

The project supported early exploration of state-space models in medical image analysis and international doctoral mentorship. A jointly submitted DAAD exchange proposal, although not funded, laid the groundwork for continued collaboration and future joint research activities.

Partner institutions

Publications 1

SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarial Generated Corruptions--An EndoVis' 24 Challenge

Hao Ding, Yuqian Zhang, Tuxun Lu, Ruixing Liang, Hongchao Shu, Lalithkumar Seenivasan, Yonghao Long, Qi Dou, Cong Gao, Yicheng Leng, Seok Bong Yoo, Eung-Joo Lee, Zijian Wu, Yuxin Chen, Septimiu E. Salcudean, Samra Irshad, Shadi Albarqouni, Seong Tae Kim, Yueyi Sun, An Wang, Long Bai, Hongliang Ren, Ihsan Ullah, Ho-Gun Ha, Attaullah Khan, Hyunki Lee, Satoshi Kondo, Satoshi Kasai, Kousuke Hirasawa, Sita Tailor, Ricardo Sanchez-Matilla, Imanol Luengo, Tianhao Fu, Jun Ma, Bo Wang, Marcos Fernández-Rodríguez, Estevao Lima, João L. Vilaça, Negin Ghamsarian, Klaus Schoeffmann, Raphael Sznitman, Mathias Unberath

IEEE Transactions on Medical Imaging, 2026

Journal Q1IF 12.4 ❝ 23 Interventional Robust surgical tool …