Abstract:This paper introduces the ``SurgT: Surgical Tracking" challenge which was organised in conjunction with MICCAI 2022. There were two purposes for the creation of this challenge: (1) the establishment of the first standardised benchmark for the research community to assess soft-tissue trackers; and (2) to encourage the development of unsupervised deep learning methods, given the lack of annotated data in surgery. A dataset of 157 stereo endoscopic videos from 20 clinical cases, along with stereo camera calibration parameters, have been provided. Participants were assigned the task of developing algorithms to track the movement of soft tissues, represented by bounding boxes, in stereo endoscopic videos. At the end of the challenge, the developed methods were assessed on a previously hidden test subset. This assessment uses benchmarking metrics that were purposely developed for this challenge, to verify the efficacy of unsupervised deep learning algorithms in tracking soft-tissue. The metric used for ranking the methods was the Expected Average Overlap (EAO) score, which measures the average overlap between a tracker's and the ground truth bounding boxes. Coming first in the challenge was the deep learning submission by ICVS-2Ai with a superior EAO score of 0.617. This method employs ARFlow to estimate unsupervised dense optical flow from cropped images, using photometric and regularization losses. Second, Jmees with an EAO of 0.583, uses deep learning for surgical tool segmentation on top of a non-deep learning baseline method: CSRT. CSRT by itself scores a similar EAO of 0.563. The results from this challenge show that currently, non-deep learning methods are still competitive. The dataset and benchmarking tool created for this challenge have been made publicly available at <a class="link-external link-https" href="https://surgt.grand-challenge.org/" rel="external noopener nofollow">this https URL</a>.

CATARACTS: Challenge on automatic tool annotation for cataRACT surgery

2020 CATARACTS Semantic Segmentation Challenge

Cataract-1K: Cataract Surgery Dataset for Scene Segmentation, Phase Recognition, and Irregularity Detection

Phase-Informed Tool Segmentation for Manual Small-Incision Cataract Surgery

Cataract-1K Dataset for Deep-Learning-Assisted Analysis of Cataract Surgery Videos

Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networks

Multicentric exploration of tool annotation in robotic surgery: lessons learned when starting a surgical artificial intelligence project

SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy Challenge

Real-time analysis of cataract surgery videos using statistical models

CholecTriplet2022: Show me a tool and tell me the triplet — An endoscopic vision challenge for surgical action triplet detection

CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection

DeepPhase: Surgical Phase Recognition in CATARACTS Videos

SurgT challenge: Benchmark of Soft-Tissue Trackers for Robotic Surgery

Real-Time Surgical Tool Detection in Minimally Invasive Surgery Based on Attention-Guided Convolutional Neural Network

CholecTrack20: A Dataset for Multi-Class Multiple Tool Tracking in Laparoscopic Surgery

CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

Synthesising Rare Cataract Surgery Samples with Guided Diffusion Models

An Objective Comparison of Detection and Segmentation Algorithms for Artefacts in Clinical Endoscopy

Artificial Intelligence in Cataract Surgery: A Systematic Review

Robust Surgical Tools Detection in Endoscopic Videos with Noisy Data

Surgical Tools Detection Based on Training Sample Adaptation in Laparoscopic Videos