Abstract:Colorectal cancer remains a major cause of cancer death and morbidity worldwide. Surgery is a major treatment modality for primary and, increasingly, secondary curative therapy. However, with more patients being diagnosed with early stage and premalignant disease manifesting as large polyps, greater accuracy in diagnostic and therapeutic precision is needed right from the time of first endoscopic encounter. Rapid advancements in the field of artificial intelligence (AI), coupled with widespread availability of near infrared imaging (currently based around indocyanine green (ICG)) can enable colonoscopic tissue classification and prognostic stratification for significant polyps, in a similar manner to contemporary dynamic radiological perfusion imaging but with the advantage of being able to do so directly within interventional procedural time frames. It can provide an explainable method for immediate digital biopsies that could guide or even replace traditional forceps biopsies and provide guidance re margins (both areas where current practice is only approximately 80% accurate prior to definitive excision). Here, we discuss the concept and practice of AI enhanced ICG perfusion analysis for rectal cancer surgery while highlighting recent and essential near-future advancements. These include breakthrough developments in computer vision and time series analysis that allow for real-time quantification and classification of fluorescent perfusion signals of rectal cancer tissue intraoperatively that accurately distinguish between normal, benign, and malignant tissues in situ endoscopically, which are now undergoing international prospective validation (the Horizon Europe CLASSICA study). Next stage advancements may include detailed digital characterisation of small rectal malignancy based on intraoperative assessment of specific intratumoral fluorescent signal pattern. This could include T staging and intratumoral molecular process profiling (e.g. regarding angiogenesis, differentiation, inflammatory component, and tumour to stroma ratio) with the potential to accurately predict the microscopic local response to nonsurgical treatment enabling personalised therapy via decision support tools. Such advancements are also applicable to the next generation fluorophores and imaging agents currently emerging from clinical trials. In addition, by providing an understandable, applicable method for detailed tissue characterisation visually, such technology paves the way for acceptance of other AI methodology during surgery including, potentially, deep learning methods based on whole screen/video detailing.

Accurate localization of rectal cancer using near infrared ray-guided surgery with intra-operative colonoscopy and da Vinci Firefly technology

Robot-assisted Surgery for Gastrointestinal Cancer Using Indocyanine Green Conjugated Endoscopic Marking Clip Under Firefly Fluorescence Imaging

Fluorescence guidance using near-infrared fluorescent clips in robotic rectal surgery: a case series

An integrated diagnosis and therapeutic system using intra-operative 5-aminolevulinic-acid-induced fluorescence guided robotic laser ablation for precision neurosurgery

Detection and Real-Time Surgical Assessment of Colorectal Liver Metastases Using Near-Infrared Fluorescence Imaging during Laparoscopic and Robotic-Assisted Resections

Interventional Real-Time Optical Imaging Guidance for Complete Tumor Ablation

Impact of Infrared Indocyanine Green Fluorescence imaging-guided Laparoscopic Hepatectomy on Securing the Resection Margin for Colorectal Liver Metastasis

A novel image-guided laparoscopic liver resection with integrated fluorescent imaging and artificial intelligence: A preliminary study.

An initial report of robotic-assisted anatomical liver resection with indocyanine green fluorescence navigation using the ultrasound-guided preoperative positive staining technique

Combination of intraoperative 5-aminolevulinic acid-induced fluorescence and 3-D MR imaging for guidance of robotic laser ablation for precision neurosurgery.

Surgical Navigation for Malignancies Guided by Near‐Infrared‐II Fluorescence Imaging

High-precision detection and navigation surgery of colorectal cancer micrometastases

A pilot study of near-infrared fluorescence guided surgery for primary tumor localization and lymph node mapping in colorectal cancer

Use of indocyanine green (ICG) augmented near-infrared fluorescence imaging in robotic radical resection of gallbladder adenocarcinomas

Indocyanine green (ICG)-guided robotic resection for liver adenoma: combined technologies for precision surgery

A Projective Surgical Navigation System for Cancer Resection

Artificial Intelligence-Based Total Mesorectal Excision Plane Navigation in Laparoscopic Colorectal Surgery

Intraoperative near infrared functional imaging of rectal cancer using artificial intelligence methods - now and near future state of the art

Intraoperative Identification and Guidance of Breast Cancer Microfoci Using Ultrasound and Near-Infrared Fluorescence Dual-Modality Imaging

Detection of Colorectal Liver Metastases Using Near-Infrared Fluorescence Imaging During Hepatectomy: Prospective Single Centre UK Study

Feasibility of Novel Intraoperative Navigation for Anatomical Liver Resection Using Real-Time Virtual Sonography Combined with Indocyanine Green Fluorescent Imaging Technology.