A Novel Dual-Modal Deep Learning Approach for Real-Time Removal of Hepatic Fluorescence in Indocyanine Green-Guided Laparoscopic Cholecystectomy

Bozheng Lin; Hu Zhou; Lu Ping; Ruohan Cui; Yangfang Liu; Jiayi Li; Yalei Wang; Chihua Fang; Xianlin Han; Surong Hua

doi:10.3791/68488

A subscription to JoVE is required to view this content. Sign in or start your free trial.

Method Article

A Novel Dual-Modal Deep Learning Approach for Real-Time Removal of Hepatic Fluorescence in Indocyanine Green-Guided Laparoscopic Cholecystectomy

202 views

⸱

DOI:

10.3791/68488

⸱

April 17th, 2026

Bozheng Lin^*¹ , Hu Zhou^*¹ , Lu Ping¹ , Ruohan Cui¹^,² , Yangfang Liu¹^,² , Jiayi Li¹^,² , Yalei Wang¹ , Chihua Fang³ , Xianlin Han¹ , Surong Hua⁴

¹Department of General Surgery, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, ²Eight-year MD Program, Chinese Academy of Medical Sciences & Peking Union Medical College, ³Department of Hepatobiliary Surgery, Zhujiang Hospital, First Military Medical University, ⁴Department of General Surgery, Beijing United Family Hospital

Corresponding Authors: Xianlin Han <hanxianlin@pumch.cn>, Surong Hua <huasurong@tsinghua.org.cn>

^* These authors contributed equally

Summary

This protocol presents a dual-modal deep learning approach for real-time hepatic fluorescence removal during indocyanine green-guided laparoscopic cholecystectomy (ICGLC).

Abstract

Indocyanine green-guided laparoscopic cholecystectomy (ICGLC) improves biliary visualization but is often hindered by hepatic fluorescence contamination, which interferes with anatomical structures. This study aims to develop and evaluate a novel dual-modal deep learning framework to automatically detect and remove hepatic fluorescence contamination in real-time during ICGLC procedures. A dataset of 33,123 dual-modality surgical frames was constructed from 48 patients who underwent elective ICGLC. Fluorescence and white-light images were fused and annotated. Several deep learning models were compared, and a DeepLabV3-based mid-fusion network was selected. Morphological post-processing and phased training strategies were implemented to enhance segmentation accuracy and generalizability. The proposed model achieved a Dice coefficient of 0.838 and recall of 0.863 on the final test set. In subjective evaluations, 10 senior surgeons consistently rated the AI-processed videos as clearer, with markedly improved bile duct visualization and reduced visual fatigue. The model demonstrated real-time performance at 0.018 seconds per frame. This study presents the first real-time AI solution for hepatic fluorescence removal in ICGLC. The dual-modal deep learning model significantly enhances visual clarity, offering potential to improve surgical safety, operational efficiency, and training effectiveness. Future prospective studies are warranted to assess the clinical impact on operative outcomes.

Introduction

Cholelithiasis is a prevalent gastrointestinal disorder, consistently showing high incidence rates globally across various populations, affecting over 4% of the global population¹^,²^,³^,⁴. Laparoscopic cholecystectomy (LC) is extensively regarded as the 'gold standard' for treating cholelithiasis due to its advantages such as minimal intraoperative trauma, mild postoperative pain, favorable cosmetic results, and short hospital stays⁵^,⁶^,⁷. In t....