a-novel-dual-modal-deep-learning-approach-for-real-time-removal

A Novel Dual-Modal Deep Learning Approach for Real-Time Removal of Hepatic Fluorescence in Indocyanine Green-Guided Laparoscopic Cholecystectomy

Indocyanine green-guided laparoscopic cholecystectomy (ICGLC) improves biliary visualization but is often hindered by hepatic fluorescence contamination, ...

Beijing United Family Hospital

To describe the genetic landscape and clinical characteristics of Chinese patients diagnosed with papillary thyroid cancer (PTC) and to determine which high-risk genetic characteristics suggest a likelihood of lymph node metastasis (LNM) and lateral lymph node metastasis (LLNM).

Genetic and Clinicopathologic Characteristics of Papillary Thyroid Carcinoma in the Chinese Population: High  Mutation Allele Frequency, Multiple Driver Gene Mutations, and  Fusion May Indicate More Advanced TN Stage.

Parathyroid carcinoma (PC) is a rare endocrine malignancy with poor outcomes. Over 60% of PC patients experience repeated disease recurrence or metastasis. The significance of cervical lymph node dissection (LND) for PC remains inconclusive.

Patterns and Predictors of Cervical Lymph Node Metastasis in Parathyroid Carcinoma.

In recent years, computer-assisted intervention and robot-assisted surgery are receiving increasing attention. The need for real-time identification and tracking of surgical tools and tool tips is constantly demanding. A series of researches focusing on surgical tool tracking and identification have been performed. However, the size of dataset, the sensitivity/precision, and the response time of these studies were limited. In this work, we developed and utilized an automated method based on Convolutional Neural Network (CNN) and You Only Look Once (YOLO) v3 algorithm to locate and identify surgical tools and tool tips covering five different surgical scenarios.

Application and evaluation of surgical tool and tool tip recognition based on Convolutional Neural Network in multiple endoscopic surgical scenarios.

Near-infrared fluorescence imaging  using intravenous indocyanine green (ICG) has a wide range of applications in multiple surgical scenarios. In laparoscopic cholecystectomy (LC), it facilitates intraoperative identification of the biliary system and reduces the risk of bile duct injury. However, the usual single color fluorescence imaging (SCFI) has limitations in manifesting the fluorescence signal of the target structure when its intensity is relatively low. Moreover, surgeons often experience visual fatigue. We hypothesized that a novel imaging strategy, named multi-color fluorescence imaging (MCFI), could potentially address these issues by decreasing hepatic and background fluorescence pollution and improving biliary visualization.

Efficacy of multi-color near-infrared fluorescence with indocyanine green: A new imaging strategy and its early experience in laparoscopic cholecystectomy.

Plasma cell-free DNA (cfDNA) has been used to monitor gene mutations and diagnose tumors. Discriminating parathyroid carcinoma (PC) from parathyroid adenoma (PA) before surgery is difficult because of the overlap in clinical features between parathyroid neoplasms. We aimed to detect cfDNA mutations in plasma samples from PC and PA patients before surgery to predict the CDC73 status in tumor tissue and help in the differential diagnosis of parathyroid neoplasms.

Primary exploration of cell-free DNA in the plasma of patients with parathyroid neoplasms using next-generation sequencing.

Laparoscopic pancreatic surgery remains highly challenging due to the complexity of the pancreas and surrounding vascular structures, with risk of injuring critical blood vessels such as the Superior Mesenteric Vein (SMV)-Portal Vein (PV) axis and splenic vein. Here, we evaluated the High Resolution Network (HRNet)-Full Convolutional Network (FCN) model for its ability to accurately identify vascular contours and improve surgical safety. Using 12,694 images from 126 laparoscopic distal pancreatectomy (LDP) videos and 35,986 images from 138 Whipple procedure videos, the model demonstrated robust performance, achieving a mean Dice coefficient of 0.754, a recall of 85.00%, and a precision of 91.10%. By combining datasets from LDP and Whipple procedures, the model showed strong generalization across different surgical contexts and achieved real-time processing speeds of 11 frames per second during surgery process. These findings highlight HRNet-FCN's potential to recognize anatomical landmarks, enhance surgical precision, reduce complications, and improve laparoscopic pancreatic outcomes.

Deep learning HRNet FCN for blood vessel identification in laparoscopic pancreatic surgery.

Despite the rapid progress of robotic surgery, intelligent object recognition and autonomous computer-assisted interventions continues to face limitations. Algorithms designed for the identification and localization of surgical tool tips are pivotal in augmenting the interactive collaboration between the robotic surgical system and its operator. In the present study, our aim to formulate a strategy proficient in recognizing and pinpointing commonly used surgical tools in robotic surgery.

Development and validation of a surgical tool recognition and localization strategy in robotic surgeries.

Laparoscopic operation holds multiple advantages as a minimal invasive method of surgical treatment. Vascular-related manipulations, including identification and dissection of vascular structures and control of bleeding, are highly experience-based and demand a tortuous learning curve. With the rapid development of artificial intelligence (AI) in the entire diagnosis and treatment process of diseases, data-driven AI models have shown promising potentials in both education and real-time aiding in surgery. However, there is no dedicated dataset existing for developing vascular identification models in laparoscopic settings.

Construction and validation of a high-precision annotated dataset for developing intelligent critical vein recognition models in laparoscopic pancreatic surgery.

The integration of artificial intelligence (AI) into surgical navigation represents a pivotal advancement in modern operative medicine. In endoscopic thyroidectomy, safeguarding the recurrent laryngeal nerve (RLN) is of critical importance due to its vulnerability to iatrogenic injury, which affects 3-8% of cases and can lead to serious complications such as vocal cord paralysis. However, existing intraoperative nerve monitoring (IONM) technologies are limited by high costs, operator dependence, and discontinuous signal acquisition. To address the lack of large-scale, annotated datasets essential for training robust deep learning models in real-world surgical settings, we present ThyRLN-PUMCH, the first comprehensive in vivo dataset dedicated to RLN identification in endoscopic thyroid surgery. This dataset comprises 18,178 pixel-level annotated frames from 28 clinically diverse surgical cases. Annotations were performed and validated by board-certified endocrine surgeons through a multi-stage quality control process. We benchmarked two segmentation models to verify their practicability and proved the dataset's capacity to support high-precision RLN segmentation tasks. ThyRLN-PUMCH fills a critical gap in AI assisted head and neck surgery by offering temporally continuous, clinically representative images and annotations. It provides a robust foundation for developing AI-based intraoperative navigation tools aimed at enhancing surgical safety, education, and efficiency in head and neck surgery.

Article	Year
Genetic and Clinicopathologic Characteristics of Papillary Thyroid Carcinoma in the Chinese Population: High Mutation Allele Frequency, Multiple Driver Gene Mutations, and Fusion May Indic... OncoTargets and therapy\| PubMed ID: 35173448	2022
Patterns and Predictors of Cervical Lymph Node Metastasis in Parathyroid Carcinoma. Cancers\| PubMed ID: 36010997	2022
Application and evaluation of surgical tool and tool tip recognition based on Convolutional Neural Network in multiple endoscopic surgical scenarios. Surgical endoscopy\| PubMed ID: 37580576	2023
Efficacy of multi-color near-infrared fluorescence with indocyanine green: A new imaging strategy and its early experience in laparoscopic cholecystectomy. World journal of gastrointestinal surgery\| PubMed ID: 39734466	2024
Primary exploration of cell-free DNA in the plasma of patients with parathyroid neoplasms using next-generation sequencing. Cancer cell international\| PubMed ID: 40075389	2025
Deep learning HRNet FCN for blood vessel identification in laparoscopic pancreatic surgery. NPJ digital medicine\| PubMed ID: 40312536	2025
Development and validation of a surgical tool recognition and localization strategy in robotic surgeries. Journal of robotic surgery\| PubMed ID: 41175306	2025
Construction and validation of a high-precision annotated dataset for developing intelligent critical vein recognition models in laparoscopic pancreatic surgery. Frontiers in surgery\| PubMed ID: 41704439	2026
A High-Quality Endoscopic Image Dataset with Annotated Recurrent Laryngeal Nerve for AI-Assisted Thyroid Surgery. Scientific data\| PubMed ID: 41932923	2026

Surong Hua

Biography

JoVE Journal Publications

Other Publications