detection-isolation-cancer-prostate-biopsies-using-stimulated-raman

Detection and Isolation of Cancer in Prostate Biopsies Using Stimulated Raman Histology and Artificial Intelligence

Prostate cancer remains one of the most prevalent malignancies affecting men worldwide, making early detection and advancements in precision medicine ...

Invenio Imaging

Stimulated Raman Scattering microscopy allows label-free chemical imaging and has enabled exciting applications in biology, material science, and medicine. It provides a major advantage in imaging speed over spontaneous Raman scattering and has improved image contrast and spectral fidelity compared to coherent anti-Stokes Raman. Wider adoption of the technique has, however, been hindered by the need for a costly and environmentally sensitive tunable ultra-fast dual-wavelength source. We present the development of an optimized all-fibre laser system based on the optical synchronization of two picosecond power amplifiers. To circumvent the high-frequency laser noise intrinsic to amplified fibre lasers, we have further developed a high-speed noise cancellation system based on voltage-subtraction autobalanced detection. We demonstrate uncompromised imaging performance of our fibre-laser based stimulated Raman scattering microscope with shot-noise limited sensitivity and an imaging speed up to 1 frame/s.

Stimulated Raman Scattering Microscopy with a Robust Fibre Laser Source.

Differentiating tumor from normal brain is a major barrier to achieving optimal outcome in brain tumor surgery. New imaging techniques for visualizing tumor margins during surgery are needed to improve surgical results. We recently demonstrated the ability of stimulated Raman scattering (SRS) microscopy, a nondestructive, label-free optical method, to reveal glioma infiltration in animal models. We show that SRS reveals human brain tumor infiltration in fresh, unprocessed surgical specimens from 22 neurosurgical patients. SRS detects tumor infiltration in near-perfect agreement with standard hematoxylin and eosin light microscopy (κ = 0.86). The unique chemical contrast specific to SRS microscopy enables tumor detection by revealing quantifiable alterations in tissue cellularity, axonal density, and protein/lipid ratio in tumor-infiltrated tissues. To ensure that SRS microscopic data can be easily used in brain tumor surgery, without the need for expert interpretation, we created a classifier based on cellularity, axonal density, and protein/lipid ratio in SRS images capable of detecting tumor infiltration with 97.5% sensitivity and 98.5% specificity. Quantitative SRS microscopy detects the spread of tumor cells, even in brain tissue surrounding a tumor that appears grossly normal. By accurately revealing tumor infiltration, quantitative SRS microscopy holds potential for improving the accuracy of brain tumor surgery.

Detection of human brain tumor infiltration with quantitative stimulated Raman scattering microscopy.

Despite advances in the surgical management of brain tumors, achieving optimal surgical results and identification of tumor remains a challenge. Raman spectroscopy, a laser-based technique that can be used to nondestructively differentiate molecules based on the inelastic scattering of light, is being applied toward improving the accuracy of brain tumor surgery. Here, the authors systematically review the application of Raman spectroscopy for guidance during brain tumor surgery. Raman spectroscopy can differentiate normal brain from necrotic and vital glioma tissue in human specimens based on chemical differences, and has recently been shown to differentiate tumor-infiltrated tissues from noninfiltrated tissues during surgery. Raman spectroscopy also forms the basis for coherent Raman scattering (CRS) microscopy, a technique that amplifies spontaneous Raman signals by 10,000-fold, enabling real-time histological imaging without the need for tissue processing, sectioning, or staining. The authors review the relevant basic and translational studies on CRS microscopy as a means of providing real-time intraoperative guidance. Recent studies have demonstrated how CRS can be used to differentiate tumor-infiltrated tissues from noninfiltrated tissues and that it has excellent agreement with traditional histology. Under simulated operative conditions, CRS has been shown to identify tumor margins that would be undetectable using standard bright-field microscopy. In addition, CRS microscopy has been shown to detect tumor in human surgical specimens with near-perfect agreement to standard H & E microscopy. The authors suggest that as the intraoperative application and instrumentation for Raman spectroscopy and imaging matures, it will become an essential component in the neurosurgical armamentarium for identifying residual tumor and improving the surgical management of brain tumors.

Improving the accuracy of brain tumor surgery via Raman-based technology.

Conventional methods for intraoperative histopathologic diagnosis are labour- and time-intensive, and may delay decision-making during brain-tumour surgery. Stimulated Raman scattering (SRS) microscopy, a label-free optical process, has been shown to rapidly detect brain-tumour infiltration in fresh, unprocessed human tissues. Here, we demonstrate the first application of SRS microscopy in the operating room by using a portable fibre-laser-based microscope and unprocessed specimens from 101 neurosurgical patients. We also introduce an image-processing method - stimulated Raman histology (SRH) - which leverages SRS images to create virtual haematoxylin-and-eosin-stained slides, revealing essential diagnostic features. In a simulation of intraoperative pathologic consultation in 30 patients, we found a remarkable concordance of SRH and conventional histology for predicting diagnosis (Cohen's kappa, κ > 0.89), with accuracy exceeding 92%. We also built and validated a multilayer perceptron based on quantified SRH image attributes that predicts brain-tumour subtype with 90% accuracy. Our findings provide insight into how SRH can now be used to improve the surgical care of brain tumour patients.

Rapid intraoperative histology of unprocessed surgical specimens via fibre-laser-based stimulated Raman scattering microscopy.

One of the key pathological features of Alzheimer's disease (AD) is the existence of extracellular deposition of amyloid plaques formed with misfolded amyloid-β (Aβ). The conformational change of proteins leads to enriched contents of β sheets, resulting in remarkable changes of vibrational spectra, especially the spectral shifts of the amide I mode. Here, we applied stimulated Raman scattering (SRS) microscopy to image amyloid plaques in the brain tissue of an AD mouse model. We have demonstrated the capability of SRS microscopy as a rapid, label-free imaging modality to differentiate misfolded from normal proteins based on the blue shift (~10 cm) of amide I SRS spectra. Furthermore, SRS imaging of Aβ plaques was verified by antibody staining of frozen thin sections and fluorescence imaging of fresh tissues. Our method may provide a new approach for studies of AD pathology, as well as other neurodegenerative diseases associated with protein misfolding.

Label-free imaging of amyloid plaques in Alzheimer's disease with stimulated Raman scattering microscopy.

Intraoperative diagnosis is essential for providing safe and effective care during cancer surgery. The existing workflow for intraoperative diagnosis based on hematoxylin and eosin staining of processed tissue is time, resource and labor intensive. Moreover, interpretation of intraoperative histologic images is dependent on a contracting, unevenly distributed, pathology workforce. In the present study, we report a parallel workflow that combines stimulated Raman histology (SRH), a label-free optical imaging method and deep convolutional neural networks (CNNs) to predict diagnosis at the bedside in near real-time in an automated fashion. Specifically, our CNNs, trained on over 2.5 million SRH images, predict brain tumor diagnosis in the operating room in under 150 s, an order of magnitude faster than conventional techniques (for example, 20-30 min). In a multicenter, prospective clinical trial (n = 278), we demonstrated that CNN-based diagnosis of SRH images was noninferior to pathologist-based interpretation of conventional histologic images (overall accuracy, 94.6% versus 93.9%). Our CNNs learned a hierarchy of recognizable histologic feature representations to classify the major histopathologic classes of brain tumors. In addition, we implemented a semantic segmentation method to identify tumor-infiltrated diagnostic regions within SRH images. These results demonstrate how intraoperative cancer diagnosis can be streamlined, creating a complementary pathway for tissue diagnosis that is independent of a traditional pathology laboratory.

Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks.

Detection of glioma recurrence remains a challenge in modern neuro-oncology. Noninvasive radiographic imaging is unable to definitively differentiate true recurrence versus pseudoprogression. Even in biopsied tissue, it can be challenging to differentiate recurrent tumor and treatment effect. We hypothesized that intraoperative stimulated Raman histology (SRH) and deep neural networks can be used to improve the intraoperative detection of glioma recurrence.

Rapid, label-free detection of diffuse glioma recurrence using intraoperative stimulated Raman histology and deep neural networks.

Accurate specimen analysis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative specimen interpretation can be challenging because of the wide range of skull base pathologies and lack of intraoperative pathology resources.

Rapid Automated Analysis of Skull Base Tumor Specimens Using Intraoperative Optical Imaging and Artificial Intelligence.

Determining the presence of tumor in biopsies and the decision-making during resections is often dependent on intraoperative rapid frozen-section histopathology. Recently, stimulated Raman scattering microscopy has been introduced to rapidly generate digital hematoxylin-and-eosin-stained-like images (stimulated Raman histology) for intraoperative analysis. To enable intraoperative prediction of tumor presence, we aimed to develop a new deep residual convolutional neural network in an automated pipeline and tested its validity. In a monocentric prospective clinical study with 94 patients undergoing biopsy, brain or spinal tumor resection, Stimulated Raman histology images of intraoperative tissue samples were obtained using a fiber-laser-based stimulated Raman scattering microscope. A residual network was established and trained in ResNetV50 to predict three classes for each image: (1) tumor, (2) non-tumor, and (3) low-quality. The residual network was validated on images obtained in three small random areas within the tissue samples and were blindly independently reviewed by a neuropathologist as ground truth. 402 images derived from 132 tissue samples were analyzed representing the entire spectrum of neurooncological surgery. The automated workflow took in a mean of 240 s per case, and the residual network correctly classified tumor (305/326), non-tumorous tissue (49/67), and low-quality (6/9) images with an inter-rater agreement of 89.6% (κ = 0.671). An excellent internal consistency was found among the random areas with 90.2% (Cα = 0.942) accuracy. In conclusion, the novel stimulated Raman histology-based residual network can reliably detect the microscopic presence of tumor and differentiate from non-tumorous brain tissue in resection and biopsy samples within 4 min and may pave a promising way for an alternative rapid intraoperative histopathological decision-making tool.

Novel rapid intraoperative qualitative tumor detection by a residual convolutional neural network using label-free stimulated Raman scattering microscopy.

Accurate intraoperative diagnosis is essential for providing safe and effective care during brain tumor surgery. Our standard-of-care diagnostic methods are time, resource, and labor intensive, which restricts access to optimal surgical treatments. To address these limitations, we propose an alternative workflow that combines stimulated Raman histology (SRH), a rapid optical imaging method, with deep learning-based automated interpretation of SRH images for intraoperative brain tumor diagnosis and real-time surgical decision support. Here, we present , the first public dataset of clinical SRH images from 300+ brain tumors patients and 1300+ unique whole slide optical images. OpenSRH contains data from the most common brain tumors diagnoses, full pathologic annotations, whole slide tumor segmentations, raw and processed optical imaging data for end-to-end model development and validation. We provide a framework for patch-based whole slide SRH classification and inference using weak (i.e. patient-level) diagnostic labels. Finally, we benchmark two computer vision tasks: multiclass histologic brain tumor classification and patch-based contrastive representation learning. We hope OpenSRH will facilitate the clinical translation of rapid optical imaging and real-time ML-based surgical decision support in order to improve the access, safety, and efficacy of cancer surgery in the era of precision medicine. Dataset access, code, and benchmarks are available at https://opensrh.mlins.org.

OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology.

Learning high-quality, self-supervised, visual representations is essential to advance the role of computer vision in biomedical microscopy and clinical medicine. Previous work has focused on self-supervised representation learning (SSL) methods developed for instance discrimination and applied them directly to image patches, or fields-of-view, sampled from gigapixel whole-slide images (WSIs) used for cancer diagnosis. However, this strategy is limited because it (1) assumes patches from the same patient are independent, (2) neglects the patient-slide-patch hierarchy of clinical biomedical microscopy, and (3) requires strong data augmentations that can degrade downstream performance. Importantly, sampled patches from WSIs of a patient's tumor are a diverse set of image examples that capture the same underlying cancer diagnosis. This motivated HiDisc, a data-driven method that leverages the inherent patient-slide-patch hierarchy of clinical biomedical microscopy to define a hierarchical discriminative learning task that implicitly learns features of the underlying diagnosis. HiDisc uses a self-supervised contrastive learning framework in which positive patch pairs are defined based on a common ancestry in the data hierarchy, and a unified patch, slide, and patient discriminative learning objective is used for visual SSL. We benchmark HiDisc visual representations on two vision tasks using two biomedical microscopy datasets, and demonstrate that (1) HiDisc pretraining outperforms current state-of-the-art self-supervised pretraining methods for cancer diagnosis and genetic mutation prediction, and (2) HiDisc learns high-quality visual representations using natural patch diversity without strong data augmentations.

Hierarchical discriminative learning improves visual representations of biomedical microscopy.

The most widely used fluorophore in glioma-resection surgery, 5-aminolevulinic acid (5-ALA), is thought to cause the selective accumulation of fluorescent protoporphyrin IX (PpIX) in tumour cells. Here we show that the clinical detection of PpIX can be improved via a microscope that performs paired stimulated Raman histology and two-photon excitation fluorescence microscopy (TPEF). We validated the technique in fresh tumour specimens from 115 patients with high-grade gliomas across four medical institutions. We found a weak negative correlation between tissue cellularity and the fluorescence intensity of PpIX across all imaged specimens. Semi-supervised clustering of the TPEF images revealed five distinct patterns of PpIX fluorescence, and spatial transcriptomic analyses of the imaged tissue showed that myeloid cells predominate in areas where PpIX accumulates in the intracellular space. Further analysis of external spatially resolved metabolomics, transcriptomics and RNA-sequencing datasets from glioblastoma specimens confirmed that myeloid cells preferentially accumulate and metabolize PpIX. Our findings question 5-ALA-induced fluorescence in glioma cells and show how 5-ALA and TPEF imaging can provide a window into the immune microenvironment of gliomas.

Article	Year
Stimulated Raman Scattering Microscopy with a Robust Fibre Laser Source. Nature photonics\| PubMed ID: 25313312	2014
Detection of human brain tumor infiltration with quantitative stimulated Raman scattering microscopy. Science translational medicine\| PubMed ID: 26468325	2015
Improving the accuracy of brain tumor surgery via Raman-based technology. Neurosurgical focus\| PubMed ID: 26926067	2016
Rapid intraoperative histology of unprocessed surgical specimens via fibre-laser-based stimulated Raman scattering microscopy. Nature biomedical engineering\| PubMed ID: 28955599	2017
Label-free imaging of amyloid plaques in Alzheimer's disease with stimulated Raman scattering microscopy. Science advances\| PubMed ID: 30456301	2018
Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks. Nature medicine\| PubMed ID: 31907460	2020
Rapid, label-free detection of diffuse glioma recurrence using intraoperative stimulated Raman histology and deep neural networks. Neuro-oncology\| PubMed ID: 32672793	2021
Rapid Automated Analysis of Skull Base Tumor Specimens Using Intraoperative Optical Imaging and Artificial Intelligence. Neurosurgery\| PubMed ID: 35343469	2022
Novel rapid intraoperative qualitative tumor detection by a residual convolutional neural network using label-free stimulated Raman scattering microscopy. Acta neuropathologica communications\| PubMed ID: 35933416	2022
OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology. Advances in neural information processing systems\| PubMed ID: 37082565	2022
Hierarchical discriminative learning improves visual representations of biomedical microscopy. Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition\| PubMed ID: 37654477	2023
Localization of protoporphyrin IX during glioma-resection surgery via paired stimulated Raman histology and fluorescence microscopy. Nature biomedical engineering\| PubMed ID: 38987630	2024

Christian W. Freudiger

Biography

JoVE Journal Publications

Other Publications