Name: Quantitative Visualization and Detection of Skin Cancer Using Dynamic Thermal Imaging (Video) | JoVE Journal
Uploaded: 2011-05-05T13:00:00.000+00:00
Duration: 6 min 8 s
Description: Learn dynamic thermal imaging for non-invasive melanoma detection using infrared temperature monitoring. This method detects increased metabolic activity in malignant skin lesions during thermal recovery.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

playerTrialDesktop

This research was funded by the National Science Foundation Grant No. 0651981 and the Alexander and Margaret Stewart Trust though the Cancer Center of the Johns Hopkins University. The authors would like to acknowledge the contributions of Dr. Rhoda Alani to the IRB and the patient study as well as the help and support of Dr. Sewon Kang and his department during the patient study.

1. Setup
<ol>
	<li>A temperature controlled exam room equipped with an infrared camera and a PC for infrared image acquisition and storage as well as a data acquisition card connected to a computer are shown in Fig.1a. </li>
 <li>The room temperature and skin surface temperature are monitored by thermocouples attached to a data acquisition card during the patient study and measurement data are stored on the computer.</li>
</ol>
2. Image Acquisition
<ol>
	<li>Since the lesion cannot be detected in the thermal image without the cooling effect, a square adhesive marker is used to localize the pigmented lesion of interest and its surroundings (Fig. 1b).</li>
 <li>We acquire a bright light image of the pigmented lesion and the adhesive window with a digital camera (Canon PowerShot G11) (Fig. 1b).</li>
 <li>A dermatoscope connected to a digital camera (DermLite Foto System) is used to capture the polarized light image. </li>
 <li>We acquire a steady state infrared image with a Merlin midwave (3-5 μm) infrared camera shown in Fig.1a, c. </li>
 <li>We apply a stream of cold air to the area of the patient’s skin containing the lesion as well as a 50 mm diameter surrounding region for the duration of one minute. </li>
 <li>After one minute, we remove this cooling stress to allow the skin to re-warm at room temperature within 3-4 minutes (thermal recovery phase) (Fig. 1c-d). </li>
 <li>During the thermal recovery phase, infrared images of the pigmented lesion are captured every 2 seconds (Fig. 1c-d). </li>
 <li>All IR images (in addition to the white light and polarized light images) taken during the study are saved and stored using the Labview software.</li>
 
</ol>
3. Image Processing
<ol>
	<li>The IR images are analyzed using a dedicated Matlab code in order to obtain accurate transient temperature distributions on the skin surface. For this purpose, we introduce several calibration steps and a multimodal image analysis system.</li>
 <li>We start with applying a landmark detection algorithm to the bright light image for localizing the corners of the adhesive marker. Next, we identified the corresponding points in the reference IR image. </li>
 <li>In order to compensate for involuntary body/limb movement of the patient, we use these points as landmarks in a quadratic motion model for aligning the IR image sequence during the recovery phase. </li>
 <li>We use the random walker, an interactive image segmentation algorithm where the user can spatially guide the segmentation by placing seed points, to create a mask image delineating the lesion. </li>
 <li>Once we determine the shape of the lesion, we identify the corresponding region in each of the registered IR images.</li>
 <li>We select random points inside the lesion and away from the lesion representing the lesion and the healthy tissue, respectively.</li>
 <li>We compare the transient thermal response of healthy skin and the response of the lesion.</li>
 <li>We prepare a table showing all the data: digital, dermoscopy, color-coded IR images of the lesion and surrounding area recorded at ambient conditions and 2 seconds after the cooling excitation, and the transient thermal response of the lesion and the healthy tissue.</li> 
</ol>
4. Representative Results:
<img src="/files/ftp_upload/2679/2679fig1.jpg" alt="Skin spectroscopy setup; thermal images of lesion analysis; recovery, steady-state data; medical diagnostics." data-altupdatedat="1788235205000" data-alt="Figure 1"> 
Figure 1. a) The infrared imaging system HRIS in the clinical trial room, b) photograph of the larger body surface area with a cluster of pigmented lesions and the template frame applied for imaging, c) reference infrared image of the region at ambient temperature, d) the same area after cooling and e) magnified section of the melanoma lesion and surroundings
<img src="/files/ftp_upload/2679/2679fig2.jpg" alt="Spectroscopy setup with computer analysis, optical measurement, diagram." data-altupdatedat="1788235205000" data-alt="Figure 2"> 
Figure 2. Exam room with our thermal imaging system.
<img src="/files/ftp_upload/2679/2679fig3.jpg" alt="Cryogenic treatment setup on arm, involving gas canister and cooling apparatus for medical research." data-altupdatedat="1788235205000" data-alt="Figure 3"> 
Figure 3. Cooling the lesion and the surrounding skin tissue by blowing a stream of cold air from a vortex tube.

<ol><li>Skin cancer foundation website [Internet]. , Skin Cancer Foundation. Available from: 
 <a target="_blank" href="http://www.skincancer.org/Skin-Cancer-Facts">http://www.skincancer.org/Skin-Cancer-Facts</a> (2010).</li>
<li>Elder, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Tumor+progression%2C+early+diagnosis+and+prognosis+of+melanoma%5BTitle%5D)+AND+%22Acta+Oncol%22%5BJournal%5D)">Tumor progression, early diagnosis and prognosis of melanoma.</a> Acta Oncol. 38, 535-547 (1999).</li>
<li>Wartman, D., Weinstock, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Are+we+overemphasizing+sun+avoidance+in+protection+from+melanoma%5BTitle%5D)+AND+%22Cancer+Epidemiol+Biomarkers+Prev%22%5BJournal%5D)">Are we overemphasizing sun avoidance in protection from melanoma.</a> Cancer Epidemiol Biomarkers Prev. 17, 469-470 (2008).</li>
<li>Pirtini Cetingul, M. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=%22Using+high+resolution+infrared+imaging+to+detect+melanoma+and+dysplastic+nevi+%5B%5D%22">Using high resolution infrared imaging to detect melanoma and dysplastic nevi [dissertation]</a>. , Johns Hopkins University. (2010).</li>
<li>Jones, B. F. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((A+reappraisal+of+the+use+of+infrared+thermal+image+analysis+in+medicine%5BTitle%5D)+AND+%22IEEE+Trans.+Med.+Imaging%22%5BJournal%5D)">A reappraisal of the use of infrared thermal image analysis in medicine.</a> IEEE Trans. Med. Imaging. 17, 1019-1027 (1998).</li>
<li>Anbar, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Clinical+thermal+imaging+today-shifting+from+phenomenological+thermography+to+pathophysiologically+based+thermal+imaging%5BTitle%5D)+AND+%22IEEE+Eng.+Med.+Biol.+Mag%22%5BJournal%5D)">Clinical thermal imaging today-shifting from phenomenological thermography to pathophysiologically based thermal imaging.</a> IEEE Eng. Med. Biol. Mag. 17, 25-33 (1998).</li>
<li>Anbar, M., Gratt, B. M., Hong, D. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Thermology+and+facial+telethermography.+Part+I%3A+history+and+technical+review%5BTitle%5D)+AND+%22Dentomaxillofacial+Radiology%22%5BJournal%5D)">Thermology and facial telethermography. Part I: history and technical review.</a> Dentomaxillofacial Radiology. 27, 61-67 (1998).</li>
<li>Jones, B. F., Plassmann, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Digital+infrared+thermal+imaging+of+human+skin%5BTitle%5D)+AND+%22IEEE+Eng.+Med.+Bio%22%5BJournal%5D)">Digital infrared thermal imaging of human skin.</a> IEEE Eng. Med. Bio. 21, 41-48 (2002).</li>
<li>Qi, H., Diakides, N. A. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aQi%2C+H+%22Infrared+imaging+in+Medicine%22">Infrared imaging in Medicine</a>. , CRC Press. (2007).</li>
<li>Pirtini Cetingul, M., Herman, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Identification+of+skin+lesions+from+the+transient+thermal+response+using+infrared+imaging+technique%5BTitle%5D)+AND+%22IEEE+5th+Int.+Symp.+on+Biomedical+Imaging%3A+From+Nano+to+Macro+1-4%22%5BJournal%5D)">Identification of skin lesions from the transient thermal response using infrared imaging technique.</a> IEEE 5th Int. Symp. on Biomedical Imaging: From Nano to Macro 1-4. , 1219-1222 (2008).</li>
<li>Cetingul, P. irtini, M,, Herman, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Quantification+of+the+thermal+signature+of+a+melanoma+lesion%5BTitle%5D)+AND+%22Int.+Journal+of+Thermal+Science%22%5BJournal%5D)">Quantification of the thermal signature of a melanoma lesion.</a> Int. Journal of Thermal Science. 50, 421-431 (2011).</li>
<li>Pirtini Cetingul, M., Herman, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((A+heat+transfer+model+of+skin+tissue+for+the+detection+of+lesions%3A+sensitivity+analysis%5BTitle%5D)+AND+%22Physics+in+Medicine+and+Biology%22%5BJournal%5D)">A heat transfer model of skin tissue for the detection of lesions: sensitivity analysis.</a> Physics in Medicine and Biology. 55, 5933-5951 (2010).</li>
<li>Pirtini Cetingul, M., Herman, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Quantitative+evaluation+of+skin+lesions+using+transient+thermal+imaging%5BTitle%5D)+AND+%22Proc.+Int.+Heat+Transfer+Conf%22%5BJournal%5D)">Quantitative evaluation of skin lesions using transient thermal imaging.</a> Proc. Int. Heat Transfer Conf. , (2010).</li>
</ol>

No conflicts of interest declared.

The results suggest that by applying the cooling stress we enhanced the temperature differences between the lesion and the surrounding healthy tissue. Also, because of small movements of the patient during the thermal imaging, we had to apply motion tracking to correctly overlay images to measure temperature differences between reference state and the temperature distribution during thermal recovery. Without the motion tracking we would not have been able to detect and measure the temperature difference between the malignant lesion and the healthy tissue. These results and the need for accurate motion tracking explain the difficulties investigators faced in the past when attempting to diagnose melanoma using IR imaging based on steady state information alone and clearly prove the advantages of dynamic thermal imaging.
It should be noted that the spatial resolution of the IR camera (number of pixels in the IR focal plane array) is critical when discerning small lesions. Both the spatial resolution and the temperature sensitivity of the early infrared cameras was limited, which also accounts for the difficulties in detecting early stage melanoma in the past. The key differences between our approach and prior thermal imaging attempts - that were moderately successful - are the sequences of calibration and image processing steps that allow us to accurately measure temperature differences in this system in addition to the dynamic imaging process that relies on active cooling.

<table><tbody><tr><td>Merlin MWIR camera </td><td>FLIR Systems Inc.</td><td></td><td></td></tr><tr><td>Canon PowerShot G11 </td><td>Canon, inc.</td><td></td><td></td></tr><tr><td>DermLite Foto System </td><td>DermLite</td><td></td><td></td></tr><tr><td>Vortex tube </td><td>Exair</td><td></td><td></td></tr><tr><td>Air tanks</td><td>Airgas</td><td></td><td></td></tr></tbody></table>

quantitative visualization and detection of skin cancer using dynamic thermal imaging

Quantitative Visualization and Detection of Skin Cancer Using Dynamic Thermal Imaging

In 2010 approximately 68,720 melanomas will be diagnosed in the US alone, with around 8,650 resulting in death 1. To date, the only effective treatment for melanoma remains surgical excision, therefore, the key to extended survival is early detection 2,3. Considering the large numbers of patients diagnosed every year and the limitations in accessing specialized care quickly, the development of objective in vivo diagnostic instruments to aid the diagnosis is essential. New techniques to detect skin cancer, especially non-invasive diagnostic tools, are being explored in numerous laboratories. Along with the surgical methods, techniques such as digital photography, dermoscopy, multispectral imaging systems (MelaFind), laser-based systems (confocal scanning laser microscopy, laser doppler perfusion imaging, optical coherence tomography), ultrasound, magnetic resonance imaging, are being tested. Each technique offers unique advantages and disadvantages, many of which pose a compromise between effectiveness and accuracy versus ease of use and cost considerations. Details about these techniques and comparisons are available in the literature 4.
Infrared (IR) imaging was shown to be a useful method to diagnose the signs of certain diseases by measuring the local skin temperature. There is a large body of evidence showing that disease or deviation from normal functioning are accompanied by changes of the temperature of the body, which again affect the temperature of the skin 5,6. Accurate data about the temperature of the human body and skin can provide a wealth of information on the processes responsible for heat generation and thermoregulation, in particular the deviation from normal conditions, often caused by disease. However, IR imaging has not been widely recognized in medicine due to the premature use of the technology 7,8 several decades ago, when temperature measurement accuracy and the spatial resolution were inadequate and sophisticated image processing tools were unavailable. This situation changed dramatically in the late 1990s-2000s. Advances in IR instrumentation, implementation of digital image processing algorithms and dynamic IR imaging, which enables scientists to analyze not only the spatial, but also the temporal thermal behavior of the skin 9, allowed breakthroughs in the field.
In our research, we explore the feasibility of IR imaging, combined with theoretical and experimental studies, as a cost effective, non-invasive, in vivo optical measurement technique for tumor detection, with emphasis on the screening and early detection of melanoma 10-13. In this study, we show data obtained in a patient study in which patients that possess a pigmented lesion with a clinical indication for biopsy are selected for imaging. We compared the difference in thermal responses between healthy and malignant tissue and compared our data with biopsy results. We concluded that the increased metabolic activity of the melanoma lesion can be detected by dynamic infrared imaging.

We demonstrated that malignant pigmented lesions with increased metabolic activity generate quantifiable amounts of heat and the measurement of the transient thermal response of the skin to a cooling excitation allows quantitative identification of melanoma and other skin cancers (vs. non-proliferative nevi) at an early stage of the disease.

In 2010 approximately 68,720 melanomas will be diagnosed in the US alone, with around 8,650 resulting in death 1. To date, the only effective treatment ...

This procedure aims to diagnose melanoma or other types of skin cancer non-invasively using dynamic infrared imaging. Start by taking a white light photograph of the lesion and the surrounding healthy tissue, followed by a reference infrared image of the same region of the skin. Next, cool, the lesion and surrounding skin.Then remove the cooling stress and record an infrared movie of the reheating process termed thermal recovery. Finally, perform the data analysis and image processing of the captured white light and infrared images to measure the temperature of the skin as a function of time during the thermal recovery process, compare the skin temperature at the location of the lesion and far away from the lesion to evaluate differences in the thermal response as an indication of increased metabolic activity that may be related to skin cancer. Ultimately, results can be obtained that show heat generation through dynamic thermal imaging.Dynamic infrared imaging is a noninvasive objective and quantitative method that allows detection of melanoma at an early stage of the disease. This method can help answer key questions in the field, such as whether I pick man signal lesions is metabolically active and measure the level of metabolic activity combined with increased blood supply. This can be linked to cancer staging.This method entails some complexity of acquiring accurate surface temperature data using infrared imaging techniques and compensating for involuntary movement of the subject during the imaging process. So Dr.Mcg Miguel Perini, a postdoc from my lab and myself will now demonstrate the procedure, Organize a temperature controlled exam room equipped with an infrared camera and a PC for infrared image acquisition and storage, as well as a data acquisition card connected to a computer. In order to monitor the room and skin surface temperatures, attach thermocouples to a data acquisition card during the patient study and store measurement data on a computer.Since lesion detection in the thermal image requires a cooling effect, use a square adhesive marker to localize the pigmented lesion of interest and its surroundings with the digital camera. Acquire a bright light image of the pigmented lesion and the adhesive window. Then connect a dermatoscope to a digital camera and capture oscopy images.The lab view software captures and saves all infrared images using the lab view software. Capture a steady state infrared image with a Merlin midway infrared camera. Proceed to apply a stream of cold air to the area of the patient's skin containing the lesion, as well as a 50 millimeter diameter of surrounding region.After one minute, remove the cooling stress to allow the skin to rewarm at room temperature for three to four minutes. During this thermal recovery phase, capture infrared images of the pigmented lesion every two seconds in order to obtain accurate transient temperature distributions on the skin surface. Analyze the IR images using a MATLAB code customized for this purpose, including several calibration steps and a multimodal image analysis system.Start by applying a landmark detection algorithm to the bright light image for localizing the corners of the adhesive marker. Next, identify the corresponding points in the reference IR image, compensate for involuntary body or limb movement of the patient by using these points as landmarks in a quadratic motion model for aligning the IR image sequence during recovery phase. Next, use the random walker to spatially guide the segmentation by placing seed points to create a mask image delineating the lesion.Once the shape of the lesion is determined, identify the corresponding region in each of the registered IR images. Select random points inside the lesion and away from the lesion representing the lesion and the healthy tissue respectively. Then compare the transient thermal responses of both sites.Finally, prepare a table including all the digital oscopy color-coded IR images of the lesion and surrounding area recorded at ambient conditions and two seconds after the cooling excitation, as well as the transient thermal responses of the lesion and corresponding healthy tissue. In a patient study in which patients who possess a pigmented lesion with a clinical indication for biopsy are selected for imaging, the increased metabolic activity of the melanoma lesion can be detected by dynamic infrared imaging. Once data is collected from the patient's study, a precise thermal response curve is obtained with motion correction.There is no difference in temperature between the benign pigmented lesion and the healthy skin tissue in the infrared image or during thermal recovery. Thermal imaging proves a particular advantage in malignant skin lesions based on the infrared images. A significant temperature and color difference is observed during the thermal recovery, only at the location of the melanoma lesion in the infrared image.Once fully optimized and automated, this technique can be done in two, three minutes if it is performed properly. This imaging procedure is harmless. There are no hazards involved, and this is essential in clinical diagnostics.While attending this procedure, it's important to remember that the subject needs to remain as motionless as possible following this procedure. Other methods like biopsy can be performed in order to answer additional questions like the staging and penetration level of the cancer and second lesion.

quantitative-visualization-detection-skin-cancer-using-dynamic

Research

JoVE Journal

Medicine

A dual-mode imaging system was developed for non-contact assessment of cutaneous tissue oxygenation and vascular function.

Dual-mode Imaging of Cutaneous Tissue Oxygenation and Vascular Function

In this report, we describe the three-dimensional skin reconstruct model which mimics human skin in architecture and composition. Melanocyte physiology, melanoma progression and the fate of dermal stem cells have been investigated using the skin reconstruct model. The model is also useful as a preclinical tool for drug assessment.

The Three-Dimensional Human Skin Reconstruct Model: a Tool to Study Normal  Skin and Melanoma Progression

A comprehensive overview of the techniques involved in generating a mouse model of oral cancer and quantitative monitoring of tumor invasion within the tongue through multi-photon microscopy of labeled cells is presented.  This system can serve as a useful platform for the molecular assessment and drug efficacy of anti-invasive compounds.

Multi-photon Imaging of Tumor Cell Invasion in an Orthotopic Mouse Model of Oral Squamous Cell Carcinoma

This article presents methods to fabricate and characterize a conformal, skin-like electronic system and protocols for the use in clinical applications, particularly on cutaneous wound management.

Fabrication and Characterization of a Conformal Skin-like Electronic System for Quantitative, Cutaneous Wound Management

This method aims at locating vertical subsurface defects. Here, we couple a laser with a spatial light modulator and trigger its video input to heat a sample surface deterministically with two anti-phased modulated lines while acquiring highly resolved thermal images. The defect position is retrieved from evaluating thermal wave interference minima.

Subsurface Defect Localization by Structured Heating Using Laser Projected Photothermal Thermography

Here, we describe protocols for acquiring good-quality images using novel, noninvasive imaging devices of reflectance confocal microscopy (RCM) and combined RCM and optical coherence tomography (OCT). We also familiarize clinicians with their clinical applications so that they can integrate the techniques into regular clinical workflows to improve patient care.

Combining Reflectance Confocal Microscopy with Optical Coherence Tomography for Noninvasive Diagnosis of Skin Cancers via Image Acquisition

The protocol presents a new tool to simplify intravital imaging using inverted confocal microscopy.

Streamlined Intravital Imaging Approach for Long-Term Monitoring of Epithelial Tissue Dynamics on an Inverted Confocal Microscope

Translation of Intravital microscopy findings is challenged by its shallow depth penetration into tissue. Here we describe a dorsal window chamber mouse model that enables co-registration of intravital microscopy and clinically applicable imaging modalities (e.g., CT, MRI) for direct spatial correlation, potentially streamlining clinical translation of intravital microscopy findings.

A Dorsal Skinfold Window Chamber Tumor Mouse Model for Combined Intravital Microscopy and Magnetic Resonance Imaging in Translational Cancer Research

This article presents the protocol for preparing tumor-tissue phantoms that replicate optical properties for plasmonic photothermal therapy. It details phantom preparation, photothermal evaluations, and validation of the developed numerical model based on photothermal temperature measurements for assessing therapeutic parameters, offering an ethical, cost-effective alternative to in vivo studies for preliminary testing.

Plasmonic Photothermal Cancer Therapy: Nanoparticle-embedded Tumor-tissue-mimicking Phantoms for Visualizing Photothermal Temperature Distribution

We describe a simple immunoassay to measure the production of pro-inflammatory cytokines, such as IL-1 beta production, in patients presenting with autoinflammatory phenotypes. By activating cells in whole blood cultures with pathogen-associated molecular patterns, specifically with lipopolysaccharide, cytokine secretion can be conveniently evaluated in whole blood supernatants.

Accurate and Simple Measurement of the Pro-inflammatory Cytokine IL-1&beta; using a Whole Blood Stimulation Assay

Learn dynamic thermal imaging for non-invasive melanoma detection using infrared temperature monitoring. This method detects increased metabolic activity in malignant skin lesions during thermal recovery.

Quantitative Visualization and Detection of Skin Cancer Using Dynamic Thermal Imaging

Explore More Videos