$$\rightleftharpoonup{xx}$$
$$\longleftharp{xx}$$,
$$\longrightharp{xx}$$,
This section describes the complete physics-constrained deep learning pipeline for thermal condition assessment using infrared thermographic imagery. The framework integrates (i) temperature field extraction, (ii) baseline CNN regression, (iii) diffusion-based physics regularization, (iv) adaptive parameter learning, and (v) uncertainty quantification. All the tools used in this study are described in the Table of Materials.
Thermal image acquisition and temperature field construction
Infrared (IR) images of high-voltage power equipment were acquired using a calibrated thermographic camera. Each image was converted into a spatial temperature matrix T(x, y) ∈ ℝH×W by mapping pixel intensities to physical temperature values (°C) using camera radiometric calibration parameters. Figure 1A–C shows temperature visualization. The original IR image is converted into a physically meaningful temperature map. The histogram shows a skewed temperature distribution with a concentration between 50–90 °C. Localized high-temperature zones (hotspots) are clearly visible. Figure 2 shows a 3D thermal surface elevation representation of the temperature field. The 3D surface elevation plot reveals steep gradients around hotspot regions. Temperature peaks approach ~120 °C. The thermal field is spatially smooth, except near energized conductors and connection joints. These characteristics justify the use of a diffusion-based regularization term to enforce physical smoothness while preserving localized high-gradient phenomena.

Figure 1: Temperature Visualization. (A) Original infrared (IR) thermographic image of the inspected high-voltage equipment showing the observed thermal pattern. (B) Extracted temperature map obtained from the thermographic image, illustrating the spatial distribution of surface temperatures and associated thermal gradients. (C) Temperature distribution histogram showing the frequency distribution of temperature values within the extracted temperature field. This figure demonstrates the conversion of a thermographic image into a quantitative temperature representation and summarizes the underlying temperature distribution used for subsequent model development and analysis. Abbreviations; IR = infrared. Please click here to view a larger version of this figure.

Figure 2: 3D thermal surface elevation representation of the temperature field. Three-dimensional visualization of the temperature distribution, where surface elevation corresponds to temperature magnitude and highlights localized thermal hotspots. Please click here to view a larger version of this figure.
Problem formulation
Let

denote the RGB infrared thermographic image, where H and W represent the spatial dimensions and C = 3 corresponds to the color channels associated with the rainbow thermal palette. Although the infrared image visually represents thermal information, it is not a direct numerical temperature matrix because the displayed colors depend on palette mapping, scaling, interpolation, and imaging conditions.
Let

denote the corresponding ground-truth temperature field obtained through radiometric calibration and temperature extraction from the infrared imaging system.
The learning objective is to approximate the mapping

where θ denotes the trainable parameters of the CNN and T̂ represents the predicted temperature field. The purpose of this supervised mapping is not simply to reproduce direct radiometric conversion, but to learn a spatially consistent temperature regression model from rendered thermographic images. Unlike direct pixel-wise color-to-temperature extraction, the CNN can exploit contextual thermal structure across neighbouring regions, reduce noise sensitivity, preserve hotspot characteristics, and generate smoother physically plausible temperature fields under the imposed diffusion constraints. The baseline objective function minimizes the pixel-wise regression error between the predicted and calibrated temperature fields:

where Tij and T̂ij denote the ground-truth and predicted temperatures at pixel location (i, j), respectively. Accordingly, the framework should be interpreted as a physics-regularized thermographic regression model rather than a replacement for direct radiometric calibration.
Infrared image acquisition conditions
Infrared thermographic images were acquired using a FLIR thermal imaging camera under outdoor substation operating conditions. The dataset consisted of RGB thermographic images with a spatial resolution of 640 × 480 pixels, recorded using the FLIR rainbow color palette. Each image included an embedded thermal scale bar indicating the temperature range associated with the acquisition frame. The thermographic inspection covered multiple categories of high-voltage equipment, including transformers, bushings, insulators, connectors, and terminal structures. Images were captured during normal operating conditions to include both standard thermal behavior and localized hotspot patterns relevant to condition monitoring applications. Image acquisition was performed from practical inspection viewpoints typically used in field thermography. The camera orientation and viewing angle varied depending on equipment accessibility and substation layout. Thermal images were visually screened to ensure that the target equipment remained clearly observable and that the hotspot regions were distinguishable from the background. The dataset was organized into labeled folders according to equipment category and thermal condition. Prior to model development, the images were segmented and resized into a consistent spatial format for temperature-field extraction and CNN training. The thermographic images contain thermal distributions suitable for computer vision and deep learning studies involving hotspot detection, fault identification, anomaly localization, and temperature-field prediction. In the present work, the thermal profiles extracted from the infrared images were used for physics-constrained temperature estimation and uncertainty-aware thermal assessment.
Thermographic dataset and data partitioning
The dataset used in this study consisted of 174 infrared thermographic images acquired from high-voltage substation equipment using a FLIR thermal imaging system15. The dataset included multiple types of power-system components, including transformers, bushings, insulators, connectors, and high-voltage terminal structures operating under practical outdoor conditions. Each thermographic image was converted into a spatial temperature field using the radiometric information provided by the infrared camera. The dataset contains thermal variations ranging from normal operating conditions to localized hotspot regions associated with elevated thermal stress. The data were divided into training, validation, and test subsets with a 70:15:15 split, yielding 121, 26, and 27 images, respectively. The partitioning was performed at the image level because the dataset consisted of independently captured thermographic scenes collected under varying operating conditions and viewpoints. Care was taken to avoid near-duplicate frames across subsets in order to reduce data leakage risk and improve evaluation fairness. All images were resized to a uniform spatial resolution prior to training. Temperature normalization was applied to stabilize optimization while preserving relative thermal gradients and hotspot characteristics important for condition assessment.
Baseline CNN architecture
A fully convolutional encoder–decoder regression architecture was adopted to preserve spatial resolution during temperature-field prediction from infrared thermographic images. All input infrared images were resized to a uniform resolution of 256 × 256 × 3 prior to training. The encoder section consisted of four convolutional blocks with progressively increasing feature depth. Each block contained a 3 × 3 convolution layer followed by batch normalization and ReLU activation. Spatial downsampling was performed using strided convolutions rather than max pooling to better preserve localized thermal structures and hotspot information. The encoder channel progression was:
32 → 64 → 128 → 256
The decoder section reconstructed the spatial temperature field using transposed convolution layers for upsampling with the reverse feature progression:
256 → 128 → 64 → 32
Each decoder block similarly employed transposed convolution, batch normalization, and ReLU activation. A final 1 × 1 convolution layer generated the predicted single-channel temperature map:
T̂ ∈ ℝ256×256
The network therefore outputs a full-resolution spatial temperature field corresponding to the infrared input image. To support uncertainty quantification, dropout layers with probability p = 0.2 were inserted near the bottleneck and decoder stages. During inference, dropout remained active to enable Monte Carlo sampling for predictive uncertainty estimation. All convolutional weights were initialized using He-normal initialization, while bias terms were initialized to zero. The model was trained using the Adam optimizer with an initial learning rate of 1 × 10−3, batch size of 8, and weight decay of 1 × 10−5. Training was performed for 100 epochs using cosine learning-rate decay and early stopping based on validation RMSE.
The baseline objective function is defined as:

where Ldata denotes the pixel-wise mean squared error between predicted and ground-truth temperature fields.
Performance was evaluated using: R2, RMSE, and MAE.
Although the baseline CNN successfully captured the overall thermal structure and hotspot distribution, it occasionally produced non-physical artifacts in low-gradient regions and slight oversmoothing near sharp thermal boundaries. These limitations motivated the introduction of diffusion-based physics regularization in the subsequent model formulation.
Physics-constrained learning via diffusion
Governing heat equation
To enforce thermal consistency in the predicted temperature field, a diffusion-based physics prior was incorporated into the heat equation. Under quasi-steady conditions, the surface temperature approximately satisfies

where T denotes temperature, α is thermal diffusivity, and S represents local heat generation. Since the available thermographic samples are single inspection snapshots rather than time-resolved sequences, the temporal derivative cannot be directly evaluated. Accordingly, the model assumes local quasi-steady conduction and enforces

away from active heating regions.
The 2D Laplacian was discretized using the standard finite-difference stencil:

The physics residual was then computed over the predicted temperature map as

To avoid ambiguity at the image boundaries, the Laplacian residual was evaluated only on valid interior pixels, where all neighboring values required by the stencil are available. No explicit masking was applied to hotspot regions, since the objective of the physics term was to regularize the full spatial field rather than suppress thermally active zones. The hotspot structure was therefore learned through the data term, while the Laplacian penalty encouraged diffusion-consistent smoothness across the predicted map.
The final objective function combined the data loss and the physics loss as

where λphys controls the strength of the physics regularization. In the ablation study, λphys ∈ {0, 10−4, 10−3, 10−2, 10−1} was examined to assess the effect of increasing physical constraint strength. Moderate values improved generalization, whereas overly strong weighting tended to oversmooth sharp hotspot gradients. This behavior is consistent with the thermal structures observed in the infrared images, where physically smooth regions coexist with localized high-temperature concentrations.
It should be emphasized that the steady-state diffusion formulation used in this work is not intended to represent the complete heat-transfer mechanism governing hotspot formation in high-voltage equipment. In practice, localized overheating arises from internal heat-generation processes such as Joule heating, contact resistance, and insulation degradation. Because the available dataset consists of snapshot thermographic images without temporal information or source measurements, the diffusion constraint is employed as a physics-inspired spatial regularization term. Its role is to encourage locally smooth, physically plausible temperature fields while allowing the hotspot characteristics to be learned from the data. Therefore, the diffusion prior should be interpreted as a spatial smoothness constraint rather than a comprehensive model of the underlying thermal physics.
Learnable thermal diffusivity and source-term augmentation
To improve physical interpretability, the effective thermal diffusivity was treated as a trainable scalar parameter. Let T̂(x, y) denote the predicted temperature field and let α > 0 denote the learnable thermal diffusivity. To enforce positivity, α was parameterized through an unconstrained variable β as

In this formulation, the physics prior was written in terms of an effective residual forcing field R(x, y), where R(x, y) represents the local departure from pure diffusion induced by unmodeled heating effects. The adaptive-diffusivity relation is therefore expressed as

Here, ∇2T̂(x, y) is the Laplacian of the predicted temperature field, and R(x, y) is the effective residual source term inferred implicitly from the thermographic data. Because the available samples are snapshot images rather than time-resolved thermal sequences, R(x, y) is not separately supervised and serves only as a latent physics quantity during optimization. The corresponding physics loss was defined as

For the source-term augmented experiment, an auxiliary CNN head was added to estimate a spatial source map Ŝ(x, y). In this case, Ŝ(x, y) represents the predicted local heat-generation field, and the governing relation becomes

The source head was attached to the encoder bottleneck and consisted of a small convolutional branch that mapped shared latent features to a single-channel output map Ŝ(x, y). No ground-truth source labels were available; therefore, Ŝ(x, y) was learned only through the joint objective

where Ldata is the temperature regression loss, λphys controls the diffusion constraint, and λs regularizes the source prediction to discourage trivial high-magnitude source maps. In the snapshot-based setting considered here, the source-term formulation remained underdetermined and did not improve prediction accuracy.
Monte Carlo dropout for uncertainty quantification
To estimate epistemic uncertainty in the predicted temperature field, Monte Carlo dropout was applied during inference. Dropout layers with a rate of 0.2 were placed after the bottleneck block and within the decoder stages of the CNN. During testing, these dropout layers were kept active, and 30 stochastic forward passes were performed for each infrared image. For the k-th stochastic pass, the predicted temperature field is denoted by

where X is the input infrared image and θk represents the sampled network parameters induced by dropout. The predictive mean was computed as

and the pixel-wise predictive variance was obtained as

with K = 30. The resulting variance map was used to identify spatial regions with lower predictive confidence. Because ground-truth uncertainty labels are not available for thermographic regression, uncertainty was evaluated using pixel-wise variance maps and summary statistics computed over hotspot and background regions, rather than calibration-based metrics. The quantitative analysis showed that the mean predictive standard deviation was 13.046 °C, while the hotspot region exhibited a higher standard deviation of 15.934 °C compared with 12.743 °C in the background region. This corresponds to an approximately 25% increase in uncertainty within hotspot areas relative to the background. These results indicate that the model expresses greater uncertainty near thermally complex regions, particularly around hotspot boundaries and steep temperature gradients, which is consistent with the structure observed in the thermal surface visualizations. The workflow is summarized in Figures 3 and 4 shows the overall CNN-based processing pipeline.

Figure 3: Workflow. Overview of the proposed methodology, including thermographic image acquisition, preprocessing, temperature-field extraction, CNN training, physics-constrained learning, and uncertainty quantification. Abbreviations; CNN = convolutional neural network. Please click here to view a larger version of this figure.

Figure 4: Overall CNN-based processing pipeline. Architecture of the proposed CNN framework showing the transformation of infrared thermographic images into spatial temperature-field predictions. Abbreviations; CNN = convolutional neural network. Please click here to view a larger version of this figure.