Research Article

Research on Transmission Line Personal Protective Equipment Detection Algorithm Based on Improved YOLOv11

DOI:

10.3791/69489

December 30th, 2025

In This Article

Summary

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The goal of this protocol is to provide a step-by-step guide for developing an improved YOLOv11n-based model for PPE detection. It details architectural and training modifications that result in a lightweight, real-time detector with a state-of-the-art accuracy of 90.1% mAP and inherent interpretability.

Abstract

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

In intelligent transmission line inspection, edge computing devices face the critical challenge of balancing real-time performance with detection accuracy for personal protective equipment recognition in complex operational scenarios. This study proposes WTLS-YOLOv11n, a lightweight and inherently interpretable detection algorithm. The methodology integrates three synergistic innovations into the YOLOv11n architecture. A C3K2-WTConv module employing a discrete wavelet transform decomposes features into physically meaningful frequency components, enabling robust multi-scale feature extraction with inherent interpretability. A lightweight shared composite detection head achieves substantial parameter reduction through strategic weight sharing while preserving multi-scale fusion capabilities. The MPDIoU loss function enhances localization accuracy for small and irregularly shaped targets. Experimental validation demonstrates that the proposed model achieves superior detection accuracy with significantly reduced parameters and computational complexity compared to the baseline, while maintaining real-time inference performance on edge hardware platforms. Quantitative interpretability analysis reveals that detection decisions are predominantly driven by low-frequency structural features rather than high-frequency textural details, providing transparent insight into the model's reasoning process. Comparative experiments against mainstream detection models validate the superior accuracy-efficiency trade-off of the proposed approach. This work establishes a transparent, efficient, and trustworthy solution for automated safety supervision in electrical power operations, with broader applicability to safety-critical detection tasks requiring edge deployment and interpretable decision-making.

Introduction

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Deep learning has transformed industrial safety protocols and introduced new approaches to occupational risk management. This transformation is particularly evident in high-risk sectors such as power systems engineering. Vision-based intelligent supervision systems now leverage the YOLO (You Only Look Once)1 architecture to enable automated detection of Personal Protective Equipment (PPE)2,3 in real time. These systems have emerged as a critical technology for workplace safety monitoring, offering significant improvements in detection accuracy and response speed compared to traditional methods.

These systems continuously monitor compliance with safety standards, reducing human error and improving oversight at complex power operation sites. Yet the deep neural networks underlying these systems present a significant challenge: their decision-making processes remain opaque. This lack of interpretability represents the primary obstacle to broader industry adoption, particularly in safety-critical applications where understanding system reasoning is essential for building trust and ensuring accountability.

When a model generates an incorrect judgment, missing a non-compliant worker or triggering unnecessary operational shutdowns, the opaque decision-making process provides no actionable information for safety managers. Without the ability to diagnose errors, understand system reasoning, or verify decisions, these systems cannot meet the reliability standards required in environments where human safety is at stake. This gap has driven growing demand for Explainable Artificial Intelligence (XAI)4,5,6 approaches that deliver both accuracy and transparency. The goal is to develop systems that safety personnel can understand, validate, and trust in critical operational contexts.

Transparency remains essential, yet it must be built upon models that perform reliably in challenging operational conditions. Power operation sites present distinct technical demands that require robust detection capabilities. These environments experience extreme illumination variations ranging from intense daylight to complete darkness. Complex machinery frequently obstructs the visual field, creating occlusion challenges that standard detection models struggle to address. Weather conditions add further variability, affecting visibility and image quality across different operational scenarios. Meeting these challenges requires models that maintain consistent performance despite such environmental complexity.

Researchers have pursued multiple approaches to optimize YOLO performance for power site applications. Architectural modifications represent one significant research direction. Several studies have enhanced the YOLOv57 network by incorporating additional detection heads within the neck structure. This modification addresses a persistent challenge in PPE detection: the difficulty of identifying small objects at a distance or in cluttered visual fields. The additional detection layers enable the model to capture finer spatial details that standard architectures may overlook.

A second major research direction focuses on model optimization for deployment environments. Power operation sites often require detection systems to operate on edge devices with limited computational resources. This constraint has driven efforts in model compression and efficiency improvements. Researchers have developed techniques to reduce model size and inference time while preserving detection accuracy, enabling real-time performance on hardware with restricted processing capabilities8,9.

Recent optimization efforts have introduced several promising techniques to reduce model complexity. Researchers have integrated efficient backbone networks such as MobileNetv310 into architectures like YOLO-M11. Others have applied model pruning and knowledge distillation to develop compact variants including Light-YOLOv412. These approaches have demonstrated measurable improvements in computational efficiency and deployment feasibility.

However, these optimization methods face a fundamental constraint inherent to conventional convolutional architectures. Standard convolution operations require increasingly deeper network layers or larger kernel sizes13 to expand the receptive field, which is essential for capturing contextual information across the image. This architectural requirement creates an unavoidable trade-off. As models gain the capacity to extract richer features and understand broader spatial context, their parameter counts and computational demands increase substantially. The resulting models often exceed the processing capabilities of edge devices, limiting their practical deployment in real-time operational environments.

This tension between feature extraction capability and computational efficiency represents a significant methodological challenge that current approaches have not fully resolved. The field requires a fundamentally different approach to feature extraction that can capture hierarchical multi-scale features without the proportional increase in parameters that conventional methods impose. Such an approach would enable models to maintain both the detection performance required for safety-critical applications and the efficiency necessary for edge deployment. Addressing this gap represents a critical research priority for advancing practical PPE detection systems in power operation environments.

Current explainability methods for object detection predominantly use post-hoc analysis approaches14 such as Grad-CAM. While these methods provide useful visualizations, they operate independently from the model's learning process. An alternative approach is to design architectural components that offer transparency through their operational mechanisms. Our wavelet-based feature extraction provides a straightforward way to understand which frequency components contribute to detections, though further research is needed to fully quantify this interpretability.

This research addresses three interconnected challenges in PPE detection systems: detection accuracy, computational efficiency, and model interpretability. The work modifies the YOLOv11n15 architecture through three targeted design changes.

The first modification introduces the C3K2-WTConv module, which replaces standard convolution with a wavelet-inspired feature extraction process. This approach separates visual information into frequency components: low-frequency signals contain shape and contour information, while high-frequency signals encode texture and edge details. This separation improves feature quality and makes the extraction process more transparent than conventional convolution operations.

The second modification implements a Lightweight Shared Composite Detection Head (LSCD) to reduce computational requirements. This component uses parameter sharing across detection scales, decreasing model size while maintaining multi-scale detection capabilities. This design targets the resource constraints typical of edge devices used in power operation sites.

The third modification replaces the standard loss function with MPDIoU loss16 to improve bounding box accuracy. This change addresses localization challenges associated with small and variably shaped PPE items by providing better gradient stability during training.

Testing shows the modified model achieves 3.8% higher mean Average Precision than the baseline while using 11.5% fewer parameters. These results indicate the approach meets practical requirements for edge deployment while improving detection performance. The work provides a functional solution for safety monitoring in power operations, though further validation in diverse operational conditions remains necessary to fully assess system reliability.

Access restricted. Please log in or start a trial to view this content.

Protocol

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The image data for this study were collected from power operation environments with necessary permissions. All images were anonymized with no personally identifiable information retained. This study focuses on detecting personal protective equipment rather than identifying individuals. As the research involves only algorithm development using anonymized data, ethical approval was not required.

The following protocol details a comprehensive procedure for designing, training, and evaluating a lightweight, high-performance, and inherently interpretable object detection model, named WTLS-YOLOv11n, for Personal Protective Equipment (PPE) detection. The software used in this study is listed in the Table of Materials.

Overall architectural framework

The proposed WTLS-YOLOv11n model is built upon the YOLOv11n baseline. The core methodology involves systematically replacing or enhancing key modules in the backbone and head to improve performance, efficiency, and interpretability.

The proposed WTLS-YOLOv11n model is built upon the YOLOv11n baseline. The core methodology involves systematically replacing or enhancing key modules in the backbone and head to improve performance, efficiency, and interpretability. The overall architectural paradigm of YOLOv11n, which consists of a backbone, neck, and head, was retained in the proposed model. In the backbone, specific C3K2 modules were replaced with the proposed C3K2-WTConv modules to enhance feature extraction. In the head, the original detection head was replaced with the proposed Lightweight Shared Composite Detection Head (LSCD) to reduce model complexity. The complete architecture of the proposed WTLS-YOLOv11n model, contrasted with the baseline, is illustrated in Figure 1.

C3K2-WTConv module design

This module is designed to replace the standard convolutional modules within the YOLOv11n backbone. Its design is guided by two primary objectives: (a) to efficiently expand the model's receptive field for capturing multi-scale contextual information without significantly increasing the parameter count or computational complexity, and (b) to learn more robust and inherently interpretable feature representations by explicitly decomposing feature maps into the frequency domain.

Design of the Core WTConv layer

The foundational WTConv (Wavelet Transform Convolution) layer is designed to implement the 2D Discrete Haar Wavelet Transform. This process is accomplished through a set of specific wavelet kernels:

Wavelet Kernels: The transform is implemented via four fixed, non-trainable depthwise convolution kernels (F_LL, F_LH, F_HL, F_HH), which correspond to the Haar wavelet basis functions. These kernels are responsible for decomposing the input feature map into its low- and high-frequency components.

Decomposition and Downsampling: These kernels are applied to the input feature map (X) with a stride of 2. This single operation efficiently performs both feature decomposition and spatial downsampling, separating the input into four distinct sub-bands.

Physical interpretation of output components

The four feature sub-bands generated by the wavelet decomposition possess a clear physical interpretation. As illustrated in Figure 2, the WTConv layer recursively decomposes the input into the following components:

Low-Frequency Component (LL): This component preserves the overall structure, contour, and other global information of the target at half the spatial resolution. It serves as the foundation for the model to understand the target's "shape."

High-Frequency Components (LH, HL, HH): These three components capture fine-grained details such as horizontal, vertical, and diagonal edges and textures, respectively. They enable the model to focus on the target's "details."

Integration into the C3K2 module structure

The designed WTConv layer is seamlessly integrated into the C3K2 bottleneck structure of YOLOv11n.

Replacement Strategy: Within the original C3K2 module, the standard 3x3 convolutional layer is replaced with the WTConv layer. This approach preserves the efficient feature reuse mechanism of the C3K2 architecture while introducing the advantages of the wavelet transform, resulting in the final C3K2-WTConv module (detailed structure shown in Figure 3).

Cascaded Receptive Field Expansion: The WTConv process can be recursively applied to the low-frequency (LL) output of the preceding stage. This cascaded decomposition mechanism allows the model to analyze features over an exponentially increasing receptive field with minimal computational overhead, thereby creating an efficient multi-scale frequency decomposition pathway.

Lightweight Shared Composite Detection Head (LSCD) Design

This module is engineered to replace the original YOLOv11n detection head, with the primary goal of drastically reducing model complexity and computational overhead for efficient deployment on resource-constrained edge devices. The design addresses the significant parameter redundancy found in standard multi-scale detection heads (detailed structure shown in Figure 4.

Rationale and design goals

The independent prediction branches for each feature scale (P3-P5) in the original YOLOv11 head lead to a high parameter count. The LSCD introduces a hybrid parameter-sharing strategy to achieve superior parameter efficiency while preserving critical multi-scale feature fusion capabilities.

Parameter sharing and feature fusion mechanism

The core of the LSCD lies in its two-stage feature processing pipeline:

Scale-specific preprocessing: For each input feature map from the neck (P3, P4, P5), a non-shared 1x1 Convolution followed by a Group Normalization (GN) layer is applied. This initial step allows the network to learn scale-specific channel transformations, ensuring that unique characteristics of each feature level are preserved before fusion.

Efficient cross-scale fusion: Following the preprocessing, a series of shared 3x3 Convolution-GN modules are employed to perform the core feature fusion across different scales. By sharing weights, these modules learn a generalized feature fusion pattern, which is the primary source of parameter reduction. This design forces the model to learn more robust and universal fusion representations.

Dynamic scale adaptation and branch optimization

To compensate for any potential information loss from weight sharing and to refine prediction accuracy, two additional mechanisms are introduced:

Learnable Scale Layer: A learnable Scale layer is added for each detection scale. This layer introduces a per-scale learnable scalar that dynamically re-weights the fused features, allowing the model to adaptively emphasize or suppress features based on the target object sizes prevalent at that scale.

Optimized classification branch: The classification branch is enhanced by using the Softmax activation function for probability distribution and incorporating a Group Normalization (GN) layer. This stabilizes the training of the classification task and improves the robustness of confidence predictions, a technique proven effective in architectures like FCOS.

Improved Loss Function Design (MPDIoU)

The loss function is re-engineered to specifically address the challenges of accurate bounding box regression for small, cluttered, and irregularly shaped targets, which are common in PPE detection scenarios.

Motivation and limitations of traditional IoU loss

Standard IoU-based losses suffer from several critical drawbacks in this context:

Vanishing Gradients: When the predicted and ground-truth boxes have no overlap, the IoU is zero, and the loss gradient vanishes, stalling the learning process.

Insensitivity to alignment: Multiple bounding box configurations can yield the same IoU score, making the loss function insensitive to the quality of alignment (e.g., center point deviation vs. shape mismatch).

Poor performance on small objects: For small targets, even minor pixel deviations can be significant, but they often result in negligible changes to the IoU value, leading to imprecise localization.

Adopting the Minimum Point Distance IoU (MPDIoU) Loss

To overcome the aforementioned limitations, the protocol replaces the standard loss with the Minimum Point Distance IoU (MPDIoU) loss. MPDIoU enhances the standard IoU metric by incorporating a penalty term that directly penalizes the distance between the predicted and ground-truth boxes, even when they do not overlap.    

Core Mechanism: The penalty term is derived from the Euclidean distance between the corresponding corner points of the predicted box (pred) and the ground-truth box (gt). Specifically, the squared distances for the top-left corners Kinematics equation d<sub>1</sub><sup>2</sup>, vector movement, physics diagram, educational use.) and the bottom-right corners (Static equilibrium formula, d²₂ symbol in equations, important for mechanics analysis.) are calculated:

Euclidean distance formula \(d^2_1=(x^{\text{pred}}_1-x^{\text{gt}}_1)^2+(y^{\text{pred}}_1-y^{\text{gt}}_1)^2\).   (1)
Euclidean distance formula d²=(x²pred-x²gt)²+(y²pred-y²gt)² for data analysis.   (2)

To ensure the penalty is scale-invariant, this distance is normalized by the dimensions of the smallest enclosing box that covers both the predicted and ground-truth boxes. Let w and h be the width and height of this enclosing box, respectively. The MPDIoU metric is then formulated as:

Mathematical formula for MPDIoU, showcasing IoU adjustment with distances and dimensions.   (3)

Finally, the MPDIoU loss function (LMPDIoU) is defined as:

LMPDIoU = 1 - MPDIoU (4)

Key advantages: This geometric penalty term directly addresses the aforementioned issues by: i) providing a meaningful, non-zero gradient even when boxes do not overlap, thus preventing gradient vanishing and ensuring continuous model optimization, ii) offering heightened sensitivity to positional, size, and aspect ratio deviations, which is critical for the precise localization of small and diverse PPE items, iii) delivering more stable and consistent gradient signals throughout training, which promotes faster convergence and results in superior localization accuracy.

Datasets and experimental setup

Self-built PPE detection dataset

We established a PPE detection dataset containing 5,000 high-resolution images from power transmission line operations, annotated with LabelImg and converted to YOLO TXT format. The dataset includes five categories: safety helmets (1,245 instances), safety harnesses (1,128 instances), armbands (892 instances), working-at-height status (1,056 instances), and ground-level status (1,124 instances). Data is split into training (4,000 images), validation (500 images), and test (500 images) sets. Images feature challenging conditions, including extreme lighting, heavy occlusion (23% with >50% coverage), and complex industrial backgrounds. Standard augmentation techniques (random flipping, rotation, color jitter, mosaic) were applied during training.

PASCAL VOC dataset for generalization testing

To evaluate the model's generalization capability beyond power operation scenarios, we used the PASCAL VOC dataset, which combines VOC2007 and VOC2012 for a total of 21,503 images. Following standard practice, we used 11,540 images from VOC2012 for training and validation, and 9,963 images from VOC2007 for testing. The VOC dataset contains 20 object categories in varied real-world scenarios. While the specific objects differ from our PPE categories, the detection challenges (scale variation, occlusion, complex backgrounds) are similar, making it suitable for assessing the model's general detection capabilities and transferability.

Implementation details

This protocol outlines the procedure for training and evaluating the model. It is assumed that the user has access to the source code, a suitable Python environment, and the prepared datasets.

System and environment preparation

A workstation equipped with an NVIDIA GPU possessing at least 24 GB of VRAM was used to ensure sufficient memory for training (e.g., NVIDIA GeForce RTX 4090). The PyTorch deep learning framework (version 1.12.0 or higher) along with its corresponding CUDA toolkit was installed on the workstation. The installation was verified by opening a terminal and executing the command "python -c 'import torch; print(torch.cuda.is_available())'", which was expected to return "True". Required Python packages were installed by navigating to the project root directory and executing the command "pip install -r requirements.txt". This command automatically installed dependencies including numpy, opencv-python, pyyaml, tensorboard, and torchvision. Dataset preparation was verified to ensure that training images were located in /data/train/images/ and annotation files were in /data/train/labels/ in YOLO format (class x_center y_center width height). The same verification process was applied to the validation (/data/val/) and test (/data/test/) datasets.

Training configuration

The configuration file config/wtls_yolov11n.yaml was opened using a text editor to set up the training parameters. Data paths were configured by locating the 'path' parameter and setting it to the dataset root directory, while the 'train', 'val', and 'test' parameters were verified to point to the correct subdirectories. The 'nc' parameter (number of classes) was confirmed to match the dataset, which was set to 5 for PPE detection. Training hyperparameters were configured with the number of epochs set to 300 for full training and the batch size set to 16, with the understanding that this value could be adjusted based on GPU memory availability and reduced to 8 if out-of-memory errors occurred. The input image size (imgsz) was set to 640, and the optimizer was confirmed to be SGD with an initial learning rate (lr0) of 0.01. The weight decay was verified to be 0.0005 and momentum was set to 0.937. Data augmentation techniques were enabled using the default configured settings, which included mosaic augmentation (mosaic: 1.0), random horizontal flip with 50% probability, and color jitter with parameters hsvh: 0.015, hsvs: 0.7, and hsv: 0.4. Hardware utilization parameters were configured with the number of workers set to 8 for CPU threads used in data loading, and the device parameter set to 0 to use the first GPU, with the option to set it to "0,1" for multi-GPU training if needed.

Model training execution

Model training was initialized from the command line by executing the command "python train.py --cfg config/wtls_yolov11n.yaml --weights ''--data data.yaml", where the --cfg parameter specified the model configuration file, the --weights parameter was set to an empty string to train from scratch (alternatively, yolov11n.pt could be used for transfer learning), and the --data parameter specified the dataset configuration. During training, convergence indicators were observed to track model performance. In the first 50 epochs, a rapid loss decrease was observed with box_loss declining from approximately 1.5 to 0.8. Between epochs 50 and 150, steady improvement was noted as box_loss decreased from approximately 0.8 to 0.5. During epochs 150 to 300, the fine-tuning phase occurred with box_loss stabilizing around 0.4 to 0.5. The validation mAP@0.5 metric was expected to reach greater than 85% by epoch 200. Checkpoint saving was verified to ensure that training automatically saved checkpoints every 10 epochs to the directory runs/train/exp/weights/. The presence of last.pt (most recent checkpoint) and best.pt (highest mAP checkpoint) was confirmed, with each checkpoint file expected to be approximately 5 to 6 MB in size. Training progress could optionally be monitored using TensorBoard by opening a new terminal and executing the command "tensorboard --logdir runs/train", then navigating a browser to http://localhost:6006 to view real-time plots of loss curves, learning rate schedule, and mAP trends. Common issues were addressed through troubleshooting procedures, where CUDA out of memory errors were resolved by reducing the batch size to 8 or 4, NaN loss values were addressed by reducing the learning rate to 0.005, and mAP plateaus below 80% were investigated by verifying annotation correctness and increasing training epochs to 400.

Model evaluation protocol

A multi-faceted evaluation procedure was performed to comprehensively validate the effectiveness, efficiency, and interpretability of the proposed model.

Quantitative performance evaluation

Performance metrics

Evaluate model accuracy using mean Average Precision (mAP) at an IoU threshold of 0.5 (mAP@0.5), Precision, and Recall. Assess model efficiency by measuring the total number of Parameters (M) and Floating-point Operations (FLOPs, G). Measure inference speed in Frames Per Second (FPS) on both a server-grade GPU and an edge device. For edge device testing, set the power mode to maximum performance and warm up the model with 100 dummy inferences before recording FPS over 500 test images.

Comparison with state-of-the-art models: Benchmark the proposed WTLS-YOLOv11n model against its direct baseline (YOLOv11n) and a diverse range of detectors, including mainstream CNN-based YOLO models (YOLOv5n, YOLOv8n, YOLOv9s), a two-stage detector (Faster R-CNN), and a Transformer-based detector (RT-DETR). Train all models for 300 epochs using their recommended default hyperparameters. Record all metrics defined in the Performance metrics section for each model on both the self-built PPE dataset and the PASCAL VOC dataset. For VOC evaluation, train on the combined VOC2012 trainval and VOC2007 trainval sets, then test on VOC2007 test set following the standard protocol.

Ablation studies: Perform a systematic ablation study to dissect the individual contributions of the proposed components.

Component Effectiveness Analysis: Starting from the baseline YOLOv11n model, incrementally integrate the C3K2-WTConv module, the LSCD head, and the MPDIoU loss. For each configuration, retrain the model for 300 epochs using identical hyperparameters (batch size 16, learning rate 0.01, SGD optimizer). Record the changes in mAP, Precision, Recall, Parameters, FLOPs, and FPS to verify the efficacy of each component. Calculate percentage improvements relative to baseline for each metric.

Placement Analysis: To determine the optimal placement of the C3K2-WTConv module, integrate it into different parts of the network architecture. Test three configurations: (i) backbone-only integration, (ii) neck-only integration, and (iii) full integration in both backbone and neck. Train each configuration for 300 epochs and compare the resulting mAP@0.5 scores to identify the most effective integration strategy. Select the optimal configuration for all subsequent experiments.

Qualitative performance evaluation

Detection result visualization: Select 12-15 representative images from the test set that feature challenging real-world scenarios, including strong backlighting, heavy object occlusion, complex backgrounds, and unconventional camera angles. For each comparison model (baseline, YOLOv5n, YOLOv8n, YOLOv9s, and WTLS-YOLOv11n), run inference on these images using a confidence threshold of 0.25 and an IoU threshold of 0.45. Generate and render the detection outputs (bounding boxes with class labels and confidence scores) onto these images. Arrange visualizations in a grid format where rows represent different scenarios and columns represent different models.

Robustness analysis: Visually compare the rendered detection outputs from different models. Assess the robustness and superiority of the proposed model by counting and marking instances of false negatives (missed objects), false positives (incorrect detections), and duplicate detections (multiple boxes for a single object with IoU > 0.7 between predictions). Use red circles to highlight problematic detections in the visualization figure. Calculate per-model false negative rates and false positive counts across the selected test images. Extract and compare the mean confidence scores for true positive detections across models.

Interpretability analysis

To validate the inherent interpretability endowed by the C3K2-WTConv module, a visualization procedure was performed on selected input images. The trained WTLS-YOLOv11n model was loaded and a forward hook was registered on the C3K2-WTConv module at the 4th layer of the backbone. Forward propagation was performed on the input image, and the output feature tensor was captured. From the captured feature tensor of shape [batch, channels, height, width], channels corresponding to different frequency components were separated. The first 25% of channels were designated as the low-frequency (LL) component and the remaining 75% were designated as high-frequency (LH, HL, HH) components. For each frequency component type, the average across all channels within that component was computed to create single-channel activation maps. L2-norm was applied across spatial dimensions when needed to emphasize strong activations. The activation maps were normalized to range [0, 1] and a color map (e.g., 'jet' colormap) was applied. The heatmaps were resized to match the original input image resolution using bilinear interpolation. The low-frequency heatmap and high-frequency heatmap were overlaid onto the original image with 40% transparency to create interpretable visualizations showing where the model focuses on structural versus textural features.

To rigorously validate that detection decisions rely on frequency-domain features, a quantitative analysis was performed. A subset of 200 to 300 images was selected from the test set that contained successful detections (confidence score greater than 0.5). This subset was ensured to represent diverse scenarios to avoid sampling bias. For each image in the subset, forward propagation was performed, and the output of the C3K2-WTConv module at the 4th backbone layer was extracted. The feature tensor was separated into low-frequency (LL, first 25% of channels) and high-frequency (HF, remaining 75% of channels) components. For each image, the mean absolute activation strength was computed across spatial dimensions (height and width) for both frequency components. The LL strength was calculated as the mean of the absolute value of LL features across all spatial positions, and the HF strength was calculated as the mean of the absolute value of HF features across all spatial positions. These values were recorded along with the maximum detection confidence score for that image. Using the collected data (LL_strength, HF_strength, confidence_score) across all images, Pearson correlation coefficients were computed. The correlation between LL strength and confidence score was calculated, as was the correlation between HF strength and confidence score. Statistical software or Python's scipy.stats.pearsonr function was used to obtain both correlation coefficients (r) and p-values. Statistical significance was assessed using a p-value threshold of 0.05, where a p-value less than 0.05 indicated that the correlation was statistically significant. The magnitude of correlation coefficients was compared to determine which frequency component had stronger association with detection confidence. The following metrics were recorded in a structured format: LL correlation coefficient (rLL) and p-value (pLL), HF correlation coefficient (rHF) and p-value (pHF), mean activation strengths (meanLL, meanHF), and sample size (number of images analyzed). The expected outcomes were that low-frequency features would demonstrate stronger positive correlation with confidence scores (rLL greater than 0.60, p less than 0.001) compared to high-frequency features (rHF approximately 0.40 to 0.50, p less than 0.01), indicating that detection decisions were predominantly driven by structural information captured in the LL component.

This quantitative analysis established interpretability beyond the limitations of qualitative visualization. The combination of correlation analysis (demonstrating statistical association) and frequency-domain visualization (showing spatial attention) provided rigorous empirical evidence that the model's decision-making genuinely relied on low-frequency structural features as intended by design.

Expected outcomes: Low-frequency features should demonstrate stronger positive correlation with confidence scores (rLL > 0.60, p < 0.001) compared to high-frequency features (rHF≈ 0.40-0.50, p < 0.01), indicating that detection decisions are predominantly driven by structural information captured in the LL component.

This quantitative analysis establishes interpretability beyond qualitative visualization. The combination of correlation analysis (demonstrating statistical association) and frequency-domain visualization (showing spatial attention) provides rigorous empirical evidence that the model's decision-making genuinely relies on low-frequency structural features as intended by design.

Access restricted. Please log in or start a trial to view this content.

Results

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

To evaluate the performance of the proposed WTLS-YOLOv11n model, we conducted experiments on our self-built PPE dataset and the PASCAL VOC 2007+2012 dataset. All metrics are reported on the respective test sets unless otherwise stated.

Comparison with State-of-the-Art Models

We benchmarked WTLS-YOLOv11n against mainstream object detectors across three architectural paradigms: CNN-based YOLO models (YOLOv5n, YOLOv8n, YOLOv9t, YOLOv11n), a two-stage ...

Access restricted. Please log in or start a trial to view this content.

Discussion

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The experimental results demonstrate that WTLS-YOLOv11n achieves 90.1% mAP while reducing parameters by 11.5% compared to the YOLOv11n baseline. This improvement in both accuracy and efficiency stems from the synergistic integration of three components: wavelet-based feature extraction, lightweight detection head design, and improved localization loss.

The ablation study reveals that the C3K2-WTConv module provides the largest individual performance gain, increasing mAP from 86.3% to 89.1%. Th...

Access restricted. Please log in or start a trial to view this content.

Disclosures

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors declare no conflicts of interest.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
CUDA ToolkitNVIDIA CorporationCUDA Toolkit Version 11.7
Deep Learning FrameworkPyTorch FoundationPyTorch Version 1.12.0
Graphics Processing UnitNVIDIA CorporationGeForce RTX 4090
NumPyNumPy DevelopersNumPy
OpenCVOpenCV Teamopencv-python
Operating SystemCanonical Ltd.Ubuntu 22.04 LTS (or specify your OS)
PythonPython Software FoundationPython Version 3.8 or higher
TensorBoardTensorFlow AuthorsTensorBoard
TorchvisionPyTorch FoundationTorchvision

References

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,
  1. You only look once: Unified, real-time object detection. Redmon, J., Divvala, S., Girshick, R., Farhadi, A. Proc IEEE Conf Comput Vis Pattern Recognit, , (2016).
  2. Liu, M., Li, Z., Li, Y., Liu, Y. A fast and accurate method of power line intelligent inspection based on edge computing. IEEE Trans Instrum Meas. 71, 1-12 (2022).
  3. Gallo, G., Di Rienzo, F., Garzelli, F., Ducange, P., Vallati, C. A smart system for personal protective equipment detection in industrial environments based on deep learning at the edge. IEEE Access. 10, 110862-111110 (2022).
  4. Selvaraju, R. R., et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization. Int J Comput Vis. 128, 336-359 (2020).
  5. Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks. Chattopadhay, A., Sarkar, A., Howlader, P., Balasubramanian, V. N. Proc. IEEE Winter Conf Appl Comput Vis (WACV, , (2018).
  6. Axiom-based grad-CAM: Towards accurate visualization and explanation of CNNs. Fu, R., et al. Proc Brit Mach Vis Conf, , (2020).
  7. Yipeng, L., Junwu, W. Personal protective equipment detection for construction workers: A novel dataset and enhanced YOLOv5 approach. IEEE Access. 12, 47338-47358 (2024).
  8. BN, R., Guru, R. Small object detection for indoor assistance to the blind using YOLO NAS small and super gradients. arXiv preprint. , (2024).
  9. Yolov9: Learning what you want to learn using programmable gradient information. Wang, C. Y., Yeh, I. H., Liao, H. Y. M. Eur Conf Comput Vis, , Springer Nature. Switzerland, Cham. (2024).
  10. Searching for mobilenetv3. Howard, A., et al. Proc. IEEE/CVF Int Conf Comput Vis, , https://ieeexplore.ieee.org/document/9008835 (2019).
  11. Liu, B., et al. YOLO-M: An efficient YOLO variant with MobileOne backbone for real-time license plate detection. Proc Int Semin Artif Intell Netw Inf Technol (AINIT). , IEEE. (2024).
  12. Ma, X., et al. Light-YOLOv4: An edge-device oriented target detection method for remote sensing images. IEEE J Sel Top Appl Earth Obs Remote Sens. 14, 10808-10820 (2021).
  13. Scaling up your kernels to 31x31: Revisiting large kernel design in CNNs. Ding, X., Zhang, X., Han, J., Ding, G. Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit, , https://openaccess.thecvf.com/content/CVPR2022/papers/Ding_Scaling_Up_Your_Kernels_to_31x31_Revisiting_Large_Kernel_Design_CVPR_2022_paper.pdf (2022).
  14. Black-box explanation of object detectors via saliency maps. Petsiuk, V., Jain, R., Manjunatha, V. Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit, , (2020).
  15. He, L., et al. Research and application of YOLOv11-based object segmentation in intelligent recognition at construction sites. Buildings. 14 (12), 3777(2024).
  16. Liu, Q., Lv, J., Zhang, C. MAE-YOLOv8-based small object detection of green crisp plum in real complex orchard environments. Comput Electron Agric. 226, 109458(2024).
  17. Fast r-cnn. Girshick, R. Proc IEEE Int Conf Comput Vis, , https://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Girshick_Fast_R-CNN_ICCV_2015_paper.pdf (2015).
  18. Detrs beat yolos on real-time object detection. Zhao, Y., et al. Proc IEEE/CVF Conf Comput Vis. Pattern Recognit, , https://openaccess.thecvf.com/content/CVPR2024/papers/Zhao_DETRs_Beat_YOLOs_on_Real-time_Object_Detection_CVPR_2024_paper.pdf (2024).

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Tags

Transmission Line InspectionYOLOv11 AlgorithmEdge ComputingObject DetectionWavelet TransformMulti Scale Feature ExtractionDetection AccuracyLightweight ModelModel Interpretability

Related Articles