Method Article

Cross-Attention Fusion of Time-Frequency Acoustic Features for Insulation Fault Recognition in Power Equipment Using a Microphone Array System

DOI:

10.3791/71752

July 21st, 2026

In This Article

Summary

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This protocol describes a non-contact method for recognizing insulation faults in power equipment by extracting and fusing time- and frequency-domain acoustic features for automated fault classification.

Abstract

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The goal of this protocol is to provide a non-contact method for recognizing insulation faults in power equipment by extracting and fusing time- and frequency-domain acoustic features for automated fault classification. Acoustic fingerprints generated by insulation faults exhibit nonlinear and non-Gaussian characteristics, which can limit the effectiveness of conventional single-domain feature extraction approaches. To address this challenge, this protocol presents a time-frequency feature extraction and fusion framework based on a cross-attention (CA) mechanism for the identification of four insulation fault types. Time-domain features are first extracted using a temporal convolutional network coupled with an autoencoder to capture dynamic variations in sequential acoustic signals. In parallel, frequency-domain features are extracted from Mel spectrograms using a convolutional block attention module to enhance spectral feature representation. A CA mechanism is then employed to adaptively fuse temporal and spectral features, strengthening the relationships between the two feature domains. The fused feature representation is subsequently input into a one-dimensional convolutional neural network optimized using the Cuckoo Search algorithm for fault classification. Representative results demonstrate that this framework effectively characterizes complex acoustic fingerprints and achieves high classification performance relative to conventional feature extraction approaches. The protocol provides a robust non-contact strategy for insulation fault diagnosis and condition monitoring of electrical power equipment.

Introduction

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Early identification of insulation faults in power equipment is critical for ensuring the safety and stability of the power grid1,2,3,4. Statistics indicate that approximately 60% of power equipment failures are directly associated with insulation degradation5. Conventional electrical monitoring methods, however, often suffer from delayed response, poor anti-interference capabilities, and the requirement for invasive, contact-based installation5. Recently, acoustic fingerprint recognition has e....

Access restricted. Please log in or start a trial to view this content.

Protocol

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This study did not involve human participants, vertebrate animals, or biological specimens. Therefore, institutional ethics approval, animal-use approval, and human-subject approval were not required.

Figure 1 illustrates the dilated causal convolution structure used within the TCN architecture. Figure 2 illustrates the residual connection structure used during temporal feature extraction. Figure 3 illustrates the AE architecture used for feature-dimension reduction. Figure 4 illustrates the CBAM architecture used for spec....

Access restricted. Please log in or start a trial to view this content.

Results

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

Time- and Frequency-Domain Feature Extraction Framework

The proposed insulation-fault identification method integrates temporal and spectral feature extraction pathways to characterize the complex acoustic signatures generated by insulation defects. Time-domain feature extraction was performed using a TCN incorporating dilated causal convolutions to capture long-range temporal dependencies within the acoustic sequences (Figure 1). Residual connect.......

Access restricted. Please log in or start a trial to view this content.

Discussion

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

This method article delineates a standardized, non-contact protocol for identifying complex insulation faults in electrical power equipment through acoustic fingerprint recognition. By integrating a TCN-AE alongside a Mel spectrogram processed by a Mel-CBAM, the established pipeline isolates both dynamic time-series fluctuations and localized spectral characteristics. The subsequent cross-modal fusion via a CA mechanism is intended to reduce the information dilution that often accompanies simple feature concatenation. Op.......

Access restricted. Please log in or start a trial to view this content.

Disclosures

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors have nothing to disclose.

Acknowledgements

Loading...
$$\rightleftharpoonup{xx}$$ $$\longleftharp{xx}$$, $$\longrightharp{xx}$$,

The authors gratefully acknowledge Shenyang University of Technology for providing the high-voltage laboratory facilities and technical support essential for the acoustic data acquisition and experimental validation in this study. We also extend our appreciation to our colleagues for their insightful discussions on feature extraction and neural network optimization. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

....

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
Autoencoder (AE)Custom modelEncoder-decoder architecture for feature compressionFeature dimensionality reduction
Cross-Attention moduleCustom modelTime-frequency feature fusion moduleCross-modal feature fusion
GCC-PHAT algorithmCustom algorithmFFT/IFFT-based implementationTime-delay estimation and signal alignment
High-voltage test circuitSelf-built laboratory platformAutotransformer T1, test transformer T2, 200 kΩ protective resistor, 1 nF coupling capacitor; operating voltage 4–12 kVGeneration of insulation-fault conditions
Mel spectrogram + CBAMCustom modelMel-frequency spectral extraction with attention enhancementFrequency-domain feature extraction
Microphone array systemSelf-built laboratory platform112-channel modified annular spiral array; 200 kHz sampling rate; 8192 points per frameAcoustic acquisition
Microphone sensorsSelf-built matched ultrasonic microphone modules112 matched channels; sensitivity -38 +/- 3 dBV/Pa; 20 Hz-100 kHz frequency response; calibrated at 94 dB SPL/1 kHz and 40 kHz; acceptance limits: +/-2 dB at 1 kHz and +/-3 dB at 40 kHzAcoustic detection
Multichannel DAQ systemSelf-built synchronized DAQ platform112-channel simultaneous acquisition; 16-bit ADC; 200 kHz/channel; 8192 points/frame; shared sampling clock; positive-edge TTL hardware triggerData acquisition and synchronization
One-dimensional CNN + CS optimizationCustom modelFive convolutional layers; kernel size 3; SGD; learning rate 0.001; batch size 50Fault classification
Python training environmentPython / PyTorchPython 3.9; PyTorch 2.0; NumPy 1.24; scikit-learn 1.2; librosa 0.10; CUDA 11.8Model training and evaluation
Temporal Convolutional Network (TCN)Custom modelDilated causal convolutions with residual connectionsTime-domain feature extraction
Test cabinet with defect modelsSelf-built laboratory platformSurface discharge, suspended discharge, internal discharge, and point discharge modelsSimulation of insulation faults
Transient Earth Voltage (TEV) testing systemCommercial TEV monitoring moduleTEV reference channel; 3-100 MHz analog bandwidth; 40 dB gain; positive-edge TTL trigger; trigger threshold set 6 dB above background noise floor or >=10 mV equivalent at sensor inputVerification of discharge activity

Reprints and Permissions

Request permission to reuse the text or figures of this JoVE article

Request Permission

Tags

Time Frequency FeaturesAcoustic Feature ExtractionPower Equipment MonitoringTemporal Convolutional NetworkMel SpectrogramsFault ClassificationCuckoo Search Algorithm

Related Articles