The performance of the proposed Low-Voltage (LV) Acceptance Automation Platform was evaluated using the Open LV Network & Smart Meter Dataset together with a synthetic smart meter dataset generated to represent additional operating conditions and fault scenarios. The synthetic dataset enabled controlled evaluation of workflow orchestration, intelligent decision-making, and fault detection under abnormal operating conditions. The Open LV Network & Smart Meter Dataset comprised household smart meter measurements, feeder-level load profiles, and voltage measurements. Time-series segments corresponding to load consumption and voltage variations were extracted for model development and evaluation.
The dataset was partitioned into training (70%), validation (15%), and testing (15%) subsets. The proposed LV Acceptance Automation Platform achieved high classification accuracy (approximately 96%–98%), effective fault detection capability, and reduced operational decision latency. To ensure statistical robustness and reproducibility, all experiments were repeated five independent times using different random seeds. The resulting performance distributions were subsequently analyzed using paired t-tests, one-way analysis of variance (ANOVA), Tukey's honestly significant difference (HSD) post-hoc analysis, and 95% confidence intervals. The simulation environment used for implementing the proposed framework is summarized in Table 4.
| Parameter | Value | Description |
| Dataset | Open LV Network & Smart Meter Dataset + Synthetic Smart Meter Dataset | Real-world and simulated LV network data |
| Total Samples | 1000 synthetic samples + selected Open LV subsets | Data used for validation and testing |
| Data Split | 70% Training / 15% Validation / 15% Testing | Model development and evaluation |
| Number of Independent Runs | 5 | Statistical reliability analysis |
| Random Seeds | 42, 52, 62, 72, 82 | Reproducible experimental setup |
| Total Statistical Observations | 30 observations (6 models × 5 runs) | Used for t-test, ANOVA, and Tukey HSD |
| Sampling Rate | 30-min / 1-min intervals | Time-series resolution |
| Features | Load, Voltage, Current, Active Power, Reactive Power, THD, Voltage Unbalance, Derived Features | Input features for ML models |
| ML Models | Random Forest, SVM, XGBoost, LSTM | Intelligent decision module |
| Hardware | NVIDIA RTX 3090 GPU, Intel Core i9 CPU, 64 GB RAM | Training and simulation environment |
| Edge Device | Raspberry Pi 4 / Jetson Nano | Edge inference and real-time processing |
| Software | Python 3.10, TensorFlow 2.12+, Scikit-learn 1.3+, PyTorch 2.0+ | Model implementation |
| Communication Protocols | MQTT / HTTP / RS-485 | Data transmission |
| Threshold Values | Voltage ±10%, THD > 5%, Voltage Unbalance > 2%, Feeder Load > 90% capacity | Fault labeling and validation rules |
| Statistical Tests | Paired t-test, One-way ANOVA, Tukey HSD, 95% Confidence Interval | Performance significance evaluation |
Table 4: Simulation environment. Configuration of the experimental environment, including dataset partitioning, machine learning models, hardware specifications, software environment, and validation protocol. Experiments were performed using a 70% training, 15% validation, and 15% testing split and repeated five times using different random seeds.
Classification performance
The proposed framework was evaluated using multiple performance metrics, including accuracy, precision, recall, F1-score, latency, and fault detection rate. Accuracy was used to assess overall classification performance, whereas precision, recall, and F1-score evaluated the effectiveness of fault detection. Latency measured the operational decision response time of the workflow, and the fault detection rate quantified the ability of the framework to identify abnormal operating conditions within the LV distribution network. Scalability was further assessed by progressively increasing the number of input data samples.
The proposed LV Acceptance Automation Platform was compared with five benchmark approaches, namely IoT-LV, Rule-Based Monitoring (RBM), Support Vector Machine (SVM), Random Forest (RF), and Long Short-Term Memory (LSTM). The IoT-LV framework primarily supports data acquisition and basic monitoring using predefined threshold criteria without intelligent decision-making capabilities. Similarly, the RBM approach relies on fixed operational thresholds and therefore lacks adaptive learning. Although SVM and RF effectively classify operational data through supervised learning, they do not incorporate workflow orchestration or integrated acceptance management. LSTM provides improved temporal learning for time-series analysis but does not support automated workflow execution. In contrast, the proposed framework combines workflow orchestration, hybrid rule-based and machine learning decision-making, feature engineering, and cloud-edge computing within a unified automation architecture.
To ensure a fair comparison, all baseline methods were evaluated using the same training, validation, and testing partitions (70%, 15%, and 15%, respectively). Hyperparameter optimization for the machine learning baselines was performed using the validation dataset, and all models employed identical preprocessing and feature-scaling procedures. Unlike the standalone SVM44, RF45, and LSTM46 classifiers, which were trained directly on the original feature space, the proposed framework incorporated advanced feature engineering, workflow validation, and acceptance-rule orchestration prior to classification.
The classification performance of all methods is summarized in Table 5. Among the conventional approaches, IoT-LV achieved the lowest classification accuracy (82.4%) because of its reliance on conventional monitoring without intelligent decision-making. RBM slightly improved performance, reaching an accuracy of 85.7%; however, its fixed validation thresholds limited adaptability. Machine learning approaches demonstrated progressively better performance, with SVM and RF achieving accuracies of 91.6% and 93.4%, respectively, owing to their ability to learn discriminative patterns from the data. LSTM further improved the classification accuracy to 95.2% by effectively capturing temporal dependencies within the smart meter time-series data.
The proposed LV Acceptance Automation Platform achieved the best overall classification performance, with an accuracy of 97.3%, precision of 96.8%, recall of 96.1%, and an F1-score of 96.4%. These improvements are attributable to the integration of advanced preprocessing, feature engineering, workflow orchestration, hybrid rule-based and machine learning decision-making, and cloud-edge collaborative processing rather than the application of the machine learning algorithms alone. Collectively, these components enhanced the separability between normal and abnormal operating conditions while improving the efficiency of automated acceptance validation.
The comparative classification performance of all evaluated methods is illustrated in Figure 3.
| Method | Accuracy (%) | Precision (%) | Recall (%) | F1-Score (%) |
| IoT-LV | 82.4 | 80.2 | 78.5 | 79.3 |
| RBM | 85.7 | 83.9 | 82.1 | 83 |
| SVM | 91.6 | 90.8 | 89.7 | 90.2 |
| RF | 93.4 | 92.6 | 91.8 | 92.2 |
| LSTM | 95.2 | 94.5 | 93.8 | 94.1 |
| Proposed Method | 97.3 | 96.8 | 96.1 | 96.4 |
Table 5: Comparison of classification metrics. Comparison of the classification performance of IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework using Accuracy, Precision, Recall, and F1-score. Results are reported as mean ± standard deviation (SD) obtained from five independent experimental runs.
Statistical significance analysis
To further evaluate the reliability of the proposed LV Acceptance Automation Platform, statistical significance testing was performed to compare its performance with the benchmark methods, including IoT-LV, RBM, SVM, RF, and LSTM. Multiple experimental runs were conducted using different train-validation-test partitions of the Open LV Network & Smart Meter Dataset. The resulting classification accuracies were used to calculate the mean and standard deviation for each method, followed by paired t-tests to determine whether the observed performance differences were statistically significant. The mathematical formulation of the paired t-test is provided in Supplementary File 1 (Section S7).
A significance level of 0.05 was adopted for all statistical analyses. To ensure reproducibility, each experiment was repeated five independent times using different random seeds and data partitions. The performance metrics obtained from each run were subsequently used for statistical evaluation.
The paired t-test results are summarized in Table 6. The proposed framework significantly outperformed all benchmark methods (p < 0.05), demonstrating statistically significant improvements in accuracy, precision, recall, and F1-score. Significant performance gains were observed not only over conventional approaches such as IoT-LV and RBM but also over the more advanced machine learning models, including SVM, RF, and LSTM. These findings indicate that the observed improvements were not attributable to random variation but resulted from the integrated workflow-oriented automation framework.
| Comparison | p-value | Significance |
| Proposed vs IoT-LV | 0.0008 | Significant |
| Proposed vs RBM | 0.0015 | Significant |
| Proposed vs SVM | 0.012 | Significant |
| Proposed vs RF | 0.021 | Significant |
| Proposed vs LSTM | 0.034 | Significant |
Table 6: Pairwise statistical significance analysis (p-values). Pairwise statistical comparison between the proposed framework and the benchmark methods. The table reports p-values obtained from statistical significance testing, where p < 0.05 indicates a statistically significant difference.
Receiver operating characteristic (ROC) analysis
Receiver operating characteristic (ROC) analysis was performed to further evaluate the classification capability of the proposed LV Acceptance Automation Platform in comparison with IoT-LV, RBM, SVM, RF, and LSTM. The area under the ROC curve (AUC) was used to quantify the discrimination capability of each classifier by evaluating the trade-off between the true positive rate (TPR) and false positive rate (FPR).
The IoT-LV framework achieved the lowest AUC (approximately 0.690), reflecting its reliance on conventional monitoring without intelligent decision-making. RBM produced a moderate AUC of approximately 0.738 because of its dependence on fixed threshold-based validation rules. The machine learning classifiers demonstrated progressively improved performance, with SVM and RF achieving AUC values of approximately 0.833 and 0.861, respectively, owing to their ability to learn discriminative patterns from operational data. LSTM further improved classification performance, achieving an AUC of approximately 0.885 by effectively modeling temporal dependencies in smart meter time-series data.
The proposed LV Acceptance Automation Platform achieved the highest AUC (approximately 0.910), demonstrating superior discrimination between normal and abnormal operating conditions. This improvement is attributed to the combined effects of advanced feature engineering, workflow orchestration, hybrid rule-based and machine learning decision-making, and cloud-edge collaborative processing. The comparative ROC curves for all evaluated methods are presented in Figure 4.

Figure 4: Receiver operating characteristic (ROC) curve comparison for LV acceptance Automation. Comparison of the Receiver Operating Characteristic (ROC) curves for IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework. The Area Under the ROC Curve (ROC-AUC) evaluates classification performance across different decision thresholds. TPR denotes True Positive Rate, and FPR denotes False Positive Rate. Please click here to view a larger version of this figure.
ANOVA-based statistical significance analysis
To further validate the experimental results, a one-way analysis of variance (ANOVA) was performed to compare the performance of the proposed framework with IoT-LV, RBM, SVM, RF, and LSTM. Whereas the paired t-test evaluates differences between two methods, ANOVA determines whether statistically significant differences exist among multiple groups simultaneously. The ANOVA analysis was conducted using repeated experiments with different train-validation-test partitions of the Open LV Network & Smart Meter Dataset. The mathematical derivations are presented in Supplementary File 1 (Section S8).
The ANOVA results are presented in Table 7. A large F-statistic (approximately 18.7) with p < 0.001, obtained from 30 observations across five independent experimental runs, demonstrated statistically significant differences among the evaluated methods.
| Source of Variation | SS | df | MS | F-value | p-value |
| Between Groups | 412.6 | 5 | 82.52 | 18.7 | < 0.001 |
| Within Groups | 132.4 | 30 | 4.41 | — | — |
| Total | 545 | 35 | — | — | — |
Table 7: One-Way analysis of variance (ANOVA) results. Results of the one-way ANOVA performed to evaluate statistical differences among the compared methods. The table reports the F-statistic, degrees of freedom (df), and corresponding p-values.
To identify the specific methods responsible for these differences, Tukey's honestly significant difference (HSD) post-hoc analysis was subsequently performed. The results are summarized in Table 8 and showed that the proposed LV Acceptance Automation Platform significantly outperformed IoT-LV, RBM, SVM, and RF while also achieving statistically significant improvements over LSTM. These findings further confirm the effectiveness of integrating workflow orchestration, feature engineering, hybrid rule-based and machine learning decision-making, and cloud-edge computing within a unified acceptance automation framework.
| Comparison | p-value | Significance |
| Proposed vs IoT-LV | < 0.001 | Significant |
| Proposed vs RBM | < 0.001 | Significant |
| Proposed vs SVM | 0.009 | Significant |
| Proposed vs RF | 0.018 | Significant |
| Proposed vs LSTM | 0.041 | Significant |
Table 8: Tukey honestly significant difference (HSD) post-hoc analysis. Pairwise comparisons among the evaluated methods using the Tukey HSD post-hoc test following ANOVA. The table reports mean differences, confidence intervals (CI), adjusted p-values, and statistical significance.
Confidence interval analysis
The reliability and consistency of the proposed framework were further evaluated by calculating 95% confidence intervals (CI) for the classification accuracy obtained from repeated experiments. The computational procedure is described in Supplementary File 1 (Section S8).
The confidence interval analysis is summarized in Table 9. Conventional approaches, including IoT-LV and RBM, exhibited relatively wide confidence intervals, indicating greater variability in classification performance. In contrast, the machine learning-based methods (SVM, RF, and LSTM) demonstrated narrower confidence intervals, reflecting improved stability across repeated experiments.
| Method | Mean Accuracy (%) | Std. Dev (%) | 95% Confidence Interval (%) |
| IoT-LV | 82.4 | 1.8 | [81.0, 83.8] |
| RBM | 85.7 | 1.6 | [84.5, 86.9] |
| SVM | 91.6 | 1.3 | [90.6, 92.6] |
| RF | 93.4 | 1.2 | [92.5, 94.3] |
| LSTM | 95.2 | 1 | [94.5, 95.9] |
| Proposed Method | 97.3 | 0.8 | [96.7, 97.9] |
Table 9: Confidence intervals for classification accuracy. Mean classification accuracy, standard deviation (SD), and 95% confidence interval (CI) for each evaluated method based on five independent experimental runs. The table summarizes the statistical variability and reliability of the classification performance.
The proposed LV Acceptance Automation Platform achieved the highest mean classification accuracy (97.3%) together with the narrowest 95% confidence interval (96.7%–97.9%), indicating excellent consistency and robustness. Furthermore, the absence of overlap between the confidence interval of the proposed framework and those of the benchmark methods provides additional evidence of its statistically superior performance.
Forecasting performance
In addition to classification performance, the forecasting capability of the proposed LV Acceptance Automation Platform was evaluated using the root mean square error (RMSE) and mean absolute error (MAE). These metrics quantify the accuracy of energy consumption prediction by measuring the deviation between the predicted and observed values.
The forecasting performance of the proposed framework and the benchmark methods is summarized in Table 10. The corresponding confusion matrix heatmaps for the evaluated classification methods are presented in Figure 5, illustrating the distributions of true positive, true negative, false positive, and false negative predictions. The proposed framework achieved the lowest prediction errors, with an RMSE of 2.1 and an MAE of 1.6, demonstrating superior forecasting performance compared with IoT-LV, RBM, SVM, RF, and LSTM. Prediction errors progressively decreased from the conventional IoT-LV and RBM approaches to the machine learning-based SVM, RF, and LSTM models, highlighting the advantages of intelligent learning techniques. The proposed framework further reduced prediction errors by integrating advanced feature engineering, workflow orchestration, hybrid rule-based and machine learning decision-making, and cloud-edge collaborative processing, thereby improving the accuracy and reliability of energy consumption forecasting. Operational decision latency for the evaluated methods is compared in Figure 6. The proposed framework achieved the shortest decision latency, demonstrating the effectiveness of workflow orchestration and cloud-edge collaborative processing.
| Method | RMSE | MAE |
| IoT-LV | 8.9 | 7.2 |
| RBM | 7.6 | 6.1 |
| SVM | 5.1 | 4.3 |
| RF | 4.2 | 3.5 |
| LSTM | 3.4 | 2.8 |
| Proposed Method | 2.1 | 1.6 |
Table 10: Comparison of forecasting error metrics (RMSE and MAE). Comparison of the forecasting performance of IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework using Root Mean Square Error (RMSE) and Mean Absolute Error (MAE). Lower RMSE and MAE values indicate smaller prediction errors.

Figure 5: Comparison of confusion matrix heatmaps. Confusion matrices for IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework showing classification outcomes in terms of True Positive (TP), True Negative (TN), False Positive (FP), and False Negative (FN). The heatmaps illustrate the distribution of correctly and incorrectly classified samples for each method. Please click here to view a larger version of this figure.

Figure 6: Comparison of operational decision latency across different methods. Comparison of the operational decision latency of IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework during LV acceptance automation. Latency is measured in milliseconds (ms) and represents the operational decision time required for workflow execution, rule validation, and acceptance decision generation. Please click here to view a larger version of this figure.
Ablation study
The contribution of each major component of the proposed LV Acceptance Automation Platform was evaluated through an ablation study. The framework was progressively constructed by enabling feature engineering, intelligent machine-learning decision-making, workflow orchestration, and cloud-edge integration. The baseline configuration, in which none of these modules was enabled, achieved an accuracy of 82.6%, an F1-score of 80.4%, an RMSE of 8.7, and an operational latency of 96 ms, demonstrating the limitations of conventional processing without intelligent automation.
The ablation results are summarized in Table 11. Progressive incorporation of feature engineering substantially improved classification performance by enhancing the representation of operational characteristics extracted from the smart meter data. Adding the intelligent decision module further increased classification accuracy and reduced prediction errors through data-driven decision-making. Integration of workflow orchestration improved automation efficiency by coordinating validation, execution, and decision processes, while cloud-edge collaboration reduced operational decision latency through distributed processing. Collectively, these modules produced consistent improvements in accuracy and F1-score while simultaneously reducing RMSE and execution latency.
The complete LV Acceptance Automation Platform achieved the best overall performance, with a classification accuracy of 97.3%, an F1-score of 96.4%, an RMSE of 2.1, and an operational latency of 31 ms. These findings demonstrate that the observed performance improvements result from the integration of workflow orchestration, advanced feature engineering, hybrid rule-based and machine-learning decision-making, and cloud-edge collaboration, rather than from any individual component alone. The fault detection performance of the evaluated methods is presented in Figure 7, where the proposed framework achieved the highest fault detection rate. Figure 8 illustrates the scalability analysis, demonstrating that the proposed framework maintained the lowest processing time as the dataset size increased, confirming its suitability for large-scale LV acceptance automation.
| Configuration | Workflow Orchestration | Feature Engineering | Cloud–Edge Processing | Intelligent ML Decision Module | Accuracy (%) | F1-Score (%) | RMSE | Latency (ms) |
| Baseline System | ✗ | ✗ | ✗ | ✗ | 82.6 | 80.4 | 8.7 | 96 |
| + Feature Engineering | ✗ | ✓ | ✗ | ✗ | 88.9 | 87.5 | 6.2 | 84 |
| + ML Decision Module | ✗ | ✓ | ✗ | ✓ | 92.8 | 91.6 | 4.5 | 63 |
| + Workflow Orchestration | ✓ | ✓ | ✗ | ✓ | 95.1 | 94.2 | 3.3 | 48 |
| + Cloud–Edge Integration | ✓ | ✓ | ✓ | ✓ | 97.3 | 96.4 | 2.1 | 31 |
Table 11: Ablation study of the proposed framework. Experimental evaluation of the contribution of feature engineering, intelligent decision-making, workflow orchestration, and cloud-edge integration to the overall performance of the proposed framework. Performance is reported for each incremental configuration using Accuracy, F1-score, RMSE, and Operational Decision Latency.

Figure 7. Comparison of fault detection rate across different methods. Comparison of the fault detection performance of IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework using the Open LV Network & Smart Meter dataset. Fault Detection Rate (%) represents the proportion of correctly identified fault conditions. Please click here to view a larger version of this figure.

Figure 8. Scalability analysis of different methods. Comparison of the scalability of IoT-LV, RBM, SVM, RF, LSTM, and the proposed framework under increasing dataset sizes. Scalability is evaluated using processing time (ms) as computational workload increases. Please click here to view a larger version of this figure.
DATA AVAILABILITY:
The Open LV Network & Smart Meter dataset used in this study is publicly available through the UK Power Networks Open Data Portal42 at: https://ukpowernetworks.opendatasoft.com/explore/assets/ukpn-smart-meter-consumption-lv-feeder/. All study-generated resources, including the simulated smart meter dataset, example workflow configurations, deployment artifacts, research prototype implementation, source code, and evaluation scripts, are publicly available through the Zenodo repository at: https://zenodo.org/records/21187749.
Supplementary Figure 1: Flowchart of the workflow orchestration engine. The diagram illustrates the sequence of operations performed by the workflow orchestration engine, including data acquisition, preprocessing, workflow execution, machine learning-based validation, decision generation, and result reporting for automated low-voltage acceptance testing.Please click here to download this file.
Supplementary Figure 2: Cloud–edge architecture for low-voltage acceptance automation. The architecture illustrates the interaction between edge devices and cloud services. Electrical measurements collected from smart meters, SCADA systems, and IoT devices are processed at the edge for preprocessing and real-time inference, then transmitted to the cloud for storage, analytics, model management, and visualization via an interactive monitoring dashboard.Please click here to download this file.