A subscription to JoVE is required to view this content. Sign in or start your free trial.

Research Article

Multi-Agent RL-Based Dynamic Feeder Acceptance Orchestration Using the FeederBW Dataset and 236-Bus Low-Voltage Distribution Network

72 views

⸱

DOI:

10.3791/72365

⸱

September 8th, 2026

 ,  ,  ,  ,  , 

In This Article

Summary

This study presents a Dynamic Orchestration Strategy for low-voltage feeder acceptance using collaborative multi-agent reinforcement learning. Intelligent agents coordinate feeder operation, congestion management, voltage stability, and renewable-energy integration under uncertain conditions. The approach was evaluated through simulations using the FeederBW and 236-bus datasets.

Abstract

The extensive integration of distributed renewable energy sources and the rapid expansion of low-voltage (LV) feeders have created operational challenges related to feeder acceptance and congestion coordination. Existing voltage-control and feeder-management approaches may have limited scalability and adaptability under intermittent renewable generation and changing network conditions. To address these limitations, this study proposes a Dynamic Orchestration Framework for Low-Voltage Feeder Acceptance based on intelligent-agent collaboration within a multi-agent reinforcement learning approach. Unlike voltage-control strategies focused primarily on voltage stabilization, the proposed framework supports dynamic feeder acceptance through the coordinated operation of agents responsible for feeder monitoring, congestion management, and voltage-sensitivity-based prioritization. The agents independently observed feeder states, evaluated congestion and voltage sensitivities, and collaborated on feeder-acceptance decisions. The framework was evaluated through simulations using the FeederBW dataset and the 236-bus low-voltage distribution-network dataset under varying renewable-integration levels and load conditions. The proposed framework achieved a Feeder Acceptance Rate of 97%, a Voltage Compliance Index of 98%, an orchestration latency of 98 ms measured as the wall-clock execution time of the orchestration algorithm on the reported hardware, and a convergence speed of 98.5%, outperforming the evaluated centralized coordination methods. The results also indicated improved adaptability, operational resilience, and decentralized decision-making efficiency under the simulated low-voltage distribution-network conditions.

Introduction

Modern power systems face significant operational challenges because of rising electricity demand and the increasing use of distributed generation. Imbalances between electricity supply and demand, or rapid increases in distributed generation, can impose financial strain on utilities and end users and jeopardize grid stability. Conventional, centrally controlled, fossil fuel-based electricity infrastructure is therefore shifting toward a distributed, renewable energy-driven design. This transition has improved access to more affordable and environmentally sustainable energy sources. However, the intermittent and unpredictable nature of photovoltaic (PV) generation raises concerns about grid reliability1,2.

The global energy transition is accelerating PV deployment because of its environmental benefits, scalability, and declining cost. According to the International Renewable Energy Agency, PV capacity is expected to account for more than 22% of global electricity supply by 2050, and solar PV is expected to become a major contributor to the global electricity supply by 20303. This widespread integration presents substantial challenges for conventional power systems, particularly regarding operational stability and reliability. Voltage fluctuation is a critical concern because PV generation is intermittent and non-dispatchable, and its effects become more pronounced as penetration increases across distribution and transmission networks4.

Variations in solar irradiance directly affect PV output and can produce rapid voltage changes. Cloud movement, abrupt irradiance variation, and load transients may cause voltage fluctuations that existing grid architectures cannot adequately accommodate5. Although conventional technologies have been effective in centralized and relatively stable grid configurations, they are less suitable for increasingly distributed networks. Rapid bidirectional voltage changes can exceed the capabilities of conventional power systems, particularly under high PV penetration6. Uncontrolled fluctuations may violate voltage limits, affect sensitive loads, and compromise grid safety.

The integration of smart loads and distributed resources into distribution networks has therefore motivated the development of more advanced control strategies. Intelligent control systems that continuously monitor and coordinate distributed equipment can help mitigate challenges in low-voltage (LV) networks with high distributed generation7. Large-scale PV integration also creates operational difficulties for thermal generation, particularly when PV output declines and thermal units must respond rapidly, sometimes exceeding ramp-rate limits8. At the same time, demand response (DR) programs must balance long-term sustainability with economic feasibility9.

DR programs can support the integration of distributed generation while helping balance electricity supply and demand. These programs are categorized as price-based DR or incentive-based DR (IBDR). Price-based DR encourages consumers to modify electricity use in response to time-varying tariffs, whereas IBDR provides fixed or variable financial incentives to reduce consumption when requested10. However, price-based DR exposes consumers to fluctuating wholesale prices and offers limited operational flexibility from the utility perspective, which may discourage risk-averse participants11,12.

Several studies have examined IBDR in PV-rich distribution systems. One study assessed the challenges and benefits of combining IBDR with high PV penetration but focused on aggregated power use rather than household-level home energy management systems13. Another proposed an incentive-based voltage-management method in which pricing signals indirectly controlled battery operation to maintain voltage limits, although household demand was not explicitly modeled14. A fuzzy logic-based method for determining incentive payments considered consumer satisfaction and renewable-integration costs but did not include feeder-level analysis15. Long-term generation planning incorporating both price-based and incentive-based DR has also been studied, including thermal and renewable generation, but without accounting for user comfort or household-level demand16.

Deep reinforcement learning (RL) has also been applied to residential DR. Deep RL methods for aggregated load control under time-of-use tariffs have been proposed, although their generalizability was limited by small user populations and the absence of appliance-level scheduling17. A multi-agent reinforcement learning framework combining DR and voltage control used long short-term memory networks for load forecasting, but did not resolve customer dissatisfaction resulting from load restriction18. Other work has focused on DR coordination for air-conditioning systems in commercial buildings using a Markov decision process, without considering other residential loads19. Existing deep RL voltage-control studies have generally not incorporated both DR and PV integration20,21.

Smart inverters can respond rapidly to abrupt and irregular changes in PV output22. When voltage violations occur, PV inverters can act within milliseconds, whereas conventional devices may require several seconds23. Some studies have proposed modifications to standard device-control procedures, including multi-agent approaches for coordinating voltage regulators and modifying conventional voltage-controller actions24. Nevertheless, standalone PV generation without co-located storage can worsen voltage excursions and does not alleviate evening peaks, even when it reduces daytime net imports24,25. Household batteries may also be depleted during periods of daytime PV surplus and become unavailable for nighttime electric-vehicle charging if their dispatch is not coordinated with local demand and generation26,27. The combined effects of stochastic demand, intermittent generation, and diverse storage behavior make capacity management, asset longevity, and resilience important concerns for distribution-system operators28. Home Energy Management Systems provide one potential means of implementing automated control at the customer level. RL is well-suited to such applications because agents can learn control strategies through interaction with the environment while handling uncertainty and making low-latency decisions.

Advances in electric-vehicle routing also illustrate how deep RL can manage dynamic energy constraints. The heterogeneous fleet-based capacitated electric-vehicle routing problem incorporates driving dynamics, road characteristics, kinetic resistance, and charging efficiency while minimizing maximum energy expenditure across a diverse fleet29. A dynamic-aware deep reinforcement learning method frames this problem as a customized Markov decision process and uses an encoder-updater-decoder architecture. In this design, the encoder develops role-specific representations for vertices and vehicles, the updater refines vehicle tokens as contextual information changes, and the decoder separates vehicle selection from vehicle-specific vertex selection to support adaptive decision-making. Similarly, an energy-optimal electric-vehicle routing problem with pickup-delivery and time windows uses a high-resolution energy-consumption model that includes charging behavior, time-dependent driving dynamics, and detailed route information30. A heterogeneous attention-driven deep reinforcement learning framework represents the routing task as a Markov decision process, with an encoder that captures role-specific interactions among depots, customers, and charging stations, and a decoder that tracks state transitions and temporal feasibility.

Despite these developments, most LV distribution-management studies emphasize voltage stabilization and reactive-power optimization rather than dynamic feeder-acceptance orchestration under renewable uncertainty. Distributed voltage-control methods based on intelligent inverters and machine learning generally focus on voltage compensation and reactive power optimization, without addressing adaptive feeder acceptance control or congestion-based orchestration in complex LV networks. Likewise, voltage-constrained multi-agent reinforcement learning approaches for DR do not directly address collaborative feeder-acceptance management, decentralized congestion-aware orchestration, or node-level admission control in interconnected LV distribution systems. Cooperative voltage-regulation methods based on multi-agent coordination typically minimize voltage deviations and tap operations using PV inverters, but do not consider adaptive feeder admission, renewable-related acceptance instability, or decentralized orchestration under dynamic network conditions.

Current distributed and multi-agent resource-coordination methods also face limitations in congestion awareness, temporal adaptability, and scalability. Most emphasize overload analysis, distributed energy resource interactions, or tariff-driven energy management rather than adaptive feeder-level acceptance and voltage-aware orchestration. Their reliance on partial centralization and static priorities can further limit decentralized decision-making, rapid response to congestion propagation, and adaptation to renewable variability. A fully decentralized, reinforcement learning-based framework that combines cooperative agent coordination with voltage- and congestion-sensitivity analysis is therefore needed for adaptive feeder-acceptance management using large-scale datasets such as FeederBW and the 236-bus LV distribution network.

In this study, feeder acceptance refers to the adaptive operational process for determining whether an LV feeder can accommodate additional distributed energy resources or electrical loads while maintaining network security, voltage compliance, thermal loading limits, and operational reliability. The operational boundary for feeder acceptance includes evaluating feeder capacity, voltage sensitivity, congestion conditions, and renewable energy variability before new feeder connections are accepted or prioritized. Unlike conventional voltage control, which regulates voltage profiles, distributed energy resource coordination, which manages resource operation, or congestion management, which mitigates network overloads, feeder acceptance integrates these functions within a collaborative multi-agent reinforcement learning framework to support dynamic, decentralized, and adaptive orchestration under renewable-rich conditions.

The objective of this study is to develop a collaborative intelligent-agent-based Dynamic Orchestration Strategy for Low-Voltage Feeder Acceptance under changing operating conditions and renewable uncertainty. The proposed framework performs decentralized feeder-acceptance orchestration by dynamically evaluating feeder states, voltage sensitivity, congestion sensitivity, and acceptance capacity, thereby enabling adaptive prioritization and decision-making beyond static voltage-control methods. Using the FeederBW dataset and the 236-bus LV distribution-network dataset, the study also develops a scalable multi-agent reinforcement learning architecture for large-scale LV systems. Through reinforcement-driven learning and low-latency collaborative optimization performed at each simulated operating interval, the framework is designed to reduce congestion propagation, improve voltage compliance, lower orchestration latency, and increase decentralized coordination efficiency.

The framework contributes a dynamic LV feeder-acceptance orchestration approach that replaces static voltage-control-based feeder-management strategies; a decentralized multi-agent reinforcement learning architecture for renewable uncertainty and varying load conditions; decentralized admission management based on low-latency conditions and dynamic feeder prioritization; joint voltage- and congestion-sensitivity indices for identifying critical feeders and prioritizing acceptance decisions; collaborative communication among neighboring agents; continuous reinforcement learning-based policy optimization to improve feeder stability, congestion mitigation, voltage compliance, and convergence; and large-scale simulation-based validation using the FeederBW and 236-bus LV datasets. Comparative results indicate improved feeder acceptance, congestion mitigation, orchestration delay, convergence speed, and voltage compliance relative to traditional centralized coordination methods.

Access restricted. Please log in or start a trial to view this content.

Protocol

Human subjects, vertebrate animals, human tissues, or animal tissues were not used in this investigation. Only publicly accessible datasets (the FeederBW dataset and the 236-bus Low-Voltage Distribution Network dataset) and computer-based simulations were used in the study. Therefore, this study did not require institutional review board (IRB), ethical, or informed consent approval.

The Dynamic Orchestration Strategy for Low-Voltage Feeder Acceptance Based on Agent Collaboration was developed using multi-agent reinforcement learning (MARL) for renewable-rich operating conditions. The FeederBW and 236-bus low-voltage datasets were preprocessed, normalized, and temporally synchronized to construct a dynamic network model representing feeder states, distributed energy resources, voltage-sensitive regions, and congestion conditions. Intelligent agents were assigned to feeder sections and network junctions to monitor local voltage, congestion, renewable-generation uncertainty, and feeder acceptance capacity, exchange information with neighboring agents, and update orchestration policies through decentralized reinforcement learning. The reward function was designed to improve feeder acceptance while limiting congestion, voltage instability, and coordination delays. Voltage, feeder loading, transformer loading, and congestion constraints were considered, whereas three-phase unbalanced operation, advanced photovoltaic inverter control, and reactive power compensation were not explicitly modeled. The overall framework is shown in Figure 1. The research tools used in this study are listed in the Table of Materials.

Grid diagram of dynamic LV network modeling with multi-agent systems, reinforcement learning.
Figure 1: Architecture of the proposed framework. Schematic of the Dynamic Orchestration Framework incorporating intelligent agents, reinforcement learning, congestion analysis, and adaptive feeder coordination. Please click here to view a larger version of this figure.

1. Data acquisition

Data were acquired from the FeederBW dataset31 and the 236-bus LV distribution dataset32. These datasets were selected because they contained information on feeder topology, voltage conditions, renewable-generation behavior, load demand, congestion, and dynamic operating profiles required for decentralized orchestration and reinforcement-based agent learning.

The FeederBW dataset was used primarily to model feeder operation, renewable-energy intermittency, voltage deviation, and congestion propagation in LV grids. It contained feeder-operating data, distributed-generation behavior, node-voltage measurements, and load fluctuations that supported adaptive orchestration analysis. The 236-bus LV dataset was used to evaluate scalability and decentralized coordination. It contained bus-connection information, feeder-loading conditions, node-voltage characteristics, distributed renewable penetration, and congestion-sensitive operating cases. Together, the two datasets supported feeder-level and large-scale analyses under conditions of high renewable-energy penetration. The dataset characteristics and their purposes in the framework are summarized in Table 1.

Dataset NameDataset TypeNumber of Nodes/BusesData AttributesPurpose in Proposed Work
FeederBW DatasetLow-Voltage Feeder Operational DatasetMultiple feeder nodesVoltage profiles, renewable generation, load demand, congestion states, feeder operational behaviorlow-latency feeder orchestration, congestion analysis, adaptive acceptance prioritization
236-bus LV DatasetLarge-Scale Low-Voltage Distribution Dataset236 busesBus topology, feeder loading, voltage sensitivity, renewable penetration, congestion dynamicsScalability validation, decentralized coordination evaluation, large-scale orchestration analysis

Table 1: Dataset characteristics. Description of the datasets, operational attributes, and their purposes within the proposed low-voltage orchestration framework.

2. Data preprocessing

The acquired datasets were preprocessed to improve consistency, temporal alignment, and reinforcement-learning stability. Missing entries, erroneous measurements, duplicate records, and inconsistent feeder data were filtered using statistical preprocessing procedures. This step was used to maintain consistency among feeder-operating data, renewable-generation profiles, voltage measurements, and congestion-state data. All operational variables were min–max normalized so that the input features were transformed to a common scale suitable for agent learning. The normalized variables included feeder voltage, active-power demand, renewable generation, congestion status, and feeder acceptance capacity. The mathematical formulation of the preprocessing procedure is provided in Supplementary File 1 (Section 1).

3. Dynamic low-voltage network modeling

After data acquisition and preprocessing, a dynamic LV network model was constructed to simulate the behavior of a distribution system with a high proportion of renewable generation under varying load and generation conditions. The model dynamically tracked feeder topology, distributed energy resource behavior, voltage-sensitive regions, and congestion propagation.

Unlike a static network representation, the model updates feeder behavior according to renewable intermittency, consumer demand, and congestion conditions. The FeederBW and 236-bus LV datasets were used to construct interconnected feeders in which buses, transformers, distributed renewable sources, and loads were represented as network nodes. Each feeder node provided updated information on voltage magnitude, active-power demand, renewable generation, feeder-loading status, and congestion status. These variables were used by the intelligent agents to monitor feeder behavior and make decentralized orchestration decisions. The network model also supported the identification of sensitive regions and feeder acceptance prioritization through continuous sensitivity analysis.

The LV distribution grid was represented as a graph-based network containing bus stations, feeder lines, transformers, renewable sources, and consumer-load nodes. Detailed mathematical derivations of the network model are provided in Supplementary File 1(Section 2). The dynamic network state and congestion index were monitored continuously. The congestion index was normalized to the range [0,1], and collaborative feeder acceptance orchestration was initiated when the congestion index exceeded 0.80.

4. Multi-Agent Environment Initialization

After the dynamic LV network model had been constructed, the multi-agent environment was initialized to support decentralized feeder acceptance. Intelligent agents were assigned to feeder segments, distributed energy resource connection points, transformer locations, and congestion-prone nodes within the LV network.

Each agent operated as an independent decision-making entity that monitored local feeder operation, exchanged information with neighboring agents, and executed adaptive orchestration actions. Agents were assigned to key feeder nodes according to voltage sensitivity, renewable penetration, congestion level, and feeder importance. The LV network was configured as an agent-based environment in which the agents continuously monitored feeder voltage, active power demand, renewable generation variation, congestion status, and feeder acceptance capacity. The mathematical formulation of the multi-agent environment is provided in Supplementary File 1(Section 3).

5. Reinforcement-driven agent learning

Following initialization of the multi-agent environment, reinforcement-driven learning was implemented to enable the agents to learn feeder-orchestration policies through interaction with changing LV operating conditions. During each interaction, an agent observed the current feeder state, selected an orchestration action, and received a reward or penalty. The decentralized learning process enabled the agents to adapt to renewable-generation uncertainty, changing congestion conditions, voltage variation, and changes in feeder acceptance capacity. Each agent selected an orchestration action according to its learned policy. The associated mathematical derivations are provided in Supplementary File 1(Section 4).

A total of 64 intelligent agents were deployed. Based on feeder topology, renewable penetration level, voltage sensitivity, and congestion severity, each agent was allocated to a feeder segment, transformer site, distributed energy resource connection point, or congestion-sensitive network node. While preserving reasonable computational complexity, the decentralized deployment allowed for cooperative monitoring and adaptive feeder acceptance throughout the 236-bus low-voltage distribution network. Each agent observed a five-dimensional state vector consisting of voltage magnitude, feeder-load demand, renewable generation, congestion status, and feeder acceptance capacity. The action space consisted of five orchestration actions: feeder acceptance prioritization, congestion mitigation, renewable coordination, load balancing, and voltage control. Cooperative decision-making was supported through a decentralized neighborhood communication topology in which each agent exchanged sensitivity indices and local operating information only with neighboring feeder agents.

A Q-learning-based MARL method was implemented using a fully connected neural network with two hidden layers containing 128 and 64 neurons. Rectified linear unit activation was applied in the hidden layers. The network parameters were optimized using the Adam optimizer with a learning rate of 0.001 and a discount factor of 0.99. A mini-batch size of 64 was used, and the experience-replay buffer had a capacity of 100,000 transitions. Training was considered to have converged when the moving average of the cumulative reward over the previous 20 episodes changed by less than 0.1% for 10 consecutive evaluation windows. If this criterion was not satisfied, training continued until a maximum of 500 episodes was reached. The reinforcement-learning workflow is shown in Figure 2.

Reinforcement learning process diagram; agent-environment interaction, policy update, rewards loop.
Figure 2: Flowchart of reinforcement-driven agent learning. Flowchart illustrating the reinforcement-based agent-learning process for decentralized feeder orchestration and decision optimization. Please click here to view a larger version of this figure.

The learning process began with initialization of the LV distribution environment, agent states, and learning parameters. Intelligent agents were placed in feeder regions, distributed energy resource locations, and congestion-prone buses. The observation space, learning rate, exploration strategy, reward factors, and policy functions were then defined. At each interaction step, every agent observed the current state of its assigned feeder region. The state consisted of node-voltage magnitude, feeder-load demand, renewable-generation characteristics, congestion level, and feeder acceptance capacity. These observations formed the environmental state used for orchestration decision-making. Each agent selected an action according to its reinforcement-learning policy. The available actions included feeder acceptance prioritization, congestion management, renewable-energy coordination, load balancing, and voltage management. The selected action was applied to the dynamic LV environment, after which the feeder state was updated.

A reward was calculated after each action. A positive reward was assigned when the selected action improved feeder acceptance, prevented congestion propagation, maintained voltage compliance, or improved network stability. A penalty was applied when the action resulted in, or failed to prevent, feeder overload, voltage violations, or orchestration delays. The calculated reward was used to update the agent’s value function and decision policy through reinforcement optimization. The observation, action selection, environment transition, reward calculation, and policy update sequence was repeated until the stopping criterion was satisfied.

6. Voltage and congestion sensitivity evaluation

Following reinforcement-driven learning, voltage and congestion sensitivities were evaluated to identify vulnerable feeder regions and to support dynamic feeder acceptance decisions under renewable energy uncertainty.

At each operating interval, the effects of changes in feeder power, renewable generation, and load demand on node voltage and network congestion were determined. Voltage- and congestion-sensitivity indices were recalculated at each simulated operating interval rather than being derived solely from static network conditions. The sensitivity indices for each feeder node were updated based on the current network conditions, renewable generation variation, and feeder loading state. The resulting values were used to rank feeder nodes for feeder acceptance, congestion management, and voltage control actions.

The voltage-sensitivity index quantified the change in node voltage resulting from a change in active-power flow. After the voltage- and congestion-sensitivity indices were calculated, they were combined into a composite sensitivity score for adaptive prioritization of feeder acceptance. The composite scoring method is described in Supplementary File 1(Section 5). Feeder nodes with higher sensitivity scores were assigned higher orchestration priorities during congestion relief, feeder acceptance correction, and voltage regulation operations. The sensitivity scores were recalculated at each operating interval and shared with neighboring agents through the collaborative communication environment.

7. Collaborative acceptance orchestration and adaptive decision optimization at each simulated operating interval

After a sensitivity evaluation, collaborative acceptance orchestration was performed to enable decentralized agents to make coordinated feeder acceptance decisions under renewable uncertainty and dynamic congestion conditions. The agents exchanged local feeder states, sensitivity indices, congestion alerts, and operating priorities. Each agent independently evaluated its local feeder condition while coordinating with neighboring agents to support overall network stability.

Feeder acceptance was prioritized according to voltage sensitivity, congestion severity, renewable-generation variability, and available feeder capacity. Local sensitivity-aware observations were aggregated across agents, and coordinated feeder acceptance actions were generated. The mathematical formulation of the collaborative orchestration process is provided in Supplementary File 1 (Section 6). The dynamic LV network environment was deployed with collaborative agents positioned in feeder regions, renewable-energy integration points, and congestion-prone buses, as described in Supplementary File 1 (Algorithm 1). At each operating interval, each agent observed local feeder parameters, including voltage magnitude, renewable generation variation, feeder loading, congestion level, and feeder acceptance capacity.

The voltage-sensitivity and congestion-sensitivity indices were then calculated to identify feeder regions susceptible to voltage instability or congestion propagation. These indices were combined into an overall feeder-sensitivity score that determined feeder acceptance and orchestration priority. Local state information, congestion levels, voltage-instability indicators, and acceptance priorities were exchanged among neighboring agents. Based on the local observations and shared information, each agent selected and implemented an adaptive orchestration action. After each action, reinforcement feedback was obtained from the dynamic LV network environment according to feeder stability, congestion reduction, voltage compliance, and feeder acceptance efficiency. This feedback was used to update each agent’s policy through reinforcement-based optimization. The global orchestration objective function simultaneously provided coordinated feedback for adaptive optimization across the agent population. Policy updates continued until the agent policies converged toward an optimal decentralized orchestration strategy.

8. Large-scale validation

The Dynamic Orchestration Strategy was validated using the FeederBW dataset and the 236-bus LV distribution network dataset under operating scenarios with high renewable-energy penetration. The validation assessed the ability of the decentralized orchestration framework to manage dynamic feeder acceptance, renewable intermittency, congestion propagation, and voltage instability in interconnected LV distribution systems. The evaluated operating scenarios included high renewable penetration, changing load demand, dynamic congestion propagation, voltage-sensitive conditions, and varying feeder acceptance capacity.

Framework performance was evaluated using feeder acceptance rate, voltage compliance index, congestion reduction rate, orchestration latency, convergence speed, decentralized coordination efficiency, and renewable accommodation capability. These measures were used to assess scalability, robustness, adaptability, and coordination performance. The proposed framework was compared with traditional centralized feeder-orchestration approaches under the same network configurations. Equivalent datasets, operating scenarios, evaluation conditions, and performance measures were applied to the comparison methods.

Table 2 summarizes the datasets, operating conditions, orchestration environments, and performance variables used for experimental validation. The FeederBW dataset was used to evaluate feeder operating dynamics, renewable intermittency, congestion development, residential load variation, and voltage fluctuations under LV feeder conditions. The 236-bus LV dataset was used to evaluate decentralized orchestration in a larger interconnected network. The architecture was validated under varying conditions of renewable generation, load demand, voltage, and congestion. Decentralized coordination and reinforcement-learning-based policy optimization were assessed jointly across the intelligent agents.

Feeder acceptance rate, voltage compliance index, congestion reduction rate, convergence speed, and orchestration latency were used to quantify performance under dynamic operating conditions in renewable energy systems.

Experimental ParameterFeederBW Dataset236-bus LV DatasetValidation Purpose
Network TypeLow-Voltage Feeder NetworkLarge-Scale LV Distribution NetworkDynamic orchestration evaluation
Number of Nodes/BusesMultiple feeder nodes236 busesScalability analysis
Renewable IntegrationPV and distributed renewable sourcesHigh renewable penetration busesRenewable uncertainty validation
Load Demand BehaviorDynamic residential load profilesLarge-scale feeder load variationsAdaptive load orchestration
Congestion ScenariosFeeder overload and congestion statesMulti-bus congestion propagationCongestion mitigation analysis
Voltage ConditionsVoltage fluctuation profilesVoltage-sensitive bus conditionsVoltage compliance evaluation
Intelligent AgentsDistributed feeder agentsLarge-scale collaborative agentsDecentralized coordination analysis
Learning EnvironmentReinforcement-driven orchestrationMulti-agent adaptive learningPolicy optimization validation
Simulation ConditionsDynamic renewable variabilityLarge-scale dynamic operationlow-latency orchestration testing
Performance MetricsAcceptance rate, congestion reductionVoltage compliance, convergence speedOverall orchestration performance

Table 2: Large-scale experimental validation. Experimental settings used to evaluate scalability, renewable-energy uncertainty, and decentralized coordination.

Access restricted. Please log in or start a trial to view this content.

Results

All experiments were conducted five times using different random seeds to reduce the influence of stochastic learning. Mean values were calculated across the five runs. The same datasets, simulation parameters, hyperparameters, stopping criteria, and evaluation procedures were used for all methods. Centralized Voltage Control (CVC)33, Conventional Multi-Agent Control (CMAC)21, Reinforcement Learning-Based Voltage Regulation (RLVR)20, Distributed Ener...

Access restricted. Please log in or start a trial to view this content.

Discussion

The experimental findings showed that the proposed Dynamic Orchestration Strategy improved decentralized feeder coordination, renewable energy integration, voltage stability, congestion management, and low-latency orchestration compared with Centralized Voltage Control (CVC)33, Conventional Multi-Agent Control (CMAC)21, Reinforcement Learning-Based Voltage Regulation (RLVR)20, Distributed Energy Resource Coordination (DERC)26,...

Access restricted. Please log in or start a trial to view this content.

Disclosures

The authors declare that they have no competing interests.

Acknowledgements

This research was supported by the Guangzhou Power Supply Bureau of Guangdong Power Grid Company through the project “Research on Automation Acceptance Technology of Low Voltage Metering Equipment Based on Process Automation” (Project Code: 030100KC24120100).

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
236-Bus Low-Voltage Distribution Network DatasetCanizes et al.DOI: 10.5281/zenodo.8274780Public benchmark dataset used for scalability analysis and large-scale validation of the proposed framework
Central Processing Unit (CPU)Intel CorporationIntel Core i9-12900K (16-Core)Used for simulation management and environment execution
Congestion Sensitivity Analysis ModuleCustom-developed ModuleZenodo DOI: 10.5281/zenodo.21423239Performs real-time congestion sensitivity computation and feeder prioritization
CUDA ToolkitNVIDIA CorporationCUDA 12.1GPU computing platform used for accelerated PyTorch model training
cuDNN LibraryNVIDIA CorporationcuDNN 9.3.0Deep neural network acceleration library used with CUDA
Custom Dynamic LV Network SimulatorCustom-developed ModuleVersion 1.0Author-developed simulation platform implemented using Python and PyTorch for dynamic feeder orchestration experiments. Implementation details are provided in the Methods and Data Availability sections.
Data Processing Librarypandas Development Teampandas 2.2.2Used for preprocessing, feature extraction, normalization, and time-series data management
Deep Learning FrameworkPyTorch FoundationPyTorch 2.3.1Used for multi-agent reinforcement learning (MARL) model implementation, neural network training, and policy optimization
Distributed Agent Communication ModuleCustom-developed FrameworkZenodo DOI: 10.5281/zenodo.21423239Enables decentralized communication and collaborative policy exchange among intelligent agents
FeederBW DatasetTreutlein et al.DOI: 10.5281/zenodo.17831177Public dataset containing real-world low-voltage feeder measurements, renewable generation, and operating profiles
Graphics Processing Unit (GPU)NVIDIA CorporationGeForce RTX 3090, 24 GB GDDR6XHardware accelerator used for neural network training and parallel computation
Multi-Agent Reinforcement Learning EnvironmentFarama FoundationGym 0.26.2Customized reinforcement learning environment for collaborative intelligent-agent interaction and training
Numerical Computing LibraryNumPy DevelopersNumPy 1.26.4Used for numerical computations, tensor manipulation, and matrix operations
Operating SystemCanonical Ltd.Ubuntu 22.04.5 LTS (64-bit)Operating system used for all simulations and reinforcement learning experiments
Python Programming LanguagePython Software FoundationPython 3.11.9Primary programming language used for algorithm implementation, simulation, and model development
System MemoryLenovo64 GB DDR5 RAMInstalled system memory used for large-scale MARL simulation and data processing.
Voltage Stability Monitoring ModuleCustom-developed ModuleZenodo DOI: 10.5281/zenodo.21423239Continuously evaluates voltage stability and compliance during feeder orchestration

References

  1. Ahmed F, et al. A multi-agent reinforcement learning framework for voltage-constrained incentive demand response in PV-rich low-voltage distribution systems. IEEE Access. 2026;14:45410–22.
  2. Lamsal D, Sreeram V, Mishra Y, Kumar DS. Smoothing control strategy of wind and photovoltaic output power fluctuation by considering the state of health of battery energy storage system. IET Renew Power Gener. 2019;13:578–86.
  3. Allahmoradi S, et al. Data-driven Volt/VAR optimization for modern distribution networks: A review. IEEE Access. 2024;12:71184–204.
  4. O'Connell N, Pinson P, Madsen H, O'Malley M. Benefits and challenges of electrical demand response: A critical review. Renew Sustain Energy Rev. 2014;39:686–99.
  5. Hossain MS, Madlool NA, Al-Fatlawi AW, El Haj Assad M. High penetration of solar photovoltaic structure on the grid system disruption: An overview of technology advancement. Sustainability. 2023;15:1174. https://doi.org/10.3390/su15021174
  6. Rahmouni A. Impact of static reactive power compensator (SVC) on the power grid. WSEAS Trans Electron. 2020;11:96–104.
  7. Chandran CV, et al. Application of demand response to improve voltage regulation with high DG penetration. Electr Power Syst Res. 2020;189:106722. https://doi.org/10.1016/j.epsr.2020.106722
  8. Wang Q, et al. A demand response strategy in high photovoltaic penetration power systems considering the thermal ramp rate limitation. IEEE Access. 2019;7:163814–22.
  9. Wang Z, et al. How to effectively implement an incentive-based residential electricity demand response policy? Experience from large-scale trials and matching questionnaires. Energy Policy. 2020;141:111450. https://doi.org/10.1016/j.enpol.2020.111450
  10. van Tilburg J, Siebert LC, Cremer JL. MARL-iDR: Multi-agent reinforcement learning for incentive-based residential demand response. arXiv. 2023. https://arxiv.org/abs/2304.04086
  11. Bahrami S, Chen YC, Wong VWS. Deep reinforcement learning for demand response in distribution networks. IEEE Trans Smart Grid. 2021;12:1496–506.
  12. Li J, et al. Model-free reinforcement learning economic dispatch algorithms for price-based residential demand response management system. IEEE Trans Ind Cyber-Phys Syst. 2023;1:123–35.
  13. Zheng S, et al. Incentive-based integrated demand response for multiple energy carriers under complex uncertainties and double coupling effects. Appl Energy. 2021;283:116254. https://doi.org/10.1016/j.apenergy.2020.116254
  14. Nainar K, Pillai JR, Bak-Jensen B. Incentive price-based demand response in active distribution grids. Appl Sci. 2020;11:1–17.
  15. Nguyen Duc T, et al. Impact of renewable energy integration on a novel method for pricing incentive payments of incentive-based demand response program. IET Gener Transm Distrib. 2022;16:1648–67.
  16. Pourramezan A, Samadi M. A novel approach for incorporating incentive-based and price-based demand response programs in long-term generation investment planning. Int J Electr Power Energy Syst. 2022;142:108315. https://doi.org/10.1016/j.ijepes.2022.108315
  17. Mathew A, Roy A, Mathew J. Intelligent residential energy management system using deep reinforcement learning. IEEE Syst J. 2020;14:5362–72.
  18. Khan DA, Arshad A, Lehtonen M, Mahmoud K. Combined DR pricing and voltage control using reinforcement learning based multi-agents and load forecasting. IEEE Access. 2022;10:130839-49.
  19. Zhang X, et al. An edge-cloud integrated solution for buildings demand response using reinforcement learning. IEEE Trans Smart Grid. 2021;12:420–31.
  20. Duan J, et al. Deep-reinforcement-learning-based autonomous voltage control for power grid operations. IEEE Trans Power Syst. 2020;35:814–7.
  21. Wang S, et al. A data-driven multi-agent autonomous voltage control framework using deep reinforcement learning. IEEE Trans Power Syst. 2020;35:4644–54.
  22. Turitsyn K, Sulc P, Backhaus S, Chertkov M. Options for control of reactive power by distributed photovoltaic generators. Proc IEEE. 2011;99:1063–73.
  23. Bedawy A, et al. Optimal voltage control strategy for voltage regulators in active unbalanced distribution systems using multi-agents. IEEE Trans Power Syst. 2020;35:1023–35.
  24. Bedawy A, Yorino N, Mahmoud K. Management of voltage regulators in unbalanced distribution networks using voltage/tap sensitivity analysis. Presented at: International Conference on Innovative Trends in Computer Engineering (ITCE); Aswan, Egypt; 2018. https://doi.org/10.1109/itce.2018.8316651
  25. Smith O, et al. The effect of renewable energy incorporation on power grid stability and resilience. Sci Adv. 2022;8:eabj6734. https://doi.org/10.1126/sciadv.abj6734
  26. Charbonnier F, Morstyn T, McCulloch MD. Scalable multi-agent reinforcement learning for distributed control of residential energy flexibility. Applied Energy. 2022;314:118825. doi:10.1016/j.apenergy.2022.118825
  27. Dugan J, Mohagheghi S, Kroposki B. Application of mobile energy storage for enhancing power grid resilience: A review. Energies. 2021;14:6476. https://doi.org/10.3390/en14206476
  28. Panossian N, et al. Challenges and opportunities of integrating electric vehicles in electricity distribution systems. Curr Sustain Renew Energy Rep. 2022;9:27–40.
  29. Guan Q, et al. Dynamic-aware deep reinforcement learning for heterogeneous fleet-based capacitated electric vehicle routing problems. Applied Energy. 2026;413:127757. https://doi.org/10.1016/j.apenergy.2026.127757
  30. Guan Q, et al. Heterogeneous attention-driven deep reinforcement learning for solving EVRPs with pickup-delivery and time windows. Applied Energy. 2026;407:127355. https://doi.org/10.1016/j.apenergy.2026.127355
  31. Treutlein M, et al. Real-world energy data of 200 feeders from low-voltage grids with metadata in Germany over two years (Version v1.0) [Data set]. Zenodo; 2025. https://doi.org/10.5281/zenodo.17831177
  32. Canizes B, Castro F, Silveira V, Vale Z. 236-Bus Low Voltage Distribution Network Data [Data set]. Zenodo; 2023. https://doi.org/10.5281/zenodo.8274780
  33. Xi, Haikuo & Chen, Can & Bai, Xuesong & Ma, Yuan & Ding, Jiachao & Chen, Qifang. (2024). Centralized and decentralized combined voltage control for distribution network with high penetration PV connected. Journal of Physics: Conference Series. 2771. 012040. 10.1088/1742-6596/2771/1/012040.
  34. Singh AK, Parida SK. Congestion management with distributed generation and its impact on electricity market. International Journal of Electrical Power & Energy Systems. 2013;48:39–47. doi:10.1016/j.ijepes.2012.11.025.
  35. Gooi HB, Wang T, Tang Y. Edge intelligence for smart grid: A survey on application potentials. CSEE Journal of Power and Energy Systems. 2023;9(5):1623–1640. https://doi.org/10.17775/CSEEJPES.2022.02210
  36. Molokomme DN, Onumanyi AJ, Abu-Mahfouz AM. Edge intelligence in smart grids: A survey on architectures, offloading models, cyber security measures, and challenges. Journal of Sensor and Actuator Networks. 2022;11(3):47. https://doi.org/10.3390/jsan11030047
  37. Chang Z, Liu S, Xiong X, Cai Z, Tu G. A survey of recent advances in edge-computing-powered artificial intelligence of things. IEEE Internet of Things Journal. 2021;8(18):13849–13875.

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Explore More Articles

Multi-Agent Reinforcement LearningCongestion ManagementVoltage SensitivityDistributed Renewable IntegrationDecentralized CoordinationFeeder MonitoringOperational Resilience