Grid Impedance Shaping for Grid-Forming Inverters: A Soft Actor-Critic Deep Reinforcement Learning Algorithm

This paper proposed an advanced method for adjusting grid impedance in grid-forming inverters, utilizing the Soft Actor-Critic Deep Reinforcement Learning (SAC-DRL) algorithm. The approach contains a flexible strategy for controlling virtual impedance, supported by an equivalent grid impedance estimator. This facilitates accurate modifications of virtual impedance based on the grid’s X/R ratio and the converter’s power capacity, aiming to optimize power flow and maintain grid stability. A unique feature of this methodology is the division of virtual reactance into two segments: one adhering to standard control protocols and the other designated for precision enhancement via the SAC-DRL method. This strategy introduces a layer of intelligence to the system, strengthening its resilience against fluctuations in grid impedance. Experimental validations, executed on a laboratory setup, verify the robustness of this approach, highlighting its potential to significantly improve intelligent power grid management practices.