(Deep) Reinforcement learning for electric power system control and related problems: A short review and perspectives

[en] This paper reviews existing works on (deep) reinforcement learning considerations in electric power system control. The works are reviewed as they relate to electric power system operating states (normal, preventive, emergency, restorative) and control levels (local, household, microgrid, subsystem, wide-area). Due attention is paid to the control-related problems considerations (cyber-security, big data analysis, short-term load forecast, and composite load modelling). Observations from reviewed literature are drawn and perspectives discussed. In order to make the text compact and as easy as possible to read, the focus is only on the works published (or "in press") in journals and books while conference publications are not included. Exceptions are several work available in open repositories likely to become journal publications in near future. Hopefully this paper could serve as a good source of information for all those interested in solving similar problems.

Disciplines :

Electrical & electronics engineering

Author, co-author :

Glavic, Mevludin ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Smart grids

Language :

English

Title :

(Deep) Reinforcement learning for electric power system control and related problems: A short review and perspectives

Publication date :

October 2019

Journal title :

Annual Reviews in Control

ISSN :

1367-5788

Publisher :

Elsevier, United Kingdom

Volume :

Peer reviewed :

Peer Reviewed verified by ORBi

Available on ORBi :

since 07 October 2019

Statistics

Number of views

186 (13 by ULiège)

Number of downloads

2979 (9 by ULiège)

More statistics

Scopus citations^®

112

Scopus citations^®
without self-citations

111

OpenCitations

OpenAlex citations

114

Bibliography

Abouheaf, M., Gueaieb, W., Sharaf, A., Model-free adaptive learning control scheme for wind turbines with doubly FED induction generators. IET Renewable Power Generation 12 (2018), 1675–1686.
Abouheaf, M., Gueaieb, W., Sharaf, A., Load frequency regulation for multi-area power system using integral reinforcement learning. IET Generation, Transmission, Distribution 13 (2019), 4311–4323.
Abramova, E., Dickens, L., Kuhn, D., & Faisal, A. (2019). RLOC: Neurobiologically inspired hierarchical reinforcement learning algorithm for continuous control of nonlinear dynamical systems, arXiv:1903.03064v1, Accessed September, 2019 (pp. 1-33), https://arxiv.org/abs/1903.03064.
Ademoye, T., Feliachi, A., Reinforcement learning tuned decentralized synergetic control of power systems. Electric Power Systems Research 86 (2012), 34–40.
Ahamed, T.P.I., Rao, P.S.N., Sastry, P.S., A reinforcement learning approach to automatic generation control. Electric Power Systems Research 63 (2002), 9–26.
Ahamed, T.P.I., Rao, P.S.N., Sastry, P.S., Ha neural network based automatic generation controller design through reinforcement learning. International Journal of Emerging Electric Power Systems 6 (2006), 1–31.
An, D., Yang, Q., Liu, W., Zhang, Y., Defending against data integrity attacks in smart grid: A deep reinforcement learning-based approach. IEEE Access 7 (2019), 110835–110845.
Anderlini, E., Forehand, D.I.M., Bannon, E., Abusara, M., Control of a realistic wave energy converter model using least-squares policy iteration. IEEE Transactions on Sustainable Energy 8 (2017), 1618–1628.
Anderlini, E., Forehand, D.I.M., Stansell, P., Xiao, Q., Abusara, M., Control of a point absorber using reinforcement learning. IEEE Transactions on Sustainable Energy 7 (2016), 1681–1690.
Annaswamy, A., Vision for smart grid control: 2030 and beyond. Technical Report, 2013, IEEE Standards Association.
Arulkumaran, K., Desienroth, M.P., Brundage, M., Bharath, A.A., A brief survey of deep reinforcement learning. IEEE Signal Processing Magazine 34 (2017), 26–38.
Azizzadenesheli, K., & Anandkumar, A. (2019). Efficient exploration through Bayesian deep Q-networks. arXiv:1802.04412v4. Accessed September, 2019, (pp. 1–40).
Bag, A., Subudhi, B., Ray, P., An adaptive variable leaky least mean square control scheme for grid integration of a PV system. IEEE Transactions on Sustainable Energy, 2019 Early access https://ieeexplore.ieee.org/document/8770144.
Bagheri, M., Nurmanova, V., Abedinia, O., Naderi, M.S., Enhancing power quality in microgrids with a new online control strategy for DSTATCOM using reinforcement learning algorithm. IEEE Access 6 (2018), 38986–38996.
Barto, A.G., Mahadevan, S., Recent advances in hierarchical reinforcement learning. Discrete Events Dynamic Systems: Theory and Applications 13 (1999), 41–77.
Bedi, G., Venayagamoorthy, G.K., Singh, R., Brooks, R.R., Wang, K.C., Review of internet of things (IoT) in electric power and energy systems. IEEE Internet of Things Journal 5 (2018), 847–870.
Belkacemi, R., Babalola, A.A., Zarrabian, S., Real-time cascading failures prevention through MAS algorithm and immune system reinforcement learning. Electric Power Components and Systems 45 (2017), 505–519.
Bertsekas, D.P., Dynamic programming and optimal control, Vols. I and II. 1995, Athena Scientific, Boston.
Bertsekas, D.P., Reinforcement learning and optimal control. 2019, Athena Scientific, Nashua, NH, USA.
Busoniu, L., Babuska, R., Schutter, B.D., Ernst, D., Reinforcement learning and dynamic programming using function approximators. 2010, CRC Press, Boca Raton.
Busoniu, L., de Bruin, T., Tolic, D., Kober, J., Palunko, I., Reinforcement learning for control: Performance, stability, and deep approximators. Annual Reviews in Control 46 (2018), 8–28.
Chen, Y., Huang, S., Liu, F., Wang, Z., Sun, X., Yang, Q., et al. Evaluation of reinforcement learning-based false data injection attack to automatic voltage control. IEEE Transactions on Smart Grid 10 (2019), 2158–2169.
Claessens, B.J., Vrancxs, P., Ruelens, F., Convolutional neural networks for automatic state-time feature extraction in reinforcement learning applied to residential load control. IEEE Transactions on Smart Grid 9 (2018), 3259–3269.
Daneshfar, F., Bevrani, H., Load-frequency control: A GA-based multi-agent reinforcement learning. IET Generation, Transmission, Distribution 4 (2010), 13–26.
De Asis, K., Chan, A., Pitis, S., Sutton, R. S., & Graves, D. (2019). Fixed horizon temporal difference methods for stable reinforcement learning, arXiv:1909.03906v1, Accessed September, 2019 (pp. 1-16), https://arxiv.org/abs/1903.03064J.
de Bruin, T., Kober, J., Tuyls, K., Babuska, R., Experience selection in deep reinforcement learning for control. Journal of Machine Learning Research 19 (2018), 1–56.
Dibaji, S.M., Pirani, M., Flamholz, D.B., Annaswamy, A.M., Johansson, K.H., Chakrabortty, A., A systems and control perspective of CPS security. Annual Reviews in Control 47 (2019), 394–411.
Duan, J., Li, Z., Shi, D., Lin, C., Wang, Z., Reinforcement-learning-based optimal control for hybrid energy storage systems in hybrid AC/DC microgrids. IEEE Transactions on Industrial Informatics 15 (2019), 5355–5364.
Duan, J., Shi, D., Diao, R., Li, H., Wang, Z., Zhang, B., Bian, D., Yi, Z., Deep-reinforcement-learning-based autonomous voltage control for power grid operations. IEEE Transactions on Power Systems, 2019 Early access https://ieeexplore.ieee.org/document/8834806.
Duan, J., Xu, H., Liu, W., Q-learning-based damping control of wide-area power systems under cyber uncertainties. IEEE Transactions on Smart Grid 9 (2018), 6408–6418.
DyLiacco, T.E., Real-time computer control of power systems. Proceedings of the IEEE 62 (1974), 884–891.
Ernst, D., Glavic, M., Capitanescu, F., Wehenkel, L., Reinforcement learning versus model predictive control: A comparison on a power system problem. IEEE Transactions on Systems, Man, and Cybernetic: Part B 39 (2009), 517–529.
Ernst, D., Glavic, M., Geurst, P., Wehenkel, L., Approximate value iteration in the reinforcement learning context. Application to electrical power system control. International Journal of Emerging Electrical Power Systems 3 (2005), 1–37.
Ernst, D., Glavic, M., Wehenkel, L., Power systems stability control: Reinforcement learning framework. IEEE Transactions on Power Systems 19 (2004), 427–435.
Fan, J., & Li, W. (2019). Safety-guided deep reinforcement learning via online Gaussian process estimation, arXiv:1903.02526v2, Accessed September, 2019, (pp. 1-13), https://arxiv.org/abs/1903.02526.
Fancois-Lavet, V., Henderson, P., Islam, R., Bellemare, M.G., Pineau, J., An introduction to deep reinforcement learning. Foundations and Trends in Machine Learning 11 (2019), 219–354.
Farhadi, M., Mohammed, O., Energy storage technologies for high-power applications. IEEE Transactions on Industry Applications 52 (2015), 1953–1961.
Feng, C., Sun, M., Zhang, J., Reinforced deterministic and probabilistic load forecasting via Q-learning dynamic model selection. IEEE Transactions on Smart Grid, 2019 Early access https://ieeexplore.ieee.org/document/8813103.
Garcia, J., Fernandez, F., A comprehensive survey on safe reinforcement learning. Journal of Machine Learning Research 16 (2015), 1437–1480.
Ghorbani, M.J., Choudhry, M.A., Feliachi, A., A multiagent design for power distribution systems automation. IEEE Transactions on Smart Grid 7 (2016), 329–339.
Glavic, M., Design of a resistive brake controller for power system stability enhancement using reinforcement learning. IEEE Transactions on Control Systems Technology 13 (2005), 743–751.
Glavic, M., Ernst, D., Wehenkel, L., Combining a stability and a performance-oriented control in power systems. IEEE Transactions on Power Systems 20 (2005), 525–526.
Glavic, M., Ernst, D., Wehenkel, L., A reinforcement learning based discrete supplementary control for power system transient stability enhancement. Engineering Intelligent Systems for Electrical Engineering and Communications 13 (2005), 81–88.
Glavic, M., Fonteneau, R., Ernst, D., Reinforcement learning for electric power system decision and control: Past considerations and perspectives. IFAC PapersOnLine 50-1 (2017), 6918–6927.
Gros, S., Zanon, M., Data-driven economic NMPC using reinforcement learning. IEEE Transactions on Automatic Control, 2019 Early access https://ieeexplore.ieee.org/document/8701462.
Hadidi, R., Jeyasurya, B., Reinforcement learning based real-time wide-area stabilizing control agents to enhance power system stability. IEEE Transactions on Smart Grid 4 (2013), 489–497.
He, J., Chen, C., Zhu, S., Yang, B., Guan, X., Antijamming game framework for secure state estimation in power systems. IEEE Transactions on Industrial Informatics 15 (2019), 2628–2637.
He, Y., Chen, C., Zhu, S., Yang, B., Guan, X., Risk-averse transmission path selection for secure state estimation in power systems. IEEE Internet of Things Journal 6 (2019), 3121–3131.
Huang, Q., Huang, R., Hao, W., Tan, J., R, F., Huang, Z., Adaptive power system emergency control using deep reinforcement learning. IEEE Transactions on Smart Grid, 2019 Early access https://ieeexplore.ieee.org/document/8787888.
Huang, Q., Huang, R., Hao, W., Tan, J., Fan, R., Huang, Z., Data-driven load frequency control for stochastic power systems: A deep reinforcement learning method with continuous action searchning. IEEE Transactions on Power Systems 34 (2019), 1653–1656.
Jin, M., & Lavaei, J. (2018). Stability-certified reinforcement learning: A control theoretic perspective, arXiv:1810.11505v1, Accessed August, 2019, (pp. 1–30), https://arxiv.org/abs/1810.11505.
Jung, J., Liu, C.C., Tanimoto, S.L., Vittal, V., Adaptation in load shedding under vulnerable operating conditions. IEEE Transactions on Power Systems 17 (2002), 1199–1205.
Kamalapurkar, R., Walters, P., Rosenfeld, J., Dixon, W., Reinforcement learning for optimal feedback control: A Lyapunov-based approach. 2018, Springer, Cham, Switzerland.
Karimi, A., Eftekharnejad, S., Feliachi, A., Reinforcement learning based backstepping control of power system oscillations. Electric Power Systems Research 79 (2009), 1511–1520.
Khargonekar, P.P., Dahleh, M.A., Advancing systems and control research in the era of ML and AI. Annual Reviews in Control 45 (2019), 1–4.
Khorramabadi, S.S., Bakhshai, A., Intelligent control of grid-connected microgrids: An adaptive critic-based approach. IEEE Journal of Emerging and Selected Topics in Power Electronics 3 (2015), 493–504.
Kiumarsi, B., Vamvoudakis, K.G., Modares, H., Lewis, F.L., Optimal and autonomous control using reinforcement learning: A survey. IEEE Transactions on Neural Networks and Learning Systems 29 (2018), 2042–2062.
Klenske, E.D., Hennig, P., Dual control for approximate Bayesian reinforcement learning. Journal of Machine Learning Research 17 (2016), 1–30.
Kretchmar, R.M., Young, P.M., Anderson, C.W., Hittle, D.C., Anderson, M.L., Delnero, C.C., Robust reinforcement learning control with static and dynamic stability. International Journal of Robust and Nonlinear Control 11 (2001), 1469–1500.
Kurt, M.N., Ogundijo, O., Li, C., Wang, X., Online cyber-attack detection in smart grid: A reinforcement learning approach. IEEE Transactions on Smart Grid 10 (2019), 5174–5185.
Lamnabhi-Lagarrigue, F., Annaswamy, A., Engell, S., Isaksson, A., Khargonekar, P., Murray, R.M., et al. Systems and control for the future of humanity, research agenda: Current and future roles, impact and grand challenges. Annual Reviews in Control 43 (2017), 1–64.
LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 426–444.
Lei, L., Tan, Y., Liu, S., Zheng, K., Shen, X., Deep reinforcement learning for autonomous internet of things: Model, applications and challenges. arXiv:1907.09059v1, Accessed August, 2019, 2019, 1–23 arXiv: 1907.09059v1. Accessed August, 2019, (pp. 1–23).
Li, B.H., Wu, Q.H., Learning coordinated fuzzy logic control of dynamic quadrature boosters in multimachine power systems. IEE Generation, Transmission, Distribution 146 (1999), 577–585.
Liu, C.C., Jung, J., Heydt, G.T., Vittal, V., Phadke, A., The strategic power infrastructure defense (SPID) system. A conceptual design. IEEE Control Systems Magazine 20 (2000), 40–52.
Liu, M., Yu, F.R., Teng, Y., Leung, V.C.M., Song, M., Performance optimization for blockchain-enabled industrial internet of things (IIoT) systems: A deep reinforcement learning approach. IEEE Transactions on Industrial Informatics 15 (2019), 3559–3570.
Madani, V., Novosel, D., Horowitz, S., Adamiak, M., Amantegui, J., Karlsson, D., et al. IEEE PSRC report on global industry experiences with system integrity protection schemes (SIPS). IEEE Transactions on Power Systems 25 (2010), 2143–2155.
Mannucci, T., van Kempen, E.J., de Viser, C., Chu, Q., Safe exploration algorithms for reinforcement learning controllers. IEEE Transactions on Neural Networks and Learning Systems 29 (2018), 1069–1081.
Oozeer, M. I., Haykin, S. (2019). Cognitive risk control for mitigating cyberattack in smart grid, IEEE Access, 7, 125806–125826.
Otomega, B., Glavic, M., Van Cutsem, T., Distributed undervoltage load shedding. IEEE Transactions on Power Systems 22 (2007), 2283–2284.
Padiyar, K.R., Power system dynamics, stability and control., 2008, BS Publications, Bangalore.
Pinto, L., Davidson, J., Sukthankar, R., & Gupta, A. (2017). Robust adversarial reinforcement learning, arXiv:1703.02702v1, Accessed September, 2019, (pp. 1–10), https://arxiv.org/abs/1703.02702.
Powell, W.B., Meisel, S., Tutorial on stochastic optimization in energy Part I: Modeling and policies. IEEE Transactions on Power Systems 31 (2016), 1459–1467.
Price, B., Boutilier, C., Accelerating reinforcement learning through implicit imitation. Journal of Artificial Intelligence Research 19 (2003), 569–629.
Ruelens, F., Claessens, B. J., Vrancx, P., Spiessens, F., & Deconinck, G. (2017). Direct load control of thermostatically controlled loads based on sparse observations using deep reinforcement learning, arXiv:1707.08553.v1, accessed August, 2019, (pp. 1–8), https://arxiv.org/abs/1707.08553.
Ruiz-Vega, D., Glavic, M., Ernst, D., Transient stability emergency control combining open-loop and closed-loop techniques. IEEE PES general meeting, 2003, IEEE, 2053–2059.
Samad, T., Annaswamy, A.M., Controls for smart grids: Architectures and applications. Proceedings of the IEEE 105 (2017), 2244–2261.
Schmidhuber, J., Deep learning in neural networks: An overview. Neural Networks 61 (2015), 85–117.
Shang, X., Li, Z., Zheng, J., Wu, Q.H., Equivalent modeling of active distribution network considering the spatial uncertainty of renewable energy resources. International Journal of Electrical Power and Energy Systems 112 (2019), 83–91.
Sun, J., Zhu, Z., Li, H., Chai, Y., Qi, G., Wang, H., An integrated critic-actor neural network for reinforcement learning with application of DERs control in grid frequency regulation. International Journal of Electrical Power and Energy Systems 111 (2019), 286–299.
Sutton, R.S., Barto, A.G., Reinforcement learning: An introduction. 1998, MIT Press, Cambridge.
Theodorou, E.A., Buchli, J., Schaal, S., A generalized path integral control approach to reinforcement learning. Journal of Machine Learning Research 11 (2010), 3137–3181.
US-DoE, Final Report on the August 14, 2003 blackout in the United States and Canada: Causes and recommendations. Technical Report, 2004, US Department of Energy, US-Canada Power System Outage Task Force.
US-DoE, An assessment of energy technologies and research opportunities. Technical Report, 2015, US Department of Energy.
Vlachogiannis, J.G., Hatziargyriou, N., Reinforcement learning for reactive power control. IEEE Transactions on Power Systems 19 (2004), 1317–1325.
Wang, D., Glavic, M., Wehenkel, L., Trajectory-based supplementary damping control for power system electromechanical oscillations. IEEE Transactions on Power Systems 29 (2014), 2835–2845.
Wang, H., Lei, Z., Zhang, X., Peng, J., Jiang, H., Multiobjective reinforcement learning-based intelligent approach for optimization of activation rules in automatic generation control. IEEE Access 7 (2019), 17480–17492.
Wang, K., Yu, J., Yu, Y., Qian, Y., Zeng, D., Guo, S., et al. A survey on energy internet: Architecture, approach, and emerging technologies. IEEE Systems Journal 12 (2018), 2403–2416.
Wang, Z., Chen, Y., Liu, F., Xia, Y., Zhang, X., Power system security under false data injection attacks with exploitation and exploration based on reinforcement learning. IEEE Access 6 (2018), 48785–48796.
Wang, Z., Liu, L., Zhang, H., Xiao, G., Fault-tolerant controller design for a class of nonlinear MIMO discrete-time systems via online reinforcement learning algorithm. IEEE Transactions on Systems, Man, and Cybernetics: Systems 46 (2016), 611–622.
Wehenkel, L., Glavic, M., Geurts, P., Ernst, D., Automatic learning of sequential decision strategies for dynamic security assessment and controls. IEEE PES general meeting, 2006, IEEE, 1–6.
Wei, C., Zhang, Z., Qiao, W., Qu, L., Reinforcement-learning-based intelligent maximum power point tracking control for wind energy conversion systems. IEEE Transactions on Industrial Electronics 62 (2015), 6360–6370.
Wei, C., Zhang, Z., Qiao, W., Qu, L., An adaptive network-based reinforcement learning method for MPPT control of PMSG wind energy conversion systems. IEEE Transactions on Power Electronics 31 (2016), 7837–7848.
Wirth, C., Akrour, R., Neumann, G., Furnkranz, J., A survey of preference-based reinforcement learning methods. Journal of Machine Learning Research 18 (2017), 1–46.
Wu, D., Zheng, X., Kalathil, D., & Xie, L. (2019a). Nested reinforcement learning based control for protective relays in power distribution systems, arXiv:1906.10815v1, Accessed August, 2019, (pp. 1–8), https://arxiv.org/abs/1906.10815.
Wu, J., Fang, B., Fang, J., Chen, X., Tse, C.K., Online tuning of a supervisory fuzzy controller for low-energy building system using reinforcement learning. Control Engineering Practice 18 (2010), 532–539.
Wu, J., Fang, B., Fang, J., Chen, X., Tse, C.K., Sequential topology recovery of complex power systems based on reinforcement learning. Physica A: Statistical Mechanics and its Applications 535 (2019), 1–13.
Wu, J., Ota, K., Dong, M., Li, J., Wang, H., Big data analysis based security situational awareness for smart grid. IEEE Transactions on Big Data 4 (2018), 408–417.
Xi, H., Dominguez-Garcia, A. D., & Sauer, P. W. (2018). Optimal tap setting of voltage regulation transformers using batch reinforcement learnings, arXiv:1807.10997v2, Accessed August, 2019, (pp. 1–8), https://arxiv.org/abs/1807.10997.
Xie, J., Ma, Z., Ma, S., & Wang, Z. (2019). Data-driven based method for power system time-varying composite load modeling, arXiv:1905.02688v1, Accessed August, 2019. (pp. 1–8), https://arxiv.org/abs/1905.02688.
Xu, Y., Zhang, W., Liu, W., Ferrese, F., Multiagent-based reinforcement learning for optimal reactive power dispatch. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews 42 (2012), 1742–1751.
Yan, J., He, H., Zhong, X., Tang, Y., Q-learning based vulnerability analysis of smart grid against sequential topology attacks. IEEE Transactions on Information Forensics and Security 12 (2017), 200–210.
Yang, Q., Wang, G., Sadeghi, A., & Giannakis, G. B. (2019). Real-time voltage control using deep reinforcement learnings, arXiv:1904.09374v1, Accessed August, 2019, (pp. 1–9), https://arxiv.org/abs/1904.09374.
Ye, D., Zhang, M., Sutanto, D., A hybrid multiagent framework with Q-learning for power grid systems restoration. IEEE Transactions on Power Systems 26 (2011), 2434–2441.
Yin, L., Yu, T., Zhou, L., Huang, L., Zhang, X., Zheng, B., Artificial emotional reinforcement learning for automatic generation control of large-scale interconnected power grids. IET Generation, Transmission, Distribution 11 (2017), 2305–2313.
Younesi, A., Shayeghi, H., Moradzadeh, M., Application of reinforcement learning for generating optimal control signal to the IPFC for damping of lowfrequency oscillations. International Transactions on Electric Energy Systems 28 (2018), 1–23.
Yousefian, R., Bhattarai, R., Kamalasadan, S., Transient stability enhancement of power grid with integrated wide area control of wind farms and synchronous generators. IEEE Transactions on Power Systems 32 (2017), 4818–4831.
Yousefian, R., Kamalasadan, S., Energy function inspired value priority based global wide-area control of power grid. IEEE Transactions on Smart Grid 9 (2018), 552–563.
Yousefian, R., Kamalsadan, S., Design and real-time implementation of optimal power system wide-area system-centric controller based on temporal difference learning. IEEE Transactions on Industry Applications 52 (2016), 395–406.
Yu, T., Wang, H.Z., Zhou, B., Chen, K.W., Tang, J., Multi-agent correlated equilibrium Q(λ) learning for coordinated smart generation control of interconnected power grids. IEEE Transactions on Power Systems 27 (2012), 373–380.
Yu, T., Zhang, X.S., Zhou, B., Chan, K.V., Hierarchical correlated q-learning for multi-layer optimal generation command dispatch. International Journal of Electric Power and Energy Systems 78 (2016), 1–12.
Yu, T., Zhou, B., Chan, K.W., Chen, L., Yang, B., Stochastic optimal relaxed automatic generation control in non-Markov environment based on multi-step Q(λ) learning. IEEE Transactions on Power Systems 26 (2011), 1272–1282.
Yu, T., Zhou, B., Chan, K.W., Yuan, Y., Yang, B., Wu, Q., R(λ) imitation learning for automatic generation control of interconnected power grids. Automatica 48 (2012), 2130–2136.
Zarabbian, S., Belkacemi, R., Babalola, A.A., Reinforcement learning approach for congestion management and cascading failure prevention with experimental application. Electric Power Systems Research 141 (2016), 179–190.
Zhang, X., Li, S., He, T., Yang, B., Yu, T., Li, H., et al. Memetic reinforcement learning based maximum power point tracking design for PV systems under partial shading condition. Energy 174 (2019), 1079–1090.
Zhang, X.S., Yu, T., Pan, Z.N., Yang, B., Bao, T., Lifelong learning for complementary generation control of interconnected power grids with high-penetration renewables and EVs. IEEE Transactions on Power Systems 33 (2018), 4097–4110.
Zheng, C., Wang, S., Liu, Y., Liu, C., Xie, W., Fang, C., A novel equivalent model of active distribution networks based on LSTM. IEEE Transactions on Neural Networks and Learning Systems 30 (2019), 2611–2624.