Reference : GYM-ANM: Reinforcement learning environments for active network management tasks in e...
Scientific journals : Article
Engineering, computing & technology : Computer science
Engineering, computing & technology : Energy
http://hdl.handle.net/2268/257972
GYM-ANM: Reinforcement learning environments for active network management tasks in electricity distribution systems
English
Henry, Robin [> >]
Ernst, Damien mailto [Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Smart grids >]
Sep-2021
Energy and AI
Elsevier
5
Yes (verified by ORBi)
International
2666-5468
[en] Gym-ANM ; reinforcement learning ; active network management ; distribution networks ; renewable energy
[en] Active network management (ANM) of electricity distribution networks include many complex stochastic sequential optimization problems. These problems need to be solved for integrating renewable energies and distributed storage into future electrical grids. In this work, we introduce Gym-ANM, a framework for designing reinforcement learning (RL) environments that model ANM tasks in electricity distribution networks. These environments provide new playgrounds for RL research in the management of electricity networks that do not require an extensive knowledge of the underlying dynamics of such systems. Along with this work, we are releasing an implementation of an introductory toy-environment, ANM6-Easy, designed to emphasize common challenges in ANM. We also show that state-of-the-art RL algorithms can already achieve good performance on ANM6-Easy when compared against a model predictive control (MPC) approach. Finally, we provide guidelines to create new Gym-ANM environments differing in terms of (a) the distribution network topology and parameters, (b) the observation space, (c) the modelling of the stochastic processes present in the system, and (d) a set of hyperparameters influencing the reward signal. Gym-ANM can be downloaded at https://github.com/robinhenry/gym-anm.
Researchers ; Professionals ; Students
http://hdl.handle.net/2268/257972
https://arxiv.org/abs/2103.07932
https://www.sciencedirect.com/science/article/pii/S266654682100046X
https://doi.org/10.1016/j.egyai.2021.100092

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
henry-ernst-Gym-ANM.pdfPublisher postprint2.82 MBView/Open

Bookmark and Share SFX Query

All documents in ORBi are protected by a user license.