Article for a general audience (Diverse speeches and writings)
Le projet de milliers d’éoliennes au Groenland de l’université de Liège validé scientifiquement
Gochel, Luc; Ernst, Damien 
2022
Article (Scientific journals)
Recurrent networks, hidden states and beliefs in partially observable environments
Lambrechts, Gaspard  ; Bolland, Adrien  ; Ernst, Damien 
2022 • In Transactions on Machine Learning Research
Reinforcement learning aims to learn optimal policies from interaction with environments whose dy...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Warming-up recurrent neural networks to maximize reachable multi-stability greatly improves learning
Lambrechts, Gaspard  ; De Geeter, Florent  ; Vecoven, Nicolas et al.
2022
Training recurrent neural networks is known to be difficult when time dependencies become long. C...
Paper published in a book (Scientific congresses and symposiums)
Optimal Connection Phase Selection of Residential Distributed Energy Resources and its Impact on Aggregated Demand
Benzerga, Amina  ; Bahmanyar, Alireza  ; Ernst, Damien 
2022 • In Proceedings of the 11TH BULK POWER SYSTEMS DYNAMICS AND CONTROL SYMPOSIUM (IREP 2022)
The recent major increase in decentralized energy resources (DERs) such as photovoltaic (PV) pane...
Paper published in a book (Scientific congresses and symposiums)
Optimal connection phase selection for single-phase electrical vehicle chargers
Benzerga, Amina  ; Gérard, Simon; Lachi, Simon et al.
2022 • In Proceedings of the 2022 CIRED workshop on E-mobility and power distribution systems
The recent major increase in decentralized energy resources (DERs) such as photovoltaic (PV) pane...
Paper published in a book (Scientific congresses and symposiums)
Computing Necessary Conditions for Near-Optimality in Capacity Expansion Planning Problems
Dubois, Antoine  ; Ernst, Damien 
2022 • In Electric Power Systems Research
In power systems, large-scale optimisation problems are extensively used to plan for capacity exp...
Speech/Talk (Diverse speeches and writings)
Active Network Management Schemes to Facilitate the Integration of Renewables and New Loads into Distribution Networks
Ernst, Damien 
2022
Speech/Talk (Diverse speeches and writings)
Enseignement et économie : quelques points de réflexion
Ernst, Damien 
2022
Unpublished conference/Abstract (Scientific congresses and symposiums)
Long term wind speed and wind power change analysis over South Greenland using the regional climate model MAR.
Lambin, Clara  ; Fettweis, Xavier  ; Kittel, Christoph  et al.
2022 • EGU 2022
Contribution to collective works (Parts of books)
On the role of resource complementarity in siting renewable power plants and its impact on power system design and economics
Berger, Mathias  ; Radu, David; Ernst, Damien 
2022 • In Jurasz, Jakub; Beluco, Alexandre (Eds.) Complementarity of Variable Renewable Energy Sources
Speech/Talk (Diverse speeches and writings)
Graph-Based Optimization Modeling Language (GBOML)
Miftari, Bardhyl  ; Berger, Mathias  ; Ernst, Damien 
2022
Article (Scientific journals)
GBOML: Graph-Based Optimization Modeling Language
Miftari, Bardhyl  ; Berger, Mathias  ; Djelassi, Hatim et al.
2022 • In Journal of Open Source Software
The Graph-Based Optimization Modeling Language (GBOML) is a modeling language for mathematical pr...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Optimal Control of Renewable Energy Communities with Controllable Assets
Aittahar, Samy  ; Manuel de Villena Millan, Miguel  ; Derval, Guillaume  et al.
2022
The control of Renewable Energy Communities (REC) with controllable assets (e.g batteries) can be...
Article (Scientific journals)
Jointly Learning Environments and Control Policies with Projected Stochastic Gradient Ascent
Bolland, Adrien  ; Boukas, Ioannis  ; Berger, Mathias  et al.
2022 • In Journal of Artificial Intelligence Research, 73, p. 117-171
We consider the joint design and control of discrete-time stochastic dynamical systems over a fin...
Eprint already available on another site (E-prints, working papers and research blog)
Allocation of locally generated electricity in renewable energy communities
De Villena, Miguel Manuel; Aittahar, Samy  ; Mathieu, Sébastien et al.
2022
Local electricity markets represent a way of supplementing traditional retailing contracts for en...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Assessment of future wind speed and wind power changes over South Greenland using the MAR regional climate model
Lambin, Clara  ; Fettweis, Xavier  ; Kittel, Christoph  et al.
2022
Wind is an infinitely renewable energy source that is not evenly distributed in space and time. T...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Churn prediction in online gambling
Merchie, Florian  ; Ernst, Damien 
2022
In business retention, churn prevention has always been a major concern. This work contributes to...
Speech/Talk (Diverse speeches and writings)
REMI - Réseaux Électriques Mondialement Interconnectés
Ernst, Damien 
2021
Cette présentation reprend les résultats principaux du projet REMI qui visait principalement à dé...
Speech/Talk (Diverse speeches and writings)
Elements of concern regarding a total nuclear phase-out in 2025 in Belgium
Ernst, Damien 
2021
Article (Scientific journals)
Extended Equal Area Criterion Revisited: a direct method for fast transient stability analysis
Bahmanyar, Alireza  ; Ernst, Damien  ; Vanaubel, Yves et al.
2021 • In Energies, 14 (21)
For transient stability analysis of a multi-machine power system, the Extended Equal Area Criteri...
Speech/Talk (Diverse speeches and writings)
Reinforcement learning for electrical markets and the energy transition
Ernst, Damien 
2021
Speech/Talk (Diverse speeches and writings)
Competition models for the electrical industry and electrical markets
Ernst, Damien 
2021
Paper published in a book (Scientific congresses and symposiums)
Reconstruction of low-voltage networks with limited observability
Marulli, Daniele; Mathieu, Sébastien; Benzerga, Amina  et al.
2021 • In IEEE PES Innovative Smart Grid Technologies Conference Europe
This work addresses the problem of reconstructing topology and cable parameters of thr...
Communication in media (Diverse speeches and writings)
Un projet d'usine wallonne de kérosène neutre en carbone
Counasse, Xavier; July, Benoît; Gil, Simon et al.
2021
Article (Scientific journals)
GYM-ANM: Reinforcement learning environments for active network management tasks in electricity distribution systems
Henry, Robin; Ernst, Damien 
2021 • In Energy and AI, 5
Active network management (ANM) of electricity distribution networks include many complex stochas...
Paper published in a book (Scientific congresses and symposiums)
Probabilistic capacity assessment for three-phase low-voltage distribution networks
Benzerga, Amina  ; Mathieu, Sébastien  ; Bahmanyar, Alireza  et al.
2021 • In Proceeding of the IEEE 15th International Conference on Compatibility, Power Electronics and Power Engineering (CPE-POWERENG)
The increase of photovoltaic panels and electric vehicles in low-voltage distribution systems lea...
Article (Scientific journals)
Siting Renewable Power Generation Assets with Combinatorial Optimisation
Berger, Mathias  ; Radu, David-Constantin  ; Dubois, Antoine  et al.
2021 • In Optimization Letters
This paper studies the problem of siting renewable power generation assets using large amounts of...
Article (Scientific journals)
A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding
Boukas, Ioannis  ; Ernst, Damien  ; Théate, Thibaut  et al.
2021 • In Machine Learning
The large integration of variable energy resources is expected to shift a large part of the energ...
Article (Scientific journals)
A bio-inspired bistable recurrent cell allows for long-lasting memory
Vecoven, Nicolas  ; Ernst, Damien  ; Drion, Guillaume 
2021 • In PLoS ONE, 16 (6), p. 1-13
Recurrent neural networks (RNNs) provide state-of-the-art performances in a wide variety of tasks...
Paper published in a book (Scientific congresses and symposiums)
Low-voltage network topology and impedance identification using smart meter measurements
Benzerga, Amina  ; Maruli, Daniele; Sutera, Antonio  et al.
2021 • In Proceedings of the 2021 IEEE Madrid PowerTech
Distribution system operators have been upgrading their network over several decades, though not ...
Article (Scientific journals)
Remote Renewable Hubs for Carbon-Neutral Synthetic Fuel Production
Berger, Mathias  ; Radu, David-Constantin  ; Detienne, Ghislain et al.
2021 • In Frontiers in Energy Research
This paper studies the economics of carbon-neutral synthetic fuel production from renewable elect...
Article (Scientific journals)
Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and education
Henry, Robin; Ernst, Damien 
2021 • In Software Impacts, 9
Gym-ANM is a Python package that facilitates the design of reinforcement learning (RL) environmen...
Paper published in a book (Scientific congresses and symposiums)
Model Reduction in Capacity Expansion Planning Problems via Renewable Generation Site Selection
Radu, David-Constantin  ; Dubois, Antoine  ; Berger, Mathias  et al.
2021 • In Proceedings of the 2021 IEEE Madrid PowerTech
The accurate representation of variable renewable generation (RES, e.g., wind, solar PV) assets i...
Paper published in a book (Scientific congresses and symposiums)
Residential Energy Communities: How to minimize the investment risk from an investor perspective
Vangulick, David  ; Manuel de Villena Millan, Miguel  ; Fonteneau, Raphaël  et al.
2021 • In Proceedings of the CIRED 2021 Conference
The success of local renewable energy communities, now foreseen by new the European Union directi...
Article for a general audience (Diverse speeches and writings)
Le rendez-vous manqué de la Wallonie avec les communautés d’énergie renouvelable
Goffin, Philippe; El Mokhtari, Yakhlef; Ernst, Damien 
2021
Eprint first made available on ORBi (E-prints, working papers and research blog)
M4Depth: A motion-based approach for monocular depth estimation on video sequences
Fonder, Michaël  ; Ernst, Damien  ; Van Droogenbroeck, Marc 
2021
Getting the distance to objects is crucial for autonomous vehicles. In instances where depth sens...
Paper published in a book (Scientific congresses and symposiums)
Sparse Training Theory for Scalable and Efficient Agents
Mocanu, Decebal Constantin; Mocanu, Elena; Pinto, Tiago et al.
2021 • In Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems - Blue Sky Ideas Track
A fundamental task for artificial intelligence is learning. Deep Neural Networks have proven to c...
Speech/Talk (Diverse speeches and writings)
Algorithms for the control and sizing of renewable energy communities
Manuel de Villena Millan, Miguel  ; Aittahar, Samy  ; Gemine, Quentin  et al.
2021
Speech/Talk (Diverse speeches and writings)
Communauté d’Energie Renouvelable (CER): un bref regard sur l’état d’avancement de la législation
Ernst, Damien 
2021
Speech/Talk (Diverse speeches and writings)
Harvesting wind energy in Greenland: a huge step towards the building a global electrical grid
Ernst, Damien 
2021
Article (Scientific journals)
Modelling and Assessing the Impact of the DSO Remuneration Strategy on its Interaction with Electricity Users
Manuel de Villena Millan, Miguel  ; Gautier, Axel  ; Ernst, Damien  et al.
2021 • In International Journal of Electrical Power and Energy Systems, 126 (Part A), p. 106585
This paper presents a simulation-based methodology for assessing the impact of employing differen...
Paper published in a book (Scientific congresses and symposiums)
QVMix and QVMix-Max: Extending the Deep Quality-Value Family of Algorithms to Cooperative Multi-Agent Reinforcement Learning
Leroy, Pascal  ; Ernst, Damien  ; Geurts, Pierre  et al.
2021 • In Proceedings of the AAAI-21 Workshop on Reinforcement Learning in Games
This paper introduces four new algorithms that can be used for tackling multi-agent reinforcement...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Graph-Based Optimization Modeling Language: A Tutorial
Berger, Mathias  ; Bolland, Adrien  ; Miftari, Bardhyl  et al.
2021
This paper introduces the graph-based optimization modeling language (GBOML), which enables the e...
Article (Scientific journals)
Network tariffs and the integration of prosumers: the Case of Wallonia
Manuel de Villena Millan, Miguel  ; Jacqmin, Julien; Fonteneau, Raphaël  et al.
2021 • In Energy Policy, 150
In Wallonia, Belgium's southern region, the distribution component of the overall electricity ret...
Article (Scientific journals)
Assessing the Impact of Offshore Wind Siting Strategies on the Design of the European Power System
Radu, David-Constantin  ; Berger, Mathias  ; Dubois, Antoine  et al.
2021 • In Applied Energy, 305
This paper provides a detailed account of the impact of different offshore wind siting strategies...
Article (Scientific journals)
An Application of Deep Reinforcement Learning to Algorithmic Trading
Théate, Thibaut  ; Ernst, Damien 
2021 • In Expert Systems with Applications, 173
This scientific research paper presents an innovative approach based on deep reinforcement learni...
Eprint already available on another site (E-prints, working papers and research blog)
Distributional Reinforcement Learning with Unconstrained Monotonic Neural Networks
Théate, Thibaut  ; Wehenkel, Antoine  ; Bolland, Adrien  et al.
2021
The distributional reinforcement learning (RL) approach advocates for representing the complete p...
Article (Scientific journals)
An Artificial Intelligence Solution for Electricity Procurement in Forward Markets
Théate, Thibaut  ; Mathieu, Sébastien  ; Ernst, Damien 
2020 • In Energies, 13 (23)
Retailers and major consumers of electricity generally purchase an important percentage of their ...
Speech/Talk (Diverse speeches and writings)
AI for energy: a bright and uncertain future ahead
Ernst, Damien 
2020
Speech/Talk (Diverse speeches and writings)
Extreme engineering for fighting climate change and the Katabata project
Ernst, Damien  ; Fettweis, Xavier  ; Fonder, Michaël  et al.
2020
Article (Scientific journals)
The impact of different COVID-19 containment measures on electricity consumption in Europe
Bahmanyar, Alizera; Abouzar, Estebsari; Ernst, Damien 
2020 • In Energy Research and Social Science, 68
As of March 13, 2020, the director general of the World Health Organization (WHO) considered Euro...
Speech/Talk (Diverse speeches and writings)
Projet MeryGrid. Contrôle centralisé de communautés à énergies renouvelables avec batterie (CER)
Ernst, Damien 
2020
Article for a general audience (Diverse speeches and writings)
Les e-fuels, des carburants dans le vent
Theunis, Laetitia; Ernst, Damien 
2020
Speech/Talk (Diverse speeches and writings)
Ex-post allocation of electricity and real-time control strategy for renewable energy communities
Aittahar, Samy  ; Manuel de Villena Millan, Miguel  ; Ernst, Damien  et al.
2020
A presentation that describes recent algorithmic developments for operating a renewable energy co...
Paper published in a book (Scientific congresses and symposiums)
A Framework to Integrate Flexibility Bids into Energy Communities to Improve Self-Consumption
Manuel de Villena Millan, Miguel  ; Boukas, Ioannis  ; Mathieu, Sébastien  et al.
2020 • In 2020 IEEE PES General Meeting
Hastened by the emergence of new technologies, a revolution of the electricity retailing business...
Paper published in a book (Scientific congresses and symposiums)
Short-term active distribution network operation under uncertainty
Mathieu, Sébastien  ; Ernst, Damien  ; Gemine, Quentin 
2020 • In Proceeedings of the16th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS 2020)
Electrical distribution systems need to integrate more and more renewable energy generation in th...
Expert report (Reports)
The Role of Hydrogen in the Dutch Electricity System
Berger, Mathias  ; Radu, David-Constantin  ; Ryszka, Karolina et al.
2020
This technical report investigates the role power-to-gas, hydrogen and battery storage technologi...
Article for a general audience (Diverse speeches and writings)
Comment le système politique chinois a favorisé la pandémie
De Salle, Corentin; Ernst, Damien 
2020
Article (Scientific journals)
The Role of Power-to-Gas and Carbon Capture Technologies in Cross-Sector Decarbonisation Strategies
Berger, Mathias  ; Radu, David-Constantin  ; Fonteneau, Raphaël  et al.
2020 • In Electric Power Systems Research, 180
This paper proposes an optimisation-based framework to tackle long-term centralised planning prob...
Article for a general audience (Diverse speeches and writings)
La transition énergétique peut réunir tous les Belges
Ernst, Damien 
2020
Article (Scientific journals)
Critical Time Windows for Renewable Resource Complementarity Assessment
Berger, Mathias  ; Radu, David-Constantin  ; Fonteneau, Raphaël  et al.
2020 • In Energy, 198
This paper proposes a framework to assess the complementarity between geographically dispersed va...
Contribution to collective works (Parts of books)
Solving Optimal Control Problems for Monotone Systems Using the Koopman Operator
Sootla, Aivar; Stan, Guy-Bart; Ernst, Damien 
2020 • In Mauroy, Alexandre; Mezic, Igor; Susuki, Yoshihiko (Eds.) The Koopman Operator in Systems and Control
Koopman operator theory offers numerous techniques for analysis and control of complex systems. I...
Article (Scientific journals)
Introducing neuromodulation in deep neural networks to learn adaptive behaviours
Vecoven, Nicolas  ; Ernst, Damien  ; Wehenkel, Antoine  et al.
2020 • In PLoS ONE
Animals excel at adapting their intentions, attention, and actions to the environment, making the...
Article for a general audience (Diverse speeches and writings)
Les voitures électriques bientôt majoritaires
Lahaye, Christian; Ernst, Damien 
2020
Paper published in a journal (Scientific congresses and symposiums)
Empirical Analysis of Policy Gradient Algorithms where Starting States are Sampled accordingly to Most Frequently Visited States
Aittahar, Samy  ; Fonteneau, Raphaël  ; Ernst, Damien 
2020 • In IFAC-PapersOnLine, 53 (2), p. 8097–8104
In this paper, we propose an extension to the policy gradient algorithms by allowing starting sta...
Speech/Talk (Diverse speeches and writings)
Big infrastructures for fighting climate change
Ernst, Damien 
2020
Speech/Talk (Diverse speeches and writings)
The Smart Grids lab at the University of Liège
Ernst, Damien  ; Fonteneau, Raphaël 
2020
Paper published in a book (Scientific congresses and symposiums)
Cellular neuromodulation in artificial networks
Vecoven, Nicolas  ; Ernst, Damien  ; Wehenkel, Antoine  et al.
2019 • In Proceedings of the NeurIPS 2019 Workshop Neuro AI
Animals excel at adapting their intentions, attention, and actions to the environment, making the...
Speech/Talk (Diverse speeches and writings)
Nuclear: the dreaming reality
Ernst, Damien 
2019
Expert report (Reports)
Global electricity network - Feasibility study
Yu, J.; Bakic, K.; Kumar, A. et al.
2019
With the strong development of renewable energy sources worldwide, the concept of a global electr...
Article for a general audience (Diverse speeches and writings)
Greta Thunberg ou l'inacessible sainteté climatique
de Salle, Corentin; Ernst, Damien 
2019
Speech/Talk (Diverse speeches and writings)
Round Table No 3. Industrial Solutions for Active Network Management
Ernst, Damien 
2019
Paper published in a book (Scientific congresses and symposiums)
Harnessing the flexibility of energy management systems: a retailer perspective
Mathieu, Sébastien  ; Manuel de Villena Millan, Miguel  ; Vermeulen, Eric et al.
2019 • In Proceedings PowerTech 2019
The business of electricity retailing is changing following the current evolution of the electric...
Article (Scientific journals)
Complementarity Assessment of South Greenland Katabatic Flows and West Europe Wind Regimes
Radu, David-Constantin  ; Berger, Mathias  ; Fonteneau, Raphaël  et al.
2019 • In Energy, 175, p. 393-401
Current global environmental challenges require vigorous and diverse actions in the energy sector...
Conference given outside the academic context (Diverse speeches and writings)
Eléments pour une vision techno-optimiste de l’écologie
Ernst, Damien 
2019
Article for a general audience (Diverse speeches and writings)
Sortir du pessimisme écologique. Réponse aux 400 ingénieurs
de Salle, Corentin; Ernst, Damien 
2019
Article (Scientific journals)
On overfitting and asymptotic bias in batch reinforcement learning with partial observability
François-Lavet, Vincent; Rabusseau, Guillaume; Pineau, Joëlle et al.
2019 • In Journal of Artificial Intelligence Research, 65, p. 1-30
This paper provides an analysis of the tradeoff between asymptotic bias (suboptimality with unlim...
Article for a general audience (Diverse speeches and writings)
L’écologie authentique, stade avancé de la civilisation technologique
de Salle, Corentin; Ernst, Damien 
2019
Article for a general audience (Diverse speeches and writings)
Damien Ernst: "La technologie sauvera la planète"
Wolff, Geoffrey; Ernst, Damien 
2019
Eprint first made available on ORBi (E-prints, working papers and research blog)
Authentic ecology as an advanced stage of technological civilization
de Salle, Corentin; Ernst, Damien 
2019
Paper published in a book (Scientific congresses and symposiums)
Blockchain: A novel approach for the consensus algorithm using Condorcet Voting procedure
Vangulick, David  ; Cornélusse, Bertrand  ; Ernst, Damien 
2019 • In Proceedings of the IEEE International Conference on Decentralized Applications and Infrastructures
The blockchain technology allows interested parties to access a common register, the update, and ...
Speech/Talk (Diverse speeches and writings)
Harvesting wind energy in Greenland: a project for Europe and a huge step towards the building a global electrical grid
Ernst, Damien 
2019
Speech/Talk (Diverse speeches and writings)
Décret favorisant le développement des communautés d’énergie renouvelable
Ernst, Damien 
2019
Eprint first made available on ORBi (E-prints, working papers and research blog)
Electric car: 697,612 km to become green! True or false?
Ernst, Damien 
2019
Eprint first made available on ORBi (E-prints, working papers and research blog)
Voiture électrique : 697.612 km pour devenir verte ! Vrai ou faux ?
Ernst, Damien 
2019
Speech/Talk (Diverse speeches and writings)
Harnessing the Potential of Power-to-Gas Technologies. Insights from a preliminary analysis focused on Belgium
Ernst, Damien  ; Berger, Mathias  ; Fonteneau, Raphaël  et al.
2019
Article for a general audience (Diverse speeches and writings)
Un réseau électrique mondial et basé sur les renouvelables, ce n’est plus de la science-fiction
Ernst, Damien  ; Fonteneau, Raphaël 
2019
Speech/Talk (Diverse speeches and writings)
Tariff simulator
Manuel de Villena Millan, Miguel  ; Fonteneau, Raphaël  ; Ernst, Damien 
2019
Article (Scientific journals)
Evaluating the Evolution of Distribution Networks under Different Regulatory Frameworks with Multi-Agent Modelling
Manuel de Villena Millan, Miguel  ; Fonteneau, Raphaël  ; Gautier, Axel  et al.
2019 • In Energies, 12 (7), p. 1-15
In the context of increasing decentralised electricity generation, this paper evaluates the effec...
Article for a general audience (Diverse speeches and writings)
Energiespecialist Damien Ernst: 'We hoeven helemaal niet minder energie te verbruiken'
Renard, Han; Ernst, Damien 
2019
Article (Scientific journals)
Impact of gate closure time on the efficiency of power systems balancing
Petitet, Marie; Perrot, Marie; Mathieu, Sébastien  et al.
2019 • In Energy Policy, 129, p. 562-573
This paper focuses on market design options for operational balancing management in self-dispatch...
Article for a general audience (Diverse speeches and writings)
Governments at COP24 should focus on building a global electricity grid – Prof. Damien Ernst
Gillman, Steve; Ernst, Damien 
2018
Speech/Talk (Diverse speeches and writings)
Soirée des Grands Prix SEE - A glimpse at the research work of the laureate of the Blondel Medal 2018 - Prof. Damien ERNST
Ernst, Damien 
2018
Paper published in a book (Scientific congresses and symposiums)
Centralised Planning of National Integrated Energy System with Power-to-Gas and Gas Storages
Berger, Mathias  ; Radu, David-Constantin  ; Fonteneau, Raphaël  et al.
2018 • In Proceedings of the 11th Mediterranean Conference on Power Generation, Transmission, Distribution and Energy Conversion (Medpower2018)
This paper proposes an optimisation-based framework to tackle long-term centralised planning prob...
Speech/Talk (Diverse speeches and writings)
Reinforcement learning, energy systems and deep neural nets
Ernst, Damien 
2018
Article (Scientific journals)
Fostering Share&Charge through proper regulation
Vanrykel, Fanny  ; Ernst, Damien  ; Bourgeois, Marc 
2018 • In Competition and Regulation in Network Industries
This article studies the emergence of Share&Charge, a German platform that organizes the sharing ...
Eprint already available on another site (E-prints, working papers and research blog)
On the efficiency of decentralized decision-making in self-dispatch power systems
Petitet, Marie; Perrot, Marie; Mathieu, Sébastien  et al.
2018
This paper focuses on market design options for operational balancing management in self-dispatch...
Article (Scientific journals)
Regulatory Challenges for Share&Charge Models
Vanrykel, Fanny  ; Ernst, Damien  ; Bourgeois, Marc 
2018 • In Network Industries Quarterly, 20 (3), p. 17-21
The platform Share&Charge provides an innovative solution to the lack of electric vehicles chargi...
Article for a general audience (Diverse speeches and writings)
Le projet énergétique à 100 milliards de Damien Ernst
Scharff, Christine; Ernst, Damien 
2018
Paper published in a book (Scientific congresses and symposiums)
Distributed Control of Photovoltaic Units in unbalanced LV Distribution Networks to Prevent Overvoltages
Olivier, Frédéric  ; Fonteneau, Raphaël  ; Mathieu, Sébastien  et al.
2018 • In Proc. of the 6th IEEE International Conference on Smart Energy Grid Engineering (SEGE 2018)
As more and more photovoltaic units are being installed, some LV networks have already attained t...
Unpublished conference/Abstract (Scientific congresses and symposiums)
Fostering Share&Charge through Proper Regulation
Vanrykel, Fanny  ; Ernst, Damien  ; Bourgeois, Marc 
2018 • 7th Conference on the Regulation of Infrastructures
Speech/Talk (Diverse speeches and writings)
Electricity retailing in Europe: remarkable events (with a special focus on Belgium)
Ernst, Damien 
2018
Paper published in a book (Scientific congresses and symposiums)
Blockchain for peer-to-peer energy exchanges: design and recommendations (additional work)
Vangulick, David  ; Cornélusse, Bertrand  ; Ernst, Damien 
2018 • In CIRED Workshop 2018 Ljubljana, Slovania
Energy communities and peer-to-peer energy exchanges are expected to play an important role in th...
Paper published in a book (Scientific congresses and symposiums)
Blockchain for peer-to-peer energy exchanges: Probabilistic approach of Proof of Stake
Vangulick, David  ; Cornélusse, Bertrand  ; Ernst, Damien 
2018 • In CIRED WORKSHOP 2018
Energy communities and peer-to-peer energy exchanges are expected to play an important role in th...
Paper published in a book (Scientific congresses and symposiums)
Real-Time Bidding Strategies from Micro-Grids Using Reinforcement Learning
Boukas, Ioannis  ; Ernst, Damien  ; Cornélusse, Bertrand 
2018 • In Proceedings of CIRED Workshop 2018
We address the problem faced by the operator of a microgrid participating in a continuous real-ti...
Paper published in a book (Scientific congresses and symposiums)
Intra-day Bidding Strategies for Storage Devices Using Deep Reinforcement Learning
Boukas, Ioannis  ; Ernst, Damien  ; Papavasiliou, Anthony et al.
2018 • In International Conference on the European Energy Market, Łódź 27-29 June 2018
The problem faced by the operator of a storage device participating in a continuous intra-day (CI...
Paper published in a book (Scientific congresses and symposiums)
Optimal operation and fair profit allocation in community microgrids
Cornélusse, Bertrand  ; Ernst, Damien  ; Lachi, Simon
2018 • In Proceedings of CIRED Workshop 2018
This work fits in the context of community migrogrids, where entities of a community can exchange...
Paper published in a book (Scientific congresses and symposiums)
A multi-agent system approach to model the interaction between distributed generation deployment and the grid
Manuel de Villena Millan, Miguel  ; Gautier, Axel  ; Fonteneau, Raphaël  et al.
2018 • In Proc. of CIRED Workshop 2018
This paper introduces a multi-agent dynamical system of the interaction between electricity consu...
Paper published in a book (Scientific congresses and symposiums)
Modelling of three-phase four-wire low-voltage cables taking into account the neutral connection to the earth
Olivier, Frédéric  ; Fonteneau, Raphaël  ; Ernst, Damien 
2018 • In Proc. of CIRED Workshop 2018
Local energy communities (LECs) usually occur at the level of low-voltage distribution networks, ...
Paper published in a book (Scientific congresses and symposiums)
Phase Identification of Smart Meters by Clustering Voltage Measurements
Olivier, Frédéric  ; Sutera, Antonio  ; Geurts, Pierre  et al.
2018 • In Proceedings of the XX Power Systems Computation Conference (PSCC 2018)
When a smart meter, be it single-phase or threephase, is connected to a three-phase network, the ...
Paper published in a book (Scientific congresses and symposiums)
Blockchain for peer-to-peer energy exchanges: design and recommendations
Vangulick, David  ; Cornélusse, Bertrand  ; Ernst, Damien 
2018 • In Proceedings of the XX Power Systems Computation Conference (PSCC2018)
Energy communities and peer-to-peer energy exchanges are expected to play an important role in th...
Speech/Talk (Diverse speeches and writings)
Reinforcement learning: a generic tool for solving  sequential decision-making problems for electrical systems
Ernst, Damien 
2018
Article (Scientific journals)
Design and real-time test of a hybrid energy storage system in the microgrid with the benefit of improving the battery lifetime
Li, Jianwei  ; Xiong, Riu; Mu, Hao et al.
2018 • In Applied Energy, 218, p. 470-478
This study proposes a hybrid energy storage system (HESS) composed of the superconducting energy ...
Paper published in a book (Scientific congresses and symposiums)
Exploring Regulation Policies in Distribution Networks through a Multi-Agent Simulator
Manuel de Villena Millan, Miguel  ; Fonteneau, Raphaël  ; Gautier, Axel  et al.
2018 • In Proceedings of YRS2018
This paper presents a multi-agent simulator that describes the interactions between the agents of...
Article (Scientific journals)
An Optimal Control Formulation of Pulse-Based Control Using Koopman Operator
Sootla, Aivar; Mauroy, Alexandre; Ernst, Damien 
2018 • In Automatica, 91, p. 217-224
In many applications, and in systems/synthetic biology in particular, it is desirable to compute ...
Speech/Talk (Diverse speeches and writings)
Projet de décret « GRD »: quelques remarques du Prof. Damien ERNST
Ernst, Damien 
2018
Article (Scientific journals)
Pulse-Based Control Using Koopman Operator Under Parametric Uncertainty
Sootla, Aivar; Ernst, Damien 
2018 • In IEEE Transactions on Automatic Control, 63 (3), p. 791-796
In applications, such as biomedicine and systems/synthetic biology, technical limitations in actu...
Paper published in a book (Scientific congresses and symposiums)
Effect of Voltage Constraints on the Exchange of Flexibility Services in Distribution Networks
Mathieu, Sébastien  ; Olivier, Frédéric  ; Ernst, Damien  et al.
2018 • In Proceedings of the 9th Conference on Innovative Smart Grid Technology North America (ISGT 2018)
Many possibilities exist to organise exchanges of flexibility within a distribution system. In th...
Speech/Talk (Diverse speeches and writings)
Time to make a choice between a fully liberal or fully regulated model for the electrical industry
Ernst, Damien 
2017
Speech/Talk (Diverse speeches and writings)
Electrification and DRC
Ernst, Damien 
2017
Speech/Talk (Diverse speeches and writings)
Aire autoroutière de Hondelange: combiner le développement durable et l’opportunité économique
Ernst, Damien 
2017
Eprint already available on another site (E-prints, working papers and research blog)
SiSTEM, a Model for the Simulation of Short-Term Electricity Markets
Mathieu, Sébastien  ; Petitet, Marie; Perrot, Marie et al.
2017
The aim of this document is to present SiSTEM, a multi-level simulation model of European short-t...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Simulation-based Assessment of the Impact of Regulatory Frameworks on the Interactions between Electricity Users and Distribution System Operator
Manuel de Villena Millan, Miguel  ; Gautier, Axel  ; Fonteneau, Raphaël  et al.
2017
Paper published in a book (Scientific congresses and symposiums)
Foreseeing New Control Challenges in Electricity Prosumer Communities
Olivier, Frédéric  ; Marulli, Daniele; Ernst, Damien  et al.
2017 • In Proc. of the 10th Bulk Power Systems Dynamics and Control Symposium – IREP’2017
This paper is dedicated to electricity prosumer communities, which are groups of people producing...
Paper published in a book (Scientific congresses and symposiums)
Reinforcement Learning for Electric Power System Decision and Control: Past Considerations and Perspectives
Glavic, Mevludin  ; Fonteneau, Raphaël  ; Ernst, Damien 
2017 • In The 20th World Congress of the International Federation of Automatic Control, Toulouse 9-14 July 2017
In this paper, we review past (including very recent) research considerations in using reinforcem...
Contribution to collective works (Parts of books)
The state of play in cross-border electricity trade and the challenges towards a global electricity market environment
Chatzivasileiadis, Spyros; Ernst, Damien 
2017 • In Cottier, Thomas; Ilaria, Espa (Eds.) International trade in sustainable electricity
Paper published in a book (Scientific congresses and symposiums)
Efficient management of a connected microgrid in Belgium
Cornélusse, Bertrand  ; Ernst, Damien  ; Warichet, Luc et al.
2017 • In Proceedings of the 24th International Conference on Electricity Distribution, Glasgow, 12-15 June 2017
Paper published in a book (Scientific congresses and symposiums)
Automatic phase identification of smart meter measurement data
Olivier, Frédéric  ; Ernst, Damien  ; Fonteneau, Raphaël 
2017 • In Proceedings of the 24th International Conference and Exhibition on Electricity Distribution, CIRED 2017
This paper highlights the importance of the knowledge of the phase identification for the differe...
Contribution to collective works (Parts of books)
Simple connectome inference from partial correlation statistics in calcium imaging
Sutera, Antonio  ; Joly, Arnaud  ; François-Lavet, Vincent et al.
2017 • In Soriano, Jordi; Battaglia, Demian; Guyon, Isabelle et al. (Eds.) Neural Connectomics Challenge
In this work, we propose a simple yet effective solution to the problem of connectome inference i...
Paper published in a book (Scientific congresses and symposiums)
E-CLOUD, the open microgrid in existing network infrastructure
Vangulick, David  ; Cornélusse, Bertrand  ; Vanherck, Thierry et al.
2017 • In Proceedings of the 24th International Conference on Electricity Distribution
The main goal of the E-Cloud, as with every microgrid, is to maximize the consumption of energy p...
Paper published in a book (Scientific congresses and symposiums)
Resilience of the DSO network near to 50.2Hz
Vangulick, David  ; Ernst, Damien  ; Van Cutsem, Thierry 
2017 • In Proceedings of the 24th International Conference on Electricity Distribution
In an electrical system where decentralized and embedded productions are becoming more and more i...
Speech/Talk (Diverse speeches and writings)
Energy: the clash of nations
Ernst, Damien 
2017
Le monde de l'énergie est en guerre. C'est une guerre qui est menée sur de nombreux fronts, du Te...
Article for a general audience (Diverse speeches and writings)
Questions d'argent - Damien Ernst
Sury, Caroline; Ernst, Damien 
2017
Paper published in a book (Scientific congresses and symposiums)
Approximate Bayes Optimal Policy Search using Neural Networks
Castronovo, Michaël  ; François-Lavet, Vincent  ; Fonteneau, Raphaël  et al.
2017 • In Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017)
Bayesian Reinforcement Learning (BRL) agents aim to maximise the expected collected rewards obtai...
Paper published in a book (Scientific congresses and symposiums)
An App-based Algorithmic Approach for Harvesting Local and Renewable Energy Using Electric Vehicles
Dubois, Antoine  ; Wehenkel, Antoine  ; Fonteneau, Raphaël  et al.
2017 • In Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017)
The emergence of electric vehicles (EVs), combined with the rise of renewable energy production c...
Article (Scientific journals)
Residential heat pump as flexible load for direct control service with parametrized duration and rebound effect
Georges, Emeline  ; Cornélusse, Bertrand  ; Ernst, Damien  et al.
2017 • In Applied Energy, 187, p. 140-153
This paper addresses the problem of an aggregator controlling residential heat pumps to offer a d...
Speech/Talk (Diverse speeches and writings)
Uber-like Models for the Electrical Industry
Ernst, Damien 
2017
Article for a general audience (Diverse speeches and writings)
Les batteries vont bouleverser notre quotidien
Scharff, Christine; Ernst, Damien 
2017
Contribution to collective works (Parts of books)
Global Power Grids for Harnessing World Renewable Energy
Chatzivasileiadis, Spyros; Ernst, Damien  ; Andersson, Goran
2017 • In Jones, Lawrence (Ed.) Renewable Energy Integration
The Global Grid advocates the connection of all regional power systems into one electricity trans...
External report (Reports)
GREDOR. Outcomes and recommendations
Cornélusse, Bertrand  ; Ernst, Damien 
2017
Article (Scientific journals)
A biased random key genetic algorithm applied to the electric distribution network reconfiguration problem
de Faria Jr., Haroldo; Resende, Mauricio; Ernst, Damien 
2017 • In Journal of Heuristics
This work presents a biased random-key genetic algorithm (BRKGA) to solve the electric distributi...
Contribution to collective works (Parts of books)
On the Dynamics of the Deployment of Renewable Energy Production Capacities
Fonteneau, Raphaël  ; Ernst, Damien 
2017 • In Furze, James N.; Swing, Kelly; Gupta, Anil K. et al. (Eds.) Mathematical Advances Towards Sustainable Environmental Systems
This chapter falls within the context of modeling the deployment of renewable en-ergy production ...
Article (Scientific journals)
A SC/battery Hybrid Energy Storage System in the Microgrid
Li, Jianwei  ; Cornélusse, Bertrand  ; Vanderbemden, Philippe  et al.
2017 • In Energy Procedia, 142, p. 3697–3702
The major challenges in power systems are driven by the energy shortage and environmental concern...
Paper published in a book (Scientific congresses and symposiums)
Agent-based analysis of dynamic access ranges to the distribution network
Mathieu, Sébastien  ; Ernst, Damien  ; Cornélusse, Bertrand 
2017 • In Proceedings of the 6th European Innovative Smart Grid Technologies (ISGT)
There is a need to clearly state an interaction model that formalizes interactions between actors...
Unpublished conference/Abstract (Scientific congresses and symposiums)
ETAT DU TERRITOIRE WALLON - PARTIE 2 : DYNAMIQUES SECTORIELLES TERRITORIALISÉES
Godart, Marie-Françoise; Lambotte, Jean-Marc  ; Bianchet, Bruno  et al.
2016 • Colloque 2016 de la CODT : Territoire(s) wallon(s) : tendances et perspectives
Ce support PPT est basé sur les travaux menés sur le volet Analyses sectorielles de l'Etat du ter...
Paper published in a book (Scientific congresses and symposiums)
Deep Reinforcement Learning Solutions for Energy Microgrids Management
François-Lavet, Vincent  ; Taralla, David; Ernst, Damien  et al.
2016 • In European Workshop on Reinforcement Learning (EWRL 2016)
This paper addresses the problem of efficiently operating the storage devices in an electricity m...
External report (Reports)
Contribution au rapport final - Subvention 2015-2016 - Actualisation du diagnostic du Schéma de Développement Territorial wallon - Secteur Production, Transport et Stockage de l'Energie
Maldague, Hubert  ; Teller, Jacques  ; Ernst, Damien 
2016
Speech/Talk (Diverse speeches and writings)
The Green Grid Network and Trading Renewable Energy
Ernst, Damien 
2016
Speech/Talk (Diverse speeches and writings)
Analyse du projet de décret relatif à la méthodologie tarifaire applicable aux gestionnaires de réseaux de distribution de gaz et d’électricité
Ernst, Damien 
2016
Speech/Talk (Diverse speeches and writings)
Batteries and disrupting business models for the energy sector
Ernst, Damien  ; Goka, Olivier
2016
Speech/Talk (Diverse speeches and writings)
La transition énergétique, l’affaire de tous
Ernst, Damien 
2016
Conférence d'ouverture donnée par le Prof . Ernst lors de la soirée de lancement de la saison 201...
Article (Scientific journals)
Active network management for electrical distribution systems: problem formulation, benchmark, and approximate solution
Gemine, Quentin  ; Ernst, Damien  ; Cornélusse, Bertrand 
2016 • In Optimization and Engineering, 18 (3), p. 587-629
With the increasing share of renewable and distributed generation in electrical distribution syst...
Unpublished conference/Abstract (Scientific congresses and symposiums)
Policy transfer using Value Function as Prior Information
Aittahar, Samy  ; Sootla, Aivar; Ernst, Damien 
2016 • Phd Forum
This work proposes an approach based on reward shaping techniques in a reinforcement learning set...
Article for a general audience (Diverse speeches and writings)
Ces robots qui pourraient nous vouloir du mal...
Bouffioux, Michel; Ernst, Damien 
2016
Article (Scientific journals)
Benchmarking for Bayesian Reinforcement Learning
Castronovo, Michaël  ; Ernst, Damien  ; Couëtoux, Adrien  et al.
2016 • In PLoS ONE
In the Bayesian Reinforcement Learning (BRL) setting, agents try to maximise the col- lected rewa...
Speech/Talk (Diverse speeches and writings)
Capacity mechanisms for improving security of supply: quick fixes or thoughtfully rethinking the way electricity is traded?
Ernst, Damien 
2016
Speech/Talk (Diverse speeches and writings)
Integration of renewable energy sources and demand-side management into distribution networks
Ernst, Damien 
2016
Paper published in a book (Scientific congresses and symposiums)
A Gaussian mixture approach to model stochastic processes in power systems
Gemine, Quentin  ; Cornélusse, Bertrand  ; Glavic, Mevludin  et al.
2016 • In Proceedings of the 19th Power Systems Computation Conference (PSCC'16)
Probabilistic methods are emerging for operating electrical networks, driven by the integration o...
Paper published in a book (Scientific congresses and symposiums)
Direct control service from residential heat pump aggregation with specified payback
Georges, Emeline  ; Cornélusse, Bertrand  ; Ernst, Damien  et al.
2016 • In Proceedings of the 19th Power Systems Computation Conference (PSCC)
This paper addresses the problem of an aggregator controlling residential heat pumps to offer a d...
Paper published in a book (Scientific congresses and symposiums)
Further validation and extensions of the Global Capacity ANnouncement procedure for distribution systems
Cornélusse, Bertrand  ; Vangulick, David; Glavic, Mevludin  et al.
2016 • In CIRED Workshop Proceedings, Helsinki 14-15 June 2016
This paper extends the Global Capacity ANnouncement procedure proposed in [5] along two direction...
Speech/Talk (Diverse speeches and writings)
Smart Grids versus Microgrids
Ernst, Damien 
2016
Speech/Talk (Diverse speeches and writings)
The Rise of Artificial Intelligence
Ernst, Damien 
2016
Paper published in a book (Scientific congresses and symposiums)
Modelling and Emulation of an Unbalanced LV Feeder with Photovoltaic Inverters
López-Erauskin, Ramón; Gyselinck, Johan; Olivier, Frédéric  et al.
2016 • In Proc. of 8th IEEE Benelux Young researchers symposium in Electrical Power Engineering
In this paper, the penetration of grid-connected pho- tovoltaic systems is studied, experimentall...
Speech/Talk (Diverse speeches and writings)
COP21 and Electrical Systems
Ernst, Damien 
2016
Contribution to collective works (Parts of books)
Towards the Minimization of the Levelized Energy Costs of Microgrids using both Long-term and Short-term Storage Devices
François-Lavet, Vincent  ; Gemine, Quentin  ; Ernst, Damien  et al.
2016 • In Smart Grid: Networking, Data Management, and Business Models
This chapter falls within the context of the optimization of the levelized energy cost (LEC) of m...
Speech/Talk (Diverse speeches and writings)
TPCV versus gouvernement(s) et gestionnaires de réseaux: décodage
Ernst, Damien 
2016
Article (Scientific journals)
Active Management of Low-Voltage Networks for Mitigating Overvoltages due to Photovoltaic Units
Olivier, Frédéric  ; Aristidou, Petros  ; Ernst, Damien  et al.
2016 • In IEEE Transactions on Smart Grid, 2 (7), p. 926-936
In this paper, the overvoltage problems that might arise from the integration of photovoltaic pan...
Article for a general audience (Diverse speeches and writings)
Mer ou RER : faut-il vraiment 10 milliards d'argent public pour l'éolien offshore ?
Ernst, Damien  ; Hermans, Michel 
2016
Paper published in a book (Scientific congresses and symposiums)
Decision Making from Confidence Measurement on the Reward Growth using Supervised Learning: A Study Intended for Large-Scale Video Games
Taralla, David  ; Qiu, Zixiao  ; Sutera, Antonio  et al.
2016 • In Proceedings of the 8th International Conference on Agents and Artificial Intelligence (ICAART 2016) - Volume 2
Video games have become more and more complex over the past decades. Today, players wander in vis...
Unpublished conference/Abstract (Scientific congresses and symposiums)
Residential heat pumps as flexible loads for direct control service with constrained payback
Georges, Emeline  ; Cornélusse, Bertrand  ; Ernst, Damien  et al.
2016 • First Seminar on Demand Response
This paper addresses the problem of an aggregator controlling residential heat pumps to offe...
Article for a general audience (Diverse speeches and writings)
Israël, vainqueur involontaire des guerres islamistes
Ernst, Damien  ; Hermans, Michel 
2016
Article (Scientific journals)
DSIMA: A testbed for the quantitative analysis of interaction models within distribution networks
Mathieu, Sébastien  ; Louveaux, Quentin  ; Ernst, Damien  et al.
2016 • In Sustainable Energy, Grids and Networks, 5, p. 78 - 93
This article proposes an open-source testbed to simulate interaction models governing the exchang...
Paper published in a book (Scientific congresses and symposiums)
Imitative Learning for Online Planning in Microgrids
Aittahar, Samy  ; François-Lavet, Vincent  ; Lodeweyckx, Stefan et al.
2015 • In Woon, Wei Lee; Zeyar, Aung; Stuart, Madnick (Eds.) Data Analytics for Renewable Energy Integration
This paper aims to design an algorithm dedicated to operational planning for microgrids in the ch...
Paper published in a book (Scientific congresses and symposiums)
How to Discount Deep Reinforcement Learning: Towards New Dynamic Strategies
François-Lavet, Vincent  ; Fonteneau, Raphaël  ; Ernst, Damien 
2015 • In NIPS 2015 Workshop on Deep Reinforcement Learning
Using deep neural nets as function approximator for reinforcement learning tasks have recently be...
Speech/Talk (Diverse speeches and writings)
The GREDOR project. Redesigning the decision chain for managing distribution networks
Ernst, Damien 
2015
Speech/Talk (Diverse speeches and writings)
Global Grid(s) versus Microgrids
Ernst, Damien 
2015
Article for a general audience (Diverse speeches and writings)
La Russie, ce dangereux ami pour lutter contre le djihadisme wahhabiste
Ernst, Damien  ; Hermans, Michel 
2015
Speech/Talk (Diverse speeches and writings)
Smart meter: cette brique de base de notre (futur) système énergétique
Ernst, Damien 
2015
Article (Scientific journals)
Global capacity announcement of electrical distribution systems: A pragmatic approach
Cornélusse, Bertrand  ; Vangulick, David; Glavic, Mevludin  et al.
2015 • In Sustainable Energy, Grids and Networks, 4, p. 43-53
We propose a pragmatic procedure to facilitate the connection process of Distributed Generation (...
Article (Scientific journals)
Sequential decision-making approach for quadrangular mesh generation
Johnen, Amaury  ; Ernst, Damien  ; Geuzaine, Christophe 
2015 • In Engineering with Computers, 31 (4), p. 729-735
A new indirect quadrangular mesh generation algorithm which relies on sequential decision-making ...
Article for a general audience (Diverse speeches and writings)
Arabie saoudite et Etats-Unis: un divorce annoncé
Hermans, Michel  ; Ernst, Damien 
2015
Article (Scientific journals)
Reinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market
Vandael, Stijn; Claessens, Bert; Ernst, Damien  et al.
2015 • In IEEE Transactions on Smart Grid, 6 (4), p. 1795 - 1805
This paper addresses the problem of defining a day-ahead consumption plan for charging a fleet of...
Speech/Talk (Diverse speeches and writings)
An economic case for transnational and international transmission
Ernst, Damien 
2015
Paper published in a book (Scientific congresses and symposiums)
Graph matching for reconciling SCADA and GIS of a distribution network
Cornélusse, Bertrand  ; Leroux, Amandine; Glavic, Mevludin  et al.
2015 • In Proceedings of the International Conference on Electricity Distribution, CIRED 2015
This article deals with the problem of automatically es- tablishing a correspondence between two ...
Paper published in a book (Scientific congresses and symposiums)
A process to address electricity distribution sector challenges: the GREDOR project approach
Cornélusse, Bertrand  ; Vangulick, David; Glavic, Mevludin  et al.
2015 • In Proceedings of the International Conference on Electricity Distribution, CIRED 2015
This paper presents a general process set in the GREDOR (French acronym for “Gestion des Réseaux ...
Paper published in a book (Scientific congresses and symposiums)
Macroscopic analysis of interaction models for the provision of flexibility in distribution systems
Mathieu, Sébastien  ; Ernst, Damien  ; Cornélusse, Bertrand 
2015 • In Proceedings of the International Conference on Electricity Distribution, CIRED 2015
To ease the transition towards the future of distribution grid management, regulators must revise...
Speech/Talk (Diverse speeches and writings)
The global grid for empowering renewable energy
Ernst, Damien 
2015
Article (Scientific journals)
Artificial Intelligence in Video Games: Towards a Unified Framework
Safadi, Firas  ; Fonteneau, Raphaël  ; Ernst, Damien 
2015 • In International Journal of Computer Games Technology, 2015, p. 30
With modern video games frequently featuring sophisticated and realistic environments, the need f...
Speech/Talk (Diverse speeches and writings)
The inevitable downfall of the Belgian electrical power industry?
Ernst, Damien 
2015
Article for a general audience (Diverse speeches and writings)
L'arme de la transition énergétique pour combattre les djihadistes
Ernst, Damien  ; Hermans, Michel 
2015
Unpublished conference/Abstract (Scientific congresses and symposiums)
Electricity storage with liquid fuels in a zone powered by 100% variable renewables
Léonard, Grégoire  ; François-Lavet, Vincent  ; Ernst, Damien  et al.
2015 • 12th International Conference on the European Energy Market - EEM 2015
Paper published in a book (Scientific congresses and symposiums)
Electricity storage with liquid fuels in a zone powered by 100% variable renewables
Léonard, Grégoire  ; François-Lavet, Vincent  ; Ernst, Damien  et al.
2015 • In Proceedings of the 12th International Conference on the European Energy Market - EEM15
In this work, an electricity zone with 100% renewables is simulated to determine the optimal sizi...
Paper published in a book (Scientific congresses and symposiums)
Optimal Assignment of Off-Peak Hours to Lower Curtailments in the Distribution Network
Merciadri, Luca  ; Mathieu, Sébastien  ; Ernst, Damien  et al.
2015 • In Proceedings of the 5th European Innovative Smart Grid Technologies (ISGT)
We consider a price signal with two settings: off-peak tariff and on-peak tariff. Some loads are ...
Article for a general audience (Diverse speeches and writings)
Le sabotage sophistiqué de Doel 4 et l’intrigant survol de centrales nucléaires par des drones: l’hypothèse pas folle d’un intérêt d’Etat ?
Ernst, Damien  ; Hermans, Michel 
2014
Article (Scientific journals)
Using approximate dynamic programming for estimating the revenues of a hydrogen-based high-capacity storage device
François-Lavet, Vincent  ; Fonteneau, Raphaël  ; Ernst, Damien 
2014 • In IEEE Symposium Series on Computational Intelligence
This paper proposes a methodology to estimate the maximum revenue that can be generated by a comp...
Speech/Talk (Diverse speeches and writings)
Blackouts: des vérités qui dérangent
Ernst, Damien 
2014
Article (Scientific journals)
Mathematical Modeling of HIV Dynamics After Antiretroviral Therapy Initiation: A Review
Rivadeneira, Pablo; Moog, Claude; Stan, Guy-Bart et al.
2014 • In BioResearch Open Access, 3 (5), p. 233-241
This review shows the potential ground-breaking impact that mathematical tools may have in the an...
Article (Scientific journals)
Mathematical modeling of HIV dynamics after antiretroviral therapy initiation: A clinical research study
Moog, Claude; Rivadeneira, Pablo; Stan, Guy-Bart et al.
2014 • In AIDS Research and Human Retroviruses, 30 (9), p. 831-834
Immunological failure is identified from the estimation of certain parameters of a mathematical m...
Contribution to collective works (Parts of books)
Global power grids for harnessing world renewable energy
Chatzivasileiadis, Spyros; Ernst, Damien  ; Andersson, Göran
2014 • In Jones, Lawrence (Ed.) Renewable Energy Integration: Practical Management of Variability, Uncertainty and Flexibility in Power Grids
The Global Grid advocates the connection of all regional power systems into one electricity trans...
Paper published in a book (Scientific congresses and symposiums)
Relaxations for multi-period optimal power flow problems with discrete decision variables
Gemine, Quentin  ; Ernst, Damien  ; Louveaux, Quentin  et al.
2014 • In Proceedings of the 18th Power Systems Computation Conference (PSCC'14)
We consider a class of optimal power flow (OPF) applications where some loads offer a modulation ...
Paper published in a book (Scientific congresses and symposiums)
A quantitative analysis of the effect of flexible loads on reserve markets
Mathieu, Sébastien  ; Louveaux, Quentin  ; Ernst, Damien  et al.
2014 • In Proceedings of the 18th Power Systems Computation Conference (PSCC)
We propose and analyze a day-ahead reserve market model that handles bids from flexible loads. T...
Paper published in a book (Scientific congresses and symposiums)
Distributed Model-free Control of Photovoltaic Units for Mitigating Overvoltages in Low-Voltage Networks
Aristidou, Petros  ; Olivier, Frédéric  ; Hervas, Maria Emilia et al.
2014 • In Proc. of CIRED 2014 workshop
In this paper, a distributed model-free control scheme to mitigate overvoltage problems caused by...
Paper published in a book (Scientific congresses and symposiums)
Bayes Adaptive Reinforcement Learning versus Off-line Prior-based Policy Search: an Empirical Comparison
Castronovo, Michaël  ; Ernst, Damien  ; Fonteneau, Raphaël 
2014 • In Proceedings of the 23rd annual machine learning conference of Belgium and the Netherlands (BENELEARN 2014)
This paper addresses the problem of decision making in unknown finite Markov decision processes (...
Contribution to collective works (Parts of books)
Simple connectome inference from partial correlation statistics in calcium imaging
Sutera, Antonio  ; Joly, Arnaud  ; François-Lavet, Vincent  et al.
2014 • In Soriano, Jordi; Battaglia, Demian; Guyon, Isabelle et al. (Eds.) Neural Connectomics Challenge
In this work, we propose a simple yet effective solution to the problem of connectome inference i...
Paper published in a book (Scientific congresses and symposiums)
Apprentissage par renforcement bayésien versus recherche directe de politique hors-ligne en utilisant une distribution a priori: comparaison empirique
Castronovo, Michaël  ; Ernst, Damien  ; Fonteneau, Raphaël 
2014 • In Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage
Cet article aborde le problème de prise de décision séquentielle dans des processus de déci- sion...
Speech/Talk (Diverse speeches and writings)
Microgrids and their destructuring effects on the electrical industry
Ernst, Damien 
2014
Paper published in a book (Scientific congresses and symposiums)
Estimating the revenues of a hydrogen-based high-capacity storage device: methodology and results
François-Lavet, Vincent  ; Fonteneau, Raphaël  ; Ernst, Damien 
2014 • In Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage
This paper proposes a methodology to estimate the maximum revenue that can be generated by a comp...
Paper published in a book (Scientific congresses and symposiums)
Gestion active d’un réseau de distribution d’électricité : formulation du problème et benchmark
Gemine, Quentin  ; Ernst, Damien  ; Cornélusse, Bertrand 
2014 • In Proceedings des 9èmes Journées Francophones de Planification, Décision et Apprentissage
Afin d’opérer un réseau de distribution d’électricité de manière fiable et efficace, c’est-à-dire...
Paper published in a book (Scientific congresses and symposiums)
Toggling a genetic switch using reinforcement learning
Sootla, Aivar; Strelkowa, Natalja; Ernst, Damien  et al.
2014 • In Proceedings of the 9th French Meeting on Planning, Decision Making and Learning
In this paper, we consider the problem of optimal exogenous control of gene regulatory networks. ...
Article (Scientific journals)
Optimized look-ahead tree policies: a bridge between look-ahead tree policies and direct policy search
Jung, Tobias  ; Wehenkel, Louis  ; Ernst, Damien  et al.
2014 • In International Journal of Adaptive Control and Signal Processing, 28 (3-5), p. 255-289
Direct policy search (DPS) and look-ahead tree (LT) policies are two popular techniques for solvi...
Article (Scientific journals)
A learning procedure for sampling semantically different valid expressions
St-Pierre, David Lupien; Maes, Francis; Ernst, Damien  et al.
2014 • In International Journal of Artificial Intelligence, 12 (1), p. 18-35
A large number of problems can be formalized as finding the best symbolic expression to maximize ...
Article for a general audience (Diverse speeches and writings)
L'invité - Damien Ernst - "Nous allons vers une globalisation du marché de l'électricité"
Ernst, Damien 
2014
En décembre 2013, Damien Ernst, Professeur à l’ULG, a donné une conférence au CESW intitulée : «V...
Paper published in a book (Scientific congresses and symposiums)
Lipschitz robust control from off-policy trajectories
Fonteneau, Raphaël  ; Ernst, Damien  ; Boigelot, Bernard  et al.
2014 • In Proceedings of the 53rd IEEE Conference on Decision and Control (IEEE CDC 2014)
We study the minmax optimization problem introduced in [Fonteneau et al. (2011), ``Towards min ma...
Paper published in a book (Scientific congresses and symposiums)
Apprentissage par renforcement batch fondé sur la reconstruction de trajectoires artificielles
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2014 • In Proceedings of the 9èmes Journées Francophones de Planification, Décision et Apprentissage (JFPDA 2014)
Cet article se situe dans le cadre de l’apprentissage par renforcement en mode batch, dont le pro...
Contribution to collective works (Parts of books)
Power system transient stability preventive and emergency control
Ruiz-Vega, Daniel; Wehenkel, Louis  ; Ernst, Damien  et al.
2014 • In Savulescu, Savu (Ed.) Real-Time Stability in Power Systems 2nd Edition
A general approach to real-time transient stability control is described, yielding various comple...
Speech/Talk (Diverse speeches and writings)
The Global Grid
Ernst, Damien 
2013
Paper published in a book (Scientific congresses and symposiums)
On periodic reference tracking using batch-mode reinforcement learning with application to gene regulatory network control
Sootla, Aivar; Strelkowa, Natajala; Ernst, Damien  et al.
2013 • In Proceedings of the 52nd Annual Conference on Decision and Control (CDC 2013)
In this paper, we consider the periodic reference tracking problem in the framework of batch-mode...
Paper published in a book (Scientific congresses and symposiums)
An efficient algorithm for the provision of a day-ahead modulation service by a load aggregator
Mathieu, Sébastien  ; Ernst, Damien  ; Louveaux, Quentin 
2013 • In Proceedings of the 4th European Innovative Smart Grid Technologies (ISGT)
This article studies a decision making problem faced by an aggregator willing to offer a load mod...
Article (Scientific journals)
The global grid
Chatzivasileiadis, Spyros; Ernst, Damien  ; Andersson, Göran
2013 • In Renewable Energy, 57, p. 372-383
This paper puts forward the vision that a natural future stage of the electricity network could b...
Speech/Talk (Diverse speeches and writings)
GREDOR
Ernst, Damien 
2013
Speech/Talk (Diverse speeches and writings)
Smart conversion of residual heat into electricity: the electricity market point of view
Ernst, Damien 
2013
Article (Scientific journals)
Batch mode reinforcement learning based on the synthesis of artificial trajectories
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2013 • In Annals of Operations Research, 208 (1), p. 383-416
Article (Scientific journals)
Monte Carlo search algorithm discovery for single-player games
Maes, Francis; Lupien St-Pierre, David  ; Ernst, Damien 
2013 • In IEEE Transactions on Computational Intelligence and AI in Games, 5 (3), p. 201-213
Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. Wh...
Article for a general audience (Diverse speeches and writings)
Risque majeur de blackout : que faire ?
Ernst, Damien 
2013
Article (Scientific journals)
Quelles perspectives pour les énergies renouvelables en Wallonie ?
Ernst, Damien 
2013 • In LiègeU, Eté 2013, p. 25-28
Speech/Talk (Diverse speeches and writings)
Meta-learning of exploration-exploitation strategies in reinforcement learning
Ernst, Damien 
2013
Speech/Talk (Diverse speeches and writings)
Understanding active network management in 30 minutes
Ernst, Damien 
2013
Article (Scientific journals)
Optimal discovery with probabilistic expert advice: finite time analysis and macroscopic optimality
Bubeck, Sébastien; Ernst, Damien  ; Garivier, Aurélien
2013 • In Journal of Machine Learning Research, 14, p. 601-623
We consider an original problem that arises from the issue of security analysis of a power system...
Speech/Talk (Diverse speeches and writings)
Solving the fluctuation problems in a land with 100% of renewable energy
Ernst, Damien 
2013
Article (Scientific journals)
Outbound SPIT Filter with Optimal Performance Guarantees
Jung, Tobias  ; Martin, Sylvain  ; Nassar, Mohamed et al.
2013 • In Computer Networks, 57 (7), p. 1630–1643
This paper presents a formal framework for identifying and filtering SPIT calls (SPam in Internet...
Article (Scientific journals)
Scenario Trees and Policy Selection for Multistage Stochastic Programming Using Machine Learning
Defourny, Boris; Ernst, Damien  ; Wehenkel, Louis 
2013 • In INFORMS Journal on Computing, 25 (3), p. 488-501
In the context of multistage stochastic optimization problems, we propose a hybrid strategy for g...
Paper published in a book (Scientific congresses and symposiums)
Généralisation Min Max pour l'Apprentissage par Renforcement Batch et Déterministe : Relaxations pour le Cas Général T Etapes
Fonteneau, Raphaël  ; Ernst, Damien  ; Boigelot, Bernard  et al.
2013 • In 8èmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA'13)
Cet article aborde le problème de généralisation minmax dans le cadre de l'apprentissage par renf...
Article (Scientific journals)
Min max generalization for deterministic batch mode reinforcement learning: relaxation schemes
Fonteneau, Raphaël  ; Ernst, Damien  ; Boigelot, Bernard  et al.
2013 • In SIAM Journal on Control and Optimization, 51 (5), p. 3355–3385
We study the min max optimization problem introduced in Fonteneau et al. [Towards min max reinfor...
Article (Scientific journals)
Stratégies d'échantillonnage pour l'apprentissage par renforcement batch
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2013 • In Revue d'Intelligence Artificielle, 27 (2), p. 171-194
Cet article présente deux stratégies d’échantillonnage dans le contexte de l’apprentissage par re...
Paper published in a book (Scientific congresses and symposiums)
Active network management: planning under uncertainty for exploiting load modulation
Gemine, Quentin  ; Karangelos, Efthymios  ; Ernst, Damien  et al.
2013 • In Proceedings of the 2013 IREP Symposium - Bulk Power Systems Dynamics and Control - IX
This paper addresses the problem faced by a distribution system operator (DSO) when planning the ...
Paper published in a book (Scientific congresses and symposiums)
Optimized Look-Ahead Trees: Extensions to Large and Continuous Action Spaces
Jung, Tobias  ; Ernst, Damien  ; Maes, Francis
2013 • In Proc. of IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL'13)
This paper studies look-ahead tree based control policies from the viewpoint of online decision m...
Contribution to collective works (Parts of books)
Meta-learning of Exploration/Exploitation Strategies: The Multi-Armed Bandit Case
Maes, Francis; Wehenkel, Louis  ; Ernst, Damien 
2013 • In Filipe, Joaquim; Fred, Ana (Eds.) Agents and Artificial Intelligence: 4th International Conference, ICAART 2012, Vilamoura, Portugal, February 6-8, 2012. Revised Selected Papers
The exploration/exploitation (E/E) dilemma arises naturally in many subfields of Science. Multi-ar...
Poster (Scientific congresses and symposiums)
Biorthogonalization Techniques for Least Squares Temporal Difference Learning
Jung, Tobias  ; Ernst, Damien 
2012 • Neural Information Processing Systems (NIPS)
We consider Markov reward processes and study OLS-LSTD, a framework for selecting basis functions...
Paper published in a book (Scientific congresses and symposiums)
Optimal discovery with probabilistic expert advice
Bubeck, Sébastien; Ernst, Damien  ; Garivier, Aurélien
2012 • In Proceedings of the 51st IEEE Conference on Decision and Control (CDC 2012)
Motivated by issues of security analysis for power systems, we analyze a new problem, called opti...
Speech/Talk (Diverse speeches and writings)
Batch mode reinforcement learning based on the synthesis of artificial trajectories
Ernst, Damien 
2012
Article (Scientific journals)
Cooperative frequency control with a multi-terminal high-voltage DC network
Sarlette, Alain; Dai, Jing; Phulpin, Yannick et al.
2012 • In Automatica, 48 (12), p. 3128–3134
We consider frequency control in power systems made of several non-synchronous AC areas connected...
Poster (Scientific congresses and symposiums)
A computationally efficient algorithm for the provision of a day-ahead modulation service by a load aggregator
Mathieu, Sébastien  ; Karangelos, Efthymios  ; Louveaux, Quentin  et al.
2012 • DYSCO Study Day : Dynamical systems, control and optimization Kickoff of phase VII
We study a decision making problem faced by an aggregator willing to offer a load modulation serv...
Paper published in a book (Scientific congresses and symposiums)
Policy search in a space of simple closed-form formulas: towards interpretability of reinforcement learning
Maes, Francis  ; Fonteneau, Raphaël  ; Wehenkel, Louis  et al.
2012 • In Discovery Science 15th International Conference, DS 2012, Lyon, France, October 29-31, 2012. Proceedings
In this paper, we address the problem of computing interpretable solutions to reinforcement learn...
Eprint first made available on ORBi (E-prints, working papers and research blog)
Contextual Multi-armed Bandits for the Prevention of Spam in VoIP Networks
Jung, Tobias  ; Martin, Sylvain  ; Ernst, Damien  et al.
2012
In this paper we argue that contextual multi-armed bandit algorithms could open avenues for desig...
Poster (Scientific congresses and symposiums)
Rhythms in Neuromorphic Reinforcement Learning
Dethier, Julie  ; Ernst, Damien  ; Sepulchre, Rodolphe 
2012 • International Conference on Brain Dynamics and Decision Making
Living organisms are able to successfully perform challenging tasks such as perception, classific...
Paper published in a book (Scientific congresses and symposiums)
Généralisation min max pour l'apprentissage par renforcement batch et déterministe : schémas de relaxation
Fonteneau, Raphaël  ; Ernst, Damien  ; Boigelot, Bernard  et al.
2012 • In Septièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2012)
On s’intéresse au problème de généralisation min max dans le cadre de l’apprentissage par renforc...
Unpublished conference/Abstract (Scientific congresses and symposiums)
Neuromorphic reinforcement learning
Dethier, Julie  ; Ernst, Damien  ; Sepulchre, Rodolphe 
2012 • 31st Benelux Meeting on Systems and Control
Living organisms are able to successfully perform challeng- ing tasks such as perception, classif...
Article (Scientific journals)
Coordinated primary frequency control among non-synchronous systems connected by a multi-terminal high-voltage direct current grid
Dai, Jing; Phulpin, Yannick; Sarlette, Alain et al.
2012 • In IET Generation, Transmission and Distribution, 6 (2), p. 99-108
The authors consider a power system composed of several non-synchronous AC areas connected by a m...
Paper published in a book (Scientific congresses and symposiums)
Learning to play K-armed bandit problems
Maes, Francis  ; Wehenkel, Louis  ; Ernst, Damien 
2012 • In Proceedings of the 4th International Conference on Agents and Artificial Intelligence (ICAART 2012)
We propose a learning approach to pre-compute K-armed bandit playing policies by exploiting prior...
Paper published in a book (Scientific congresses and symposiums)
Learning exploration/exploitation strategies for single trajectory reinforcement learning
Castronovo, Michaël  ; Maes, Francis  ; Fonteneau, Raphaël  et al.
2012 • In Proceedings of the 10th European Workshop on Reinforcement Learning (EWRL 2012)
We consider the problem of learning high-performance Exploration/Exploitation (E/E) strategies fo...
Speech/Talk (Diverse speeches and writings)
Multi-terminal HVDC systems and ancillary services
Ernst, Damien 
2012
Other (Reports)
Min max generalization for two-stage deterministic batch mode reinforcement learning: relaxation schemes
Fonteneau, Raphaël  ; Ernst, Damien  ; Boigelot, Bernard  et al.
2012
Paper published in a book (Scientific congresses and symposiums)
Imitative Learning for Real-Time Strategy Games
Gemine, Quentin  ; Safadi, Firas  ; Fonteneau, Raphaël  et al.
2012 • In Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games
Over the past decades, video games have become increasingly popular and complex. Virtual worlds h...
Paper published in a book (Scientific congresses and symposiums)
Contextual Multi-armed Bandits for Web Server Defense
Jung, Tobias  ; Martin, Sylvain  ; Ernst, Damien  et al.
2012 • In Hussein, Abbas (Ed.) Proceedings of 2012 International Joint Conference on Neural Networks (IJCNN)
In this paper we argue that contextual multi-armed bandit algorithms could open avenues for desig...
Paper published in a book (Scientific congresses and symposiums)
SPRT for SPIT: Using the Sequential Probability Ratio Test for Spam in VoIP Prevention
Jung, Tobias  ; Martin, Sylvain  ; Ernst, Damien  et al.
2012 • In Proc. of 6th International Conference on Autonomous Infrastructure, Management and Security
This paper presents the first formal framework for identifying and filtering SPIT calls (SPam in ...
Paper published in a book (Scientific congresses and symposiums)
Comparison of Different Selection Strategies in Monte-Carlo Tree Search for the Game of Tron
Perrick, Pierre; Lupien St-Pierre, David  ; Maes, Francis  et al.
2012 • In IEEE Conference on Computational and Intelligence in Games 2012
Monte-Carlo Tree Search (MCTS) techniques are essentially known for their performance on turn-bas...
Paper published in a book (Scientific congresses and symposiums)
Relaxation schemes for min max generalization in deterministic batch mode reinforcement learning
Fonteneau, Raphaël  ; Ernst, Damien  ; Boigelot, Bernard  et al.
2011 • In 4th International NIPS Workshop on Optimization for Machine Learning (OPT 2011)
We study the min max optimization problem introduced in [Fonteneau, 2011] for computing policies ...
Paper published in a book (Scientific congresses and symposiums)
Artificial intelligence design for real-time strategy games
Safadi, Firas  ; Fonteneau, Raphaël  ; Ernst, Damien 
2011 • In NIPS Workshop on Decision Making with Multiple Imperfect Decision Makers
For now over a decade, real-time strategy (RTS) games have been challenging intelligence, human a...
Speech/Talk (Diverse speeches and writings)
Learning for exploration-exploitation in RL. The dusk of the small formulas’ reign
Ernst, Damien 
2011
Paper published in a book (Scientific congresses and symposiums)
Ancillary services and operation of multi-terminal HVDC grids
Phulpin, Yannick; Ernst, Damien 
2011 • In Proceedings of the International Workshop on Transmission Networks for Offshore Wind Power as well as on Transmission Networks for Offshore Wind Power Farms Plants
This paper addresses the problem of ancillary services in ac systems interconnected by a multi-te...
Paper published in a book (Scientific congresses and symposiums)
Model predictive control of HVDC power flow to improve transient stability in power systems
Phulpin, Yannick; Hazra, Jagabondhu; Ernst, Damien 
2011 • In Proceedings of the Second IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm)
This paper addresses the problem of HVDC control using real-time information to avoid loss of syn...
Paper published in a book (Scientific congresses and symposiums)
Apprentissage actif par modification de la politique de décision courante
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2011 • In Sixièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2011)
Article (Scientific journals)
Estimation Monte Carlo sans modèle de politiques de décision
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2011 • In Revue d'Intelligence Artificielle, 25, p. 321-343
Paper published in a book (Scientific congresses and symposiums)
Approximate reinforcement learning: an overview
Busoniu, Lucian; Babuska, Robert; De Schutter, Bart et al.
2011 • In Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11)
Reinforcement learning (RL) allows agents to learn how to optimally interact with complex environ...
Paper published in a book (Scientific congresses and symposiums)
Active exploration by searching for experiments that falsify the computed control policy
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2011 • In Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11)
We propose a strategy for experiment selection - in the context of reinforcement learning - based...
Article (Scientific journals)
Cross-entropy optimization of control policies with adaptive basis functions
Busoniu, Lucian; Ernst, Damien  ; Babuska, Robert et al.
2011 • In IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics, 41 (1), p. 196-209
This paper introduces an algorithm for direct search of control policies in continuous-state, dis...
Contribution to collective works (Parts of books)
Multistage stochastic programming: A scenario tree based approach to planning under uncertainty
Defourny, Boris  ; Ernst, Damien  ; Wehenkel, Louis 
2011 • In Sucar, L. Enrique; Morales, Eduardo F.; Hoey, Jesse (Eds.) Decision Theory Models for Applications in Artificial Intelligence: Concepts and Solutions
In this chapter, we present the multistage stochastic programming framework for sequential decisi...
Contribution to collective works (Parts of books)
Towards min max generalization in reinforcement learning
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2011 • In Filipe, Joaquim; Fred, Ana; Sharp, Bernadette (Eds.) Agents and Artificial Intelligence: International Conference, ICAART 2010, Valencia, Spain, January 2010, Revised Selected Papers
In this paper, we introduce a min max approach for addressing the generalization problem in Reinf...
Paper published in a book (Scientific congresses and symposiums)
Voltage control in an HVDC system to share primary frequency reserves between non-synchronous areas
Jing, Dai; Phulpin, Yannick; Sarlette, Alain  et al.
2011 • In Proceedings of the 17th Power Systems Computation Conference (PSCC-11)
This paper addresses the problem of frequency control for non-synchronous AC areas connected by a...
Paper published in a book (Scientific congresses and symposiums)
Automatic discovery of ranking formulas for playing with multi-armed bandits
Maes, Francis  ; Wehenkel, Louis  ; Ernst, Damien 
2011 • In Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011)
We propose an approach for discovering in an automatic way formulas for ranking arms while playin...
Paper published in a book (Scientific congresses and symposiums)
Optimized look-ahead tree policies
Maes, Francis  ; Wehenkel, Louis  ; Ernst, Damien 
2011 • In Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011)
We consider in this paper look-ahead tree techniques for the discrete-time control of a determini...
Paper published in a book (Scientific congresses and symposiums)
Optimal sample selection for batch-mode reinforcement learning
Rachelson, Emmanuel  ; Schnitzler, François  ; Wehenkel, Louis  et al.
2011 • In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence (ICAART 2011)
We introduce the Optimal Sample Selection (OSS) meta-algorithm for solving discrete-time Optimal ...
Speech/Talk (Diverse speeches and writings)
Beyond function approximators for batch mode reinforcement learning: rebuilding trajectories
Ernst, Damien 
2010
Speech/Talk (Diverse speeches and writings)
Model-free Monte Carlo-like policy evaluation
Ernst, Damien 
2010
Paper published in a book (Scientific congresses and symposiums)
Impact of delays on a consensus-based primary frequency control scheme for AC systems connected by a multi-terminal HVDC grid
Dai, Jing; Phulpin, Yannick; Sarlette, Alain  et al.
2010 • In Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII
This paper addresses the problem of sharing primary frequency control reserves among nonsynchrono...
Speech/Talk (Diverse speeches and writings)
Consequence driven decomposition of large-scale power systems security analysis
Ernst, Damien 
2010
Paper published in a book (Scientific congresses and symposiums)
Consequence driven decomposition of large-scale power system security analysis
Fonteneau, Florence  ; Ernst, Damien  ; Druet, Christophe et al.
2010 • In Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII
This paper presents an approach for assessing, in operation planning studies, the security of a l...
Paper published in a book (Scientific congresses and symposiums)
Coordination of voltage control in a power system operated by multiple transmission utilities
Phulpin, Yannick; Begovic, Miroslav; Ernst, Damien 
2010 • In Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII
This paper addresses the problem of coordinating voltage control in a large-scale power system pa...
Paper published in a book (Scientific congresses and symposiums)
Using prior knowledge to accelerate online least-squares policy iteration
Busoniu, Lucian; De Schutter, Bart; Babuska, Robert et al.
2010 • In Proceedings of the 2010 IEEE International Conference on Automation, Quality and Testing, Robotics
Reinforcement learning (RL) is a promising paradigm for learning optimal control. Although RL is ...
Article (Scientific journals)
Approximate dynamic programming with a fuzzy parameterization
Busoniu, Lucian; Ernst, Damien  ; De Schutter, Bart et al.
2010 • In Automatica, 46 (5), p. 804-814
Dynamic programming (DP) is a powerful paradigm for general, nonlinear optimal control. Computing...
Paper published in a book (Scientific congresses and symposiums)
Generating informative trajectories by using bounds on the return of control policies
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2010 • In Proceedings of the Workshop on Active Learning and Experimental Design 2010 (in conjunction with AISTATS 2010)
We propose new methods for guiding the generation of informative trajectories when solving discre...
Paper published in a book (Scientific congresses and symposiums)
Model-free Monte Carlo–like policy evaluation
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2010 • In Proceedings of Conférence Francophone sur l'Apprentissage Automatique (CAp) 2010
We propose an algorithm for estimating the finite-horizon expected return of a closed loop contro...
Paper published in a book (Scientific congresses and symposiums)
Model-free Monte Carlo-like policy evaluation
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2010 • In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010)
We propose an algorithm for estimating the finite-horizon expected return of a closed loop contro...
Paper published in a book (Scientific congresses and symposiums)
Upper confidence bound based decision making strategies and dynamic spectrum access
jouini, wassim; Ernst, Damien  ; Moy, Christophe et al.
2010 • In Proceedings of the 2010 IEEE International Conference on Communications
In this paper, we consider the problem of exploiting spectrum resources for a secondary user (SU)...
Book published as author, translator, etc. (Books)
Reinforcement Learning and Dynamic Programming using Function Approximators
Busoniu, Lucian; Babuska, Robert; De Schutter, Bart et al.
2010 • CRC Press
Article (Scientific journals)
Exploiting policy knowledge in online least-squares policy iteration: An empirical study
Busoniu, Lucian; Ernst, Damien  ; Babusku, Robert et al.
2010 • In Automation, Computers, Applied Mathematics, 19 (4), p. 521-529
Reinforcement learning (RL) is a promising paradigm for learning optimal control. Traditional RL ...
Paper published in a book (Scientific congresses and symposiums)
Online least-squares policy iteration for reinforcement learning control
Busoniu, Lucian; Ernst, Damien  ; De Schutter, Bart et al.
2010 • In Proceedings of the 2010 American Control Conference
Reinforcement learning is a promising paradigm for learning optimal control. We consider policy i...
External report (Reports)
Voronoi model learning for batch mode reinforcement learning
Fonteneau, Raphaël  ; Ernst, Damien 
2010
We consider deterministic optimal control problems with continuous state spaces where the informa...
Paper published in a book (Scientific congresses and symposiums)
A cautious approach to generalization in reinforcement learning
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2010 • In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence
In the context of a deterministic Lipschitz continuous environment over continuous state spaces, ...
External report (Reports)
Computing bounds for kernel-based policy evaluation in reinforcement learning
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2010
This technical report proposes an approach for computing bounds on the finite-time return of a po...
Paper published in a book (Scientific congresses and symposiums)
Model-free Monte Carlo-like policy evaluation
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2010 • In 29th Benelux Meeting on Systems and Control
Paper published in a book (Scientific congresses and symposiums)
Multi-armed bandit based policies for cognitive radio's decision making issues
Jouini, Wassim; Ernst, Damien  ; Moy, Christophe et al.
2009 • In Proceedings of the 3rd International Conference on Signals, Circuits and Systems (SCS)
We suggest in this paper that many problems related to Cognitive Radio’s (CR) decision making ins...
Article (Scientific journals)
Apoptosis characterizes immunological failure of HIV infected patients
Mhawej, Marie-José; Brunet-Francois, Cécile; Fonteneau, Raphaël  et al.
2009 • In Control Engineering Practice, 17 (7), p. 798-804
This paper studies the influence of apoptosis in the dynamics of the HIV infection. A new modelin...
Paper published in a book (Scientific congresses and symposiums)
A rare-event approach to build security analysis tools when N-k (k > 1) analyses are needed (as they are in large-scale power systems)
Belmudes, Florence  ; Ernst, Damien  ; Wehenkel, Louis 
2009 • In Proceedings of the 2009 IEEE Bucharest PowerTech
We consider the problem of performing N − k security analyses in large scale power systems. In su...
Paper published in a book (Scientific congresses and symposiums)
Pseudo-geographical representations of power system buses by multidimensional scaling
Belmudes, Florence  ; Ernst, Damien  ; Wehenkel, Louis 
2009 • In Proceedings of the 15th International Conference on Intelligent System Applications to Power Systems (ISAP 2009)
Graphical representations of power systems are systematically used for planning and operation. Th...
Paper published in a book (Scientific congresses and symposiums)
Policy search with cross-entropy optimization of basis functions
Busoniu, Lucian; Ernst, Damien  ; De Schutter, Bart et al.
2009 • In Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09)
This paper introduces a novel algorithm for approximate policy search in continuous-state, discre...
Paper published in a book (Scientific congresses and symposiums)
Apprentissage par renforcement appliqué à la commande des systèmes électriques
Dai, Jing; Phulpin, Yannick; Vannier, Jean-Claude et al.
2009 • In Proceedings of "Les Journées Electrotechnique du Futur 2009"
Cet article propose une revue de littérature concernant les applications de l’apprentissage par r...
Paper published in a book (Scientific congresses and symposiums)
Bounds for Multistage Stochastic Programs using Supervised Learning Strategies
Defourny, Boris  ; Ernst, Damien  ; Wehenkel, Louis 
2009 • In Watanabe, Osamu; Zeugmann, Thomas (Eds.) Stochastic Algorithms: Foundations and Applications
We propose a generic method for obtaining quickly good upper bounds on the minimal value of a mul...
Paper published in a book (Scientific congresses and symposiums)
Planning under uncertainty, ensembles of disturbance trees and kernelized discrete action spaces
Defourny, Boris  ; Ernst, Damien  ; Wehenkel, Louis 
2009 • In Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09)
Optimizing decisions on an ensemble of incomplete disturbance trees and aggregating their first s...
Speech/Talk (Diverse speeches and writings)
Lower bounds in reinforcement learning: the intelligent agent dream is getting closer
Ernst, Damien 
2009
Article (Scientific journals)
Reinforcement learning versus model predictive control: a comparison on a power system problem
Ernst, Damien  ; Glavic, Mevludin  ; Capitanescu, Florin  et al.
2009 • In IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics, 33 (2), p. 517-519
This paper compares reinforcement learning (RL) with model predictive control (MPC) in a unified ...
Paper published in a book (Scientific congresses and symposiums)
What is the likely future of real-time transient stability ?
Ernst, Damien  ; Wehenkel, Louis  ; Pavella, Mania 
2009 • In Proceedings of the 2009 IEEE/PES Power Systems Conference & Exposition (PSCE 2009)
Despite very intensive research efforts in the field of transient stability during the last five ...
Poster (Scientific congresses and symposiums)
Dynamic treatment regimes using reinforcement learning: a cautious generalization approach
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2009 • Benelux Bioinformatics Conference (BBC 2009)
Paper published in a book (Scientific congresses and symposiums)
Inferring bounds on the performance of a control policy from a sample of one-step system transitions
Fonteneau, Raphaël  ; Murphy, Susan A.; Wehenkel, Louis  et al.
2009 • In 28th Benelux Meeting on Systems and Control
Paper published in a book (Scientific congresses and symposiums)
Inferring bounds on the performance of a control policy from a sample of trajectories
Fonteneau, Raphaël  ; Murphy, Susan; Wehenkel, Louis  et al.
2009 • In Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09)
We propose an approach for inferring bounds on the finite-horizon return of a control policy from...
Paper published in a book (Scientific congresses and symposiums)
HVDC control strategies to improve transient stability in interconnected power systems
Hazra, Jagabondhu; Phulpin, Yannick; Ernst, Damien 
2009 • In Proceedings of the 2009 IEEE Bucharest PowerTech
This paper presents three HVDC modulation strategies to improve transient stability in an interco...
Article (Scientific journals)
A fair method for centralized optimization of multi-TSO power systems
Phulpin, Yannick; Begovic, Miroslav; Petit, Marc et al.
2009 • In International Journal of Electrical Power and Energy Systems, 31, p. 482-488
This paper addresses the problem of centralized optimization of an interconnected power system pa...
Paper published in a book (Scientific congresses and symposiums)
Decentralized reactive power dispatch for a time-varying multi-TSO system
Phulpin, Yannick; Begovic, Miroslav; Petit, Marc et al.
2009 • In Proceedings of the 42nd Hawaii International Conference on System Sciences (HICSS-42)
This paper addresses the problem of reactive power dispatch in a power system partitioned into se...
Article (Scientific journals)
Evaluation of network equivalents for voltage optimization in multi-area power systems
Phulpin, Yannick; Miroslav, Begovic; Petit, Marc et al.
2009 • In IEEE Transactions on Power Systems, 24 (2), p. 729-743
The paper addresses the problem of decentralized optimization for a power system partitioned into...
Article (Scientific journals)
Research and Education Activities in Electric Power Systems at the University of Liège
Wehenkel, Louis  ; Ernst, Damien  ; Rousseaux, Patricia  et al.
2008 • In Revue E: Revue d'Electricité et d'Electronique Industrielle, (4), p. 54-59
This paper presents research and education activities of the power systems group of the Departmen...
Speech/Talk (Diverse speeches and writings)
A reinforcement learning approach for designing artificial autonomous intelligent agents
Ernst, Damien 
2008
Paper published in a book (Scientific congresses and symposiums)
Variable selection for dynamic treatment regimes: a reinforcement learning approach
Fonteneau, Raphaël  ; Wehenkel, Louis  ; Ernst, Damien 
2008 • In The annual machine learning conference of Belgium and the Netherlands (BeNeLearn 2008)
Article (Scientific journals)
Modelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV-infected patient
Stan, Guy-Bart; Belmudes, Florence  ; Fonteneau, Raphaël  et al.
2008 • In IET Systems Biology, 2 (2), p. 94-102
On the basis of the human immunodeficiency virus (HIV) infection dynamics model proposed by Adams...
Paper published in a book (Scientific congresses and symposiums)
Analyzing transient instability phenomena beyond the classical stability boundary
Ali, Mahmoud; Glavic, Mevludin  ; Buisson, Jean et al.
2008 • In Proceedings of the 40th North American Power Symposium (NAPS 2008)
We consider power systems for which the amount of power produced by their individual power plants...
Paper published in a book (Scientific congresses and symposiums)
Cross-entropy based rare-event simulation for the identification of dangerous events in power systems
Belmudes, Florence  ; Ernst, Damien  ; Wehenkel, Louis 
2008 • In Proceedings of the 10th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS-08)
We propose in this paper a novel approach for identifying rare events that may endanger power sys...
Paper published in a book (Scientific congresses and symposiums)
Consistency of fuzzy model-based reinforcement learning
Busoniu, Lucian; Ernst, Damien  ; Babuska, Robert et al.
2008 • In Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-08)
Reinforcement learning (RL) is a widely used paradigm for learning control. Computing exact RL so...
Paper published in a book (Scientific congresses and symposiums)
Fuzzy partition optimization for approximate fuzzy Q-iteration
Busoniu, Lucian; Ernst, Damien  ; Babuska, Robert et al.
2008 • In Proceedings of the 17th IFAC World Congress (IFAC-08)
Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. Because exact...
Paper published in a book (Scientific congresses and symposiums)
Continuous-state reinforcement learning with fuzzy approximation
Busoniu, Lucian; Ernst, Damien  ; De Schutter, Bart et al.
2008 • In Tuyls, K.; Nowé, A.; Guessoum, Z. et al. (Eds.) Adaptive Agents and Multi-Agent Systems III, Adaptation and Multi-Agent Learning
Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. There exist s...
Paper published in a book (Scientific congresses and symposiums)
Lazy planning under uncertainty by optimizing decisions on an ensemble of incomplete disturbance trees
Defourny, Boris  ; Ernst, Damien  ; Wehenkel, Louis 
2008 • In Defourny, Boris ; Ernst, Damien ; Wehenkel, Louis  (Eds.) Recent Advances in Reinforcement Learning
This paper addresses the problem of solving discrete-time optimal sequential decision making prob...
Unpublished conference/Abstract (Scientific congresses and symposiums)
Risk-aware decision making and dynamic programming
Defourny, Boris  ; Ernst, Damien  ; Wehenkel, Louis 
2008 • NIPS-08 Workshop on Model Uncertainty and Risk in Reinforcement Learning
This paper considers sequential decision making problems under uncertainty, the tradeoff between ...
Paper published in a book (Scientific congresses and symposiums)
Variable selection for dynamic treatment regimes
Fonteneau, Raphaël  ; Wehenkel, Louis  ; Ernst, Damien 
2008 • In 27th Benelux Meeting on Systems and Control
Unpublished conference/Abstract (Scientific congresses and symposiums)
Variable selection for dynamic treatment regimes: a reinforcement learning approach
Fonteneau, Raphaël  ; Wehenkel, Louis  ; Ernst, Damien 
2008 • European Workshop on Reinforcement Learning 2008 (EWRL'08)
Dynamic treatment regimes (DTRs) can be inferred from data collected through some randomized clin...
Paper published in a book (Scientific congresses and symposiums)
How compatible is perfect competition with transmission loss allocation methods?
Jing, Dai; Phulpin, Yannick; Rious, Vincent et al.
2008 • In Proceedings of the 5th International Conference on the European Electricity Market (EEM-08)
This paper addresses the problem of transmission loss allocation in a power system where the gene...
Paper published in a book (Scientific congresses and symposiums)
On the fairness of centralised decision-making strategies in multi-area power systems
Phulpin, Yannick; Begovic, Miroslav; Petit, Marc et al.
2008 • In Proceedings of the 16th Power Systems Computation Conference (PSCC-08)
In this paper, we consider an interconnected power system, where the different Transmission Syste...
Article (Scientific journals)
Contingency filtering techniques for preventive security-constrained optimal power flow
Capitanescu, Florin  ; Glavic, Mevludin  ; Ernst, Damien  et al.
2007 • In IEEE Transactions on Power Systems, 22 (4), p. 1690-1697
This paper focuses on contingency filtering to accelerate the iterative solution of preventive se...
Article (Scientific journals)
Estimation of rotor angles of synchronous machines using artificial neural networks and local PMU-based quantities
Del Angel, Alberto  ; Geurts, Pierre  ; Ernst, Damien  et al.
2007 • In Neurocomputing, 70 (16-18), p. 2668-2678
This paper investigates a possibility for estimating rotor angles in the time frame of transient ...
Article (Scientific journals)
Interior-point based algorithms for the solution of optimal power flow problems
Capitanescu, Florin  ; Glavic, Mevludin  ; Ernst, Damien  et al.
2007 • In Electric Power Systems Research, 77 (5-6), p. 508-517
Interior-point method (IPM) is a very appealing approach to the optimal power flow (OPF) problem ...
Paper published in a book (Scientific congresses and symposiums)
Nash equilibrium as the minimum of a function. Application to electricity markets with large number of actors
Beck, Elena Vdovina; Cherkaoui, Rachid; Minoia, Anna et al.
2007 • In Proceedings of the 2007 Power Tech
We introduce in this paper a new approach for efficiently identifying Nash equilibria for games c...
Paper published in a book (Scientific congresses and symposiums)
Continuous-state reinforcement learning with fuzzy approximation
Busoniu, Lucian; Ernst, Damien  ; Babuska, Robert et al.
2007 • In Proceedings of the 7th European Symposium on Adaptive Learning Agents and Multi-Agent Systems (ALAMAS-07)
Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. Well-understo...
Paper published in a book (Scientific congresses and symposiums)
Fuzzy approximation for convergent model-based reinforcement learning
Busoniu, Lucian; Ernst, Damien  ; Babuska, Robert et al.
2007 • In Proceedings of the 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-07)
Reinforcement learning (RL) is a learning control paradigm that provides well-understood algorith...
Article (Scientific journals)
Model predictive control and reinforcement learning as two complementary frameworks
Ernst, Damien  ; Glavic, Mevludin  ; Capitanescu, Florin  et al.
2007 • In International Journal of Tomography and Statistics, 6, p. 122-127
Model predictive control (MPC) and reinforcement learning (RL) are two popular families of method...
Paper published in a book (Scientific congresses and symposiums)
The cross-entropy method for power system combinatorial optimization problems
Ernst, Damien  ; Glavic, Mevludin  ; Stan, Guy-Bart et al.
2007 • In Proceedings of the 2007 Power Tech
We present an application of a cross-entropy based combinatorial optimization method for solving ...
Paper published in a book (Scientific congresses and symposiums)
E-SIME- A method for transient stability closed-loop emergency control: achievements and prospects
Glavic, Mevludin  ; Ernst, Damien  ; Ruiz-Vega, Daniel et al.
2007 • In Proceedings of 2007 IREP Symposium - Bulk Power Systems Dynamics and Control - VII
A general response-based technique is presented for closed-loop transient stability emergency con...
Poster (Scientific congresses and symposiums)
Modelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV infected patient
Stan, Guy-Bart; Belmudes, Florence; Fonteneau, Raphaël  et al.
2007 • Benelux Bioinformatics Conference (BBC 2007)
Paper published in a book (Scientific congresses and symposiums)
A collaborative framework for multi-area dynamic security assessment of large scale systems
Wehenkel, Louis  ; Glavic, Mevludin  ; Ernst, Damien 
2007 • In Proceedings of the 2007 Power Tech
In this paper we propose a collaborative framework to carry out multi-area dynamic security asses...
Speech/Talk (Diverse speeches and writings)
Computing near-optimal policies from trajectories by solving a sequence of standard supervised learning problems
Ernst, Damien 
2006
Article (Scientific journals)
A comparison of Nash equilibria analysis and agent-based modelling for power markets
Krause, Thilo; Beck, Elena Vdovina; Cherkaoui, Rachid et al.
2006 • In International Journal of Electrical Power and Energy Systems, 28 (9), p. 599-607
In this paper we compare Nash equilibria analysis and agent-based modelling for assessing the mar...
Article (Scientific journals)
Extremely randomized trees
Geurts, Pierre  ; Ernst, Damien  ; Wehenkel, Louis 
2006 • In Machine Learning, 63 (1), p. 3-42
This paper proposes anew tree-based ensemble method for supervised classification and regression ...
Speech/Talk (Diverse speeches and writings)
Clinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, Damien 
2006
Article (Scientific journals)
Reference transmission network: A game theory approach
Minoia, Anna; Ernst, Damien  ; Dicorato, Maria et al.
2006 • In IEEE Transactions on Power Systems, 21 (1), p. 249-259
The transmission network plays a key role in an oligopolistic electricity market. In fact, the ca...
Paper published in a book (Scientific congresses and symposiums)
Applications of security-constrained optimal power flows
Capitanescu, Florin  ; Glavic, Mevludin  ; Ernst, Damien  et al.
2006 • In In Proceedings of Modern Electric Power Systems Symposium, MEPS06
This paper proposes to formulate security control as a sequential decision making problem and pre...
Paper published in a book (Scientific congresses and symposiums)
Model predictive control and reinforcement learning as two complementary frameworks
Ernst, Damien  ; Glavic, Mevludin  ; Capitanescu, Florin  et al.
2006 • In Proceedings of the 13th IFAC Workshop on Control Applications of Optimisation
Model predictive control (MPC) and reinforcement learning (RL) are two popular families of method...
Paper published in a book (Scientific congresses and symposiums)
Reinforcement learning with raw image pixels as input state
Ernst, Damien  ; Marée, Raphaël  ; Wehenkel, Louis 
2006 • In Advances in machine vision, image processing & pattern analysis (Lecture notes in computer science, Vol. 4153)
We report in this paper some positive simulation results obtained when image pixels are directly ...
Paper published in a book (Scientific congresses and symposiums)
Clinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, Damien  ; Stan, Guy-Bart; Gonçalves, Jorge et al.
2006 • In Proceedings of the 15th Annual Machine Learning Conference of Belgium and The Netherlands (Benelearn 2006)
This paper addresses the problem of computing optimal structured treatment interruption strategie...
Paper published in a book (Scientific congresses and symposiums)
Clinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, Damien  ; Stan, Guy-Bart; Gonçalves, Jorge et al.
2006 • In Proceedings of the 45th IEEE Conference on Decision and Control (CDC 2006)
This paper addresses the problem of computing optimal structured treatment interruption strategie...
Paper published in a book (Scientific congresses and symposiums)
Damping control by fusion of reinforcement learning and control Lyapunov functions
Glavic, Mevludin  ; Wehenkel, Louis  ; Ernst, Damien 
2006 • In Proceedings of the 38th North American Power Symposium (NAPS 2006)
The main idea behind the concept, proposed in the paper, is the opportunity to make control syste...
Paper published in a book (Scientific congresses and symposiums)
Ensembles of extremely randomized trees and some generic applications
Wehenkel, Louis  ; Ernst, Damien  ; Geurts, Pierre 
2006 • In Proceedings of Robust Methods for Power System State Estimation and Load Forecasting
In this paper we present a new tree-based ensemble method called “Extra-Trees”. This algorithm av...
Paper published in a book (Scientific congresses and symposiums)
Multi-area security assessment: results using efficient bounding method
Wehenkel, Louis  ; Glavic, Mevludin  ; Ernst, Damien 
2006 • In Proceedings of the 38th North American Power Symposium (NAPS 2006)
We present our recent results on using previously introduced framework for multi-area security as...
Paper published in a book (Scientific congresses and symposiums)
On multi-area security assessment of large interconnected power systems
Wehenkel, Louis  ; Glavic, Mevludin  ; Ernst, Damien 
2006 • In Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry
The paper introduces a framework for information exchange and coordination of security assessment...
Paper published in a book (Scientific congresses and symposiums)
About automatic learning for advanced sensing, monitoring and control of electric power systems
Wehenkel, Louis  ; Glavic, Mevludin  ; Geurts, Pierre  et al.
2006 • In Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry
The paper considers the possible uses of automatic learning for improving power system performanc...
Paper published in a book (Scientific congresses and symposiums)
Automatic learning of sequential decision strategies for dynamic security assessment and control
Wehenkel, Louis  ; Glavic, Mevludin  ; Geurts, Pierre  et al.
2006 • In Proceedings of the IEEE Power Engineering Society General Meeting 2006
This paper proposes to formulate security control as a sequential decision making problem and pre...
Speech/Talk (Diverse speeches and writings)
Supervised learning based sequential decision making
Ernst, Damien 
2005
Article (Scientific journals)
A reinforcement learning based discrete supplementary control for power system transient stability enhancement
Glavic, Mevludin  ; Ernst, Damien  ; Wehenkel, Louis 
2005 • In International Journal of Engineering Intelligent Systems for Electrical Engineering and Communications, 13 (2 Sp. Iss. SI), p. 81-88
This paper proposes an application of a Reinforcement Learning (RL) method to the control of a dy...
Article (Scientific journals)
Tree-based batch mode reinforcement learning
Ernst, Damien  ; Geurts, Pierre  ; Wehenkel, Louis 
2005 • In Journal of Machine Learning Research, 6, p. 503-556
Reinforcement learning aims to determine an optimal control policy from interaction with a system...
Article (Scientific journals)
Combining a stability and a performance-oriented control in power systems
Glavic, Mevludin  ; Ernst, Damien  ; Wehenkel, Louis 
2005 • In IEEE Transactions on Power Systems, 20 (1), p. 525-526
This paper suggests that the appropriate combination of a stability-oriented and a performance-or...
Paper published in a book (Scientific congresses and symposiums)
Application of an advanced transient stability assessment and control method to a realistic power system
Cirio, D.; Lucarella, D.; Vimercati, G. et al.
2005 • In Proceedings of the 15th Power System Computation Conference (PSCC 2005)
The paper presents a technical overview of a large research project on Dynamic Security Assessmen...
Paper published in a book (Scientific congresses and symposiums)
Selecting concise sets of samples for a reinforcement learning agent
Ernst, Damien 
2005 • In Proceedings of the 3rd International Conference on Computational Intelligence, Robotics and Autonomous Systems (CIRAS 2005)
We derive an algorithm for selecting from the set of samples gathered by a reinforcement learning...
Article (Scientific journals)
Approximate value iteration in the reinforcement learning context. Application to electrical power system control
Ernst, Damien  ; Glavic, Mevludin  ; Geurts, Pierre  et al.
2005 • In International Journal of Emerging Electrical Power Systems, 3 (1)
In this paper we explain how to design intelligent agents able to process the information acquire...
Paper published in a book (Scientific congresses and symposiums)
A comparison of Nash equilibria analysis and agent-based modelling for power markets
Krause, Thilo; Andersson, Goran; Ernst, Damien  et al.
2005 • In Proceedings of the 15th Power System Computation Conference (PSCC 2005)
In this paper we compare Nash equilibria analysis and agent-based modelling for assessing the mar...
Paper published in a book (Scientific congresses and symposiums)
New developments in the application of automatic learning to power system control
Wehenkel, Louis  ; Glavic, Mevludin  ; Ernst, Damien 
2005 • In Proceedings of the 15th Power System Computation Conference (PSCC 2005)
In this paper we present the basic principles of supervised learning and reinforcement learning a...
Contribution to collective works (Parts of books)
Preventive and emergency control of power systems
Wehenkel, Louis  ; Ruiz-Vega, Daniel; Ernst, Damien  et al.
2005 • In Real Time Stability in Power Systems - Techniques for Early Detection of the Risk of Blackout
A general approach to real-time transient stability control is described, yielding various comple...
Paper published in a book (Scientific congresses and symposiums)
On multi-area control in electric power systems
Zima, Marek; Ernst, Damien 
2005 • In Proceedings of the 15th Power System Computation Conference (PSCC 2005)
In this paper we study the concept of electric power system control, when the responsibility for ...
Article (Scientific journals)
Power systems stability control: Reinforcement learning framework
Ernst, Damien  ; Glavic, Mevludin  ; Wehenkel, Louis 
2004 • In IEEE Transactions on Power Systems, 19 (1), p. 427-435
In this paper, we explore how a computational approach to learning from interactions, called rein...
Paper published in a book (Scientific congresses and symposiums)
Market dynamics driven by the decision-making power producers
Ernst, Damien  ; Minoia, Anna; Marija, Ilic
2004 • In Proceedings of 2004 IREP Symposium - Bulk Power System Dynamics and Control - VI
In this paper we consider a tool for analyzing the market outcomes when competitive agents (power...
Paper published in a book (Scientific congresses and symposiums)
Nash equilibria and reinforcement learning for active decision maker modelling in power markets
Krause, Thilo; Andersson, Goran; Ernst, Damien  et al.
2004 • In Proceedings of the 6th IAEE European Conference: Modelling in Energy Economics and Policy
In this paper, we study the behavior of power suppliers who submit their bids to the market place...
Paper published in a book (Scientific congresses and symposiums)
Market dynamics driven by the decision-making of both power producers and transmission owners
Minoia, Anna; Ernst, Damien  ; Ilic, Marija
2004 • In Proceedings of the IEEE Power Engineering Society General Meeting 2004
In this paper we consider an electricity market in which not only the power producers but also th...
Doctoral thesis (Dissertations and theses)
Near Optimal Closed-Loop Control. Application to Electric Power Systems
Ernst, Damien 
2003
Paper published in a book (Scientific congresses and symposiums)
Iteratively extending time horizon reinforcement learning
Ernst, Damien  ; Geurts, Pierre  ; Wehenkel, Louis 
2003 • In Machine Learning: ECML 2003, 14th European Conference on Machine Learning
Reinforcement learning aims to determine an (infinite time horizon) optimal control policy from i...
Paper published in a book (Scientific congresses and symposiums)
A reinforcement learning based discrete supplementary control for power system transient stability enhancement
Glavic, Mevludin  ; Ernst, Damien  ; Wehenkel, Louis 
2003 • In Proceedings of the 12th Intelligent Systems Application to Power Systems Conference (ISAP 2003)
This paper proposes an application of a Reinforcement Learning (RL) method to the control of a dy...
Paper published in a book (Scientific congresses and symposiums)
Transient stability emergency control combining open-loop and closed-loop technique
Ruiz-Vega, Daniel; Glavic, Mevludin  ; Ernst, Damien 
2003 • In Proceedings of the IEEE Power Engineering Society General Meeting, 2003
An on-line transient stability emergency control approach is proposed, which couples an open-loop...
Other (Scientific journals)
Closure of "a unified approach to transient stability contingency filtering, ranking, and assessment"
Ernst, Damien  ; Ruiz-Vega, Daniel; Pavella, Mania  et al.
2002 • In IEEE Transactions on Power Systems, 17 (2), p. 528-529
Paper published in a book (Scientific congresses and symposiums)
FACTS devices controlled by means of reinforcement learning algorithms
Ernst, Damien  ; Wehenkel, Louis 
2002 • In Proceedings of the 14th Power Systems Computation Conference (PSCC 2002)
Reinforcement learning consists of a collection of methods for approximating solutions to determi...
Article (Scientific journals)
A unified approach to transient stability contingency filtering, ranking and assessment
Ernst, Damien  ; Ruiz-Vega, Daniel; Pavella, Mania  et al.
2001 • In IEEE Transactions on Power Systems, 16 (3), p. 435-443
This paper proposes a unified approach to contingency filtering, ranking and assessment in power ...
Paper published in a book (Scientific congresses and symposiums)
Reinforcement learning applied to power system oscillations damping
Ernst, Damien 
2001 • In Proceedings of the 40th Conference on Decision and Control (CDC 2001)
Article (Scientific journals)
A control strategy for controllable series capacitor in electric power systems
Ghandhari, Mehrdad; Andersson, Goran; Pavella, Mania  et al.
2001 • In Automatica, 37, p. 1575-1583
It has been veri"ed that a controllable series capacitor with a suitable control scheme can impro...
Paper published in a book (Scientific congresses and symposiums)
An approach to modal analysis of power system angle stability
Roth, Anna; Ruiz-Vega, Daniel; Ernst, Damien  et al.
2001 • In Proceedings of IEEE Powertech 2001
An approach to modal analysis and modal identification is proposed, capable of complementing the...
Speech/Talk (Diverse speeches and writings)
Preventive and emergency transient stability control
Ernst, Damien 
2000
Paper published in a book (Scientific congresses and symposiums)
On-line transient stability constrained ATC calculations
Avilas-Rosales, R.; Ruiz-Vega, Daniel; Ernst, Damien  et al.
2000 • In Proceedings of the IEEE Power Engineering Society Summer Meeting 2000 - Volume 2
Transient Stability Assessment, preventive control measures and dynamic A X calculations are addr...
Paper published in a book (Scientific congresses and symposiums)
Application of reinforcement learning to electrical power system closed-loop emergency control
Druet, Christophe; Ernst, Damien  ; Wehenkel, Louis 
2000 • In Principles of Data Mining and Knowledge Discovery, 4th European Conference, PKDD 2000
This paper investigates the use of reinforcement learning in electric power system emergency cont...
Paper published in a book (Scientific congresses and symposiums)
Closed-loop transient stability emergency control
Ernst, Damien  ; Pavella, Mania 
2000 • In Proceedings of the IEEE Power Engineering Society Winter Meeting 2000
The question of transient stability control is revisited, various types of controls are identifie...
Paper published in a book (Scientific congresses and symposiums)
Preventive and emergency transient stability control
Ernst, Damien  ; Ruiz-Vega, Daniel; Pavella, Mania 
2000 • In Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000)
A unified approach to transient stability closed-loop control is presented. It relies on the gene...
Book published as author, translator, etc. (Books)
Transient Stability of Power Systems: A Unified Approach to Assessment and Control
Pavella, Mania  ; Ernst, Damien  ; Ruiz-Vega, Daniel
2000 • Kluwer Academic Publishers, United States
Paper published in a book (Scientific congresses and symposiums)
A contingency filtering, ranking and assessment technique for on-line transient stability studies
Ruiz-Vega, Daniel; Ernst, Damien  ; Machado Ferreira, C. et al.
2000 • In Proceedings of International Conference on Electric Utility Deregulation and Restructing and Power Technologies 2000
Paper published in a book (Scientific congresses and symposiums)
Preventive countermeasures for transient stability-constrained power systems
Ruiz-Vega, Daniel; Ernst, Damien  ; Pavella, Mania 
2000 • In Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000)
A general transient stability control technique is applied to the design of preventive countermea...
Article (Scientific journals)
A general framework for power system transient stability control
Pavella, Mania  ; Ernst, Damien  ; Ruiz-Vega, Daniel
1999 • In IEEE Power Engineering Society Letters, 19 (10), p. 45-46
Paper published in a book (Scientific congresses and symposiums)
Transient stability-constrained optimal power flow
Bettiol, Arlan; Ruiz-Vega, Daniel; Ernst, Damien  et al.
1999 • In Proceedings of the IEEE Power Tech'99
This paper proposes a new approach able to maximize the interface flow limits in power systems an...
Paper published in a book (Scientific congresses and symposiums)
Transient stability-constrained generation rescheduling
Ruiz-Vega, Daniel; Bettiol, Arlan; Ernst, Damien  et al.
1998 • In Proceedings of 1998 IREP Symposium - Bulk Power System Dynamics and Control - IV
Paper published in a book (Scientific congresses and symposiums)
Compensation schemes for transient stability assessment and control
Ernst, Damien  ; Bettiol, Arlon; Zhang, Yiwei et al.
1998 • In Proceedings of LESCOPE 98
Paper published in a book (Scientific congresses and symposiums)
Real-time transient stability emergency control of the South-Southeast Brazilian system
Ernst, Damien  ; Bettiol, Arlan; Zhang, Yiwei et al.
1998 • In Proceedings of SEPOPE 1998
A method is proposed for during transients emergency control which predicts the evolution of a sy...
Paper published in a book (Scientific congresses and symposiums)
An approach to real-time transient stability assessment and control
Pavella, Mania  ; Wehenkel, Louis  ; Bettiol, Arlon et al.
1997 • In Techniques for stability limit search - Publication IEEE : TP-138-0