Ernst Damien

Dép. d'électric., électron. et informat. (Inst.Montefiore) > Smart grids

Montefiore Institute

See author's contact details
ORCID
0000-0002-3035-8260
Main Referenced Co-authors
Fonteneau, Raphaël  (82)
Wehenkel, Louis  (78)
Glavic, Mevludin  (31)
Cornélusse, Bertrand  (30)
Mathieu, Sébastien  (21)
Main Referenced Keywords
reinforcement learning (63); transient stability (19); power systems (18); renewable energy (17); Reinforcement learning (16);
Main Referenced Unit & Research Centers
Montefiore Institute - Montefiore Institute of Electrical Engineering and Computer Science - ULiège [BE] (8)
Lepur : Centre de Recherche sur la Ville, le Territoire et le Milieu rural - ULiège [BE] (2)
Systems and Modeling Research Unit (2)
Applied and Computational Electromagnetics (1)
Smartgrids (1)
Main Referenced Disciplines
Computer science (188)
Energy (162)
Electrical & electronics engineering (156)
Engineering, computing & technology: Multidisciplinary, general & others (17)
Immunology & infectious disease (7)

Publications (total 456)

The most downloaded
45271 downloads
Pavella, M., Ernst, D., & Ruiz-Vega, D. (2000). Transient Stability of Power Systems: A Unified Approach to Assessment and Control. United States: Kluwer Academic Publishers. https://hdl.handle.net/2268/13288

The most cited

5131 citations (Scopus®)

Geurts, P., Ernst, D., & Wehenkel, L. (April 2006). Extremely randomized trees. Machine Learning, 63 (1), 3-42. doi:10.1007/s10994-006-6226-1 https://hdl.handle.net/2268/9357

Lambrechts, G., Bolland, A., & Ernst, D. (August 2024). Informed POMDP: Leveraging Additional Information in Model-Based RL [Paper presentation]. Reinforcement Learning Conference, Amherst, United States - Massachusetts.
Peer reviewed

Bahmanyar, A., Duchesne, L., Dekeyne, G., Goubet, C., Gemine, Q., Panciatici, P., & Ernst, D. (June 2024). Identification of the critical cluster of generators by during fault angle trajectory estimation for transient stability analysis [Paper presentation]. 23rd Power Systems Computation Conference (PSCC 2024).
Peer reviewed

Ernst, D., Jordaens, P.-J., Monballieu, J., & Vermeylen, A. (2024). La Belgique peut gagner son indépendance énergétique en haute mer. L'Echo.

Dachet, V., Lokotar, I., & Ernst, D. (2024). Les Centres d’Énergie Renouvelable Distants (CERD). Une opportunité de leadership que l’Europe doit saisir. Confrontations Europe.

De Geeter, F., Ernst, D., & Drion, G. (15 May 2024). Spike-based computation using classical recurrent neural networks. Neuromorphic Computing and Engineering, 4 (2), 024007. doi:10.1088/2634-4386/ad473b
Peer Reviewed verified by ORBi

Dachet, V., Lokotar, I., & Ernst, D. (2024). Remote Renewable Energy Hubs: A Leadership Opportunity that Europe Must Seize. Confrontations Europe.

Ernst, D. (2024). Mix Électrique Renouvelable + Nucléaire : 10 Actions pour la Réussite [Paper presentation]. Solar Xpo.

Boveroux, L., Louveaux, Q., & Ernst, D. (22 April 2024). Investigating Monte-Carlo Tree Search Approach for the Job Shop Scheduling Problem [Paper presentation]. 24th edition of the Belgian Mathematical Optimization Workshop, La Roche-en-Ardennes, Belgium.

Vassallo, M., Bahmanyar, A., Duchesne, L., Leerschool, A., Gerard, S., Wehenkel, T., & Ernst, D. (2024). A Systematic Procedure for Topological Path Identification with Raw Data Transformation in Electrical Distribution Networks. In Proceedings of International Conference on Energy, Electrical and Power Engineering. Yangzhou, China: CEEPE.
Peer reviewed

Ernst, D. (2024). Modern aviation: Taking off towards a new carbon-neutral technological era [Paper presentation]. Orizio event: A Century of Belgian Aviation.

Fonder, M., Counotte, P., Dachet, V., de Séjournet, J., & Ernst, D. (15 March 2024). Synthetic methane for closing the carbon loop: Comparative study of three carbon sources for remote carbon-neutral fuel synthetization. Applied Energy, 358. doi:10.1016/j.apenergy.2023.122606
Peer Reviewed verified by ORBi

Miftari, B., Derval, G., Louveaux, Q., & Ernst, D. (08 February 2024). Parametric upper and lower bounds of linear variations of a linear problem’s LHS [Paper presentation]. ORBEL 38, Anvers, Belgium.
Editorial reviewed

Boveroux, L., Ernst, D., & Louveaux, Q. (08 February 2024). A comparative study of methods for solving the large flexible assembly job shop scheduling problems [Paper presentation]. Orbel 38.

Ernst, D. (2024). Un momentum pour des frappes ukrainiennes massives contre l'industrie pétrolière russe est arrivé. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/312421.

Ernst, D., & de Salle, C. (2024). Le pétrole, nerf de la guerre en Ukraine. Le Monde.

Ernst, D., & de Salle, C. (2024). A momentum for Ukrainian strikes against the Russian oil industry has arrived. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/312439.

Aittahar, S., Bolland, A., Derval, G., & Ernst, D. (2024). Optimal control of renewable energy communities subject to network peak fees with model predictive control and reinforcement learning algorithms. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/312776.

Rahimipour Behbahani, M., Jalilian, A., Bahmanyar, A., & Ernst, D. (08 January 2024). Comprehensive Review on Static and Dynamic Distribution Network Reconfiguration Methodologies. IEEE Access, 12, 9510-9525. doi:10.1109/ACCESS.2024.3350207
Peer Reviewed verified by ORBi

Bolland, A., Lambrechts, G., & Ernst, D. (2024). Behind the Myth of Exploration in Policy Gradients. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/312658.

de Salle, C., & Ernst, D. (2024). Transition écologique : "L'impératif, c'est la prospérité, pas la sobriété". L'Express.

Dauchat, L., Dachet, V., Fonteneau, R., & Ernst, D. (2024). Waste Heat Recovery in Remote Renewable Energy Hubs. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/313825.

Mbenoun, J., Benzerga, A., Miftari, B., Detienne, G., Deschuyteneer, T., Vazquez, J., Derval, G., & Ernst, D. (2024). Integration of offshore energy into national energy system: a case study on Belgium. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/314586.

Dachet, V., Benzerga, A., Coppitters, D., Contino, F., Fonteneau, R., & Ernst, D. (2024). Towards CO2 valorization in a multi remote renewable energy hub framework with uncertainty quantification. Journal of Environmental Management, 363, 121262. doi:10.1016/j.jenvman.2024.121262
Peer Reviewed verified by ORBi

Benzerga, A., Bahmanyar, A., Derval, G., & Ernst, D. (2024). A unified definition of hosting capacity, applications and review. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/315915.

Leroy, P., Morato, P. G., Pisane, J., Kolios, A., & Ernst, D. (2023). IMP-MARL: a Suite of Environments for Large-scale Infrastructure Management Planning via MARL. Advances in Neural Information Processing Systems.
Peer Reviewed verified by ORBi

Ernst, D., & Sutera, A. (2023). Rethinking electricity retail contracts for leveraging flexibility [Paper presentation]. Workshop on Electrical Load Flexibility in Retail by KBVE-SRBE, Brussels, Belgium.

Ernst, D. (2023). Harvesting wind energy in Greenland and exporting it as electricity or energy-rich molecules [Paper presentation]. Agoria & Sirris: Nocturne Nordics & Baltics, Antwerp, Belgium.

Dubois, A., Dumas, J., Thiran, P., Limpens, G., & Ernst, D. (15 November 2023). Multi-objective near-optimal necessary conditions for multi-sectoral planning. Applied Energy, 350.
Peer Reviewed verified by ORBi

Ernst, D. (2023). Generation 2 Platforms for Retailers: an important tool for integrating electric vehicles into our energy systems [Paper presentation]. E mobility seminar, Brussels, Belgium.

Sutera, A., & Ernst, D. (2023). Advanced platforms for electricity retailers. (ULiège - University of Liège, Liège, Belgium, Energy markets and regulation).

Bolland, A., Louppe, G., & Ernst, D. (2023). Policy Gradient Algorithms Implicitly Optimize by Continuation. Transactions on Machine Learning Research.
Peer Reviewed verified by ORBi

Dachet, V., Miftari, B., Colin, J., & Ernst, D. (2023). Remote Renewable Energy Hubs (v2) [Paper presentation]. Invited talk at DTU, Department of Wind and Energy Systems, Copenhague, Denmark.

Dachet, V., Miftari, B., Derval, G., & Ernst, D. (2023). Hydrogen as the basis of Remote Renewable Energy Hubs [Paper presentation]. Club Industrie-Université 22/09/23.

Miftari, B., Berger, M., Derval, G., Louveaux, Q., & Ernst, D. (2023). GBOML: A Structure-exploiting Optimization Modelling Language in Python. Optimization Methods and Software. doi:10.1080/10556788.2023.2246169
Peer Reviewed verified by ORBi

Lambrechts, G.* , De Geeter, F.* , Vecoven, N.* , Ernst, D., & Drion, G. (August 2023). Warming up recurrent neural networks to maximise reachable multistability greatly improves learning. Neural Networks, 166, 645-669. doi:10.1016/j.neunet.2023.07.023
Peer Reviewed verified by ORBi
* These authors have contributed equally to this work.

Miftari, B., Derval, G., Berger, M., & Ernst, D. (13 July 2023). GBOML: A modelling tool for structured MILPs [Paper presentation]. The 23rd Conference of the International Federation of Operational Research Societies, Santiago, Chile.
Peer reviewed

Miftari, B., Derval, G., & Ernst, D. (2023). Sizing and Operations of Energy Systems Using GBOML [Paper presentation]. Company meetings.

Pavella, M., Wehenkel, L., & Ernst, D. (2023). Power Systems Operation and Control: Contributions of the Liège Group, 1970–2000. In J. S. Tietjen, M. D. Ilic, L. Bertlin Tjernberg, ... N. N. Schulz, Women in Power (pp. 247–263). Springer.
Peer reviewed

Théate, T., & Ernst, D. (30 June 2023). Risk-Sensitive Policy with Distributional Reinforcement Learning. Algorithms, 16 (325), 16. doi:10.3390/a16070325
Peer Reviewed verified by ORBi

Ernst, D., & Fonteneau, R. (2023). Patrimoine Religieux et Transition Energétique [Paper presentation]. Journée d’étude « Le Patrimoine religieux liégeois dans tous ses états », Liège, Belgium.

Bolland, A., Louppe, G., & Ernst, D. (19 June 2023). Policy Gradient Algorithms Implicitly Optimize by Continuation [Poster presentation]. ICML Workshop on New Frontiers in Learning, Control, and Dynamical Systems, Honolulu, United States - Hawaii.
Peer reviewed

Miftari, B., Berger, M., Derval, G., & Ernst, D. (2023). Exploiting structure in MILP: a modeler’s perspective [Paper presentation]. SIAM OP23, Seattle, United States.

Mattheus, B., & Ernst, D. (2023). Le partage d’énergie au sein des copropriétés [Paper presentation]. Réunion de copropriété de l'immeuble Athéna, Liège, Belgium.

Benzerga, A., & Ernst, D. (June 2023). Hosting capacity identification and optimization for low-voltage distribution networks [Poster presentation]. DTU PES Summer School - Future Energy Systems: Advances in OR and AI, Copenhague, Denmark.

Vangulick, D., Escalona Coronel, S. J., & Ernst, D. (June 2023). Distributed ledger technology for monitoring operations carried out on the embedded generation units [Paper presentation]. 27th International Conference on Electricity Distribution, Rome, Italy.
Peer reviewed

Ernst, D. (2023). La politisation de la Boucle du Hainaut compromet l’avenir de la province, du pays et du climat. L'Echo.

Théate, T., Wehenkel, A., Bolland, A., Louppe, G., & Ernst, D. (14 May 2023). Distributional Reinforcement Learning with Unconstrained Monotonic Neural Networks. Neurocomputing, 534, 199-219. doi:10.1016/j.neucom.2023.02.049
Peer Reviewed verified by ORBi

Dachet, V., Collin, J., & Ernst, D. (2023). Remote Renewable Energy Hubs [Paper presentation]. Total Energies Town Hall, Paris, France.

Boukas, I., Burtin, E., Sutera, A., Gemine, Q., Pevee, B., & Ernst, D. (2023). Exploiting the flexibility potential of water distribution networks: A pilot project in Belgium. IEEE Transactions on Smart Grid. doi:10.1109/TSG.2023.3272469
Peer Reviewed verified by ORBi

Ernst, D. (2023). Patrimoine et transition énergétique [Paper presentation]. Patrimoine et Energie, Liège, Belgium.

Miftari, B., Derval, G., & Ernst, D. (2023). Tutorial: “An Introduction To Sizing And Operations of Energy Systems with GBOML” [Paper presentation]. 2nd International workshop on "Open Source Modeling and Simulation of Energy Systems" OSMSES 2023, Aachen, Germany.

Dachet, V., Benzerga, A., Fonteneau, R., & Ernst, D. (17 March 2023). Towards CO2 valorization in a multi remote renewable energy hub framework [Paper presentation]. Proceedings of ECOS 2023 - The 36th International Conference on Efficiency, Cost, Optimization, Simulation and Environmental Impact of Energy Systems, Las Palmas, Spain. doi:10.52202/069564-0172
Peer reviewed

Miftari, B., Derval, G., & Ernst, D. (2023). Optimal Sizing and Operations Of Energy Systems Using GBOML.

Aittahar, S., Manuel de Villena Millan, M., Derval, G., Castronovo, M., Boukas, I., Gemine, Q., & Ernst, D. (2023). Optimal Control of Renewable Energy Communities with Controllable Assets. Frontiers in Energy Research. doi:10.3389/fenrg.2023.879041
Peer Reviewed verified by ORBi

Ernst, D. (2023). Contexte d’une crise annoncée. Quelles perspectives pour l’Europe, la Belgique et ses régions ? Quelles alternatives pour les entreprises et les citoyens ? [Paper presentation]. ½ journée de formation continuée FEMARBEL “Les maisons de repos face à la crise de l’énergie”, Nivelles, Belgium.

Ernst, D. (2023). Crise énergétique : et l’après [Paper presentation]. Conférence donnée dans de multiples endroits, Belgium.

Benzerga, A., Bahmanyar, A., Ernst, D., & Mathieu, S. (2023). Smart Meter Data Analytics Case Study: Identification of LV Distribution Network Topology to Design Optimal Planning Solutions. In Neelu Nagpal, Hassan Haes Alhelou, Pierluigi Siano, Sanjeevikumar Padmanaban, ... D. Lakshmi, Applications of Big Data and Artificial Intelligence in Smart Energy Systems (pp. 161 - 192). Denmark: IEEE River Publishers.
Editorial reviewed

Dachet, V., Dubois, A., Miftari, B., Derval, G., Fonteneau, R., & Ernst, D. (2023). Remote Renewable Energy Hubs: a Taxonomy. https://orbi.uliege.be/handle/2268/309761

Vassallo, M., Benzerga, A., Bahmanyar, A., & Ernst, D. (2023). Fair Reinforcement Learning Algorithm for PV Active Control in LV Distribution Networks [Paper presentation]. ICCEP 2023 conference, Palermo, Italy. doi:10.1109/ICCEP57914.2023.10247485

Théate, T., Sutera, A., & Ernst, D. (January 2023). Matching of everyday power supply and demand with dynamic pricing: Problem formalisation and conceptual analysis. Energy Reports, 9, 2453-2462. doi:10.1016/j.egyr.2023.01.040
Peer Reviewed verified by ORBi

Derval, G., & Ernst, D. (2023). Symbolism for modelling, reformulations, and parallelism: MaxiCP-Modelling [Paper presentation]. ModRef 2023, Canada.
Peer reviewed

Dubois, A., & Ernst, D. (2023). Impacts of spatial and temporal resolutions on the near-optimal spaces of energy system optimisation models [Paper presentation]. ISGT.
Peer reviewed

Larbanois, A.* , Dachet, V.* , Dubois, A., Fonteneau, R., & Ernst, D. (2023). Ammonia, Methane, Hydrogen and Methanol Produced in Remote Renewable Energy Hubs: a Comparative Quantitative Analysis. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/310172.
* These authors have contributed equally to this work.

Fonder, M., Ernst, D., & Van Droogenbroeck, M. (01 December 2022). Parallax Inference for Robust Temporal Monocular Depth Estimation in Unstructured Environments. Sensors, 22 (23), 1-22. doi:10.3390/s22239374
Peer Reviewed verified by ORBi

Leroy, P., Jonathan Pisane, & Ernst, D. (18 November 2022). Value-based CTDE Methods in Symmetric Two-team Markov Game: from Cooperation to Team Competition [Paper presentation]. Deep Reinforcement Learning Workshop, NeurIPS.
Peer reviewed

Ernst, D., & François, R. (2022). Transition énergétique : une immense erreur se produit sous nos yeux en sous-finançant les réseaux de distribution". Trends-Tendances.

Lambrechts, G., Bolland, A., & Ernst, D. (September 2022). Belief states of POMDPs and internal states of recurrent RL agents: an empirical analysis of their mutual information [Paper presentation]. European Workshop on Reinforcement Learning, Milan, Italy.
Peer reviewed

Bouffioux, M., & Ernst, D. (2022). Damien Ernst "Le boulot de ministre de l'énergie ne me déplairait pas". Paris Match Belgique.

Lambin, C., Fettweis, X., Kittel, C., Fonder, M., & Ernst, D. (2022). Assessment of future wind speed and wind power changes over South Greenland using the MAR regional climate model. International Journal of Climatology. doi:10.1002/joc.7795
Peer Reviewed verified by ORBi

Devillers, S., & Ernst, D. (2022). Le vent du Groenland pour produire l’électricité européenne ? La Libre Belgique.

Gochel, L., & Ernst, D. (2022). Le projet de milliers d’éoliennes au Groenland de l’université de Liège validé scientifiquement. La Meuse.

Lambrechts, G., Bolland, A., & Ernst, D. (2022). Recurrent networks, hidden states and beliefs in partially observable environments. Transactions on Machine Learning Research.
Peer reviewed

Benzerga, A., Bahmanyar, A., & Ernst, D. (2022). Optimal Connection Phase Selection of Residential Distributed Energy Resources and its Impact on Aggregated Demand. In Proceedings of the 11TH BULK POWER SYSTEMS DYNAMICS AND CONTROL SYMPOSIUM (IREP 2022). IREP.
Peer reviewed

Ernst, D. (2022). Enseignement et économie : quelques points de réflexion [Paper presentation]. Parlement des animateurs du MCC. Thématique du jour : La relation entre enseignement et industrie, Bastogne, Belgium.

Benzerga, A., Gérard, S., Lachi, S., Garnier, Q., Bahmanyar, A., & Ernst, D. (2022). Optimal connection phase selection for single-phase electrical vehicle chargers. In Proceedings of the 2022 CIRED workshop on E-mobility and power distribution systems. CIRED. doi:10.1049/icp.2022.0759
Peer reviewed

Dubois, A., & Ernst, D. (2022). Computing Necessary Conditions for Near-Optimality in Capacity Expansion Planning Problems. In Electric Power Systems Research. Elsevier. doi:10.1016/j.epsr.2022.108343
Peer reviewed

Ernst, D. (2022). Active Network Management Schemes to Facilitate the Integration of Renewables and New Loads into Distribution Networks [Paper presentation]. SRBE Study Day: Power Network Digitalization Impacts on Protection, Automation and Control.

Lambin, C., Fettweis, X., Kittel, C., Fonder, M., & Ernst, D. (25 May 2022). Long term wind speed and wind power change analysis over South Greenland using the regional climate model MAR [Paper presentation]. EGU 2022.

Miftari, B., Berger, M., & Ernst, D. (2022). Graph-Based Optimization Modeling Language (GBOML) [Paper presentation]. Meeting with TotalEnergies.

Berger, M., Radu, D., & Ernst, D. (2022). On the role of resource complementarity in siting renewable power plants and its impact on power system design and economics. In J. Jurasz & A. Beluco, Complementarity of Variable Renewable Energy Sources (pp. 171-195). Academic Press. doi:10.1016/B978-0-323-85527-3.00021-2
Peer reviewed

Miftari, B.* , Berger, M.* , Djelassi, H., & Ernst, D. (2022). GBOML: Graph-Based Optimization Modeling Language. Journal of Open Source Software.
Peer Reviewed verified by ORBi
* These authors have contributed equally to this work.

Manuel De Villena, M., Aittahar, S., Mathieu, S., Boukas, I., Vermeulen, E., & Ernst, D. (2022). Financial Optimization of Renewable Energy Communities Through Optimal Allocation of Locally Generated Electricity. IEEE Access, 10, 77571 - 77586. doi:10.1109/ACCESS.2022.3191804
Peer Reviewed verified by ORBi

De Villena, M. M., Aittahar, S., Mathieu, S., Boukas, I., Vermeulen, E., & Ernst, D. (2022). Allocation of locally generated electricity in renewable energy communities. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/250878.

Merchie, F., & Ernst, D. (2022). Churn prediction in online gambling. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/266886.

Bolland, A., Boukas, I., Berger, M., & Ernst, D. (January 2022). Jointly Learning Environments and Control Policies with Projected Stochastic Gradient Ascent. Journal of Artificial Intelligence Research, 73, 117-171. doi:10.1613/JAIR.1.13350
Peer reviewed

Ernst, D. (2021). REMI - Réseaux Électriques Mondialement Interconnectés.

Ernst, D. (2021). Elements of concern regarding a total nuclear phase-out in 2025 in Belgium.

Bahmanyar, A., Ernst, D., Vanaubel, Y., Gemine, Q., Pache, C., & Panciatici, P. (03 November 2021). Extended Equal Area Criterion Revisited: a direct method for fast transient stability analysis. Energies, 14 (21). doi:10.3390/en14217259
Peer Reviewed verified by ORBi

Ernst, D. (2021). Reinforcement learning for electrical markets and the energy transition [Paper presentation]. AI Conference: 2 days dedicated to Artificial Intelligence, Paris, France.

Ernst, D. (2021). Competition models for the electrical industry and electrical markets.

Marulli, D., Mathieu, S., Benzerga, A., Sutera, A., & Ernst, D. (2021). Reconstruction of low-voltage networks with limited observability. In IEEE PES Innovative Smart Grid Technologies Conference Europe. doi:10.1109/ISGTEurope52324.2021.9640163
Peer reviewed

Counasse, X., July, B., Gil, S., Léonard, G., Orban, F., Ernst, D., & Bonhomme, V. (2021). Un projet d'usine wallonne de kérosène neutre en carbone. Belgium: Le Soir +.

Henry, R., & Ernst, D. (September 2021). GYM-ANM: Reinforcement learning environments for active network management tasks in electricity distribution systems. Energy and AI, 5. doi:10.1016/j.egyai.2021.100092
Peer Reviewed verified by ORBi

Berger, M., Radu, D.-C., Dubois, A., Pandzic, H., Dvorkin, Y., Louveaux, Q., & Ernst, D. (2021). Siting Renewable Power Generation Assets with Combinatorial Optimisation. Optimization Letters. doi:10.1007/s11590-021-01795-0
Peer Reviewed verified by ORBi

Benzerga, A., Mathieu, S., Bahmanyar, A., & Ernst, D. (2021). Probabilistic capacity assessment for three-phase low-voltage distribution networks. In Proceeding of the IEEE 15th International Conference on Compatibility, Power Electronics and Power Engineering (CPE-POWERENG). IEEE. doi:10.1109/CPE-POWERENG50821.2021.9501226
Peer reviewed

Boukas, I., Ernst, D., Théate, T., Bolland, A., Huynen, A., Buchwald, M., Wynants, C., & Cornélusse, B. (2021). A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding. Machine Learning. doi:10.1007/s10994-021-06020-8
Peer Reviewed verified by ORBi

Vecoven, N., Ernst, D., & Drion, G. (08 June 2021). A bio-inspired bistable recurrent cell allows for long-lasting memory. PLoS ONE, 16 (6), 1-13. doi:10.1371/journal.pone.0252676
Peer Reviewed verified by ORBi

Henry, R., & Ernst, D. (June 2021). Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and education. Software Impacts, 9. doi:10.1016/j.simpa.2021.100092
Peer Reviewed verified by ORBi

Benzerga, A., Maruli, D., Sutera, A., Bahmanyar, A., Mathieu, S., & Ernst, D. (2021). Low-voltage network topology and impedance identification using smart meter measurements. In Proceedings of the 2021 IEEE Madrid PowerTech. doi:10.1109/PowerTech46648.2021.9495093
Peer reviewed

Radu, D.-C., Dubois, A., Berger, M., & Ernst, D. (2021). Model Reduction in Capacity Expansion Planning Problems via Renewable Generation Site Selection. In Proceedings of the 2021 IEEE Madrid PowerTech. doi:10.1109/PowerTech46648.2021.9495027
Peer reviewed

Berger, M., Radu, D.-C., Detienne, G., Deschuyteneer, T., Richel, A., & Ernst, D. (2021). Remote Renewable Hubs for Carbon-Neutral Synthetic Fuel Production. Frontiers in Energy Research. doi:10.3389/fenrg.2021.671279
Peer Reviewed verified by ORBi

Vangulick, D., Manuel de Villena Millan, M., Fonteneau, R., & Ernst, D. (2021). Residential Energy Communities: How to minimize the investment risk from an investor perspective. In Proceedings of the CIRED 2021 Conference.
Peer reviewed

Goffin, P., El Mokhtari, Y., & Ernst, D. (2021). Le rendez-vous manqué de la Wallonie avec les communautés d’énergie renouvelable. L'Echo.

Mocanu, D. C., Mocanu, E., Pinto, T., Curci, S., Nguyen, P., Gibescu, M., Ernst, D., & Vale, Z. (2021). Sparse Training Theory for Scalable and Efficient Agents. In Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems - Blue Sky Ideas Track.
Peer reviewed

Manuel de Villena Millan, M., Aittahar, S., Gemine, Q., & Ernst, D. (2021). Algorithms for the control and sizing of renewable energy communities.

Ernst, D. (2021). Communauté d’Energie Renouvelable (CER): un bref regard sur l’état d’avancement de la législation [Paper presentation]. Atelier sur les micro-réseaux et les communautés d’énergie renouvelable de la Province de Liège, Liege, Belgium.

Ernst, D. (2021). Harvesting wind energy in Greenland: a huge step towards the building a global electrical grid [Paper presentation]. Stanford Decarbonizing the Grid Workshop: The Role of Grid Interconnection.

Manuel de Villena Millan, M., Gautier, A., Ernst, D., Glavic, M., & Fonteneau, R. (March 2021). Modelling and Assessing the Impact of the DSO Remuneration Strategy on its Interaction with Electricity Users. International Journal of Electrical Power and Energy Systems, 126 (Part A), 106585. doi:10.1016/j.ijepes.2020.106585
Peer Reviewed verified by ORBi

Leroy, P., Ernst, D., Geurts, P., Louppe, G., Pisane, J., & Sabatelli, M. (2021). QVMix and QVMix-Max: Extending the Deep Quality-Value Family of Algorithms to Cooperative Multi-Agent Reinforcement Learning. In Proceedings of the AAAI-21 Workshop on Reinforcement Learning in Games (pp. 8).
Peer reviewed

Théate, T., & Ernst, D. (2021). An Application of Deep Reinforcement Learning to Algorithmic Trading. Expert Systems with Applications, 173. doi:10.1016/j.eswa.2021.114632
Peer Reviewed verified by ORBi

Berger, M., Bolland, A., Miftari, B., Djelassi, H., & Ernst, D. (2021). Graph-Based Optimization Modeling Language: A Tutorial. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/256705.

Radu, D.-C., Berger, M., Dubois, A., Fonteneau, R., Pandzic, H., Dvorkin, Y., Louveaux, Q., & Ernst, D. (2021). Assessing the Impact of Offshore Wind Siting Strategies on the Design of the European Power System. Applied Energy, 305. doi:10.1016/j.apenergy.2021.117700
Peer Reviewed verified by ORBi

Manuel de Villena Millan, M., Jacqmin, J., Fonteneau, R., Gautier, A., & Ernst, D. (2021). Network tariffs and the integration of prosumers: the Case of Wallonia. Energy Policy, 150. doi:10.1016/j.enpol.2020.112065
Peer Reviewed verified by ORBi

Théate, T., Mathieu, S., & Ernst, D. (December 2020). An Artificial Intelligence Solution for Electricity Procurement in Forward Markets. Energies, 13 (23). doi:10.3390/en13236435
Peer Reviewed verified by ORBi

Ernst, D. (2020). AI for energy: a bright and uncertain future ahead [Paper presentation]. AI4Energy - Kickoff meeting, Belgium.

Ernst, D., Fettweis, X., Fonder, M., & Louis, J. (2020). Extreme engineering for fighting climate change and the Katabata project.

Bahmanyar, A., Abouzar, E., & Ernst, D. (October 2020). The impact of different COVID-19 containment measures on electricity consumption in Europe. Energy Research and Social Science, 68. doi:10.1016/j.erss.2020.101683
Peer Reviewed verified by ORBi

Theunis, L., & Ernst, D. (2020). Les e-fuels, des carburants dans le vent. Daily Science.

Ernst, D. (2020). Projet MeryGrid. Contrôle centralisé de communautés à énergies renouvelables avec batterie (CER) [Paper presentation]. Réunion technique du projet Merygrid 2, Liège, Belgium.

Aittahar, S., Manuel de Villena Millan, M., Ernst, D., & Gemine, Q. (2020). Ex-post allocation of electricity and real-time control strategy for renewable energy communities [Paper presentation]. 2020 International Conference on Probabilistic Methods Applied to Power Systems (PMAPS 2020), Liège, Belgium.

Mathieu, S., Ernst, D., & Gemine, Q. (2020). Short-term active distribution network operation under uncertainty. In Proceeedings of the16th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS 2020) (pp. 6).
Peer reviewed

Manuel de Villena Millan, M., Boukas, I., Mathieu, S., Ernst, D., & Vermeulen, E. (2020). A Framework to Integrate Flexibility Bids into Energy Communities to Improve Self-Consumption. In 2020 IEEE PES General Meeting. IEEE. doi:10.1109/PESGM41954.2020.9282036
Peer reviewed

Berger, M., Radu, D.-C., Ryszka, K., Ernst, D., Fonteneau, R., Detienne, G., & Deschuyteneer, T. (2020). The Role of Hydrogen in the Dutch Electricity System. https://orbi.uliege.be/handle/2268/248904

De Salle, C., & Ernst, D. (2020). Comment le système politique chinois a favorisé la pandémie. Le Point.

Berger, M., Radu, D.-C., Fonteneau, R., Deschuyteneer, T., Detienne, G., & Ernst, D. (March 2020). The Role of Power-to-Gas and Carbon Capture Technologies in Cross-Sector Decarbonisation Strategies. Electric Power Systems Research, 180. doi:10.1016/j.epsr.2019.106039
Peer Reviewed verified by ORBi

Ernst, D. (2020). La transition énergétique peut réunir tous les Belges. L'Echo.

Berger, M., Radu, D.-C., Fonteneau, R., Henry, R., Glavic, M., Fettweis, X., Le Du, M., Panciatici, P., Balea, L., & Ernst, D. (05 February 2020). Critical Time Windows for Renewable Resource Complementarity Assessment. Energy, 198. doi:10.1016/j.energy.2020.117308
Peer Reviewed verified by ORBi

Sootla, A., Stan, G.-B., & Ernst, D. (2020). Solving Optimal Control Problems for Monotone Systems Using the Koopman Operator. In A. Mauroy, I. Mezic, ... Y. Susuki, The Koopman Operator in Systems and Control (pp. 335-357). Springer. doi:10.1007/978-3-030-35713-9_11
Peer reviewed

Vecoven, N., Ernst, D., Wehenkel, A., & Drion, G. (2020). Introducing neuromodulation in deep neural networks to learn adaptive behaviours. PLoS ONE. doi:10.1371/journal.pone.0227922
Peer Reviewed verified by ORBi

Lahaye, C., & Ernst, D. (2020). Les voitures électriques bientôt majoritaires. Paris Match Belgique, p. 88-89.

Aittahar, S., Fonteneau, R., & Ernst, D. (2020). Empirical Analysis of Policy Gradient Algorithms where Starting States are Sampled accordingly to Most Frequently Visited States. IFAC-PapersOnLine, 53 (2), 8097–8104. doi:10.1016/j.ifacol.2020.12.2279
Peer Reviewed verified by ORBi

Ernst, D. (2020). Big infrastructures for fighting climate change [Paper presentation]. IPFA Europe: Brussels: Infrastructure Investments in Belgium – Focus on Brussels and Wallonia, Belgium.

Ernst, D., & Fonteneau, R. (2020). The Smart Grids lab at the University of Liège [Paper presentation]. Exchange program on renewables energies between the Walloon Parliament and US senators and deputies in the framework of the National Conference of States Legislature, Namur, Belgium.

Vecoven, N., Ernst, D., Wehenkel, A., & Drion, G. (2019). Cellular neuromodulation in artificial networks. In Proceedings of the NeurIPS 2019 Workshop Neuro AI.
Peer reviewed

Ernst, D. (2019). Nuclear: the dreaming reality.

Yu, J., Bakic, K., Kumar, A., Iliceto, A., Beleke Tabu, L., Ruaud, J. L., Fan, J., Cova, B., Li, H., Ernst, D., Fonteneau, R., Theku, M., Sanchis, G., Chamollet, M., Le Du, M., Zhang, Y., Chatzivasileiadis, S., Radu, D.-C., Berger, M., ... Ranjbar, M. (2019). Global electricity network - Feasibility study. https://orbi.uliege.be/handle/2268/239969

de Salle, C., & Ernst, D. (2019). Greta Thunberg ou l'inacessible sainteté climatique. Le Monde.

Ernst, D. (2019). Round Table No 3. Industrial Solutions for Active Network Management [Paper presentation]. CIRED 2019, Madrid, Spain.

Mathieu, S., Manuel de Villena Millan, M., Vermeulen, E., & Ernst, D. (2019). Harnessing the flexibility of energy management systems: a retailer perspective. In Proceedings PowerTech 2019. doi:10.1109/PTC.2019.8810813
Peer reviewed

Radu, D.-C., Berger, M., Fonteneau, R., Hardy, S., Fettweis, X., Le Du, M., Panciatici, P., Balea, L., & Ernst, D. (15 May 2019). Complementarity Assessment of South Greenland Katabatic Flows and West Europe Wind Regimes. Energy, 175, 393-401. doi:10.1016/j.energy.2019.03.048
Peer Reviewed verified by ORBi

Ernst, D. (2019). Eléments pour une vision techno-optimiste de l’écologie [Paper presentation]. Les enjeux climatiques et énergétiques, Liège, Belgium.

François-Lavet, V., Rabusseau, G., Pineau, J., Ernst, D., & Fonteneau, R. (May 2019). On overfitting and asymptotic bias in batch reinforcement learning with partial observability. Journal of Artificial Intelligence Research, 65, 1-30. doi:10.1613/jair.1.11478
Peer Reviewed verified by ORBi

de Salle, C., & Ernst, D. (2019). Sortir du pessimisme écologique. Réponse aux 400 ingénieurs. Le Vif. L'Express.

de Salle, C., & Ernst, D. (2019). L’écologie authentique, stade avancé de la civilisation technologique. La Libre Belgique.

Wolff, G., & Ernst, D. (2019). Damien Ernst: "La technologie sauvera la planète". La Meuse.

de Salle, C., & Ernst, D. (2019). Authentic ecology as an advanced stage of technological civilization. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/234542.

Vangulick, D., Cornélusse, B., & Ernst, D. (2019). Blockchain: A novel approach for the consensus algorithm using Condorcet Voting procedure. In Proceedings of the IEEE International Conference on Decentralized Applications and Infrastructures. doi:10.1109/DAPPCON.2019.00011
Peer reviewed

Ernst, D. (2019). Harvesting wind energy in Greenland: a project for Europe and a huge step towards the building a global electrical grid.

Ernst, D. (2019). Electric car: 697,612 km to become green! True or false? ORBi-University of Liège. https://orbi.uliege.be/handle/2268/233555.

Ernst, D. (2019). Voiture électrique : 697.612 km pour devenir verte ! Vrai ou faux ? ORBi-University of Liège. https://orbi.uliege.be/handle/2268/233554.

Manuel de Villena Millan, M., Fonteneau, R., Gautier, A., & Ernst, D. (March 2019). Evaluating the Evolution of Distribution Networks under Different Regulatory Frameworks with Multi-Agent Modelling. Energies, 12 (7), 1-15. doi:10.3390/en12071203
Peer Reviewed verified by ORBi

Manuel de Villena Millan, M., Fonteneau, R., & Ernst, D. (2019). Tariff simulator [Paper presentation]. Transition énergétique : Consommateurs et réseaux, Liège, Belgium.

Ernst, D., & Fonteneau, R. (2019). Un réseau électrique mondial et basé sur les renouvelables, ce n’est plus de la science-fiction. The Conversation.

Ernst, D., Berger, M., Fonteneau, R., & Radu, D.-C. (2019). Harnessing the Potential of Power-to-Gas Technologies. Insights from a preliminary analysis focused on Belgium.

Ernst, D. (2019). Décret favorisant le développement des communautés d’énergie renouvelable [Paper presentation]. Transition énergétique : Consommateurs et réseaux, Liège, Belgium.

Renard, H., & Ernst, D. (2019). Energiespecialist Damien Ernst: 'We hoeven helemaal niet minder energie te verbruiken'. Knack.

Petitet, M., Perrot, M., Mathieu, S., Ernst, D., & Phulpin, Y. (2019). Impact of gate closure time on the efficiency of power systems balancing. Energy Policy, 129, 562-573. doi:10.1016/j.enpol.2019.02.039
Peer Reviewed verified by ORBi

Gillman, S., & Ernst, D. (2018). Governments at COP24 should focus on building a global electricity grid – Prof. Damien Ernst. Horizon. The EU Research & Innovation Magazine.

Ernst, D. (2018). Soirée des Grands Prix SEE - A glimpse at the research work of the laureate of the Blondel Medal 2018 - Prof. Damien ERNST [Paper presentation]. Soirée des Grands Prix SEE, Paris, France.

Berger, M., Radu, D.-C., Fonteneau, R., Ernst, D., Deschuyteneer, T., & Detienne, G. (2018). Centralised Planning of National Integrated Energy System with Power-to-Gas and Gas Storages. In Proceedings of the 11th Mediterranean Conference on Power Generation, Transmission, Distribution and Energy Conversion (Medpower2018). doi:10.1049/cp.2018.1912
Peer reviewed

Vanrykel, F., Ernst, D., & Bourgeois, M. (2018). Fostering Share&Charge through proper regulation. Competition and Regulation in Network Industries. doi:10.1177/1783591718809576
Peer Reviewed verified by ORBi

Ernst, D. (2018). Reinforcement learning, energy systems and deep neural nets [Paper presentation]. PGMO Days, EDF'Lab Paris-Saclay, France.

Vanrykel, F., Ernst, D., & Bourgeois, M. (September 2018). Regulatory Challenges for Share&Charge Models. Network Industries Quarterly, 20 (3), 17-21.
Peer reviewed

Petitet, M., Perrot, M., Mathieu, S., Ernst, D., & Phulpin, Y. (2018). On the efficiency of decentralized decision-making in self-dispatch power systems. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/227744.

Scharff, C., & Ernst, D. (2018). Le projet énergétique à 100 milliards de Damien Ernst. L'Echo.

Olivier, F., Fonteneau, R., Mathieu, S., & Ernst, D. (2018). Distributed Control of Photovoltaic Units in unbalanced LV Distribution Networks to Prevent Overvoltages. In Proc. of the 6th IEEE International Conference on Smart Energy Grid Engineering (SEGE 2018). doi:10.1109/SEGE.2018.8499515
Peer reviewed

Vanrykel, F., Ernst, D., & Bourgeois, M. (22 June 2018). Fostering Share&Charge through Proper Regulation [Paper presentation]. 7th Conference on the Regulation of Infrastructures, Florence, Italy.

Ernst, D. (2018). Electricity retailing in Europe: remarkable events (with a special focus on Belgium) [Paper presentation]. ECONOMIE CIRCULAIRE: Comment créer de la valeur, réduire ses coûts et trouver des opportunités de financement ?.

Vangulick, D., Cornélusse, B., & Ernst, D. (2018). Blockchain for peer-to-peer energy exchanges: design and recommendations (additional work). In CIRED Workshop 2018 Ljubljana, Slovania.
Peer reviewed

Vangulick, D., Cornélusse, B., & Ernst, D. (2018). Blockchain for peer-to-peer energy exchanges: Probabilistic approach of Proof of Stake. In CIRED WORKSHOP 2018.
Peer reviewed

Boukas, I., Ernst, D., & Cornélusse, B. (2018). Real-Time Bidding Strategies from Micro-Grids Using Reinforcement Learning. In Proceedings of CIRED Workshop 2018.
Peer reviewed

Manuel de Villena Millan, M., Gautier, A., Fonteneau, R., & Ernst, D. (2018). A multi-agent system approach to model the interaction between distributed generation deployment and the grid. In Proc. of CIRED Workshop 2018.
Peer reviewed

Olivier, F., Fonteneau, R., & Ernst, D. (2018). Modelling of three-phase four-wire low-voltage cables taking into account the neutral connection to the earth. In Proc. of CIRED Workshop 2018.
Peer reviewed

Boukas, I., Ernst, D., Papavasiliou, A., & Cornélusse, B. (2018). Intra-day Bidding Strategies for Storage Devices Using Deep Reinforcement Learning. In International Conference on the European Energy Market, Łódź 27-29 June 2018 (pp. 6).
Peer reviewed

Olivier, F., Sutera, A., Geurts, P., Fonteneau, R., & Ernst, D. (2018). Phase Identification of Smart Meters by Clustering Voltage Measurements. In Proceedings of the XX Power Systems Computation Conference (PSCC 2018). doi:10.23919/PSCC.2018.8442853
Peer reviewed

Cornélusse, B., Ernst, D., & Lachi, S. (2018). Optimal operation and fair profit allocation in community microgrids. In Proceedings of CIRED Workshop 2018.
Peer reviewed

Vangulick, D., Cornélusse, B., & Ernst, D. (2018). Blockchain for peer-to-peer energy exchanges: design and recommendations. In Proceedings of the XX Power Systems Computation Conference (PSCC2018). doi:10.23919/PSCC.2018.8443042
Peer reviewed

Ernst, D. (2018). Reinforcement learning: a generic tool for solving  sequential decision-making problems for electrical systems [Paper presentation]. Artificial intelligence in the electrical system: Its applications, potentials and dangers, Brussels, Belgium.

Manuel de Villena Millan, M., Fonteneau, R., Gautier, A., & Ernst, D. (2018). Exploring Regulation Policies in Distribution Networks through a Multi-Agent Simulator. In Proceedings of YRS2018.
Peer reviewed

Li, J., Xiong, R., Mu, H., Cornélusse, B., Vanderbemden, P., Ernst, D., & Yuan, W. (May 2018). Design and real-time test of a hybrid energy storage system in the microgrid with the benefit of improving the battery lifetime. Applied Energy, 218, 470-478. doi:10.1016/j.apenergy.2018.01.096
Peer Reviewed verified by ORBi

Sootla, A., Mauroy, A., & Ernst, D. (May 2018). An Optimal Control Formulation of Pulse-Based Control Using Koopman Operator. Automatica, 91, 217-224. doi:10.1016/j.automatica.2018.01.036
Peer Reviewed verified by ORBi

Ernst, D. (2018). Projet de décret « GRD »: quelques remarques du Prof. Damien ERNST [Paper presentation]. Commission de l'énergie du Parlement de Wallonie, Namur, Belgium.

Sootla, A., & Ernst, D. (March 2018). Pulse-Based Control Using Koopman Operator Under Parametric Uncertainty. IEEE Transactions on Automatic Control, 63 (3), 791-796. doi:10.1109/TAC.2017.2736941
Peer Reviewed verified by ORBi

Mathieu, S., Olivier, F., Ernst, D., & Cornélusse, B. (2018). Effect of Voltage Constraints on the Exchange of Flexibility Services in Distribution Networks. In Proceedings of the 9th Conference on Innovative Smart Grid Technology North America (ISGT 2018). doi:10.1109/ISGT.2018.8403328
Peer reviewed

Ernst, D. (2017). Time to make a choice between a fully liberal or fully regulated model for the electrical industry [Paper presentation]. Regards croisés sur la transition énergétique, Louvain-la-Neuve, Belgium.

Ernst, D. (2017). Electrification and DRC [Paper presentation]. Enjeux électriques en République Démocratique du Congo, Liège, Belgium.

Ernst, D. (2017). Aire autoroutière de Hondelange: combiner le développement durable et l’opportunité économique.

Mathieu, S., Petitet, M., Perrot, M., Ernst, D., & Phulpin, Y. (2017). SiSTEM, a Model for the Simulation of Short-Term Electricity Markets. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/215614.

Manuel de Villena Millan, M., Gautier, A., Fonteneau, R., & Ernst, D. (2017). Simulation-based Assessment of the Impact of Regulatory Frameworks on the Interactions between Electricity Users and Distribution System Operator. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/215196.

Olivier, F., Marulli, D., Ernst, D., & Fonteneau, R. (2017). Foreseeing New Control Challenges in Electricity Prosumer Communities. In Proc. of the 10th Bulk Power Systems Dynamics and Control Symposium – IREP’2017.
Peer reviewed

Glavic, M., Fonteneau, R., & Ernst, D. (2017). Reinforcement Learning for Electric Power System Decision and Control: Past Considerations and Perspectives. In The 20th World Congress of the International Federation of Automatic Control, Toulouse 9-14 July 2017 (pp. 1-10). doi:10.1016/j.ifacol.2017.08.1217
Peer reviewed

Cornélusse, B., Ernst, D., Warichet, L., & Legros, W. (2017). Efficient management of a connected microgrid in Belgium. In Proceedings of the 24th International Conference on Electricity Distribution, Glasgow, 12-15 June 2017. doi:10.1049/oap-cired.2017.0211
Peer reviewed

Vangulick, D., Ernst, D., & Van Cutsem, T. (2017). Resilience of the DSO network near to 50.2Hz. In Proceedings of the 24th International Conference on Electricity Distribution. doi:10.1049/oap-cired.2017.0294
Peer reviewed

Sutera, A., Joly, A., François-Lavet, V., Qiu, Z., Ernst, D., & Geurts, P. (2017). Simple connectome inference from partial correlation statistics in calcium imaging. In J. Soriano, D. Battaglia, I. Guyon, V. Lemaire, J. Orlandi, ... B. Ray (Eds.), Neural Connectomics Challenge (pp. 23-36). Springer. doi:10.1007/978-3-319-53070-3
Peer reviewed

Vangulick, D., Cornélusse, B., Vanherck, T., Devolder, O., & Ernst, D. (2017). E-CLOUD, the open microgrid in existing network infrastructure. In Proceedings of the 24th International Conference on Electricity Distribution. doi:10.1049/oap-cired.2017.0221
Peer reviewed

Olivier, F., Ernst, D., & Fonteneau, R. (2017). Automatic phase identification of smart meter measurement data. In Proceedings of the 24th International Conference and Exhibition on Electricity Distribution, CIRED 2017. doi:10.1049/oap-cired.2017.1143
Peer reviewed

Chatzivasileiadis, S., & Ernst, D. (2017). The state of play in cross-border electricity trade and the challenges towards a global electricity market environment. In E. Ilaria & T. Cottier (Ed.), International trade in sustainable electricity (pp. 21-45). Cambridge University Press. doi:10.1017/9781316681275.003
Peer reviewed

Ernst, D. (2017). Energy: the clash of nations.

Sury, C., & Ernst, D. (2017). Questions d'argent - Damien Ernst. L'Echo.

Georges, E., Cornélusse, B., Ernst, D., Lemort, V., & Mathieu, S. (February 2017). Residential heat pump as flexible load for direct control service with parametrized duration and rebound effect. Applied Energy, 187, 140-153. doi:10.1016/j.apenergy.2016.11.012
Peer Reviewed verified by ORBi

Dubois, A., Wehenkel, A., Fonteneau, R., Olivier, F., & Ernst, D. (2017). An App-based Algorithmic Approach for Harvesting Local and Renewable Energy Using Electric Vehicles. In Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017). doi:10.5220/0006250803220327
Peer reviewed

Castronovo, M., François-Lavet, V., Fonteneau, R., Ernst, D., & Couëtoux, A. (2017). Approximate Bayes Optimal Policy Search using Neural Networks. In Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017). doi:10.5220/0006191701420153
Peer reviewed

Ernst, D. (2017). Uber-like Models for the Electrical Industry [Paper presentation]. EVENT Powerdale, Brussels, Belgium.

Scharff, C., & Ernst, D. (2017). Les batteries vont bouleverser notre quotidien. L'Echo.

Fonteneau, R., & Ernst, D. (2017). On the Dynamics of the Deployment of Renewable Energy Production Capacities. In J. N. Furze, K. Swing, A. K. Gupta, R. H. McClatchey, ... D. M. Reynolds, Mathematical Advances Towards Sustainable Environmental Systems (pp. 43-60). Springer. doi:10.1007/978-3-319-43901-3_3
Peer reviewed

Cornélusse, B., & Ernst, D. (2017). GREDOR. Outcomes and recommendations. University of Liège. https://orbi.uliege.be/handle/2268/205034

Chatzivasileiadis, S., Ernst, D., & Andersson, G. (2017). Global Power Grids for Harnessing World Renewable Energy. In L. Jones, Renewable Energy Integration (Second Edition, pp. 161-174). Academic Press. doi:10.1016/B978-0-12-809592-8.00012-3
Peer reviewed

de Faria Jr., H., Resende, M., & Ernst, D. (2017). A biased random key genetic algorithm applied to the electric distribution network reconfiguration problem. Journal of Heuristics. doi:10.1007/s10732-017-9355-8
Peer Reviewed verified by ORBi

Mathieu, S., Ernst, D., & Cornélusse, B. (2017). Agent-based analysis of dynamic access ranges to the distribution network. In Proceedings of the 6th European Innovative Smart Grid Technologies (ISGT). doi:10.1109/ISGTEurope.2016.7856191
Peer reviewed

Li, J., Cornélusse, B., Vanderbemden, P., & Ernst, D. (2017). A SC/battery Hybrid Energy Storage System in the Microgrid. Energy Procedia, 142, 3697–3702. doi:10.1016/j.egypro.2017.12.264
Peer Reviewed verified by ORBi

Godart, M.-F., Lambotte, J.-M., Bianchet, B., Maldague, H., Hendrickx, S., Copée, P., Wilmotte, P.-F., Ruelle, C., Bastin, F., Mercenier, C., Sandu, R., Vazquez Parras, J., Devillet, G., Sérusiaux, E., Teller, J., Ernst, D., Halleux, J.-M., Bottiau, V., Romain, J., ... Verelst, S. (08 December 2016). ETAT DU TERRITOIRE WALLON - PARTIE 2 : DYNAMIQUES SECTORIELLES TERRITORIALISÉES [Paper presentation]. Colloque 2016 de la CODT : Territoire(s) wallon(s) : tendances et perspectives, Mons, Belgium.

Maldague, H., Teller, J. (Ed.), & Ernst, D. (Ed.). (2016). Contribution au rapport final - Subvention 2015-2016 - Actualisation du diagnostic du Schéma de Développement Territorial wallon - Secteur Production, Transport et Stockage de l'Energie. Namur, Belgium: Conférence Permanente du Développement Territorial. https://orbi.uliege.be/handle/2268/208330

François-Lavet, V., Taralla, D., Ernst, D., & Fonteneau, R. (2016). Deep Reinforcement Learning Solutions for Energy Microgrids Management. In European Workshop on Reinforcement Learning (EWRL 2016).
Peer reviewed

Ernst, D. (2016). The Green Grid Network and Trading Renewable Energy [Paper presentation]. Green Grid Network Parliamentary Roundtable, Marrakesh, Morocco.

Ernst, D. (2016). Analyse du projet de décret relatif à la méthodologie tarifaire applicable aux gestionnaires de réseaux de distribution de gaz et d’électricité [Paper presentation]. Commission des pouvoirs locaux, du logement et de l'énergie du Parlement de Wallon.

Ernst, D., & Goka, O. (2016). Batteries and disrupting business models for the energy sector [Paper presentation]. ournée d’étude "Stockage de l’électricité : réel bouleversement ?", Liège, Belgium.

Gemine, Q., Ernst, D., & Cornélusse, B. (October 2016). Active network management for electrical distribution systems: problem formulation, benchmark, and approximate solution. Optimization and Engineering, 18 (3), 587-629. doi:10.1007/s11081-016-9339-9
Peer reviewed

Ernst, D. (2016). La transition énergétique, l’affaire de tous [Paper presentation]. Soirée de lancement de la saison 2016-2017 de Liège Créative, Liège, Belgium.

Aittahar, S., Sootla, A., & Ernst, D. (Other coll.). (19 September 2016). Policy transfer using Value Function as Prior Information [Paper presentation]. Phd Forum, Riva del Garda, Italy.

Bouffioux, M., & Ernst, D. (2016). Ces robots qui pourraient nous vouloir du mal. Paris Match, p. 70-71.

Georges, E., Cornélusse, B., Ernst, D., Louveaux, Q., Lemort, V., & Mathieu, S. (2016). Direct control service from residential heat pump aggregation with specified payback. In Proceedings of the 19th Power Systems Computation Conference (PSCC). doi:10.1109/PSCC.2016.7540835
Peer reviewed

Ernst, D. (2016). Integration of renewable energy sources and demand-side management into distribution networks [Paper presentation]. EES-UETP course on "Risk Management in Power Systems: from Theory to Practice", Porto, Portugal.

Ernst, D. (2016). Capacity mechanisms for improving security of supply: quick fixes or thoughtfully rethinking the way electricity is traded? [Paper presentation]. Conference on Capacity Remuneration Mechanisms, Brussels, Belgium.

Gemine, Q., Cornélusse, B., Glavic, M., Fonteneau, R., & Ernst, D. (2016). A Gaussian mixture approach to model stochastic processes in power systems. In Proceedings of the 19th Power Systems Computation Conference (PSCC'16). doi:10.1109/PSCC.2016.7540921
Peer reviewed

Castronovo, M., Ernst, D., Couëtoux, A., & Fonteneau, R. (2016). Benchmarking for Bayesian Reinforcement Learning. PLoS ONE. doi:10.1371/journal.pone.0157088
Peer Reviewed verified by ORBi

Ernst, D. (2016). Smart Grids versus Microgrids.

Ernst, D. (2016). The Rise of Artificial Intelligence.

López-Erauskin, R., Gyselinck, J., Olivier, F., Ernst, D., Hervás, M. E., & Fabre, A. (2016). Modelling and Emulation of an Unbalanced LV Feeder with Photovoltaic Inverters. In Proc. of 8th IEEE Benelux Young researchers symposium in Electrical Power Engineering.
Peer reviewed

Cornélusse, B., Vangulick, D., Glavic, M., & Ernst, D. (2016). Further validation and extensions of the Global Capacity ANnouncement procedure for distribution systems. In CIRED Workshop Proceedings, Helsinki 14-15 June 2016.
Peer reviewed

Ernst, D. (2016). COP21 and Electrical Systems [Paper presentation]. Accord de Paris sur le climat: quels défis pour la Belgique ?, Brussels, Belgium.

François-Lavet, V., Gemine, Q., Ernst, D., & Fonteneau, R. (2016). Towards the Minimization of the Levelized Energy Costs of Microgrids using both Long-term and Short-term Storage Devices. In Smart Grid: Networking, Data Management, and Business Models (pp. 295-319). CRC Press.
Peer reviewed

Olivier, F., Aristidou, P., Ernst, D., & Van Cutsem, T. (March 2016). Active Management of Low-Voltage Networks for Mitigating Overvoltages due to Photovoltaic Units. IEEE Transactions on Smart Grid, 2 (7), 926-936. doi:10.1109/TSG.2015.2410171
Peer Reviewed verified by ORBi

Ernst, D. (2016). TPCV versus gouvernement(s) et gestionnaires de réseaux: décodage [Paper presentation]. Assemblée générale "Touche pas à mes certificats verts", Marche-en-Famenne, Belgium.

Ernst, D., & Hermans, M. (2016). Mer ou RER : faut-il vraiment 10 milliards d'argent public pour l'éolien offshore ? Le Vif. L'Express.

Taralla, D., Qiu, Z., Sutera, A., Fonteneau, R., & Ernst, D. (2016). Decision Making from Confidence Measurement on the Reward Growth using Supervised Learning: A Study Intended for Large-Scale Video Games. In Proceedings of the 8th International Conference on Agents and Artificial Intelligence (ICAART 2016) - Volume 2 (pp. 264-271). doi:10.5220/0005666202640271
Peer reviewed

Georges, E., Cornélusse, B., Ernst, D., Lemort, V., & Mathieu, S. (26 January 2016). Residential heat pumps as flexible loads for direct control service with constrained payback [Paper presentation]. First Seminar on Demand Response, Brussels, Belgium.

Ernst, D., & Hermans, M. (2016). Israël, vainqueur involontaire des guerres islamistes. Le Vif. L'Express.

Mathieu, S., Louveaux, Q., Ernst, D., & Cornélusse, B. (2016). DSIMA: A testbed for the quantitative analysis of interaction models within distribution networks. Sustainable Energy, Grids and Networks, 5, 78 - 93. doi:10.1016/j.segan.2015.11.004
Peer Reviewed verified by ORBi

Aittahar, S., François-Lavet, V., Lodeweyckx, S., Ernst, D., & Fonteneau, R. (2015). Imitative Learning for Online Planning in Microgrids. In W. L. Woon, A. Zeyar, ... M. Stuart (Eds.), Data Analytics for Renewable Energy Integration (pp. 1-15). Springer. doi:10.1007/978-3-319-27430-0_1
Peer reviewed

François-Lavet, V., Fonteneau, R., & Ernst, D. (2015). How to Discount Deep Reinforcement Learning: Towards New Dynamic Strategies. In NIPS 2015 Workshop on Deep Reinforcement Learning.
Peer reviewed

Ernst, D. (2015). The GREDOR project. Redesigning the decision chain for managing distribution networks [Paper presentation]. Grid+Storage Workshop, Lille, France.

Ernst, D. (2015). Global Grid(s) versus Microgrids [Paper presentation]. Elia Stokeholders' Days.

Ernst, D., & Hermans, M. (2015). La Russie, ce dangereux ami pour lutter contre le djihadisme wahhabiste. Le Vif. L'Express.

Ernst, D. (2015). Smart meter: cette brique de base de notre (futur) système énergétique [Paper presentation]. Parlement wallon - commission énergie, Namur, Belgium.

Cornélusse, B., Vangulick, D., Glavic, M., & Ernst, D. (October 2015). Global capacity announcement of electrical distribution systems: A pragmatic approach. Sustainable Energy, Grids and Networks, 4, 43-53. doi:10.1016/j.segan.2015.10.001
Peer Reviewed verified by ORBi

Johnen, A., Ernst, D., & Geuzaine, C. (October 2015). Sequential decision-making approach for quadrangular mesh generation. Engineering with Computers, 31 (4), 729-735. doi:10.1007/s00366-014-0383-9
Peer Reviewed verified by ORBi

Hermans, M., & Ernst, D. (2015). Arabie saoudite et Etats-Unis: un divorce annoncé. Le Vif. L'Express.

Vandael, S., Claessens, B., Ernst, D., Holvoet, T., & Deconinck, G. (July 2015). Reinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market. IEEE Transactions on Smart Grid, 6 (4), 1795 - 1805. doi:10.1109/TSG.2015.2393059
Peer Reviewed verified by ORBi

Ernst, D. (2015). An economic case for transnational and international transmission [Paper presentation]. International Energy & Climate Forum, Lucerne, Switzerland.

Cornélusse, B., Vangulick, D., Glavic, M., & Ernst, D. (2015). A process to address electricity distribution sector challenges: the GREDOR project approach. In Proceedings of the International Conference on Electricity Distribution, CIRED 2015.
Peer reviewed

Cornélusse, B., Leroux, A., Glavic, M., & Ernst, D. (2015). Graph matching for reconciling SCADA and GIS of a distribution network. In Proceedings of the International Conference on Electricity Distribution, CIRED 2015.
Peer reviewed

Mathieu, S., Ernst, D., & Cornélusse, B. (2015). Macroscopic analysis of interaction models for the provision of flexibility in distribution systems. In Proceedings of the International Conference on Electricity Distribution, CIRED 2015.
Peer reviewed

Ernst, D. (2015). The global grid for empowering renewable energy [Paper presentation]. 2015 TEDx Liège - Moonshot Edition - Crazy Ideas that Change the World, Liège, Belgium.

Safadi, F., Fonteneau, R., & Ernst, D. (13 March 2015). Artificial Intelligence in Video Games: Towards a Unified Framework. International Journal of Computer Games Technology, 2015, 30. doi:10.1155/2015/271296
Peer Reviewed verified by ORBi

Ernst, D. (2015). The inevitable downfall of the Belgian electrical power industry?

Ernst, D., & Hermans, M. (2015). L'arme de la transition énergétique pour combattre les djihadistes. L'Echo, p. 12.

Merciadri, L., Mathieu, S., Ernst, D., & Louveaux, Q. (2015). Optimal Assignment of Off-Peak Hours to Lower Curtailments in the Distribution Network. In Proceedings of the 5th European Innovative Smart Grid Technologies (ISGT). doi:10.1109/ISGTEurope.2014.7028787
Peer reviewed

Léonard, G., François-Lavet, V., Ernst, D., Meinrenken J., C., & Lackner S., K. (2015). Electricity storage with liquid fuels in a zone powered by 100% variable renewables. In Proceedings of the 12th International Conference on the European Energy Market - EEM15. doi:10.1109/EEM.2015.7216634
Peer reviewed

Léonard, G., François-Lavet, V., Ernst, D., Meinrenken, C. J., & Lackner, K. S. (2015). Electricity storage with liquid fuels in a zone powered by 100% variable renewables [Paper presentation]. 12th International Conference on the European Energy Market - EEM 2015, Lisbon, Portugal.

Ernst, D., & Hermans, M. (2014). Le sabotage sophistiqué de Doel 4 et l’intrigant survol de centrales nucléaires par des drones: l’hypothèse pas folle d’un intérêt d’Etat ? L'Echo.

François-Lavet, V., Fonteneau, R., & Ernst, D. (2014). Using approximate dynamic programming for estimating the revenues of a hydrogen-based high-capacity storage device. IEEE Symposium Series on Computational Intelligence. doi:10.1109/ADPRL.2014.7010624
Peer reviewed

Ernst, D. (2014). Blackouts: des vérités qui dérangent.

Rivadeneira, P., Moog, C., Stan, G.-B., Brunet, C., Raffi, F., Ferré, V., Costanza, V., Mhawej, M.-J., Biafore, F., Ouattara, D., Ernst, D., Fonteneau, R., & Xia, X. (October 2014). Mathematical Modeling of HIV Dynamics After Antiretroviral Therapy Initiation: A Review. BioResearch Open Access, 3 (5), 233-241. doi:10.1089/biores.2014.0024
Peer Reviewed verified by ORBi

Moog, C., Rivadeneira, P., Stan, G.-B., Brunet, C., Raffi, F., Ferre, V., Costanza, V., Mhawej, M.-J., Ernst, D., Fonteneau, R., Biafore, F., Ouattara, D., & Xia, X. (September 2014). Mathematical modeling of HIV dynamics after antiretroviral therapy initiation: A clinical research study. AIDS Research and Human Retroviruses, 30 (9), 831-834. doi:10.1089/aid.2013.0286
Peer Reviewed verified by ORBi

Chatzivasileiadis, S., Ernst, D., & Andersson, G. (2014). Global power grids for harnessing world renewable energy. In L. Jones (Ed.), Renewable Energy Integration: Practical Management of Variability, Uncertainty and Flexibility in Power Grids (pp. 175-188). Academic Press. doi:10.1016/B978-0-12-407910-6.00014-4
Peer reviewed

Mathieu, S., Louveaux, Q., Ernst, D., & Cornélusse, B. (2014). A quantitative analysis of the effect of flexible loads on reserve markets. In Proceedings of the 18th Power Systems Computation Conference (PSCC). doi:10.1109/PSCC.2014.7038428
Peer reviewed

Gemine, Q., Ernst, D., Louveaux, Q., & Cornélusse, B. (2014). Relaxations for multi-period optimal power flow problems with discrete decision variables. In Proceedings of the 18th Power Systems Computation Conference (PSCC'14). doi:10.1109/PSCC.2014.7038396
Peer reviewed

Aristidou, P., Olivier, F., Hervas, M. E., Ernst, D., & Van Cutsem, T. (2014). Distributed Model-free Control of Photovoltaic Units for Mitigating Overvoltages in Low-Voltage Networks. In Proc. of CIRED 2014 workshop (pp. 0087).
Peer reviewed

Sutera, A., Joly, A., François-Lavet, V., Qiu, Z., Louppe, G., Ernst, D., & Geurts, P. (2014). Simple connectome inference from partial correlation statistics in calcium imaging. In J. Soriano, D. Battaglia, I. Guyon, V. Lemaire, J. Orlandi, ... B. Ray (Eds.), Neural Connectomics Challenge. Springer.
Peer reviewed

Castronovo, M., Ernst, D., & Fonteneau, R. (2014). Bayes Adaptive Reinforcement Learning versus Off-line Prior-based Policy Search: an Empirical Comparison. In Proceedings of the 23rd annual machine learning conference of Belgium and the Netherlands (BENELEARN 2014).
Peer reviewed

Gemine, Q., Ernst, D., & Cornélusse, B. (2014). Gestion active d’un réseau de distribution d’électricité : formulation du problème et benchmark. In Proceedings des 9èmes Journées Francophones de Planification, Décision et Apprentissage.
Peer reviewed

François-Lavet, V., Fonteneau, R., & Ernst, D. (2014). Estimating the revenues of a hydrogen-based high-capacity storage device: methodology and results. In Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage.
Peer reviewed

Sootla, A., Strelkowa, N., Ernst, D., Barahona, M., & Guy-Bart, S. (2014). Toggling a genetic switch using reinforcement learning. In Proceedings of the 9th French Meeting on Planning, Decision Making and Learning.
Peer reviewed

Ernst, D. (2014). Microgrids and their destructuring effects on the electrical industry.

Castronovo, M., Ernst, D., & Fonteneau, R. (2014). Apprentissage par renforcement bayésien versus recherche directe de politique hors-ligne en utilisant une distribution a priori: comparaison empirique. In Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage.
Peer reviewed

St-Pierre, D. L., Maes, F., Ernst, D., & Louveaux, Q. (March 2014). A learning procedure for sampling semantically different valid expressions. International Journal of Artificial Intelligence, 12 (1), 18-35.
Peer reviewed

Jung, T., Wehenkel, L., Ernst, D., & Maes, F. (March 2014). Optimized look-ahead tree policies: a bridge between look-ahead tree policies and direct policy search. International Journal of Adaptive Control and Signal Processing, 28 (3-5), 255-289. doi:10.1002/acs.2387
Peer Reviewed verified by ORBi

Ernst, D. (2014). L'invité - Damien Ernst - "Nous allons vers une globalisation du marché de l'électricité". La revue Wallonie, (120), p. 28-31.

Fonteneau, R., Ernst, D., Boigelot, B., & Louveaux, Q. (2014). Lipschitz robust control from off-policy trajectories. In Proceedings of the 53rd IEEE Conference on Decision and Control (IEEE CDC 2014).
Peer reviewed

Ruiz-Vega, D., Wehenkel, L., Ernst, D., Pizano-Martinez, A., & Fuerte-Esquivel, C. (2014). Power system transient stability preventive and emergency control. In S. Savulescu (Ed.), Real-Time Stability in Power Systems 2nd Edition (pp. 123-158). Springer.

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2014). Apprentissage par renforcement batch fondé sur la reconstruction de trajectoires artificielles. In Proceedings of the 9èmes Journées Francophones de Planification, Décision et Apprentissage (JFPDA 2014).
Peer reviewed

Ernst, D. (2013). The Global Grid [Paper presentation]. Conseil Economique et Social de Wallonie (CESW), Liège, Belgium.

Sootla, A., Strelkowa, N., Ernst, D., Barahona, M., & Stan, G.-B. (2013). On periodic reference tracking using batch-mode reinforcement learning with application to gene regulatory network control. In Proceedings of the 52nd Annual Conference on Decision and Control (CDC 2013) (pp. 4086-4091).
Peer reviewed

Mathieu, S., Ernst, D., & Louveaux, Q. (2013). An efficient algorithm for the provision of a day-ahead modulation service by a load aggregator. In Proceedings of the 4th European Innovative Smart Grid Technologies (ISGT). doi:10.1109/ISGTEurope.2013.6695247
Peer reviewed

Ernst, D. (2013). GREDOR.

Ernst, D. (2013). Smart conversion of residual heat into electricity: the electricity market point of view [Paper presentation]. Restwarmterecuperatie - iets voor uw bedrijf?, ArcelorMittal-Gent, Belgium.

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (September 2013). Batch mode reinforcement learning based on the synthesis of artificial trajectories. Annals of Operations Research, 208 (1), 383-416. doi:10.1007/s10479-012-1248-5
Peer Reviewed verified by ORBi

Maes, F., Lupien St-Pierre, D., & Ernst, D. (September 2013). Monte Carlo search algorithm discovery for single-player games. IEEE Transactions on Computational Intelligence and AI in Games, 5 (3), 201-213. doi:10.1109/TCIAIG.2013.2239295
Peer Reviewed verified by ORBi

Chatzivasileiadis, S., Ernst, D., & Andersson, G. (September 2013). The global grid. Renewable Energy, 57, 372-383. doi:10.1016/j.renene.2013.01.032
Peer Reviewed verified by ORBi

Ernst, D. (2013). Risque majeur de blackout : que faire ? La Libre Belgique, p. 54-55.

Ernst, D. (June 2013). Quelles perspectives pour les énergies renouvelables en Wallonie ? LiègeU, Eté 2013, 25-28.

Ernst, D. (2013). Meta-learning of exploration-exploitation strategies in reinforcement learning.

Ernst, D. (2013). Understanding active network management in 30 minutes [Paper presentation]. 9ème RENDEZ-VOUS ANNUEL DU SOLAIRE PHOTOVOLTAIQUE, Namur, Belgium.

Bubeck, S., Ernst, D., & Garivier, A. (February 2013). Optimal discovery with probabilistic expert advice: finite time analysis and macroscopic optimality. Journal of Machine Learning Research, 14, 601-623.
Peer Reviewed verified by ORBi

Ernst, D. (2013). Solving the fluctuation problems in a land with 100% of renewable energy.

Jung, T., Martin, S., Nassar, M., Ernst, D., & Leduc, G. (February 2013). Outbound SPIT Filter with Optimal Performance Guarantees. Computer Networks, 57 (7), 1630–1643. doi:10.1016/j.comnet.2013.02.013
Peer Reviewed verified by ORBi

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2013). Stratégies d'échantillonnage pour l'apprentissage par renforcement batch. Revue d'Intelligence Artificielle, 27 (2), 171-194. doi:10.3166/RIA.27.171-194
Peer Reviewed verified by ORBi

Gemine, Q., Karangelos, E., Ernst, D., & Cornélusse, B. (2013). Active network management: planning under uncertainty for exploiting load modulation. In Proceedings of the 2013 IREP Symposium - Bulk Power Systems Dynamics and Control - IX. IEEE. doi:10.1109/IREP.2013.6629406
Peer reviewed

Fonteneau, R., Ernst, D., Boigelot, B., & Louveaux, Q. (2013). Min max generalization for deterministic batch mode reinforcement learning: relaxation schemes. SIAM Journal on Control and Optimization, 51 (5), 3355–3385. doi:10.1137/120867263
Peer Reviewed verified by ORBi

Jung, T., Ernst, D., & Maes, F. (2013). Optimized Look-Ahead Trees: Extensions to Large and Continuous Action Spaces. In Proc. of IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL'13).
Peer reviewed

Defourny, B., Ernst, D., & Wehenkel, L. (2013). Scenario Trees and Policy Selection for Multistage Stochastic Programming Using Machine Learning. INFORMS Journal on Computing, 25 (3), 488-501. doi:10.1287/ijoc.1120.0516
Peer Reviewed verified by ORBi

Fonteneau, R., Ernst, D., Boigelot, B., & Louveaux, Q. (2013). Généralisation Min Max pour l'Apprentissage par Renforcement Batch et Déterministe : Relaxations pour le Cas Général T Etapes. In 8èmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA'13).
Peer reviewed

Maes, F., Wehenkel, L., & Ernst, D. (2013). Meta-learning of Exploration/Exploitation Strategies: The Multi-Armed Bandit Case. In J. Filipe & A. Fred (Eds.), Agents and Artificial Intelligence: 4th International Conference, ICAART 2012, Vilamoura, Portugal, February 6-8, 2012. Revised Selected Papers (pp. 110-115). Springer.
Peer reviewed

Jung, T., & Ernst, D. (07 December 2012). Biorthogonalization Techniques for Least Squares Temporal Difference Learning [Poster presentation]. Neural Information Processing Systems (NIPS), South Lake Tahoe, NV, United States.

Sarlette, A., Dai, J., Phulpin, Y., & Ernst, D. (December 2012). Cooperative frequency control with a multi-terminal high-voltage DC network. Automatica, 48 (12), 3128–3134. doi:10.1016/j.automatica.2012.08.017
Peer Reviewed verified by ORBi

Ernst, D. (2012). Batch mode reinforcement learning based on the synthesis of artificial trajectories.

Bubeck, S., Ernst, D., & Garivier, A. (2012). Optimal discovery with probabilistic expert advice. In Proceedings of the 51st IEEE Conference on Decision and Control (CDC 2012).
Peer reviewed

Mathieu, S., Karangelos, E., Louveaux, Q., & Ernst, D. (08 October 2012). A computationally efficient algorithm for the provision of a day-ahead modulation service by a load aggregator [Poster presentation]. DYSCO Study Day : Dynamical systems, control and optimization Kickoff of phase VII.

Maes, F., Fonteneau, R., Wehenkel, L., & Ernst, D. (2012). Policy search in a space of simple closed-form formulas: towards interpretability of reinforcement learning. In Discovery Science 15th International Conference, DS 2012, Lyon, France, October 29-31, 2012. Proceedings (pp. 37-51). Berlin, Germany: Springer. doi:10.1007/978-3-642-33492-4_6
Peer reviewed

Jung, T., Martin, S., Ernst, D., & Leduc, G. (2012). Contextual Multi-armed Bandits for the Prevention of Spam in VoIP Networks. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/115524.

Dethier, J., Ernst, D., & Sepulchre, R. (28 May 2012). Rhythms in Neuromorphic Reinforcement Learning [Poster presentation]. International Conference on Brain Dynamics and Decision Making, Ascona, Switzerland.

Fonteneau, R., Ernst, D., Boigelot, B., & Louveaux, Q. (2012). Généralisation min max pour l'apprentissage par renforcement batch et déterministe : schémas de relaxation. In Septièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2012).
Peer reviewed

Dethier, J., Ernst, D., & Sepulchre, R. (29 March 2012). Neuromorphic reinforcement learning [Paper presentation]. 31st Benelux Meeting on Systems and Control, Heijen, Netherlands.

Maes, F., Wehenkel, L., & Ernst, D. (2012). Learning to play K-armed bandit problems. In Proceedings of the 4th International Conference on Agents and Artificial Intelligence (ICAART 2012).
Peer reviewed

Dai, J., Phulpin, Y., Sarlette, A., & Ernst, D. (February 2012). Coordinated primary frequency control among non-synchronous systems connected by a multi-terminal high-voltage direct current grid. IET Generation, Transmission and Distribution, 6 (2), 99-108. doi:10.1049/iet-gtd.2011.0312
Peer Reviewed verified by ORBi

Gemine, Q., Safadi, F., Fonteneau, R., & Ernst, D. (2012). Imitative Learning for Real-Time Strategy Games. In Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (pp. 424-429).
Peer reviewed

Fonteneau, R., Ernst, D., Boigelot, B., & Louveaux, Q. (2012). Min max generalization for two-stage deterministic batch mode reinforcement learning: relaxation schemes. https://orbi.uliege.be/handle/2268/136851

Castronovo, M., Maes, F., Fonteneau, R., & Ernst, D. (2012). Learning exploration/exploitation strategies for single trajectory reinforcement learning. In Proceedings of the 10th European Workshop on Reinforcement Learning (EWRL 2012) (pp. 1-9).
Peer reviewed

Ernst, D. (2012). Multi-terminal HVDC systems and ancillary services [Paper presentation]. Franco-Taiwanese workshop on Energy Management, Tainan, Taiwan.

Perrick, P., Lupien St-Pierre, D., Maes, F., & Ernst, D. (2012). Comparison of Different Selection Strategies in Monte-Carlo Tree Search for the Game of Tron. In IEEE Conference on Computational and Intelligence in Games 2012 (pp. 242-249).
Peer reviewed

Jung, T., Martin, S., Ernst, D., & Leduc, G. (2012). SPRT for SPIT: Using the Sequential Probability Ratio Test for Spam in VoIP Prevention. In Proc. of 6th International Conference on Autonomous Infrastructure, Management and Security. Springer Berlin. doi:10.1007/978-3-642-30633-4
Peer reviewed

Jung, T., Martin, S., Ernst, D., & Leduc, G. (2012). Contextual Multi-armed Bandits for Web Server Defense. In A. Hussein (Ed.), Proceedings of 2012 International Joint Conference on Neural Networks (IJCNN) (pp. 8). IEEE. doi:10.1109/IJCNN.2012.6252760
Peer reviewed

Safadi, F., Fonteneau, R., & Ernst, D. (2011). Artificial intelligence design for real-time strategy games. In NIPS Workshop on Decision Making with Multiple Imperfect Decision Makers.
Peer reviewed

Fonteneau, R., Ernst, D., Boigelot, B., & Louveaux, Q. (2011). Relaxation schemes for min max generalization in deterministic batch mode reinforcement learning. In 4th International NIPS Workshop on Optimization for Machine Learning (OPT 2011).
Peer reviewed

Ernst, D. (2011). Learning for exploration-exploitation in RL. The dusk of the small formulas’ reign.

Phulpin, Y., & Ernst, D. (2011). Ancillary services and operation of multi-terminal HVDC grids. In Proceedings of the International Workshop on Transmission Networks for Offshore Wind Power as well as on Transmission Networks for Offshore Wind Power Farms Plants.
Peer reviewed

Phulpin, Y., Hazra, J., & Ernst, D. (2011). Model predictive control of HVDC power flow to improve transient stability in power systems. In Proceedings of the Second IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm) (pp. 611-616).
Peer reviewed

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2011). Apprentissage actif par modification de la politique de décision courante. In Sixièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2011).
Peer reviewed

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (June 2011). Estimation Monte Carlo sans modèle de politiques de décision. Revue d'Intelligence Artificielle, 25, 321-343. doi:10.3166/ria.25.321-343
Peer Reviewed verified by ORBi

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2011). Active exploration by searching for experiments that falsify the computed control policy. In Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11). doi:10.1109/ADPRL.2011.5967364
Peer reviewed

Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2011). Approximate reinforcement learning: an overview. In Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11). doi:10.1109/ADPRL.2011.5967353
Peer reviewed

Busoniu, L., Ernst, D., Babuska, R., & De Schutter, B. (February 2011). Cross-entropy optimization of control policies with adaptive basis functions. IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics, 41 (1), 196-209. doi:10.1109/TSMCB.2010.2050586
Peer Reviewed verified by ORBi

Rachelson, E., Schnitzler, F., Wehenkel, L., & Ernst, D. (2011). Optimal sample selection for batch-mode reinforcement learning. In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence (ICAART 2011).
Peer reviewed

Maes, F., Wehenkel, L., & Ernst, D. (2011). Automatic discovery of ranking formulas for playing with multi-armed bandits. In Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011).
Peer reviewed

Jing, D., Phulpin, Y., Sarlette, A., & Ernst, D. (2011). Voltage control in an HVDC system to share primary frequency reserves between non-synchronous areas. In Proceedings of the 17th Power Systems Computation Conference (PSCC-11).
Peer reviewed

Maes, F., Wehenkel, L., & Ernst, D. (2011). Optimized look-ahead tree policies. In Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011).
Peer reviewed

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2011). Towards min max generalization in reinforcement learning. In J. Filipe, A. Fred, ... B. Sharp (Eds.), Agents and Artificial Intelligence: International Conference, ICAART 2010, Valencia, Spain, January 2010, Revised Selected Papers (pp. 61-77). Springer.
Peer reviewed

Defourny, B., Ernst, D., & Wehenkel, L. (2011). Multistage stochastic programming: A scenario tree based approach to planning under uncertainty. In L. E. Sucar, E. F. Morales, ... J. Hoey (Eds.), Decision Theory Models for Applications in Artificial Intelligence: Concepts and Solutions. Hershey, United States - Pennsylvania: Information Science Publishing. doi:10.4018/978-1-60960-165-2.ch006
Peer reviewed

Ernst, D. (2010). Beyond function approximators for batch mode reinforcement learning: rebuilding trajectories [Paper presentation]. Learning and Planning from Batch Time Series Data”, NIPS 2010, Whistler, Canada.

Ernst, D. (2010). Model-free Monte Carlo-like policy evaluation [Paper presentation]. Journées MAS 201, Bordeaux, France.

Fonteneau, F., Ernst, D., Druet, C., Panciatici, P., & Wehenkel, L. (2010). Consequence driven decomposition of large-scale power system security analysis. In Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII. doi:10.1109/IREP.2010.5563285
Peer reviewed

Dai, J., Phulpin, Y., Sarlette, A., & Ernst, D. (2010). Impact of delays on a consensus-based primary frequency control scheme for AC systems connected by a multi-terminal HVDC grid. In Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII. doi:10.1109/IREP.2010.5563305
Peer reviewed

Phulpin, Y., Begovic, M., & Ernst, D. (2010). Coordination of voltage control in a power system operated by multiple transmission utilities. In Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII. doi:10.1109/IREP.2010.5563246
Peer reviewed

Ernst, D. (2010). Consequence driven decomposition of large-scale power systems security analysis [Paper presentation]. 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII, Buzios, Rio de Janeiro, Brazil.

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2010). Model-free Monte Carlo–like policy evaluation. In Proceedings of Conférence Francophone sur l'Apprentissage Automatique (CAp) 2010.
Peer reviewed

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2010). Generating informative trajectories by using bounds on the return of control policies. In Proceedings of the Workshop on Active Learning and Experimental Design 2010 (in conjunction with AISTATS 2010).
Peer reviewed

Busoniu, L., De Schutter, B., Babuska, R., & Ernst, D. (2010). Using prior knowledge to accelerate online least-squares policy iteration. In Proceedings of the 2010 IEEE International Conference on Automation, Quality and Testing, Robotics. doi:10.1109/AQTR.2010.5520917
Peer reviewed

jouini, W., Ernst, D., Moy, C., & Palicot, J. (2010). Upper confidence bound based decision making strategies and dynamic spectrum access. In Proceedings of the 2010 IEEE International Conference on Communications.
Peer reviewed

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2010). Model-free Monte Carlo-like policy evaluation. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010) (pp. 217-224).
Peer reviewed

Busoniu, L., Ernst, D., De Schutter, B., & Robert, B. (May 2010). Approximate dynamic programming with a fuzzy parameterization. Automatica, 46 (5), 804-814. doi:10.1016/j.automatica.2010.02.006
Peer Reviewed verified by ORBi

Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2010). Reinforcement Learning and Dynamic Programming using Function Approximators. CRC Press. doi:10.1201/9781439821091

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2010). A cautious approach to generalization in reinforcement learning. In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence (pp. 10).
Peer reviewed

Busoniu, L., Ernst, D., De Schutter, B., & Babuska, R. (2010). Online least-squares policy iteration for reinforcement learning control. In Proceedings of the 2010 American Control Conference (pp. 486-491). doi:10.1109/acc.2010.5530856
Peer reviewed

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2010). Computing bounds for kernel-based policy evaluation in reinforcement learning. University of Liège. https://orbi.uliege.be/handle/2268/103545

Busoniu, L., Ernst, D., Babusku, R., & De Schutter, B. (2010). Exploiting policy knowledge in online least-squares policy iteration: An empirical study. Automation, Computers, Applied Mathematics, 19 (4), 521-529.
Peer Reviewed verified by ORBi

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2010). Model-free Monte Carlo-like policy evaluation. In 29th Benelux Meeting on Systems and Control.
Peer reviewed

Fonteneau, R., & Ernst, D. (2010). Voronoi model learning for batch mode reinforcement learning. University of Liège. https://orbi.uliege.be/handle/2268/103539

Jouini, W., Ernst, D., Moy, C., & Palicot, J. (2009). Multi-armed bandit based policies for cognitive radio's decision making issues. In Proceedings of the 3rd International Conference on Signals, Circuits and Systems (SCS). doi:10.1109/ICSCS.2009.5412697
Peer reviewed

Mhawej, M.-J., Brunet-Francois, C., Fonteneau, R., Ernst, D., Ferré, V., Stan, G.-B., Raffi, F., & Moog, C. H. (July 2009). Apoptosis characterizes immunological failure of HIV infected patients. Control Engineering Practice, 17 (7), 798-804. doi:10.1016/j.conengprac.2009.01.001
Peer Reviewed verified by ORBi

Defourny, B., Ernst, D., & Wehenkel, L. (2009). Bounds for Multistage Stochastic Programs using Supervised Learning Strategies. In O. Watanabe & T. Zeugmann (Eds.), Stochastic Algorithms: Foundations and Applications (pp. 61-73). Springer. doi:10.1007/978-3-642-04944-6_6
Peer reviewed

Belmudes, F., Ernst, D., & Wehenkel, L. (2009). A rare-event approach to build security analysis tools when N-k (k > 1) analyses are needed (as they are in large-scale power systems). In Proceedings of the 2009 IEEE Bucharest PowerTech. doi:10.1109/PTC.2009.5282223
Peer reviewed

Busoniu, L., Ernst, D., De Schutter, B., & Babuska, R. (2009). Policy search with cross-entropy optimization of basis functions. In Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (pp. 153-160). doi:10.1109/ADPRL.2009.4927539
Peer reviewed

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2009). Inferring bounds on the performance of a control policy from a sample of one-step system transitions. In 28th Benelux Meeting on Systems and Control.
Peer reviewed

Fonteneau, R., Murphy, S. A., Wehenkel, L., & Ernst, D. (2009). Dynamic treatment regimes using reinforcement learning: a cautious generalization approach [Poster presentation]. Benelux Bioinformatics Conference (BBC 2009), Liège, Belgium.

Ernst, D. (2009). Lower bounds in reinforcement learning: the intelligent agent dream is getting closer [Paper presentation]. The Netherlands, Control Group, TU Delft, Netherlands.

Fonteneau, R., Murphy, S., Wehenkel, L., & Ernst, D. (2009). Inferring bounds on the performance of a control policy from a sample of trajectories. In Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (pp. 117-123). doi:10.1109/ADPRL.2009.4927534
Peer reviewed

Belmudes, F., Ernst, D., & Wehenkel, L. (2009). Pseudo-geographical representations of power system buses by multidimensional scaling. In Proceedings of the 15th International Conference on Intelligent System Applications to Power Systems (ISAP 2009). doi:10.1109/ISAP.2009.5352920
Peer reviewed

Hazra, J., Phulpin, Y., & Ernst, D. (2009). HVDC control strategies to improve transient stability in interconnected power systems. In Proceedings of the 2009 IEEE Bucharest PowerTech. doi:10.1109/PTC.2009.5281816
Peer reviewed

Phulpin, Y., Begovic, M., Petit, M., & Ernst, D. (2009). Decentralized reactive power dispatch for a time-varying multi-TSO system. In Proceedings of the 42nd Hawaii International Conference on System Sciences (HICSS-42). doi:10.1109/HICSS.2009.142
Peer reviewed

Ernst, D., Glavic, M., Capitanescu, F., & Wehenkel, L. (2009). Reinforcement learning versus model predictive control: a comparison on a power system problem. IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics, 33 (2), 517-519. doi:10.1109/TSMCB.2008.2007630
Peer Reviewed verified by ORBi

Phulpin, Y., Miroslav, B., Petit, M., Heyberger, J.-B., & Ernst, D. (2009). Evaluation of network equivalents for voltage optimization in multi-area power systems. IEEE Transactions on Power Systems, 24 (2), 729-743. doi:10.1109/TPWRS.2009.2016534
Peer Reviewed verified by ORBi

Ernst, D., Wehenkel, L., & Pavella, M. (2009). What is the likely future of real-time transient stability ? In Proceedings of the 2009 IEEE/PES Power Systems Conference & Exposition (PSCE 2009). doi:10.1109/PSCE.2009.4840101
Peer reviewed

Defourny, B., Ernst, D., & Wehenkel, L. (2009). Planning under uncertainty, ensembles of disturbance trees and kernelized discrete action spaces. In Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (pp. 145-152). doi:10.1109/ADPRL.2009.4927538
Peer reviewed

Dai, J., Phulpin, Y., Vannier, J.-C., & Ernst, D. (2009). Apprentissage par renforcement appliqué à la commande des systèmes électriques. In Proceedings of "Les Journées Electrotechnique du Futur 2009".
Peer reviewed

Phulpin, Y., Begovic, M., Petit, M., & Ernst, D. (2009). A fair method for centralized optimization of multi-TSO power systems. International Journal of Electrical Power and Energy Systems, 31, 482-488. doi:10.1016/j.ijepes.2009.03.014
Peer Reviewed verified by ORBi

Wehenkel, L., Ernst, D., Rousseaux, P., & Van Cutsem, T. (2008). Research and Education Activities in Electric Power Systems at the University of Liège. Revue E: Revue d'Electricité et d'Electronique Industrielle, (4), 54-59.
Peer reviewed

Fonteneau, R., Wehenkel, L., & Ernst, D. (2008). Variable selection for dynamic treatment regimes: a reinforcement learning approach. In The annual machine learning conference of Belgium and the Netherlands (BeNeLearn 2008).
Peer reviewed

Ernst, D. (2008). A reinforcement learning approach for designing artificial autonomous intelligent agents [Paper presentation]. EPIT 2008, Porquerolles, France.

Stan, G.-B., Belmudes, F., Fonteneau, R., Zeggwagh, F., Lefebvre, M.-A., Michelet, C., & Ernst, D. (March 2008). Modelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV-infected patient. IET Systems Biology, 2 (2), 94-102. doi:10.1049/iet-syb:20070029
Peer Reviewed verified by ORBi

Defourny, B., Ernst, D., & Wehenkel, L. (2008). Lazy planning under uncertainty by optimizing decisions on an ensemble of incomplete disturbance trees. In B. Defourny, D. Ernst, ... L. Wehenkel, Recent Advances in Reinforcement Learning (pp. 1-14). doi:10.1007/978-3-540-89722-4_1
Peer reviewed

Fonteneau, R., Wehenkel, L., & Ernst, D. (2008). Variable selection for dynamic treatment regimes: a reinforcement learning approach [Paper presentation]. European Workshop on Reinforcement Learning 2008 (EWRL'08), Villeneuve d'Ascq, France.

Belmudes, F., Ernst, D., & Wehenkel, L. (2008). Cross-entropy based rare-event simulation for the identification of dangerous events in power systems. In Proceedings of the 10th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS-08).
Peer reviewed

Busoniu, L., Ernst, D., Babuska, R., & De Schutter, B. (2008). Consistency of fuzzy model-based reinforcement learning. In Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-08) (pp. 518-524). doi:10.1109/FUZZY.2008.4630417
Peer reviewed

Jing, D., Phulpin, Y., Rious, V., & Ernst, D. (2008). How compatible is perfect competition with transmission loss allocation methods? In Proceedings of the 5th International Conference on the European Electricity Market (EEM-08). doi:10.1109/EEM.2008.4579022
Peer reviewed

Ali, M., Glavic, M., Buisson, J., Wehenkel, L., & Ernst, D. (2008). Analyzing transient instability phenomena beyond the classical stability boundary. In Proceedings of the 40th North American Power Symposium (NAPS 2008). doi:10.1109/NAPS.2008.5307390
Peer reviewed

Busoniu, L., Ernst, D., Babuska, R., & De Schutter, B. (2008). Fuzzy partition optimization for approximate fuzzy Q-iteration. In Proceedings of the 17th IFAC World Congress (IFAC-08).
Peer reviewed

Busoniu, L., Ernst, D., De Schutter, B., & Babuska, R. (2008). Continuous-state reinforcement learning with fuzzy approximation. In K. Tuyls, A. Nowé, Z. Guessoum, ... D. Kudenko (Eds.), Adaptive Agents and Multi-Agent Systems III, Adaptation and Multi-Agent Learning (pp. 27-43). doi:10.1007/978-3-540-77949-0_3
Peer reviewed

Fonteneau, R., Wehenkel, L., & Ernst, D. (2008). Variable selection for dynamic treatment regimes. In 27th Benelux Meeting on Systems and Control.
Peer reviewed

Phulpin, Y., Begovic, M., Petit, M., & Ernst, D. (2008). On the fairness of centralised decision-making strategies in multi-area power systems. In Proceedings of the 16th Power Systems Computation Conference (PSCC-08).
Peer reviewed

Defourny, B., Ernst, D., & Wehenkel, L. (2008). Risk-aware decision making and dynamic programming [Paper presentation]. NIPS-08 Workshop on Model Uncertainty and Risk in Reinforcement Learning, Whistler, Canada.

Capitanescu, F., Glavic, M., Ernst, D., & Wehenkel, L. (November 2007). Contingency filtering techniques for preventive security-constrained optimal power flow. IEEE Transactions on Power Systems, 22 (4), 1690-1697. doi:10.1109/TPWRS.2007.907528
Peer Reviewed verified by ORBi

Del Angel, A., Geurts, P., Ernst, D., Glavic, M., & Wehenkel, L. (October 2007). Estimation of rotor angles of synchronous machines using artificial neural networks and local PMU-based quantities. Neurocomputing, 70 (16-18), 2668-2678. doi:10.1016/j.neucom.2006.12.017
Peer Reviewed verified by ORBi

Capitanescu, F., Glavic, M., Ernst, D., & Wehenkel, L. (April 2007). Interior-point based algorithms for the solution of optimal power flow problems. Electric Power Systems Research, 77 (5-6), 508-517. doi:10.1016/j.epsr.2006.05.003
Peer Reviewed verified by ORBi

Busoniu, L., Ernst, D., Babuska, R., & De Schutter, B. (2007). Fuzzy approximation for convergent model-based reinforcement learning. In Proceedings of the 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-07). doi:10.1109/FUZZY.2007.4295497
Peer reviewed

Wehenkel, L., Glavic, M., & Ernst, D. (2007). A collaborative framework for multi-area dynamic security assessment of large scale systems. In Proceedings of the 2007 Power Tech (pp. 261-266). doi:10.1109/PCT.2007.4538327
Peer reviewed

Glavic, M., Ernst, D., Ruiz-Vega, D., Wehenkel, L., & Pavella, M. (2007). E-SIME- A method for transient stability closed-loop emergency control: achievements and prospects. In Proceedings of 2007 IREP Symposium - Bulk Power Systems Dynamics and Control - VII. doi:10.1109/IREP.2007.4410519
Peer reviewed

Ernst, D., Glavic, M., Stan, G.-B., Mannor, S., & Wehenkel, L. (2007). The cross-entropy method for power system combinatorial optimization problems. In Proceedings of the 2007 Power Tech (pp. 1290-1295). doi:10.1109/PCT.2007.4538502
Peer reviewed

Busoniu, L., Ernst, D., Babuska, R., & De Schutter, B. (2007). Continuous-state reinforcement learning with fuzzy approximation. In Proceedings of the 7th European Symposium on Adaptive Learning Agents and Multi-Agent Systems (ALAMAS-07) (pp. 21-35).
Peer reviewed

Ernst, D., Glavic, M., Capitanescu, F., & Wehenkel, L. (2007). Model predictive control and reinforcement learning as two complementary frameworks. International Journal of Tomography and Statistics, 6, 122-127.
Peer Reviewed verified by ORBi

Stan, G.-B., Belmudes, F., Fonteneau, R., Zeggwagh, F., Lefebvre, M.-A., Michelet, C., & Ernst, D. (2007). Modelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV infected patient [Poster presentation]. Benelux Bioinformatics Conference (BBC 2007), Leuven, Belgium.

Beck, E. V., Cherkaoui, R., Minoia, A., & Ernst, D. (2007). Nash equilibrium as the minimum of a function. Application to electricity markets with large number of actors. In Proceedings of the 2007 Power Tech (pp. 837-842). doi:10.1109/PCT.2007.4538424
Peer reviewed

Krause, T., Beck, E. V., Cherkaoui, R., Germond, A., Andersson, G., & Ernst, D. (November 2006). A comparison of Nash equilibria analysis and agent-based modelling for power markets. International Journal of Electrical Power and Energy Systems, 28 (9), 599-607. doi:10.1016/j.ijepes.2006.03.002
Peer Reviewed verified by ORBi

Ernst, D. (2006). Computing near-optimal policies from trajectories by solving a sequence of standard supervised learning problems.

Geurts, P., Ernst, D., & Wehenkel, L. (April 2006). Extremely randomized trees. Machine Learning, 63 (1), 3-42. doi:10.1007/s10994-006-6226-1
Peer Reviewed verified by ORBi

Ernst, D. (2006). Clinical data based optimal STI strategies for HIV: a reinforcement learning approach.

Minoia, A., Ernst, D., Dicorato, M., Trovato, M., & Ilic, M. (February 2006). Reference transmission network: A game theory approach. IEEE Transactions on Power Systems, 21 (1), 249-259. doi:10.1109/TPWRS.2005.861966
Peer Reviewed verified by ORBi

Wehenkel, L., Glavic, M., & Ernst, D. (2006). On multi-area security assessment of large interconnected power systems. In Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry.
Peer reviewed

Ernst, D., Marée, R., & Wehenkel, L. (2006). Reinforcement learning with raw image pixels as input state. In Advances in machine vision, image processing & pattern analysis (Lecture notes in computer science, Vol. 4153). Berlin, Germany: Springer-Verlag Berlin.
Peer reviewed

Ernst, D., Glavic, M., Capitanescu, F., & Wehenkel, L. (2006). Model predictive control and reinforcement learning as two complementary frameworks. In Proceedings of the 13th IFAC Workshop on Control Applications of Optimisation.
Peer reviewed

Wehenkel, L., Glavic, M., Geurts, P., & Ernst, D. (2006). Automatic learning of sequential decision strategies for dynamic security assessment and control. In Proceedings of the IEEE Power Engineering Society General Meeting 2006. doi:10.1109/PES.2006.1708874
Peer reviewed

Capitanescu, F., Glavic, M., Ernst, D., & Wehenkel, L. (2006). Applications of security-constrained optimal power flows. In In Proceedings of Modern Electric Power Systems Symposium, MEPS06.
Peer reviewed

Wehenkel, L., Glavic, M., Geurts, P., & Ernst, D. (2006). About automatic learning for advanced sensing, monitoring and control of electric power systems. In Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry.
Peer reviewed

Glavic, M., Wehenkel, L., & Ernst, D. (2006). Damping control by fusion of reinforcement learning and control Lyapunov functions. In Proceedings of the 38th North American Power Symposium (NAPS 2006) (pp. 361-367). doi:10.1109/NAPS.2006.359598
Peer reviewed

Wehenkel, L., Glavic, M., & Ernst, D. (2006). Multi-area security assessment: results using efficient bounding method. In Proceedings of the 38th North American Power Symposium (NAPS 2006) (pp. 511-515). doi:10.1109/NAPS.2006.359620
Peer reviewed

Ernst, D., Stan, G.-B., Gonçalves, J., & Wehenkel, L. (2006). Clinical data based optimal STI strategies for HIV: a reinforcement learning approach. In Proceedings of the 45th IEEE Conference on Decision and Control (CDC 2006) (pp. 667 - 672). doi:10.1109/CDC.2006.377527
Peer reviewed

Ernst, D., Stan, G.-B., Gonçalves, J., & Wehenkel, L. (2006). Clinical data based optimal STI strategies for HIV: a reinforcement learning approach. In Proceedings of the 15th Annual Machine Learning Conference of Belgium and The Netherlands (Benelearn 2006).
Peer reviewed

Wehenkel, L., Ernst, D., & Geurts, P. (2006). Ensembles of extremely randomized trees and some generic applications. In Proceedings of Robust Methods for Power System State Estimation and Load Forecasting.
Peer reviewed

Ernst, D. (2005). Supervised learning based sequential decision making [Paper presentation]. Optimization frameworks for industrial applications, Paris, France.

Glavic, M., Ernst, D., & Wehenkel, L. (June 2005). A reinforcement learning based discrete supplementary control for power system transient stability enhancement. International Journal of Engineering Intelligent Systems for Electrical Engineering and Communications, 13 (2 Sp. Iss. SI), 81-88.
Peer reviewed

Ernst, D., Geurts, P., & Wehenkel, L. (April 2005). Tree-based batch mode reinforcement learning. Journal of Machine Learning Research, 6, 503-556.
Peer Reviewed verified by ORBi

Glavic, M., Ernst, D., & Wehenkel, L. (February 2005). Combining a stability and a performance-oriented control in power systems. IEEE Transactions on Power Systems, 20 (1), 525-526. doi:10.1109/TPWRS.2004.841146
Peer Reviewed verified by ORBi

Wehenkel, L., Ruiz-Vega, D., Ernst, D., & Pavella, M. (2005). Preventive and emergency control of power systems. In Real Time Stability in Power Systems - Techniques for Early Detection of the Risk of Blackout (pp. 199-232). Springer Berlin.

Ernst, D., Glavic, M., Geurts, P., & Wehenkel, L. (2005). Approximate value iteration in the reinforcement learning context. Application to electrical power system control. International Journal of Emerging Electrical Power Systems, 3 (1). doi:10.2202/1553-779X.1066
Peer Reviewed verified by ORBi

Cirio, D., Lucarella, D., Vimercati, G., Massucco, S., Morini, A., Silvestro, F., Ernst, D., Pavella, M., & Wehenkel, L. (2005). Application of an advanced transient stability assessment and control method to a realistic power system. In Proceedings of the 15th Power System Computation Conference (PSCC 2005).
Peer reviewed

Wehenkel, L., Glavic, M., & Ernst, D. (2005). New developments in the application of automatic learning to power system control. In Proceedings of the 15th Power System Computation Conference (PSCC 2005).
Peer reviewed

Ernst, D. (2005). Selecting concise sets of samples for a reinforcement learning agent. In Proceedings of the 3rd International Conference on Computational Intelligence, Robotics and Autonomous Systems (CIRAS 2005).
Peer reviewed

Zima, M., & Ernst, D. (2005). On multi-area control in electric power systems. In Proceedings of the 15th Power System Computation Conference (PSCC 2005).
Peer reviewed

Krause, T., Andersson, G., Ernst, D., Vdovina-Beck, E., Cherkaoui, R., & Germond, A. (2005). A comparison of Nash equilibria analysis and agent-based modelling for power markets. In Proceedings of the 15th Power System Computation Conference (PSCC 2005).
Peer reviewed

Ernst, D., Glavic, M., & Wehenkel, L. (February 2004). Power systems stability control: Reinforcement learning framework. IEEE Transactions on Power Systems, 19 (1), 427-435. doi:10.1109/TPWRS.2003.821457
Peer Reviewed verified by ORBi

Minoia, A., Ernst, D., & Ilic, M. (2004). Market dynamics driven by the decision-making of both power producers and transmission owners. In Proceedings of the IEEE Power Engineering Society General Meeting 2004 (pp. 255-260). doi:10.1109/PES.2004.1372795
Peer reviewed

Krause, T., Andersson, G., Ernst, D., Vdovina-Beck, E., Cherkaoui, R., & Germond, A. (2004). Nash equilibria and reinforcement learning for active decision maker modelling in power markets. In Proceedings of the 6th IAEE European Conference: Modelling in Energy Economics and Policy.
Peer reviewed

Ernst, D., Minoia, A., & Marija, I. (2004). Market dynamics driven by the decision-making power producers. In Proceedings of 2004 IREP Symposium - Bulk Power System Dynamics and Control - VI.
Peer reviewed

Ernst, D. (2003). Near Optimal Closed-Loop Control. Application to Electric Power Systems [Doctoral thesis, ULiège - Université de Liège]. ORBi-University of Liège. https://orbi.uliege.be/handle/2268/13270

Ruiz-Vega, D., Glavic, M., & Ernst, D. (2003). Transient stability emergency control combining open-loop and closed-loop technique. In Proceedings of the IEEE Power Engineering Society General Meeting, 2003. doi:10.1109/PES.2003.1270929
Peer reviewed

Glavic, M., Ernst, D., & Wehenkel, L. (2003). A reinforcement learning based discrete supplementary control for power system transient stability enhancement. In Proceedings of the 12th Intelligent Systems Application to Power Systems Conference (ISAP 2003).
Peer reviewed

Ernst, D., Geurts, P., & Wehenkel, L. (2003). Iteratively extending time horizon reinforcement learning. In Machine Learning: ECML 2003, 14th European Conference on Machine Learning (pp. 96-107). Berlin, Germany: Springer-Verlag Berlin. doi:10.1007/978-3-540-39857-8_11
Peer reviewed

Ernst, D., Ruiz-Vega, D., Pavella, M., Hirsch, P., & Sobajic, D. (May 2002). Closure of "a unified approach to transient stability contingency filtering, ranking, and assessment". IEEE Transactions on Power Systems, 17 (2), 528-529. doi:10.1109/TPWRS.2002.1008374
Peer Reviewed verified by ORBi

Ernst, D., & Wehenkel, L. (2002). FACTS devices controlled by means of reinforcement learning algorithms. In Proceedings of the 14th Power Systems Computation Conference (PSCC 2002).
Peer reviewed

Ernst, D., Ruiz-Vega, D., Pavella, M., Hirsch, P., & Sobajic, D. (August 2001). A unified approach to transient stability contingency filtering, ranking and assessment. IEEE Transactions on Power Systems, 16 (3), 435-443. doi:10.1109/59.932279
Peer Reviewed verified by ORBi

Ghandhari, M., Andersson, G., Pavella, M., & Ernst, D. (2001). A control strategy for controllable series capacitor in electric power systems. Automatica, 37, 1575-1583. doi:10.1016/S0005-1098(01)00099-1
Peer Reviewed verified by ORBi

Roth, A., Ruiz-Vega, D., Ernst, D., Bulac, C., Pavella, M., & Andersson, G. (2001). An approach to modal analysis of power system angle stability. In Proceedings of IEEE Powertech 2001. doi:10.1109/PTC.2001.964728
Peer reviewed

Ernst, D. (2001). Reinforcement learning applied to power system oscillations damping. In Proceedings of the 40th Conference on Decision and Control (CDC 2001) (pp. 3043-3044). doi:10.1109/.2001.980282
Peer reviewed

Ernst, D. (2000). Preventive and emergency transient stability control [Paper presentation]. VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000), Curitiba, Brazil.

Ruiz-Vega, D., Ernst, D., Machado Ferreira, C., Pavella, M., Hirsch, P., & Sobajic, D. (2000). A contingency filtering, ranking and assessment technique for on-line transient stability studies. In Proceedings of International Conference on Electric Utility Deregulation and Restructing and Power Technologies 2000 (pp. 459-464). doi:10.1109/DRPT.2000.855708
Peer reviewed

Ruiz-Vega, D., Ernst, D., & Pavella, M. (2000). Preventive countermeasures for transient stability-constrained power systems. In Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000).
Peer reviewed

Ernst, D., & Pavella, M. (2000). Closed-loop transient stability emergency control. In Proceedings of the IEEE Power Engineering Society Winter Meeting 2000 (pp. 58-62). doi:10.1109/PESW.2000.849927
Peer reviewed

Druet, C., Ernst, D., & Wehenkel, L. (2000). Application of reinforcement learning to electrical power system closed-loop emergency control. In Principles of Data Mining and Knowledge Discovery, 4th European Conference, PKDD 2000. Heidelberg. doi:10.1007/3-540-45372-5_9
Peer reviewed

Pavella, M., Ernst, D., & Ruiz-Vega, D. (2000). Transient Stability of Power Systems: A Unified Approach to Assessment and Control. United States: Kluwer Academic Publishers.

Ernst, D., Ruiz-Vega, D., & Pavella, M. (2000). Preventive and emergency transient stability control. In Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000).
Peer reviewed

Avilas-Rosales, R., Ruiz-Vega, D., Ernst, D., & Pavella, M. (2000). On-line transient stability constrained ATC calculations. In Proceedings of the IEEE Power Engineering Society Summer Meeting 2000 - Volume 2 (pp. 1291-1296). doi:10.1109/PESS.2000.867575
Peer reviewed

Pavella, M., Ernst, D., & Ruiz-Vega, D. (October 1999). A general framework for power system transient stability control. IEEE Power Engineering Society Letters, 19 (10), 45-46.
Peer reviewed

Bettiol, A., Ruiz-Vega, D., Ernst, D., Wehenkel, L., & Pavella, M. (1999). Transient stability-constrained optimal power flow. In Proceedings of the IEEE Power Tech'99.
Peer reviewed

Ruiz-Vega, D., Bettiol, A., Ernst, D., Wehenkel, L., & Pavella, M. (1998). Transient stability-constrained generation rescheduling. In Proceedings of 1998 IREP Symposium - Bulk Power System Dynamics and Control - IV (pp. 105-115).
Peer reviewed

Ernst, D., Bettiol, A., Zhang, Y., Wehenkel, L., & Pavella, M. (1998). Compensation schemes for transient stability assessment and control. In Proceedings of LESCOPE 98 (pp. 225-230).
Peer reviewed

Ernst, D., Bettiol, A., Zhang, Y., Wehenkel, L., & Pavella, M. (1998). Real-time transient stability emergency control of the South-Southeast Brazilian system. In Proceedings of SEPOPE 1998.

Pavella, M., Wehenkel, L., Bettiol, A., & Ernst, D. (1997). An approach to real-time transient stability assessment and control. In Techniques for stability limit search - Publication IEEE : TP-138-0.
Peer reviewed

Contact ORBi