Full Text
See detailBlockchain: A novel approach for the consensus algorithm using Condorcet Voting procedure
Vangulick, David; Cornélusse, Bertrand; Ernst, Damien

in Proceedings of the IEEE International Conference on Decentralized Applications and Infrastructures (2019, April)

The blockchain technology allows interested parties to access a common register, the update, and ...

Full Text
See detailDécret favorisant le développement des communautés d’énergie renouvelable
Ernst, Damien

Speech/Talk (2019)

Full Text
See detailElectric car: 697,612 km to become green! True or false?
Ernst, Damien

E-print/Working paper (2019)

Full Text
See detailVoiture électrique : 697.612 km pour devenir verte ! Vrai ou faux ?
Ernst, Damien

E-print/Working paper (2019)

Full Text
See detailHarnessing the Potential of Power-to-Gas Technologies. Insights from a preliminary analysis focused on Belgium
Ernst, Damien; Berger, Mathias; Fonteneau, Raphaël; Radu, David-Constantin

Speech/Talk (2019)

Full Text
See detailUn réseau électrique mondial et basé sur les renouvelables, ce n’est plus de la science-fiction
Ernst, Damien; Fonteneau, Raphaël

Article for general public (2019)

Full Text
See detailOn overfitting and asymptotic bias in batch reinforcement learning with partial observability
François-Lavet, Vincent; Rabusseau, Guillaume; Pineau, Joelle; Ernst, Damien et al

E-print/Working paper (2019)

This paper provides an analysis of the tradeoff between asymptotic bias (suboptimality with ...

Full Text
See detailComplementarity Assessment of South Greenland Katabatic Flows and West Europe Wind Regimes
Radu, David-Constantin; Berger, Mathias; Fonteneau, Raphaël; Hardy, Simon et al

in Energy (2019)

Current global environmental challenges require vigorous and diverse actions in the energy sector ...

Full Text
See detailEnergiespecialist Damien Ernst: 'We hoeven helemaal niet minder energie te verbruiken'
Renard, Han; Ernst, Damien

Article for general public (2019)

Full Text
See detailIntroducing neuromodulation in deep neural networks to learn adaptive behaviours
Vecoven, Nicolas; Ernst, Damien; Wehenkel, Antoine; Drion, Guillaume

E-print/Working paper (2019)

In this paper, we propose a new deep neural network architecture, called NMD net, that has been ...

Full Text
See detailA Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding
Boukas, Ioannis; Ernst, Damien; Théate, Thibaut; Cornélusse, Bertrand

E-print/Working paper (2019)

Full Text
See detailSimulation-based Assessment of the Impact of Regulatory Frameworks on the Interactions between Electricity Users and Distribution System Operator
Manuel de Villena Millan, Miguel; Ernst, Damien; Gautier, Axel; Fonteneau, Raphaël

E-print/Working paper (2019)

This paper proposes a simulation-based methodology for evaluating the effectiveness of various ...

Full Text
See detailEvaluating the Evolution of Distribution Networks under Different Regulatory Frameworks with Multi-Agent Modelling
Manuel de Villena Millan, Miguel; Fonteneau, Raphaël; Gautier, Axel; Ernst, Damien

E-print/Working paper (2019)

In the context of increasing decentralised electricity generation, this paper evaluates the effect ...

Full Text
See detailImpact of gate closure time on the efficiency of power systems balancing
Petitet, Marie; Perrot, Marie; Mathieu, Sébastien; Ernst, Damien et al

in Energy Policy (2019), 129

This paper focuses on market design options for operational balancing management in self-dispatch ...

Full Text
See detailGovernments at COP24 should focus on building a global electricity grid – Prof. Damien Ernst
Gillman, Steve; Ernst, Damien

Article for general public (2018)

Full Text
See detailSoirée des Grands Prix SEE - A glimpse at the research work of the laureate of the Blondel Medal 2018 - Prof. Damien ERNST
Ernst, Damien

Speech/Talk (2018)

Full Text
See detailCritical Time Windows for Renewable Resource Complementarity Assessment
Berger, Mathias; Radu, David-Constantin; Fonteneau, Raphaël; Henry, Robin et al

E-print/Working paper (2018)

This paper proposes a systematic framework to assess the complementarity of renewable resources ...

Full Text
See detailCentralised Planning of National Integrated Energy System with Power-to-Gas and Gas Storages
Berger, Mathias; Radu, David-Constantin; Fonteneau, Raphaël; Ernst, Damien et al

in Proceedings of the 11th Mediterranean Conference on Power Generation, Transmission, Distribution and Energy Conversion (Medpower2018) (2018, November)

This paper proposes an optimisation-based framework to tackle long-term centralised planning ...

Full Text
See detailReinforcement learning, energy systems and deep neural nets
Ernst, Damien

Speech/Talk (2018)

Full Text
See detailFostering Share&Charge through proper regulation
Vanrykel, Fanny; Ernst, Damien; Bourgeois, Marc

in Competition and Regulation in Network Industries (2018)

This article studies the emergence of Share&Charge, a German platform that organizes the sharing of ...

Full Text
See detailOn the efficiency of decentralized decision-making in self-dispatch power systems
Petitet, Marie; Perrot, Marie; Mathieu, Sébastien; Ernst, Damien et al

E-print/Working paper (2018)

This paper focuses on market design options for operational balancing management in self-dispatch ...

Full Text
See detailRegulatory Challenges for Share&Charge Models
Vanrykel, Fanny; Ernst, Damien; Bourgeois, Marc

in Network Industries Quarterly (2018), 20(3), 17-21

The platform Share&Charge provides an innovative solution to the lack of electric vehicles charging ...

Full Text
See detailLe projet énergétique à 100 milliards de Damien Ernst
Scharff, Christine; Ernst, Damien

Article for general public (2018)

Full Text
See detailDistributed Control of Photovoltaic Units in unbalanced LV Distribution Networks to Prevent Overvoltages
Olivier, Frédéric; Fonteneau, Raphaël; Mathieu, Sébastien; Ernst, Damien

in Proc. of the 6th IEEE International Conference on Smart Energy Grid Engineering (SEGE 2018) (2018, August 12)

As more and more photovoltaic units are being installed, some LV networks have already attained ...

Full Text
See detailFostering Share&Charge through Proper Regulation
Vanrykel, Fanny; Ernst, Damien; Bourgeois, Marc

Conference (2018, June 22)

Full Text
See detailElectricity retailing in Europe: remarkable events (with a special focus on Belgium)
Ernst, Damien

Speech/Talk (2018)

Full Text
See detailBlockchain for peer-to-peer energy exchanges: design and recommendations (additional work)
Vangulick, David; Cornélusse, Bertrand; Ernst, Damien

in CIRED Workshop 2018 Ljubljana, Slovania (2018, June 07)

Energy communities and peer-to-peer energy exchanges are expected to play an important role in the ...

Full Text
See detailBlockchain for peer-to-peer energy exchanges: Probabilistic approach of Proof of Stake
Vangulick, David; Cornélusse, Bertrand; Ernst, Damien

in CIRED WORKSHOP 2018 (2018, June 07)

Energy communities and peer-to-peer energy exchanges are expected to play an important role in the ...

Full Text
See detailReal-Time Bidding Strategies from Micro-Grids Using Reinforcement Learning
Boukas, Ioannis; Ernst, Damien; Cornélusse, Bertrand

in Proceedings of CIRED Workshop 2018 (2018, June)

We address the problem faced by the operator of a microgrid participating in a continuous real-time ...

Full Text
See detailIntra-day Bidding Strategies for Storage Devices Using Deep Reinforcement Learning
Boukas, Ioannis; Ernst, Damien; Papavasiliou, Anthony; Cornélusse, Bertrand

in International Conference on the European Energy Market, Łódź 27-29 June 2018 (2018, June)

The problem faced by the operator of a storage device participating in a continuous intra-day (CID ...

Full Text
See detailOptimal operation and fair profit allocation in community microgrids
Cornélusse, Bertrand; Ernst, Damien; Lachi, Simon

in Proceedings of CIRED Workshop 2018 (2018, June)

This work fits in the context of community migrogrids, where entities of a community can exchange ...

Full Text
See detailA multi-agent system approach to model the interaction between distributed generation deployment and the grid
Manuel de Villena Millan, Miguel; Gautier, Axel; Fonteneau, Raphaël; Ernst, Damien

in Proc. of CIRED Workshop 2018 (2018, June)

This paper introduces a multi-agent dynamical system of the interaction between electricity ...

Full Text
See detailModelling of three-phase four-wire low-voltage cables taking into account the neutral connection to the earth
Olivier, Frédéric; Fonteneau, Raphaël; Ernst, Damien

in Proc. of CIRED Workshop 2018 (2018, June)

Local energy communities (LECs) usually occur at the level of low-voltage distribution networks ...

Full Text
See detailPhase Identification of Smart Meters by Clustering Voltage Measurements
Olivier, Frédéric; Sutera, Antonio; Geurts, Pierre; Fonteneau, Raphaël et al

in Proceedings of the XX Power Systems Computation Conference (PSCC 2018) (2018, June)

When a smart meter, be it single-phase or threephase, is connected to a three-phase network, the ...

Full Text
See detailBlockchain for peer-to-peer energy exchanges: design and recommendations
Vangulick, David; Cornélusse, Bertrand; Ernst, Damien

in Proceedings of the XX Power Systems Computation Conference (PSCC2018) (2018, June)

Energy communities and peer-to-peer energy exchanges are expected to play an important role in the ...

Full Text
See detailReinforcement learning: a generic tool for solving  sequential decision-making problems for electrical systems
Ernst, Damien

Speech/Talk (2018)

Full Text
See detailDesign and real-time test of a hybrid energy storage system in the microgrid with the benefit of improving the battery lifetime
Li, Jianwei; Xiong, Riu; Mu, Hao; Cornélusse, Bertrand et al

in Applied Energy (2018), 218

This study proposes a hybrid energy storage system (HESS) composed of the superconducting energy ...

Full Text
See detailExploring Regulation Policies in Distribution Networks through a Multi-Agent Simulator
Manuel de Villena Millan, Miguel; Fonteneau, Raphaël; Gautier, Axel; Ernst, Damien

in Proc. of YRS2018 (2018, May)

This paper presents a multi-agent simulator that describes the interactions between the agents of a ...

Full Text
See detailAn Optimal Control Formulation of Pulse-Based Control Using Koopman Operator
Sootla, Aivar; Mauroy, Alexandre; Ernst, Damien

in Automatica (2018), 91

In many applications, and in systems/synthetic biology in particular, it is desirable to compute ...

Full Text
See detailProjet de décret « GRD »: quelques remarques du Prof. Damien ERNST
Ernst, Damien

Speech/Talk (2018)

Full Text
See detailPulse-Based Control Using Koopman Operator Under Parametric Uncertainty
Sootla, Aivar; Ernst, Damien

in IEEE Transactions on Automatic Control (2018), 63(3), 791-796

In applications, such as biomedicine and systems/synthetic biology, technical limitations in ...

Full Text
See detailEffect of Voltage Constraints on the Exchange of Flexibility Services in Distribution Networks
Mathieu, Sébastien; Olivier, Frédéric; Ernst, Damien; Cornélusse, Bertrand

in Proceedings of the 9th Conference on Innovative Smart Grid Technology North America (ISGT 2018) (2018, February)

Many possibilities exist to organise exchanges of flexibility within a distribution system. In this ...

Full Text
See detailTime to make a choice between a fully liberal or fully regulated model for the electrical industry
Ernst, Damien

Speech/Talk (2017)

Full Text
See detailElectrification and DRC
Ernst, Damien

Speech/Talk (2017)

Full Text
See detailAire autoroutière de Hondelange: combiner le développement durable et l’opportunité économique
Ernst, Damien

Speech/Talk (2017)

Full Text
See detailSiSTEM, a Model for the Simulation of Short-Term Electricity Markets
Mathieu, Sébastien; Petitet, Marie; Perrot, Marie; Ernst, Damien et al

E-print/Working paper (2017)

The aim of this document is to present SiSTEM, a multi-level simulation model of European short ...

Full Text
See detailA Simulator to Explore Tarification Designs for Distribution Networks
Manuel de Villena Millan, Miguel; Gautier, Axel; Fonteneau, Raphaël; Ernst, Damien

E-print/Working paper (2017)

This paper introduces a computational tool to help assess the impact of regulation policies within ...

Full Text
See detailForeseeing New Control Challenges in Electricity Prosumer Communities
Olivier, Frédéric; Marulli, Daniele; Ernst, Damien; Fonteneau, Raphaël

in Proc. of the 10th Bulk Power Systems Dynamics and Control Symposium – IREP’2017 (2017, August)

This paper is dedicated to electricity prosumer communities, which are groups of people producing ...

Full Text
See detailReinforcement Learning for Electric Power System Decision and Control: Past Considerations and Perspectives
Glavic, Mevludin; Fonteneau, Raphaël; Ernst, Damien

in The 20th World Congress of the International Federation of Automatic Control, Toulouse 9-14 July 2017 (2017, July)

In this paper, we review past (including very recent) research considerations in using ...

Full Text
See detailThe state of play in cross-border electricity trade and the challenges towards a global electricity market environment
Chatzivasileiadis, Spyros; Ernst, Damien

in Ilaria, Espa; Cottier, Thomas (Eds.) International trade in sustainable electricity (2017)

Full Text
See detailEfficient management of a connected microgrid in Belgium
Cornélusse, Bertrand; Ernst, Damien; Warichet, Luc; Legros, Willy

in Proceedings of the 24th International Conference on Electricity Distribution, Glasgow, 12-15 June 2017 (2017, June)

Full Text
See detailAutomatic phase identification of smart meter measurement data
Olivier, Frédéric; Ernst, Damien; Fonteneau, Raphaël

in Proceedings of the 24th International Conference and Exhibition on Electricity Distribution, CIRED 2017 (2017, June)

This paper highlights the importance of the knowledge of the phase identification for the different ...

Full Text
See detailSimple connectome inference from partial correlation statistics in calcium imaging
Sutera, Antonio; Joly, Arnaud; François-Lavet, Vincent; Qiu, Zixiao et al

in Soriano, Jordi; Battaglia, Demian; Guyon, Isabelle; Lemaire, Vincent (Eds.) et al Neural Connectomics Challenge (2017)

In this work, we propose a simple yet effective solution to the problem of connectome inference in ...

Full Text
See detailE-CLOUD, the open microgrid in existing network infrastructure
Vangulick, David; Cornélusse, Bertrand; Vanherck, Thierry; Devolder, Olivier et al

in Proceedings of the 24th International Conference on Electricity Distribution (2017, June)

The main goal of the E-Cloud, as with every microgrid, is to maximize the consumption of energy ...

Full Text
See detailResilience of the DSO network near to 50.2Hz
Vangulick, David; Ernst, Damien; Van Cutsem, Thierry

in Proceedings of the 24th International Conference on Electricity Distribution (2017, June)

In an electrical system where decentralized and embedded productions are becoming more and more ...

Full Text
See detailEnergy: the clash of nations
Ernst, Damien

Speech/Talk (2017)

Le monde de l'énergie est en guerre. C'est une guerre qui est menée sur de nombreux fronts, du ...

Full Text
See detailQuestions d'argent - Damien Ernst
Sury, Caroline; Ernst, Damien

Article for general public (2017)

Full Text
See detailApproximate Bayes Optimal Policy Search using Neural Networks
Castronovo, Michaël; François-Lavet, Vincent; Fonteneau, Raphaël; Ernst, Damien et al

in Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017) (2017, February)

Bayesian Reinforcement Learning (BRL) agents aim to maximise the expected collected rewards ...

Full Text
See detailAn App-based Algorithmic Approach for Harvesting Local and Renewable Energy Using Electric Vehicles
Dubois, Antoine; Wehenkel, Antoine; Fonteneau, Raphaël; Olivier, Frédéric et al

in Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017) (2017, February)

The emergence of electric vehicles (EVs), combined with the rise of renewable energy production ...

Full Text
See detailResidential heat pump as flexible load for direct control service with parametrized duration and rebound effect
Georges, Emeline; Cornélusse, Bertrand; Ernst, Damien; Lemort, Vincent et al

in Applied Energy (2017), 187

This paper addresses the problem of an aggregator controlling residential heat pumps to offer a ...

Full Text
See detailUber-like Models for the Electrical Industry
Ernst, Damien

Speech/Talk (2017)

Full Text
See detailLes batteries vont bouleverser notre quotidien
Scharff, Christine; Ernst, Damien

Article for general public (2017)

Full Text
See detailGREDOR. Outcomes and recommendations
Cornélusse, Bertrand; Ernst, Damien

Report (2017)

Full Text
See detailA biased random key genetic algorithm applied to the electric distribution network reconfiguration problem
de Faria Jr., Haroldo; Resende, Mauricio; Ernst, Damien

in Journal of Heuristics (2017)

This work presents a biased random-key genetic algorithm (BRKGA) to solve the electric distribution ...

Full Text
See detailOn the Dynamics of the Deployment of Renewable Energy Production Capacities
Fonteneau, Raphaël; Ernst, Damien

in Furze, James N.; Swing, Kelly; Gupta, Anil K.; McClatchey, Richard H. (Eds.) et al Mathematical Advances Towards Sustainable Environmental Systems (2017)

This chapter falls within the context of modeling the deployment of renewable en-ergy production ...

Full Text
See detailA SC/battery Hybrid Energy Storage System in the Microgrid
Li, Jianwei; Cornélusse, Bertrand; Vanderbemden, Philippe; Ernst, Damien

in Energy Procedia (2017), 142

The major challenges in power systems are driven by the energy shortage and environmental concerns ...

Full Text
See detailAgent-based analysis of dynamic access ranges to the distribution network
Mathieu, Sébastien; Ernst, Damien; Cornélusse, Bertrand

in Proceedings of the 6th European Innovative Smart Grid Technologies (ISGT) (2017)

There is a need to clearly state an interaction model that formalizes interactions between actors ...

Full Text
See detailDeep Reinforcement Learning Solutions for Energy Microgrids Management
François-Lavet, Vincent; Taralla, David; Ernst, Damien; Fonteneau, Raphaël

in European Workshop on Reinforcement Learning (EWRL 2016) (2016, December)

This paper addresses the problem of efficiently operating the storage devices in an electricity ...

Full Text
See detailContribution au rapport final - Subvention 2015-2016 - Actualisation du diagnostic du Schéma de Développement Territorial wallon - Secteur Production, Transport et Stockage de l'Energie
Maldague, Hubert; Teller, Jacques; Ernst, Damien

Report (2016)

Full Text
See detailThe Green Grid Network and Trading Renewable Energy
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailAnalyse du projet de décret relatif à la méthodologie tarifaire applicable aux gestionnaires de réseaux de distribution de gaz et d’électricité
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailBatteries and disrupting business models for the energy sector
Ernst, Damien; Goka, Olivier

Speech/Talk (2016)

Full Text
See detailLa transition énergétique, l’affaire de tous
Ernst, Damien

Speech/Talk (2016)

Conférence d'ouverture donnée par le Prof . Ernst lors de la soirée de lancement de la saison 2016 ...

Full Text
See detailActive network management for electrical distribution systems: problem formulation, benchmark, and approximate solution
Gemine, Quentin; Ernst, Damien; Cornélusse, Bertrand

in Optimization and Engineering (2016), 18(3), 587-629

With the increasing share of renewable and distributed generation in electrical distribution ...

Full Text
See detailPolicy transfer using Value Function as Prior Information
Aittahar, Samy; Sootla, Aivar; Ernst, Damien

Conference (2016, September 19)

This work proposes an approach based on reward shaping techniques in a reinforcement learning ...

Full Text
See detailCes robots qui pourraient nous vouloir du mal...
Bouffioux, Michel; Ernst, Damien

Article for general public (2016)

Full Text
See detailBenchmarking for Bayesian Reinforcement Learning
Castronovo, Michaël; Ernst, Damien; Couëtoux, Adrien; Fonteneau, Raphaël

in PLoS ONE (2016)

In the Bayesian Reinforcement Learning (BRL) setting, agents try to maximise the col- lected ...

Full Text
See detailCapacity mechanisms for improving security of supply: quick fixes or thoughtfully rethinking the way electricity is traded?
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailIntegration of renewable energy sources and demand-side management into distribution networks
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailA Gaussian mixture approach to model stochastic processes in power systems
Gemine, Quentin; Cornélusse, Bertrand; Glavic, Mevludin; Fonteneau, Raphaël et al

in Proceedings of the 19th Power Systems Computation Conference (PSCC'16) (2016, June)

Probabilistic methods are emerging for operating electrical networks, driven by the integration of ...

Full Text
See detailDirect control service from residential heat pump aggregation with specified payback
Georges, Emeline; Cornélusse, Bertrand; Ernst, Damien; Louveaux, Quentin et al

in Proceedings of the 19th Power Systems Computation Conference (PSCC) (2016, June)

This paper addresses the problem of an aggregator controlling residential heat pumps to offer a ...

Full Text
See detailFurther validation and extensions of the Global Capacity ANnouncement procedure for distribution systems
Cornélusse, Bertrand; Vangulick, David; Glavic, Mevludin; Ernst, Damien

in CIRED Workshop Proceedings, Helsinki 14-15 June 2016 (2016, May)

This paper extends the Global Capacity ANnouncement procedure proposed in [5] along two directions ...

Full Text
See detailThe Rise of Artificial Intelligence
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailSmart Grids versus Microgrids
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailModelling and Emulation of an Unbalanced LV Feeder with Photovoltaic Inverters
López-Erauskin, Ramón; Gyselinck, Johan; Olivier, Frédéric; Ernst, Damien et al

in Proc. of 8th IEEE Benelux Young researchers symposium in Electrical Power Engineering (2016, May)

In this paper, the penetration of grid-connected pho- tovoltaic systems is studied, experimentally ...

Full Text
See detailCOP21 and Electrical Systems
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailTowards the Minimization of the Levelized Energy Costs of Microgrids using both Long-term and Short-term Storage Devices
François-Lavet, Vincent; Gemine, Quentin; Ernst, Damien; Fonteneau, Raphaël

in Smart Grid: Networking, Data Management, and Business Models (2016)

This chapter falls within the context of the optimization of the levelized energy cost (LEC) of ...

Full Text
See detailTPCV versus gouvernement(s) et gestionnaires de réseaux: décodage
Ernst, Damien

Speech/Talk (2016)

Full Text
See detailActive Management of Low-Voltage Networks for Mitigating Overvoltages due to Photovoltaic Units
Olivier, Frédéric; Aristidou, Petros; Ernst, Damien; Van Cutsem, Thierry

in IEEE Transactions on Smart Grid (2016), 2(7), 926-936

In this paper, the overvoltage problems that might arise from the integration of photovoltaic ...

Full Text
See detailMer ou RER : faut-il vraiment 10 milliards d'argent public pour l'éolien offshore ?
Ernst, Damien; Hermans, Michel

Article for general public (2016)

Full Text
See detailDecision Making from Confidence Measurement on the Reward Growth using Supervised Learning: A Study Intended for Large-Scale Video Games
Taralla, David; Qiu, Zixiao; Sutera, Antonio; Fonteneau, Raphaël et al

in Proceedings of the 8th International Conference on Agents and Artificial Intelligence (ICAART 2016) - Volume 2 (2016, February)

Video games have become more and more complex over the past decades. Today, players wander in ...

Full Text
See detailResidential heat pumps as flexible loads for direct control service with constrained payback
Georges, Emeline; Cornélusse, Bertrand; Ernst, Damien; Lemort, Vincent et al

Conference (2016, January 26)

This paper addresses the problem of an aggregator controlling residential heat pumps to offer a ...

Full Text
See detailIsraël, vainqueur involontaire des guerres islamistes
Ernst, Damien; Hermans, Michel

Article for general public (2016)

Full Text
See detailDSIMA: A testbed for the quantitative analysis of interaction models within distribution networks
Mathieu, Sébastien; Louveaux, Quentin; Ernst, Damien; Cornélusse, Bertrand

in Sustainable Energy, Grids and Networks (2016), 5

This article proposes an open-source testbed to simulate interaction models governing the exchange ...

Full Text
See detailImitative Learning for Online Planning in Microgrids
Aittahar, Samy; François-Lavet, Vincent; Lodeweyckx, Stefan; Ernst, Damien et al

in Woon, Wei Lee; Zeyar, Aung; Stuart, Madnick (Eds.) Data Analytics for Renewable Energy Integration (2015, December 15)

This paper aims to design an algorithm dedicated to operational planning for microgrids in the ...

Full Text
See detailHow to Discount Deep Reinforcement Learning: Towards New Dynamic Strategies
François-Lavet, Vincent; Fonteneau, Raphaël; Ernst, Damien

in NIPS 2015 Workshop on Deep Reinforcement Learning (2015, December)

Using deep neural nets as function approximator for reinforcement learning tasks have recently been ...

Full Text
See detailThe GREDOR project. Redesigning the decision chain for managing distribution networks
Ernst, Damien

Speech/Talk (2015)

Full Text
See detailGlobal Grid(s) versus Microgrids
Ernst, Damien

Speech/Talk (2015)

Full Text
See detailLa Russie, ce dangereux ami pour lutter contre le djihadisme wahhabiste
Ernst, Damien; Hermans, Michel

Article for general public (2015)

Full Text
See detailSmart meter: cette brique de base de notre (futur) système énergétique
Ernst, Damien

Speech/Talk (2015)

Full Text
See detailGlobal capacity announcement of electrical distribution systems: A pragmatic approach
Cornélusse, Bertrand; Vangulick, David; Glavic, Mevludin; Ernst, Damien

in Sustainable Energy, Grids and Networks (2015), 4

We propose a pragmatic procedure to facilitate the connection process of Distributed Generation (DG ...

Full Text
See detailSequential decision-making approach for quadrangular mesh generation
Johnen, Amaury; Ernst, Damien; Geuzaine, Christophe

in Engineering with Computers (2015), 31(4), 729-735

A new indirect quadrangular mesh generation algorithm which relies on sequential decision-making ...

Full Text
See detailArabie saoudite et Etats-Unis: un divorce annoncé
Hermans, Michel; Ernst, Damien

Article for general public (2015)

Full Text
See detailReinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market
Vandael, Stijn; Claessens, Bert; Ernst, Damien; Holvoet, Tom et al

in IEEE Transactions on Smart Grid (2015), 6(4), 1795-1805

This paper addresses the problem of defining a day-ahead consumption plan for charging a fleet of ...

Full Text
See detailAn economic case for transnational and international transmission
Ernst, Damien

Speech/Talk (2015)

Full Text
See detailGraph matching for reconciling SCADA and GIS of a distribution network
Cornélusse, Bertrand; Leroux, Amandine; Glavic, Mevludin; Ernst, Damien

in Proceedings of the International Conference on Electricity Distribution, CIRED 2015 (2015, June)

This article deals with the problem of automatically es- tablishing a correspondence between two ...

Full Text
See detailA process to address electricity distribution sector challenges: the GREDOR project approach
Cornélusse, Bertrand; Vangulick, David; Glavic, Mevludin; Ernst, Damien

in Proceedings of the International Conference on Electricity Distribution, CIRED 2015 (2015, June)

This paper presents a general process set in the GREDOR (French acronym for “Gestion des Réseaux ...

Full Text
See detailMacroscopic analysis of interaction models for the provision of flexibility in distribution systems
Mathieu, Sébastien; Ernst, Damien; Cornélusse, Bertrand

in Proceedings of the International Conference on Electricity Distribution, CIRED 2015 (2015, June)

To ease the transition towards the future of distribution grid management, regulators must revise ...

Full Text
See detailThe global grid for empowering renewable energy
Ernst, Damien

Speech/Talk (2015)

Full Text
See detailArtificial Intelligence in Video Games: Towards a Unified Framework
Safadi, Firas; Fonteneau, Raphaël; Ernst, Damien

in International Journal of Computer Games Technology (2015), 2015

With modern video games frequently featuring sophisticated and realistic environments, the need for ...

Full Text
See detailThe inevitable downfall of the Belgian electrical power industry?
Ernst, Damien

Speech/Talk (2015)

Full Text
See detailL'arme de la transition énergétique pour combattre les djihadistes
Ernst, Damien; Hermans, Michel

Article for general public (2015)

Full Text
See detailElectricity storage with liquid fuels in a zone powered by 100% variable renewables
Léonard, Grégoire; François-Lavet, Vincent; Ernst, Damien; Meinrenken, Christoph J et al

Conference (2015)

Full Text
See detailElectricity storage with liquid fuels in a zone powered by 100% variable renewables
Léonard, Grégoire; François-Lavet, Vincent; Ernst, Damien; Meinrenken J., Christoph et al

in Proceedings of the 12th International Conference on the European Energy Market - EEM15 (2015)

In this work, an electricity zone with 100% renewables is simulated to determine the optimal sizing ...

Full Text
See detailOptimal Assignment of Off-Peak Hours to Lower Curtailments in the Distribution Network
Merciadri, Luca; Mathieu, Sébastien; Ernst, Damien; Louveaux, Quentin

in Proceedings of the 5th European Innovative Smart Grid Technologies (ISGT) (2015)

We consider a price signal with two settings: off-peak tariff and on-peak tariff. Some loads are ...

Full Text
See detailLe sabotage sophistiqué de Doel 4 et l’intrigant survol de centrales nucléaires par des drones: l’hypothèse pas folle d’un intérêt d’Etat ?
Ernst, Damien; Hermans, Michel

Article for general public (2014)

Full Text
See detailUsing approximate dynamic programming for estimating the revenues of a hydrogen-based high-capacity storage device
François-Lavet, Vincent; Fonteneau, Raphaël; Ernst, Damien

in IEEE Symposium Series on Computational Intelligence (2014)

This paper proposes a methodology to estimate the maximum revenue that can be generated by a ...

Full Text
See detailBlackouts: des vérités qui dérangent
Ernst, Damien

Speech/Talk (2014)

Full Text
See detailMathematical Modeling of HIV Dynamics After Antiretroviral Therapy Initiation: A Review
Rivadeneira, Pablo; Moog, Claude; Stan, Guy-Bart; Brunet, Cécile et al

in BioResearch Open Access (2014), 3(5), 233-241

This review shows the potential ground-breaking impact that mathematical tools may have in the ...

Full Text
See detailMathematical modeling of HIV dynamics after antiretroviral therapy initiation: A clinical research study
Moog, Claude; Rivadeneira, Pablo; Stan, Guy-Bart; Brunet, Cécile et al

in AIDS Research and Human Retroviruses (2014), 30(9), 831-834

Immunological failure is identified from the estimation of certain parameters of a mathematical ...

Full Text
See detailGlobal power grids for harnessing world renewable energy
Chatzivasileiadis, Spyros; Ernst, Damien; Andersson, Göran

in Jones, Lawrence (Ed.) Renewable Energy Integration: Practical Management of Variability, Uncertainty and Flexibility in Power Grids (2014)

The Global Grid advocates the connection of all regional power systems into one electricity ...

Full Text
See detailRelaxations for multi-period optimal power flow problems with discrete decision variables
Gemine, Quentin; Ernst, Damien; Louveaux, Quentin; Cornélusse, Bertrand

in Proceedings of the 18th Power Systems Computation Conference (PSCC'14) (2014, August)

We consider a class of optimal power flow (OPF) applications where some loads offer a modulation ...

Full Text
See detailA quantitative analysis of the effect of flexible loads on reserve markets
Mathieu, Sébastien; Louveaux, Quentin; Ernst, Damien; Cornélusse, Bertrand

in Proceedings of the 18th Power Systems Computation Conference (PSCC) (2014, August)

We propose and analyze a day-ahead reserve market model that handles bids from flexible loads. This ...

Full Text
See detailDistributed Model-free Control of Photovoltaic Units for Mitigating Overvoltages in Low-Voltage Networks
Aristidou, Petros; Olivier, Frédéric; Hervas, Maria Emilia; Ernst, Damien et al

in Proc. of CIRED 2014 workshop (2014, June)

In this paper, a distributed model-free control scheme to mitigate overvoltage problems caused by ...

Full Text
See detailBayes Adaptive Reinforcement Learning versus Off-line Prior-based Policy Search: an Empirical Comparison
Castronovo, Michaël; Ernst, Damien; Fonteneau, Raphaël

in Proceedings of the 23rd annual machine learning conference of Belgium and the Netherlands (BENELEARN 2014) (2014, June)

This paper addresses the problem of decision making in unknown finite Markov decision processes ...

Full Text
See detailSimple connectome inference from partial correlation statistics in calcium imaging
Sutera, Antonio; Joly, Arnaud; François-Lavet, Vincent; Qiu, Zixiao et al

in Soriano, Jordi; Battaglia, Demian; Guyon, Isabelle; Lemaire, Vincent (Eds.) et al Neural Connectomics Challenge (2014)

In this work, we propose a simple yet effective solution to the problem of connectome inference in ...

Full Text
See detailApprentissage par renforcement bayésien versus recherche directe de politique hors-ligne en utilisant une distribution a priori: comparaison empirique
Castronovo, Michaël; Ernst, Damien; Fonteneau, Raphaël

in Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage (2014, May)

Cet article aborde le problème de prise de décision séquentielle dans des processus de déci- sion ...

Full Text
See detailMicrogrids and their destructuring effects on the electrical industry
Ernst, Damien

Speech/Talk (2014)

Full Text
See detailEstimating the revenues of a hydrogen-based high-capacity storage device: methodology and results
François-Lavet, Vincent; Fonteneau, Raphaël; Ernst, Damien

in Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage (2014, May)

This paper proposes a methodology to estimate the maximum revenue that can be generated by a ...

Full Text
See detailGestion active d’un réseau de distribution d’électricité : formulation du problème et benchmark
Gemine, Quentin; Ernst, Damien; Cornélusse, Bertrand

in Proceedings des 9èmes Journées Francophones de Planification, Décision et Apprentissage (2014, May)

Afin d’opérer un réseau de distribution d’électricité de manière fiable et efficace, c’est-à-dire ...

Full Text
See detailToggling a genetic switch using reinforcement learning
Sootla, Aivar; Strelkowa, Natalja; Ernst, Damien; Barahona, Mauricio et al

in Proceedings of the 9th French Meeting on Planning, Decision Making and Learning (2014, May)

In this paper, we consider the problem of optimal exogenous control of gene regulatory networks ...

Full Text
See detailOptimized look-ahead tree policies: a bridge between look-ahead tree policies and direct policy search
Jung, Tobias; Wehenkel, Louis; Ernst, Damien; Maes, Francis

in International Journal of Adaptive Control and Signal Processing (2014), 28(3-5), 255-289

Direct policy search (DPS) and look-ahead tree (LT) policies are two popular techniques for solving ...

Full Text
See detailA learning procedure for sampling semantically different valid expressions
St-Pierre, David Lupien; Maes, Francis; Ernst, Damien; Louveaux, Quentin

in International Journal of Artificial Intelligence (2014), 12(1), 18-35

A large number of problems can be formalized as finding the best symbolic expression to maximize a ...

Full Text
See detailL'invité - Damien Ernst - "Nous allons vers une globalisation du marché de l'électricité"
Ernst, Damien

Article for general public (2014)

En décembre 2013, Damien Ernst, Professeur à l’ULG, a donné une conférence au CESW intitulée ...

Full Text
See detailLipschitz robust control from off-policy trajectories
Fonteneau, Raphaël; Ernst, Damien; Boigelot, Bernard; Louveaux, Quentin

in Proceedings of the 53rd IEEE Conference on Decision and Control (IEEE CDC 2014) (2014)

We study the minmax optimization problem introduced in [Fonteneau et al. (2011), ``Towards min max ...

Full Text
See detailApprentissage par renforcement batch fondé sur la reconstruction de trajectoires artificielles
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 9èmes Journées Francophones de Planification, Décision et Apprentissage (JFPDA 2014) (2014)

Cet article se situe dans le cadre de l’apprentissage par renforcement en mode batch, dont le ...

See detailPower system transient stability preventive and emergency control
Ruiz-Vega, Daniel; Wehenkel, Louis; Ernst, Damien; Pizano-Martinez, Alejandro et al

in Savulescu, Savu (Ed.) Real-Time Stability in Power Systems 2nd Edition (2014)

A general approach to real-time transient stability control is described, yielding various ...

Full Text
See detailThe Global Grid
Ernst, Damien

Speech/Talk (2013)

Full Text
See detailOn periodic reference tracking using batch-mode reinforcement learning with application to gene regulatory network control
Sootla, Aivar; Strelkowa, Natajala; Ernst, Damien; Barahona, Mauricio et al

in Proceedings of the 52nd Annual Conference on Decision and Control (CDC 2013) (2013, December)

In this paper, we consider the periodic reference tracking problem in the framework of batch-mode ...

Full Text
See detailAn efficient algorithm for the provision of a day-ahead modulation service by a load aggregator
Mathieu, Sébastien; Ernst, Damien; Louveaux, Quentin

in Proceedings of the 4th European Innovative Smart Grid Technologies (ISGT) (2013, October)

This article studies a decision making problem faced by an aggregator willing to offer a load ...

Full Text
See detailThe global grid
Chatzivasileiadis, Spyros; Ernst, Damien; Andersson, Göran

in Renewable Energy (2013), 57

This paper puts forward the vision that a natural future stage of the electricity network could be ...

Full Text
See detailGREDOR
Ernst, Damien

Speech/Talk (2013)

Full Text
See detailSmart conversion of residual heat into electricity: the electricity market point of view
Ernst, Damien

Speech/Talk (2013)

Full Text
See detailBatch mode reinforcement learning based on the synthesis of artificial trajectories
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in Annals of Operations Research (2013), 208(1), 383-416

Full Text
See detailMonte Carlo search algorithm discovery for single-player games
Maes, Francis; Lupien St-Pierre, David; Ernst, Damien

in IEEE Transactions on Computational Intelligence and AI in Games (2013), 5(3), 201-213

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms ...

Full Text
See detailRisque majeur de blackout : que faire ?
Ernst, Damien

Article for general public (2013)

Full Text
See detailQuelles perspectives pour les énergies renouvelables en Wallonie ?
Ernst, Damien

in LiègeU (2013), Eté 2013

Full Text
See detailMeta-learning of exploration-exploitation strategies in reinforcement learning
Ernst, Damien

Speech/Talk (2013)

Full Text
See detailUnderstanding active network management in 30 minutes
Ernst, Damien

Speech/Talk (2013)

Full Text
See detailOptimal discovery with probabilistic expert advice: finite time analysis and macroscopic optimality
Bubeck, Sébastien; Ernst, Damien; Garivier, Aurélien

in Journal of Machine Learning Research (2013), 14

We consider an original problem that arises from the issue of security analysis of a power system ...

Full Text
See detailSolving the fluctuation problems in a land with 100% of renewable energy
Ernst, Damien

Speech/Talk (2013)

Full Text
See detailOutbound SPIT Filter with Optimal Performance Guarantees
Jung, Tobias; Martin, Sylvain; Nassar, Mohamed; Ernst, Damien et al

in Computer Networks (2013), 57(7), 16301643

This paper presents a formal framework for identifying and filtering SPIT calls (SPam in Internet ...

Full Text
See detailScenario Trees and Policy Selection for Multistage Stochastic Programming Using Machine Learning
Defourny, Boris; Ernst, Damien; Wehenkel, Louis

in INFORMS Journal on Computing (2013), 25(3), 488-501

In the context of multistage stochastic optimization problems, we propose a hybrid strategy for ...

Full Text
See detailGénéralisation Min Max pour l'Apprentissage par Renforcement Batch et Déterministe : Relaxations pour le Cas Général T Etapes
Fonteneau, Raphaël; Ernst, Damien; Boigelot, Bernard; Louveaux, Quentin

in 8èmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA'13) (2013)

Cet article aborde le problème de généralisation minmax dans le cadre de l'apprentissage par ...

Full Text
See detailMin max generalization for deterministic batch mode reinforcement learning: relaxation schemes
Fonteneau, Raphaël; Ernst, Damien; Boigelot, Bernard; Louveaux, Quentin

in SIAM Journal on Control and Optimization (2013), 51(5), 33553385

We study the min max optimization problem introduced in Fonteneau et al. [Towards min max ...

Full Text
See detailStratégies d'échantillonnage pour l'apprentissage par renforcement batch
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in Revue d'Intelligence Artificielle (2013), 27(2), 171-194

We propose two strategies for experiment selection in the context of batch mode reinforcement ...

Full Text
See detailActive network management: planning under uncertainty for exploiting load modulation
Gemine, Quentin; Karangelos, Efthymios; Ernst, Damien; Cornélusse, Bertrand

in Proceedings of the 2013 IREP Symposium - Bulk Power Systems Dynamics and Control - IX (2013)

This paper addresses the problem faced by a distribution system operator (DSO) when planning the ...

Full Text
See detailOptimized Look-Ahead Trees: Extensions to Large and Continuous Action Spaces
Jung, Tobias; Ernst, Damien; Maes, Francis

in Proc. of IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL'13) (2013)

This paper studies look-ahead tree based control policies from the viewpoint of online decision ...

Full Text
See detailMeta-learning of Exploration/Exploitation Strategies: The Multi-Armed Bandit Case
Maes, Francis; Wehenkel, Louis; Ernst, Damien

in Filipe, Joaquim; Fred, Ana (Eds.) Agents and Artificial Intelligence: 4th International Conference, ICAART 2012, Vilamoura, Portugal, February 6-8, 2012. Revised Selected Papers (2013)

The exploration/exploitation (E/E) dilemma arises naturally in many subfields of Science. Multi ...

Full Text
See detailBiorthogonalization Techniques for Least Squares Temporal Difference Learning
Jung, Tobias; Ernst, Damien

Poster (2012, December 07)

We consider Markov reward processes and study OLS-LSTD, a framework for selecting basis functions ...

Full Text
See detailOptimal discovery with probabilistic expert advice
Bubeck, Sébastien; Ernst, Damien; Garivier, Aurélien

in Proceedings of the 51st IEEE Conference on Decision and Control (CDC 2012) (2012, December)

Motivated by issues of security analysis for power systems, we analyze a new problem, called ...

Full Text
See detailBatch mode reinforcement learning based on the synthesis of artificial trajectories
Ernst, Damien

Speech/Talk (2012)

Full Text
See detailCooperative frequency control with a multi-terminal high-voltage DC network
Sarlette, Alain; Dai, Jing; Phulpin, Yannick; Ernst, Damien

in Automatica (2012), 48(12), 31283134

We consider frequency control in power systems made of several non-synchronous AC areas connected ...

Full Text
See detailA computationally efficient algorithm for the provision of a day-ahead modulation service by a load aggregator
Mathieu, Sébastien; Karangelos, Efthymios; Louveaux, Quentin; Ernst, Damien

Poster (2012, October 08)

We study a decision making problem faced by an aggregator willing to offer a load modulation ...

Full Text
See detailPolicy search in a space of simple closed-form formulas: towards interpretability of reinforcement learning
Maes, Francis; Fonteneau, Raphaël; Wehenkel, Louis; Ernst, Damien

in Discovery Science 15th International Conference, DS 2012, Lyon, France, October 29-31, 2012. Proceedings (2012, October)

In this paper, we address the problem of computing interpretable solutions to reinforcement ...

Full Text
See detailContextual Multi-armed Bandits for the Prevention of Spam in VoIP Networks
Jung, Tobias; Martin, Sylvain; Ernst, Damien; Leduc, Guy

E-print/Working paper (2012)

In this paper we argue that contextual multi-armed bandit algorithms could open avenues for ...

Full Text
See detailGénéralisation min max pour l'apprentissage par renforcement batch et déterministe : schémas de relaxation
Fonteneau, Raphaël; Ernst, Damien; Boigelot, Bernard; Louveaux, Quentin

in Septièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2012) (2012, May)

On s’intéresse au problème de généralisation min max dans le cadre de l’apprentissage par ...

Full Text
See detailCoordinated primary frequency control among non-synchronous systems connected by a multi-terminal high-voltage direct current grid
Dai, Jing; Phulpin, Yannick; Sarlette, Alain; Ernst, Damien

in IET Generation, Transmission and Distribution (2012), 6(2), 99-108

The authors consider a power system composed of several non-synchronous AC areas connected by a ...

Full Text
See detailLearning to play K-armed bandit problems
Maes, Francis; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 4th International Conference on Agents and Artificial Intelligence (ICAART 2012) (2012, February)

We propose a learning approach to pre-compute K-armed bandit playing policies by exploiting prior ...

Full Text
See detailLearning exploration/exploitation strategies for single trajectory reinforcement learning
Castronovo, Michaël; Maes, Francis; Fonteneau, Raphaël; Ernst, Damien

in Proceedings of the 10th European Workshop on Reinforcement Learning (EWRL 2012) (2012)

We consider the problem of learning high-performance Exploration/Exploitation (E/E) strategies for ...

Full Text
See detailMulti-terminal HVDC systems and ancillary services
Ernst, Damien

Speech/Talk (2012)

Full Text
See detailMin max generalization for two-stage deterministic batch mode reinforcement learning: relaxation schemes
Fonteneau, Raphaël; Ernst, Damien; Boigelot, Bernard; Louveaux, Quentin

Report (2012)

Full Text
See detailImitative Learning for Real-Time Strategy Games
Gemine, Quentin; Safadi, Firas; Fonteneau, Raphaël; Ernst, Damien

in Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (2012)

Over the past decades, video games have become increasingly popular and complex. Virtual worlds ...

Full Text
See detailContextual Multi-armed Bandits for Web Server Defense
Jung, Tobias; Martin, Sylvain; Ernst, Damien; Leduc, Guy

in Hussein, Abbas (Ed.) Proceedings of 2012 International Joint Conference on Neural Networks (IJCNN) (2012)

In this paper we argue that contextual multi-armed bandit algorithms could open avenues for ...

Full Text
See detailSPRT for SPIT: Using the Sequential Probability Ratio Test for Spam in VoIP Prevention
Jung, Tobias; Martin, Sylvain; Ernst, Damien; Leduc, Guy

in Proc. of 6th International Conference on Autonomous Infrastructure, Management and Security (2012)

This paper presents the first formal framework for identifying and filtering SPIT calls (SPam in ...

Full Text
See detailComparison of Different Selection Strategies in Monte-Carlo Tree Search for the Game of Tron
Perrick, Pierre; Lupien St-Pierre, David; Maes, Francis; Ernst, Damien

in IEEE Conference on Computational and Intelligence in Games 2012 (2012)

Monte-Carlo Tree Search (MCTS) techniques are essentially known for their performance on turn-based ...

Full Text
See detailRelaxation schemes for min max generalization in deterministic batch mode reinforcement learning
Fonteneau, Raphaël; Ernst, Damien; Boigelot, Bernard; Louveaux, Quentin

in 4th International NIPS Workshop on Optimization for Machine Learning (OPT 2011) (2011, December)

We study the min max optimization problem introduced in [Fonteneau, 2011] for computing policies ...

Full Text
See detailArtificial intelligence design for real-time strategy games
Safadi, Firas; Fonteneau, Raphaël; Ernst, Damien

in NIPS Workshop on Decision Making with Multiple Imperfect Decision Makers (2011, December)

For now over a decade, real-time strategy (RTS) games have been challenging intelligence, human and ...

Full Text
See detailLearning for exploration-exploitation in RL. The dusk of the small formulas’ reign
Ernst, Damien

Speech/Talk (2011)

Full Text
See detailAncillary services and operation of multi-terminal HVDC grids
Phulpin, Yannick; Ernst, Damien

in Proceedings of the International Workshop on Transmission Networks for Offshore Wind Power as well as on Transmission Networks for Offshore Wind Power Farms Plants (2011, October)

This paper addresses the problem of ancillary services in ac systems interconnected by a multi ...

Full Text
See detailModel predictive control of HVDC power flow to improve transient stability in power systems
Phulpin, Yannick; Hazra, Jagabondhu; Ernst, Damien

in Proceedings of the Second IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm) (2011, October)

This paper addresses the problem of HVDC control using real-time information to avoid loss of ...

Full Text
See detailApprentissage actif par modification de la politique de décision courante
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in Sixièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2011) (2011, June)

Full Text
See detailEstimation Monte Carlo sans modèle de politiques de décision
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in Revue d'Intelligence Artificielle (2011), 25

Full Text
See detailApproximate reinforcement learning: an overview
Busoniu, Lucian; Babuska, Robert; De Schutter, Bart; Ernst, Damien

in Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11) (2011, April)

Reinforcement learning (RL) allows agents to learn how to optimally interact with complex ...

Full Text
See detailActive exploration by searching for experiments that falsify the computed control policy
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11) (2011, April)

We propose a strategy for experiment selection - in the context of reinforcement learning - based ...

Full Text
See detailCross-entropy optimization of control policies with adaptive basis functions
Busoniu, Lucian; Ernst, Damien; Babuska, Robert; De Schutter, Bart

in IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics (2011), 41(1), 196-209

This paper introduces an algorithm for direct search of control policies in continuous-state ...

Full Text
See detailMultistage stochastic programming: A scenario tree based approach to planning under uncertainty
Defourny, Boris; Ernst, Damien; Wehenkel, Louis

in Sucar, L. Enrique; Morales, Eduardo F.; Hoey, Jesse (Eds.) Decision Theory Models for Applications in Artificial Intelligence: Concepts and Solutions (2011)

In this chapter, we present the multistage stochastic programming framework for sequential decision ...

Full Text
See detailTowards min max generalization in reinforcement learning
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Filipe, Joaquim; Fred, Ana; Sharp, Bernadette (Eds.) Agents and Artificial Intelligence: International Conference, ICAART 2010, Valencia, Spain, January 2010, Revised Selected Papers (2011)

In this paper, we introduce a min max approach for addressing the generalization problem in ...

Full Text
See detailVoltage control in an HVDC system to share primary frequency reserves between non-synchronous areas
Jing, Dai; Phulpin, Yannick; Sarlette, Alain; Ernst, Damien

in Proceedings of the 17th Power Systems Computation Conference (PSCC-11) (2011)

This paper addresses the problem of frequency control for non-synchronous AC areas connected by a ...

Full Text
See detailAutomatic discovery of ranking formulas for playing with multi-armed bandits
Maes, Francis; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011) (2011)

We propose an approach for discovering in an automatic way formulas for ranking arms while playing ...

Full Text
See detailOptimized look-ahead tree policies
Maes, Francis; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011) (2011)

We consider in this paper look-ahead tree techniques for the discrete-time control of a ...

Full Text
See detailOptimal sample selection for batch-mode reinforcement learning
Rachelson, Emmanuel; Schnitzler, François; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 3rd International Conference on Agents and Artificial Intelligence (ICAART 2011) (2011)

We introduce the Optimal Sample Selection (OSS) meta-algorithm for solving discrete-time Optimal ...

Full Text
See detailBeyond function approximators for batch mode reinforcement learning: rebuilding trajectories
Ernst, Damien

Speech/Talk (2010)

Full Text
See detailModel-free Monte Carlo-like policy evaluation
Ernst, Damien

Speech/Talk (2010)

Full Text
See detailImpact of delays on a consensus-based primary frequency control scheme for AC systems connected by a multi-terminal HVDC grid
Dai, Jing; Phulpin, Yannick; Sarlette, Alain; Ernst, Damien

in Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII (2010, August)

This paper addresses the problem of sharing primary frequency control reserves among nonsynchronous ...

Full Text
See detailConsequence driven decomposition of large-scale power systems security analysis
Ernst, Damien

Speech/Talk (2010)

Full Text
See detailConsequence driven decomposition of large-scale power system security analysis
Fonteneau, Florence; Ernst, Damien; Druet, Christophe; Panciatici, Patrick et al

in Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII (2010, August)

This paper presents an approach for assessing, in operation planning studies, the security of a ...

Full Text
See detailCoordination of voltage control in a power system operated by multiple transmission utilities
Phulpin, Yannick; Begovic, Miroslav; Ernst, Damien

in Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII (2010, August)

This paper addresses the problem of coordinating voltage control in a large-scale power system ...

Full Text
See detailUsing prior knowledge to accelerate online least-squares policy iteration
Busoniu, Lucian; De Schutter, Bart; Babuska, Robert; Ernst, Damien

in Proceedings of the 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (2010, May)

Reinforcement learning (RL) is a promising paradigm for learning optimal control. Although RL is ...

Full Text
See detailApproximate dynamic programming with a fuzzy parameterization
Busoniu, Lucian; Ernst, Damien; De Schutter, Bart; Robert, Babuska

in Automatica (2010), 46(5), 804-814

Dynamic programming (DP) is a powerful paradigm for general, nonlinear optimal control. Computing ...

Full Text
See detailGenerating informative trajectories by using bounds on the return of control policies
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Proceedings of the Workshop on Active Learning and Experimental Design 2010 (in conjunction with AISTATS 2010) (2010, May)

We propose new methods for guiding the generation of informative trajectories when solving discrete ...

Full Text
See detailModel-free Monte Carlo-like policy evaluation
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010) (2010, May)

We propose an algorithm for estimating the finite-horizon expected return of a closed loop control ...

Full Text
See detailModel-free Monte Carlo–like policy evaluation
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Proceedings of Conférence Francophone sur l'Apprentissage Automatique (CAp) 2010 (2010, May)

We propose an algorithm for estimating the finite-horizon expected return of a closed loop control ...

Full Text
See detailUpper confidence bound based decision making strategies and dynamic spectrum access
jouini, wassim; Ernst, Damien; Moy, Christophe; Palicot, Jacques

in Proceedings of the 2010 IEEE International Conference on Communications (2010, May)

In this paper, we consider the problem of exploiting spectrum resources for a secondary user (SU ...

Full Text
See detailReinforcement Learning and Dynamic Programming using Function Approximators
Busoniu, Lucian; Babuska, Robert; De Schutter, Bart; Ernst, Damien

Book published by CRC Press (2010)

Full Text
See detailA cautious approach to generalization in reinforcement learning
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 2nd International Conference on Agents and Artificial Intelligence (2010, January)

In the context of a deterministic Lipschitz continuous environment over continuous state spaces ...

Full Text
See detailExploiting policy knowledge in online least-squares policy iteration: An empirical study
Busoniu, Lucian; Ernst, Damien; Babusku, Robert; De Schutter, Bart

in Automation, Computers, Applied Mathematics (2010), 19(4), 521-529

Reinforcement learning (RL) is a promising paradigm for learning optimal control. Traditional RL ...

Full Text
See detailOnline least-squares policy iteration for reinforcement learning control
Busoniu, Lucian; Ernst, Damien; De Schutter, Bart; Babuska, Robert

in Proceedings of the 2010 American Control Conference (2010)

Reinforcement learning is a promising paradigm for learning optimal control. We consider policy ...

Full Text
See detailVoronoi model learning for batch mode reinforcement learning
Fonteneau, Raphaël; Ernst, Damien

Report (2010)

We consider deterministic optimal control problems with continuous state spaces where the ...

Full Text
See detailComputing bounds for kernel-based policy evaluation in reinforcement learning
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

Report (2010)

This technical report proposes an approach for computing bounds on the finite-time return of a ...

Full Text
See detailModel-free Monte Carlo-like policy evaluation
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in 29th Benelux Meeting on Systems and Control (2010)

Full Text
See detailMulti-armed bandit based policies for cognitive radio's decision making issues
Jouini, Wassim; Ernst, Damien; Moy, Christophe; Palicot, Jacques

in Proceedings of the 3rd International Conference on Signals, Circuits and Systems (SCS) (2009, November)

We suggest in this paper that many problems related to Cognitive Radio’s (CR) decision making ...

Full Text
See detailApoptosis characterizes immunological failure of HIV infected patients
Mhawej, Marie-José; Brunet-Francois, Cécile; Fonteneau, Raphaël; Ernst, Damien et al

in Control Engineering Practice (2009), 17(7), 798-804

This paper studies the influence of apoptosis in the dynamics of the HIV infection. A new modeling ...

Full Text
See detailLower bounds in reinforcement learning: the intelligent agent dream is getting closer
Ernst, Damien

Speech/Talk (2009)

Full Text
See detailPseudo-geographical representations of power system buses by multidimensional scaling
Belmudes, Florence; Ernst, Damien; Wehenkel, Louis

in Proceedings of the 15th International Conference on Intelligent System Applications to Power Systems (ISAP 2009) (2009)

Graphical representations of power systems are systematically used for planning and operation. The ...

Full Text
See detailA rare-event approach to build security analysis tools when N-k (k > 1) analyses are needed (as they are in large-scale power systems)
Belmudes, Florence; Ernst, Damien; Wehenkel, Louis

in Proceedings of the 2009 IEEE Bucharest PowerTech (2009)

We consider the problem of performing N − k security analyses in large scale power systems. In such ...

Full Text
See detailPolicy search with cross-entropy optimization of basis functions
Busoniu, Lucian; Ernst, Damien; De Schutter, Bart; Babuska, Robert

in Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (2009)

This paper introduces a novel algorithm for approximate policy search in continuous-state, discrete ...

Full Text
See detailApprentissage par renforcement appliqué à la commande des systèmes électriques
Dai, Jing; Phulpin, Yannick; Vannier, Jean-Claude; Ernst, Damien

in Proceedings of "Les Journées Electrotechnique du Futur 2009" (2009)

Cet article propose une revue de littérature concernant les applications de l’apprentissage par ...

Full Text
See detailBounds for Multistage Stochastic Programs using Supervised Learning Strategies
Defourny, Boris; Ernst, Damien; Wehenkel, Louis

in Watanabe, Osamu; Zeugmann, Thomas (Eds.) Stochastic Algorithms: Foundations and Applications (2009)

We propose a generic method for obtaining quickly good upper bounds on the minimal value of a ...

Full Text
See detailPlanning under uncertainty, ensembles of disturbance trees and kernelized discrete action spaces
Defourny, Boris; Ernst, Damien; Wehenkel, Louis

in Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (2009)

Optimizing decisions on an ensemble of incomplete disturbance trees and aggregating their first ...

Full Text
See detailReinforcement learning versus model predictive control: a comparison on a power system problem
Ernst, Damien; Glavic, Mevludin; Capitanescu, Florin; Wehenkel, Louis

in IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics (2009), 33(2), 517-519

This paper compares reinforcement learning (RL) with model predictive control (MPC) in a unified ...

Full Text
See detailWhat is the likely future of real-time transient stability ?
Ernst, Damien; Wehenkel, Louis; Pavella, Mania

in Proceedings of the 2009 IEEE/PES Power Systems Conference & Exposition (PSCE 2009) (2009)

Despite very intensive research efforts in the field of transient stability during the last five ...

Full Text
See detailDynamic treatment regimes using reinforcement learning: a cautious generalization approach
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

Poster (2009)

Full Text
See detailInferring bounds on the performance of a control policy from a sample of one-step system transitions
Fonteneau, Raphaël; Murphy, Susan A.; Wehenkel, Louis; Ernst, Damien

in 28th Benelux Meeting on Systems and Control (2009)

Full Text
See detailInferring bounds on the performance of a control policy from a sample of trajectories
Fonteneau, Raphaël; Murphy, Susan; Wehenkel, Louis; Ernst, Damien

in Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (2009)

We propose an approach for inferring bounds on the finite-horizon return of a control policy from ...

Full Text
See detailHVDC control strategies to improve transient stability in interconnected power systems
Hazra, Jagabondhu; Phulpin, Yannick; Ernst, Damien

in Proceedings of the 2009 IEEE Bucharest PowerTech (2009)

This paper presents three HVDC modulation strategies to improve transient stability in an ...

Full Text
See detailDecentralized reactive power dispatch for a time-varying multi-TSO system
Phulpin, Yannick; Begovic, Miroslav; Petit, Marc; Ernst, Damien

in Proceedings of the 42nd Hawaii International Conference on System Sciences (HICSS-42) (2009)

This paper addresses the problem of reactive power dispatch in a power system partitioned into ...

Full Text
See detailA fair method for centralized optimization of multi-TSO power systems
Phulpin, Yannick; Begovic, Miroslav; Petit, Marc; Ernst, Damien

in International Journal of Electrical Power and Energy Systems (2009), 31

This paper addresses the problem of centralized optimization of an interconnected power system ...

Full Text
See detailEvaluation of network equivalents for voltage optimization in multi-area power systems
Phulpin, Yannick; Miroslav, Begovic; Petit, Marc; Heyberger, Jean-Baptiste et al

in IEEE Transactions on Power Systems (2009), 24(2), 729-743

The paper addresses the problem of decentralized optimization for a power system partitioned into ...

Full Text
See detailResearch and Education Activities in Electric Power Systems at the University of Liège
Wehenkel, Louis; Ernst, Damien; Rousseaux, Patricia; Van Cutsem, Thierry

in Revue E: Revue d'Electricité et d'Electronique Industrielle (2008), (4), 54-59

This paper presents research and education activities of the power systems group of the Department ...

Full Text
See detailA reinforcement learning approach for designing artificial autonomous intelligent agents
Ernst, Damien

Speech/Talk (2008)

Full Text
See detailVariable selection for dynamic treatment regimes: a reinforcement learning approach
Fonteneau, Raphaël; Wehenkel, Louis; Ernst, Damien

in The annual machine learning conference of Belgium and the Netherlands (BeNeLearn 2008) (2008, May)

Full Text
See detailModelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV-infected patient
Stan, Guy-Bart; Belmudes, Florence; Fonteneau, Raphaël; Zeggwagh, Frédéric et al

in IET Systems Biology (2008), 2(2), 94-102

On the basis of the human immunodeficiency virus (HIV) infection dynamics model proposed by Adams ...

Full Text
See detailAnalyzing transient instability phenomena beyond the classical stability boundary
Ali, Mahmoud; Glavic, Mevludin; Buisson, Jean; Wehenkel, Louis et al

in Proceedings of the 40th North American Power Symposium (NAPS 2008) (2008)

We consider power systems for which the amount of power produced by their individual power plants ...

Full Text
See detailCross-entropy based rare-event simulation for the identification of dangerous events in power systems
Belmudes, Florence; Ernst, Damien; Wehenkel, Louis

in Proceedings of the 10th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS-08) (2008)

We propose in this paper a novel approach for identifying rare events that may endanger power ...

Full Text
See detailConsistency of fuzzy model-based reinforcement learning
Busoniu, Lucian; Ernst, Damien; Babuska, Robert; De Schutter, Bart

in Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-08) (2008)

Reinforcement learning (RL) is a widely used paradigm for learning control. Computing exact RL ...

Full Text
See detailFuzzy partition optimization for approximate fuzzy Q-iteration
Busoniu, Lucian; Ernst, Damien; Babuska, Robert; De Schutter, Bart

in Proceedings of the 17th IFAC World Congress (IFAC-08) (2008)

Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. Because exact ...

Full Text
See detailContinuous-state reinforcement learning with fuzzy approximation
Busoniu, Lucian; Ernst, Damien; De Schutter, Bart; Babuska, Robert

in Tuyls, K.; Nowé, A.; Guessoum, Z.; Kudenko, D. (Eds.) Adaptive Agents and Multi-Agent Systems III, Adaptation and Multi-Agent Learning (2008)

Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. There exist ...

Full Text
See detailLazy planning under uncertainty by optimizing decisions on an ensemble of incomplete disturbance trees
Defourny, Boris; Ernst, Damien; Wehenkel, Louis

in Defourny, Boris; Ernst, Damien; Wehenkel, Louis (Eds.) Recent Advances in Reinforcement Learning (2008)

This paper addresses the problem of solving discrete-time optimal sequential decision making ...

Full Text
See detailRisk-aware decision making and dynamic programming
Defourny, Boris; Ernst, Damien; Wehenkel, Louis

Conference (2008)

This paper considers sequential decision making problems under uncertainty, the tradeoff between ...

Full Text
See detailVariable selection for dynamic treatment regimes
Fonteneau, Raphaël; Wehenkel, Louis; Ernst, Damien

in 27th Benelux Meeting on Systems and Control (2008)

Full Text
See detailVariable selection for dynamic treatment regimes: a reinforcement learning approach
Fonteneau, Raphaël; Wehenkel, Louis; Ernst, Damien

Conference (2008)

Dynamic treatment regimes (DTRs) can be inferred from data collected through some randomized ...

Full Text
See detailHow compatible is perfect competition with transmission loss allocation methods?
Jing, Dai; Phulpin, Yannick; Rious, Vincent; Ernst, Damien

in Proceedings of the 5th International Conference on the European Electricity Market (EEM-08) (2008)

This paper addresses the problem of transmission loss allocation in a power system where the ...

Full Text
See detailOn the fairness of centralised decision-making strategies in multi-area power systems
Phulpin, Yannick; Begovic, Miroslav; Petit, Marc; Ernst, Damien

in Proceedings of the 16th Power Systems Computation Conference (PSCC-08) (2008)

In this paper, we consider an interconnected power system, where the different Transmission System ...

Full Text
See detailContingency filtering techniques for preventive security-constrained optimal power flow
Capitanescu, Florin; Glavic, M.; Ernst, Damien; Wehenkel, Louis

in IEEE Transactions on Power Systems (2007), 22(4), 1690-1697

This paper focuses on contingency filtering to accelerate the iterative solution of preventive ...

Full Text
See detailEstimation of rotor angles of synchronous machines using artificial neural networks and local PMU-based quantities
Del Angel, A.; Geurts, Pierre; Ernst, Damien; Glavic, M. et al

in Neurocomputing (2007), 70(16-18), 2668-2678

This paper investigates a possibility for estimating rotor angles in the time frame of transient ...

Full Text
See detailInterior-point based algorithms for the solution of optimal power flow problems
Capitanescu, Florin; Glavic, Mevludin; Ernst, Damien; Wehenkel, Louis

in Electric Power Systems Research (2007), 77(5-6), 508-517

Interior-point method (IPM) is a very appealing approach to the optimal power flow (OPF) problem ...

Full Text
See detailNash equilibrium as the minimum of a function. Application to electricity markets with large number of actors
Beck, Elena Vdovina; Cherkaoui, Rachid; Minoia, Anna; Ernst, Damien

in Proceedings of the 2007 Power Tech (2007)

We introduce in this paper a new approach for efficiently identifying Nash equilibria for games ...

Full Text
See detailContinuous-state reinforcement learning with fuzzy approximation
Busoniu, Lucian; Ernst, Damien; Babuska, Robert; De Schutter, Bart

in Proceedings of the 7th European Symposium on Adaptive Learning Agents and Multi-Agent Systems (ALAMAS-07) (2007)

Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. Well-understood ...

Full Text
See detailFuzzy approximation for convergent model-based reinforcement learning
Busoniu, Lucian; Ernst, Damien; Babuska, Robert; De Schutter, Bart

in Proceedings of the 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-07) (2007)

Reinforcement learning (RL) is a learning control paradigm that provides well-understood algorithms ...

Full Text
See detailModel predictive control and reinforcement learning as two complementary frameworks
Ernst, Damien; Glavic, Mevludin; Capitanescu, Florin; Wehenkel, Louis

in International Journal of Tomography and Statistics (2007), 6

Model predictive control (MPC) and reinforcement learning (RL) are two popular families of methods ...

Full Text
See detailThe cross-entropy method for power system combinatorial optimization problems
Ernst, Damien; Glavic, Mevludin; Stan, Guy-Bart; Mannor, Shie et al

in Proceedings of the 2007 Power Tech (2007)

We present an application of a cross-entropy based combinatorial optimization method for solving ...

Full Text
See detailE-SIME- A method for transient stability closed-loop emergency control: achievements and prospects
Glavic, Mevludin; Ernst, Damien; Ruiz-Vega, Daniel; Wehenkel, Louis et al

in Proceedings of 2007 IREP Symposium - Bulk Power Systems Dynamics and Control - VII (2007)

A general response-based technique is presented for closed-loop transient stability emergency ...

Full Text
See detailModelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV infected patient
Stan, Guy-Bart; Belmudes, Florence; Fonteneau, Raphaël; Zeggwagh, Frédéric et al

Poster (2007)

Full Text
See detailA collaborative framework for multi-area dynamic security assessment of large scale systems
Wehenkel, Louis; Glavic, Mevludin; Ernst, Damien

in Proceedings of the 2007 Power Tech (2007)

In this paper we propose a collaborative framework to carry out multi-area dynamic security ...

Full Text
See detailComputing near-optimal policies from trajectories by solving a sequence of standard supervised learning problems
Ernst, Damien

Speech/Talk (2006)

Full Text
See detailA comparison of Nash equilibria analysis and agent-based modelling for power markets
Krause, Thilo; Beck, Elena Vdovina; Cherkaoui, Rachid; Germond, Alain et al

in International Journal of Electrical Power and Energy Systems (2006), 28(9), 599-607

In this paper we compare Nash equilibria analysis and agent-based modelling for assessing the ...

Full Text
See detailExtremely randomized trees
Geurts, Pierre; Ernst, Damien; Wehenkel, Louis

in Machine Learning (2006), 63(1), 3-42

This paper proposes anew tree-based ensemble method for supervised classification and regression ...

Full Text
See detailClinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, Damien

Speech/Talk (2006)

Full Text
See detailReference transmission network: A game theory approach
Minoia, Anna; Ernst, Damien; Dicorato, Maria; Trovato, Michele et al

in IEEE Transactions on Power Systems (2006), 21(1), 249-259

The transmission network plays a key role in an oligopolistic electricity market. In fact, the ...

Full Text
See detailApplications of security-constrained optimal power flows
Capitanescu, Florin; Glavic, Mevludin; Ernst, Damien; Wehenkel, Louis

in In Proceedings of Modern Electric Power Systems Symposium, MEPS06 (2006)

This paper proposes to formulate security control as a sequential decision making problem and ...

Full Text
See detailModel predictive control and reinforcement learning as two complementary frameworks
Ernst, Damien; Glavic, Mevludin; Capitanescu, Florin; Wehenkel, Louis

in Proceedings of the 13th IFAC Workshop on Control Applications of Optimisation (2006)

Model predictive control (MPC) and reinforcement learning (RL) are two popular families of methods ...

Full Text
See detailReinforcement learning with raw image pixels as input state
Ernst, Damien; Marée, Raphaël; Wehenkel, Louis

in Advances in machine vision, image processing & pattern analysis (Lecture notes in computer science, Vol. 4153) (2006)

We report in this paper some positive simulation results obtained when image pixels are directly ...

Full Text
See detailClinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, Damien; Stan, Guy-Bart; Gonçalves, Jorge; Wehenkel, Louis

in Proceedings of the 45th IEEE Conference on Decision and Control (CDC 2006) (2006)

This paper addresses the problem of computing optimal structured treatment interruption strategies ...

Full Text
See detailClinical data based optimal STI strategies for HIV: a reinforcement learning approach
Ernst, Damien; Stan, Guy-Bart; Gonçalves, Jorge; Wehenkel, Louis

in Proceedings of the 15th Annual Machine Learning Conference of Belgium and The Netherlands (Benelearn 2006) (2006)

This paper addresses the problem of computing optimal structured treatment interruption strategies ...

Full Text
See detailDamping control by fusion of reinforcement learning and control Lyapunov functions
Glavic, Mevludin; Wehenkel, Louis; Ernst, Damien

in Proceedings of the 38th North American Power Symposium (NAPS 2006) (2006)

The main idea behind the concept, proposed in the paper, is the opportunity to make control systems ...

Full Text
See detailEnsembles of extremely randomized trees and some generic applications
Wehenkel, Louis; Ernst, Damien; Geurts, Pierre

in Proceedings of Robust Methods for Power System State Estimation and Load Forecasting (2006)

In this paper we present a new tree-based ensemble method called “Extra-Trees”. This algorithm ...

Full Text
See detailMulti-area security assessment: results using efficient bounding method
Wehenkel, Louis; Glavic, Mevludin; Ernst, Damien

in Proceedings of the 38th North American Power Symposium (NAPS 2006) (2006)

We present our recent results on using previously introduced framework for multi-area security ...

Full Text
See detailOn multi-area security assessment of large interconnected power systems
Wehenkel, Louis; Glavic, Mevludin; Ernst, Damien

in Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry (2006)

The paper introduces a framework for information exchange and coordination of security assessment ...

Full Text
See detailAbout automatic learning for advanced sensing, monitoring and control of electric power systems
Wehenkel, Louis; Glavic, Mevludin; Geurts, Pierre; Ernst, Damien

in Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry (2006)

The paper considers the possible uses of automatic learning for improving power system performance ...

Full Text
See detailAutomatic learning of sequential decision strategies for dynamic security assessment and control
Wehenkel, Louis; Glavic, Mevludin; Geurts, Pierre; Ernst, Damien

in Proceedings of the IEEE Power Engineering Society General Meeting 2006 (2006)

This paper proposes to formulate security control as a sequential decision making problem and ...

Full Text
See detailSupervised learning based sequential decision making
Ernst, Damien

Speech/Talk (2005)

Full Text
See detailA reinforcement learning based discrete supplementary control for power system transient stability enhancement
Glavic, M.; Ernst, Damien; Wehenkel, Louis

in Engineering Intelligent Systems for Electrical Engineering and Communications (2005), 13(2 Sp. Iss. SI), 81-88

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a ...

Full Text
See detailTree-based batch mode reinforcement learning
Ernst, Damien; Geurts, Pierre; Wehenkel, Louis

in Journal of Machine Learning Research (2005), 6

Reinforcement learning aims to determine an optimal control policy from interaction with a system ...

Full Text
See detailCombining a stability and a performance-oriented control in power systems
Glavic, M.; Ernst, Damien; Wehenkel, Louis

in IEEE Transactions on Power Systems (2005), 20(1), 525-526

This paper suggests that the appropriate combination of a stability-oriented and a performance ...

Full Text
See detailApplication of an advanced transient stability assessment and control method to a realistic power system
Cirio, D.; Lucarella, D.; Vimercati, G.; Massucco, S. et al

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

The paper presents a technical overview of a large research project on Dynamic Security Assessment ...

Full Text
See detailSelecting concise sets of samples for a reinforcement learning agent
Ernst, Damien

in Proceedings of the 3rd International Conference on Computational Intelligence, Robotics and Autonomous Systems (CIRAS 2005) (2005)

We derive an algorithm for selecting from the set of samples gathered by a reinforcement learning ...

Full Text
See detailApproximate value iteration in the reinforcement learning context. Application to electrical power system control
Ernst, Damien; Glavic, Mevludin; Geurts, Pierre; Wehenkel, Louis

in International Journal of Emerging Electrical Power Systems (2005), 3(1),

In this paper we explain how to design intelligent agents able to process the information acquired ...

Full Text
See detailA comparison of Nash equilibria analysis and agent-based modelling for power markets
Krause, Thilo; Andersson, Goran; Ernst, Damien; Vdovina-Beck, Elena et al

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

In this paper we compare Nash equilibria analysis and agent-based modelling for assessing the ...

Full Text
See detailNew developments in the application of automatic learning to power system control
Wehenkel, Louis; Glavic, Mevludin; Ernst, Damien

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

In this paper we present the basic principles of supervised learning and reinforcement learning as ...

Full Text
See detailPreventive and emergency control of power systems
Wehenkel, Louis; Ruiz-Vega, Daniel; Ernst, Damien; Pavella, Mania

in Real Time Stability in Power Systems - Techniques for Early Detection of the Risk of Blackout (2005)

A general approach to real-time transient stability control is described, yielding various ...

Full Text
See detailOn multi-area control in electric power systems
Zima, Marek; Ernst, Damien

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

In this paper we study the concept of electric power system control, when the responsibility for ...

Full Text
See detailPower systems stability control: Reinforcement learning framework
Ernst, Damien; Glavic, Mevludin; Wehenkel, Louis

in IEEE Transactions on Power Systems (2004), 19(1), 427-435

In this paper, we explore how a computational approach to learning from interactions, called ...

Full Text
See detailMarket dynamics driven by the decision-making power producers
Ernst, Damien; Minoia, Anna; Marija, Ilic

in Proceedings of 2004 IREP Symposium - Bulk Power System Dynamics and Control - VI (2004)

In this paper we consider a tool for analyzing the market outcomes when competitive agents (power ...

Full Text
See detailNash equilibria and reinforcement learning for active decision maker modelling in power markets
Krause, Thilo; Andersson, Goran; Ernst, Damien; Vdovina-Beck, Elena et al

in Proceedings of the 6th IAEE European Conference: Modelling in Energy Economics and Policy (2004)

In this paper, we study the behavior of power suppliers who submit their bids to the market place ...

Full Text
See detailMarket dynamics driven by the decision-making of both power producers and transmission owners
Minoia, Anna; Ernst, Damien; Ilic, Marija

in Proceedings of the IEEE Power Engineering Society General Meeting 2004 (2004)

In this paper we consider an electricity market in which not only the power producers but also the ...

Full Text
See detailNear Optimal Closed-Loop Control. Application to Electric Power Systems
Ernst, Damien

Doctoral thesis (2003)

Full Text
See detailIteratively extending time horizon reinforcement learning
Ernst, Damien; Geurts, Pierre; Wehenkel, Louis

in Machine Learning: ECML 2003, 14th European Conference on Machine Learning (2003)

Reinforcement learning aims to determine an (infinite time horizon) optimal control policy from ...

Full Text
See detailA reinforcement learning based discrete supplementary control for power system transient stability enhancement
Glavic, Mevludin; Ernst, Damien; Wehenkel, Louis

in Proceedings of the 12th Intelligent Systems Application to Power Systems Conference (ISAP 2003) (2003)

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a ...

Full Text
See detailTransient stability emergency control combining open-loop and closed-loop technique
Ruiz-Vega, Daniel; Glavic, Mevludin; Ernst, Damien

in Proceedings of the IEEE Power Engineering Society General Meeting, 2003 (2003)

An on-line transient stability emergency control approach is proposed, which couples an open-loop ...

Full Text
See detailClosure of "a unified approach to transient stability contingency filtering, ranking, and assessment"
Ernst, Damien; Ruiz-Vega, Daniel; Pavella, Mania; Hirsch, Peter et al

in IEEE Transactions on Power Systems (2002), 17(2), 528-529

Full Text
See detailFACTS devices controlled by means of reinforcement learning algorithms
Ernst, Damien; Wehenkel, Louis

in Proceedings of the 14th Power Systems Computation Conference (PSCC 2002) (2002)

Reinforcement learning consists of a collection of methods for approximating solutions to ...

Full Text
See detailA unified approach to transient stability contingency filtering, ranking and assessment
Ernst, Damien; Ruiz-Vega, Daniel; Pavella, Mania; Hirsch, Peter et al

in IEEE Transactions on Power Systems (2001), 16(3), 435-443

This paper proposes a unified approach to contingency filtering, ranking and assessment in power ...

Full Text
See detailReinforcement learning applied to power system oscillations damping
Ernst, Damien

in Proceedings of the 40th Conference on Decision and Control (CDC 2001) (2001)

Full Text
See detailA control strategy for controllable series capacitor in electric power systems
Ghandhari, Mehrdad; Andersson, Goran; Pavella, Mania; Ernst, Damien

in Automatica (2001), 37

It has been veri"ed that a controllable series capacitor with a suitable control scheme can improve ...

Full Text
See detailAn approach to modal analysis of power system angle stability
Roth, Anna; Ruiz-Vega, Daniel; Ernst, Damien; Bulac, Constantin et al

in Proceedings of IEEE Powertech 2001 (2001)

An approach to modal analysis and modal identification is proposed, capable of complementing the ...

Full Text
See detailPreventive and emergency transient stability control
Ernst, Damien

Speech/Talk (2000)

Full Text
See detailOn-line transient stability constrained ATC calculations
Avilas-Rosales, R.; Ruiz-Vega, Daniel; Ernst, Damien; Pavella, Mania

in Proceedings of the IEEE Power Engineering Society Summer Meeting 2000 - Volume 2 (2000)

Transient Stability Assessment, preventive control measures and dynamic A X calculations are ...

Full Text
See detailApplication of reinforcement learning to electrical power system closed-loop emergency control
Druet, Christophe; Ernst, Damien; Wehenkel, Louis

in Principles of Data Mining and Knowledge Discovery, 4th European Conference, PKDD 2000 (2000)

This paper investigates the use of reinforcement learning in electric power system emergency ...

Full Text
See detailClosed-loop transient stability emergency control
Ernst, Damien; Pavella, Mania

in Proceedings of the IEEE Power Engineering Society Winter Meeting 2000 (2000)

The question of transient stability control is revisited, various types of controls are identified ...

Full Text
See detailPreventive and emergency transient stability control
Ernst, Damien; Ruiz-Vega, Daniel; Pavella, Mania

in Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000) (2000)

A unified approach to transient stability closed-loop control is presented. It relies on the ...

Full Text
See detailTransient Stability of Power Systems: A Unified Approach to Assessment and Control
Pavella, Mania; Ernst, Damien; Ruiz-Vega, Daniel

Book published by Kluwer Academic Publishers (2000)

Full Text
See detailA contingency filtering, ranking and assessment technique for on-line transient stability studies
Ruiz-Vega, Daniel; Ernst, Damien; Machado Ferreira, C.; Pavella, Mania et al

in Proceedings of International Conference on Electric Utility Deregulation and Restructing and Power Technologies 2000 (2000)

Full Text
See detailPreventive countermeasures for transient stability-constrained power systems
Ruiz-Vega, Daniel; Ernst, Damien; Pavella, Mania

in Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000) (2000)

A general transient stability control technique is applied to the design of preventive ...

Full Text
See detailA general framework for power system transient stability control
Pavella, Mania; Ernst, Damien; Ruiz-Vega, Daniel

in IEEE Power Engineering Society Letters (1999), 19(10), 45-46

Full Text
See detailTransient stability-constrained optimal power flow
Bettiol, Arlan; Ruiz-Vega, Daniel; Ernst, Damien; Wehenkel, Louis et al

in Proceedings of the IEEE Power Tech'99 (1999)

This paper proposes a new approach able to maximize the interface flow limits in power systems and ...

Full Text
See detailTransient stability-constrained generation rescheduling
Ruiz-Vega, Daniel; Bettiol, Arlan; Ernst, Damien; Wehenkel, Louis et al

in Proceedings of 1998 IREP Symposium - Bulk Power System Dynamics and Control - IV (1998, August)

Full Text
See detailReal-time transient stability emergency control of the South-Southeast Brazilian system
Ernst, Damien; Bettiol, Arlan; Zhang, Yiwei; Wehenkel, Louis et al

in Proceedings of SEPOPE 1998 (1998)

A method is proposed for during transients emergency control which predicts the evolution of a ...

Full Text
See detailCompensation schemes for transient stability assessment and control
Ernst, Damien; Bettiol, Arlon; Zhang, Yiwei; Wehenkel, Louis et al

in Proceedings of LESCOPE 98 (1998)

Full Text
See detailAn approach to real-time transient stability assessment and control
Pavella, Mania; Wehenkel, Louis; Bettiol, Arlon; Ernst, Damien

in Techniques for stability limit search - Publication IEEE : TP-138-0 (1997)