Blockchain: A novel approach for the consensus algorithm using Condorcet Voting procedure

; ;

; ;

in Proceedings of the IEEE International Conference on Decentralized Applications and Infrastructures (2019, April)

The blockchain technology allows interested parties to access a common register, the update, and ...

Un réseau électrique mondial et basé sur les renouvelables, ce n’est plus de la science-fiction

;

;

Article for general public (2019)

On overfitting and asymptotic bias in batch reinforcement learning with partial observability

; ; ; et al

; ; ; et al

E-print/Working paper (2019)

This paper provides an analysis of the tradeoff between asymptotic bias (suboptimality with ...

Complementarity Assessment of South Greenland Katabatic Flows and West Europe Wind Regimes

; ; ; et al

; ; ; et al

in Energy (2019)

Current global environmental challenges require vigorous and diverse actions in the energy sector ...

Energiespecialist Damien Ernst: 'We hoeven helemaal niet minder energie te verbruiken'

;

;

Article for general public (2019)

Introducing neuromodulation in deep neural networks to learn adaptive behaviours

; ; ;

; ; ;

E-print/Working paper (2019)

In this paper, we propose a new deep neural network architecture, called NMD net, that has been ...

A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding

; ; ;

; ; ;

E-print/Working paper (2019)

Simulation-based Assessment of the Impact of Regulatory Frameworks on the Interactions between Electricity Users and Distribution System Operator

; ; ;

; ; ;

E-print/Working paper (2019)

This paper proposes a simulation-based methodology for evaluating the effectiveness of various ...

Evaluating the Evolution of Distribution Networks under Different Regulatory Frameworks with Multi-Agent Modelling

; ; ;

; ; ;

E-print/Working paper (2019)

In the context of increasing decentralised electricity generation, this paper evaluates the effect ...

Impact of gate closure time on the efficiency of power systems balancing

; ; ; et al

; ; ; et al

in Energy Policy (2019), 129

This paper focuses on market design options for operational balancing management in self-dispatch ...

Governments at COP24 should focus on building a global electricity grid – Prof. Damien Ernst

;

;

Article for general public (2018)

Critical Time Windows for Renewable Resource Complementarity Assessment

; ; ; et al

; ; ; et al

E-print/Working paper (2018)

This paper proposes a systematic framework to assess the complementarity of renewable resources ...

Centralised Planning of National Integrated Energy System with Power-to-Gas and Gas Storages

; ; ; et al

; ; ; et al

in Proceedings of the 11th Mediterranean Conference on Power Generation, Transmission, Distribution and Energy Conversion (Medpower2018) (2018, November)

This paper proposes an optimisation-based framework to tackle long-term centralised planning ...

Fostering Share&Charge through proper regulation

; ;

; ;

in Competition and Regulation in Network Industries (2018)

This article studies the emergence of Share&Charge, a German platform that organizes the sharing of ...

On the efficiency of decentralized decision-making in self-dispatch power systems

; ; ; et al

; ; ; et al

E-print/Working paper (2018)

This paper focuses on market design options for operational balancing management in self-dispatch ...

Regulatory Challenges for Share&Charge Models

; ;

; ;

in Network Industries Quarterly (2018), 20(3), 17-21

The platform Share&Charge provides an innovative solution to the lack of electric vehicles charging ...

Distributed Control of Photovoltaic Units in unbalanced LV Distribution Networks to Prevent Overvoltages

; ; ;

; ; ;

in Proc. of the 6th IEEE International Conference on Smart Energy Grid Engineering (SEGE 2018) (2018, August 12)

As more and more photovoltaic units are being installed, some LV networks have already attained ...

Blockchain for peer-to-peer energy exchanges: design and recommendations (additional work)

; ;

; ;

in CIRED Workshop 2018 Ljubljana, Slovania (2018, June 07)

Energy communities and peer-to-peer energy exchanges are expected to play an important role in the ...

Blockchain for peer-to-peer energy exchanges: Probabilistic approach of Proof of Stake

; ;

; ;

in CIRED WORKSHOP 2018 (2018, June 07)

Energy communities and peer-to-peer energy exchanges are expected to play an important role in the ...

Real-Time Bidding Strategies from Micro-Grids Using Reinforcement Learning

; ;

; ;

in Proceedings of CIRED Workshop 2018 (2018, June)

We address the problem faced by the operator of a microgrid participating in a continuous real-time ...

Intra-day Bidding Strategies for Storage Devices Using Deep Reinforcement Learning

; ; ;

; ; ;

in International Conference on the European Energy Market, Łódź 27-29 June 2018 (2018, June)

The problem faced by the operator of a storage device participating in a continuous intra-day (CID ...

Optimal operation and fair profit allocation in community microgrids

; ;

; ;

in Proceedings of CIRED Workshop 2018 (2018, June)

This work fits in the context of community migrogrids, where entities of a community can exchange ...

A multi-agent system approach to model the interaction between distributed generation deployment and the grid

; ; ;

; ; ;

in Proc. of CIRED Workshop 2018 (2018, June)

This paper introduces a multi-agent dynamical system of the interaction between electricity ...

Modelling of three-phase four-wire low-voltage cables taking into account the neutral connection to the earth

; ;

; ;

in Proc. of CIRED Workshop 2018 (2018, June)

Local energy communities (LECs) usually occur at the level of low-voltage distribution networks ...

Phase Identification of Smart Meters by Clustering Voltage Measurements

; ; ; et al

; ; ; et al

in Proceedings of the XX Power Systems Computation Conference (PSCC 2018) (2018, June)

When a smart meter, be it single-phase or threephase, is connected to a three-phase network, the ...

Blockchain for peer-to-peer energy exchanges: design and recommendations

; ;

; ;

in Proceedings of the XX Power Systems Computation Conference (PSCC2018) (2018, June)

Energy communities and peer-to-peer energy exchanges are expected to play an important role in the ...

Design and real-time test of a hybrid energy storage system in the microgrid with the benefit of improving the battery lifetime

; ; ; et al

; ; ; et al

in Applied Energy (2018), 218

This study proposes a hybrid energy storage system (HESS) composed of the superconducting energy ...

Exploring Regulation Policies in Distribution Networks through a Multi-Agent Simulator

; ; ;

; ; ;

in Proc. of YRS2018 (2018, May)

This paper presents a multi-agent simulator that describes the interactions between the agents of a ...

An Optimal Control Formulation of Pulse-Based Control Using Koopman Operator

; ;

; ;

in Automatica (2018), 91

In many applications, and in systems/synthetic biology in particular, it is desirable to compute ...

Pulse-Based Control Using Koopman Operator Under Parametric Uncertainty

;

;

in IEEE Transactions on Automatic Control (2018), 63(3), 791-796

In applications, such as biomedicine and systems/synthetic biology, technical limitations in ...

Effect of Voltage Constraints on the Exchange of Flexibility Services in Distribution Networks

; ; ;

; ; ;

in Proceedings of the 9th Conference on Innovative Smart Grid Technology North America (ISGT 2018) (2018, February)

Many possibilities exist to organise exchanges of flexibility within a distribution system. In this ...

SiSTEM, a Model for the Simulation of Short-Term Electricity Markets

; ; ; et al

; ; ; et al

E-print/Working paper (2017)

The aim of this document is to present SiSTEM, a multi-level simulation model of European short ...

A Simulator to Explore Tarification Designs for Distribution Networks

; ; ;

; ; ;

E-print/Working paper (2017)

This paper introduces a computational tool to help assess the impact of regulation policies within ...

Foreseeing New Control Challenges in Electricity Prosumer Communities

; ; ;

; ; ;

in Proc. of the 10th Bulk Power Systems Dynamics and Control Symposium – IREP’2017 (2017, August)

This paper is dedicated to electricity prosumer communities, which are groups of people producing ...

Reinforcement Learning for Electric Power System Decision and Control: Past Considerations and Perspectives

; ;

; ;

in The 20th World Congress of the International Federation of Automatic Control, Toulouse 9-14 July 2017 (2017, July)

In this paper, we review past (including very recent) research considerations in using ...

The state of play in cross-border electricity trade and the challenges towards a global electricity market environment

;

;

in Ilaria, Espa; Cottier, Thomas (Eds.) International trade in sustainable electricity (2017)

Efficient management of a connected microgrid in Belgium

; ; ;

; ; ;

in Proceedings of the 24th International Conference on Electricity Distribution, Glasgow, 12-15 June 2017 (2017, June)

Automatic phase identification of smart meter measurement data

; ;

; ;

in Proceedings of the 24th International Conference and Exhibition on Electricity Distribution, CIRED 2017 (2017, June)

This paper highlights the importance of the knowledge of the phase identification for the different ...

Simple connectome inference from partial correlation statistics in calcium imaging

; ; ; et al

; ; ; et al

in Soriano, Jordi; Battaglia, Demian; Guyon, Isabelle; Lemaire, Vincent (Eds.) et al Neural Connectomics Challenge (2017)

In this work, we propose a simple yet effective solution to the problem of connectome inference in ...

E-CLOUD, the open microgrid in existing network infrastructure

; ; ; et al

; ; ; et al

in Proceedings of the 24th International Conference on Electricity Distribution (2017, June)

The main goal of the E-Cloud, as with every microgrid, is to maximize the consumption of energy ...

Resilience of the DSO network near to 50.2Hz

; ;

; ;

in Proceedings of the 24th International Conference on Electricity Distribution (2017, June)

In an electrical system where decentralized and embedded productions are becoming more and more ...

Energy: the clash of nations

Speech/Talk (2017)

Le monde de l'énergie est en guerre. C'est une guerre qui est menée sur de nombreux fronts, du ...

Approximate Bayes Optimal Policy Search using Neural Networks

; ; ; et al

; ; ; et al

in Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017) (2017, February)

Bayesian Reinforcement Learning (BRL) agents aim to maximise the expected collected rewards ...

An App-based Algorithmic Approach for Harvesting Local and Renewable Energy Using Electric Vehicles

; ; ; et al

; ; ; et al

in Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017) (2017, February)

The emergence of electric vehicles (EVs), combined with the rise of renewable energy production ...

Residential heat pump as flexible load for direct control service with parametrized duration and rebound effect

; ; ; et al

; ; ; et al

in Applied Energy (2017), 187

This paper addresses the problem of an aggregator controlling residential heat pumps to offer a ...

A biased random key genetic algorithm applied to the electric distribution network reconfiguration problem

; ;

; ;

in Journal of Heuristics (2017)

This work presents a biased random-key genetic algorithm (BRKGA) to solve the electric distribution ...

On the Dynamics of the Deployment of Renewable Energy Production Capacities

;

;

in Furze, James N.; Swing, Kelly; Gupta, Anil K.; McClatchey, Richard H. (Eds.) et al Mathematical Advances Towards Sustainable Environmental Systems (2017)

This chapter falls within the context of modeling the deployment of renewable en-ergy production ...

A SC/battery Hybrid Energy Storage System in the Microgrid

; ; ;

; ; ;

in Energy Procedia (2017), 142

The major challenges in power systems are driven by the energy shortage and environmental concerns ...

Agent-based analysis of dynamic access ranges to the distribution network

; ;

; ;

in Proceedings of the 6th European Innovative Smart Grid Technologies (ISGT) (2017)

There is a need to clearly state an interaction model that formalizes interactions between actors ...

Deep Reinforcement Learning Solutions for Energy Microgrids Management

; ; ;

; ; ;

in European Workshop on Reinforcement Learning (EWRL 2016) (2016, December)

This paper addresses the problem of efficiently operating the storage devices in an electricity ...

La transition énergétique, l’affaire de tous

Speech/Talk (2016)

Conférence d'ouverture donnée par le Prof . Ernst lors de la soirée de lancement de la saison 2016 ...

Active network management for electrical distribution systems: problem formulation, benchmark, and approximate solution

; ;

; ;

in Optimization and Engineering (2016), 18(3), 587-629

With the increasing share of renewable and distributed generation in electrical distribution ...

Policy transfer using Value Function as Prior Information

; ;

; ;

Conference (2016, September 19)

This work proposes an approach based on reward shaping techniques in a reinforcement learning ...

Benchmarking for Bayesian Reinforcement Learning

; ; ;

; ; ;

in PLoS ONE (2016)

In the Bayesian Reinforcement Learning (BRL) setting, agents try to maximise the col- lected ...

A Gaussian mixture approach to model stochastic processes in power systems

; ; ; et al

; ; ; et al

in Proceedings of the 19th Power Systems Computation Conference (PSCC'16) (2016, June)

Probabilistic methods are emerging for operating electrical networks, driven by the integration of ...

Direct control service from residential heat pump aggregation with specified payback

; ; ; et al

; ; ; et al

in Proceedings of the 19th Power Systems Computation Conference (PSCC) (2016, June)

This paper addresses the problem of an aggregator controlling residential heat pumps to offer a ...

Further validation and extensions of the Global Capacity ANnouncement procedure for distribution systems

; ; ;

; ; ;

in CIRED Workshop Proceedings, Helsinki 14-15 June 2016 (2016, May)

This paper extends the Global Capacity ANnouncement procedure proposed in [5] along two directions ...

Modelling and Emulation of an Unbalanced LV Feeder with Photovoltaic Inverters

; ; ; et al

; ; ; et al

in Proc. of 8th IEEE Benelux Young researchers symposium in Electrical Power Engineering (2016, May)

In this paper, the penetration of grid-connected pho- tovoltaic systems is studied, experimentally ...

Towards the Minimization of the Levelized Energy Costs of Microgrids using both Long-term and Short-term Storage Devices

; ; ;

; ; ;

in Smart Grid: Networking, Data Management, and Business Models (2016)

This chapter falls within the context of the optimization of the levelized energy cost (LEC) of ...

Active Management of Low-Voltage Networks for Mitigating Overvoltages due to Photovoltaic Units

; ; ;

; ; ;

in IEEE Transactions on Smart Grid (2016), 2(7), 926-936

In this paper, the overvoltage problems that might arise from the integration of photovoltaic ...

Mer ou RER : faut-il vraiment 10 milliards d'argent public pour l'éolien offshore ?

;

;

Article for general public (2016)

Decision Making from Confidence Measurement on the Reward Growth using Supervised Learning: A Study Intended for Large-Scale Video Games

; ; ; et al

; ; ; et al

in Proceedings of the 8th International Conference on Agents and Artificial Intelligence (ICAART 2016) - Volume 2 (2016, February)

Video games have become more and more complex over the past decades. Today, players wander in ...

Residential heat pumps as flexible loads for direct control service with constrained payback

; ; ; et al

; ; ; et al

Conference (2016, January 26)

This paper addresses the problem of an aggregator controlling residential heat pumps to offer a ...

DSIMA: A testbed for the quantitative analysis of interaction models within distribution networks

; ; ;

; ; ;

in Sustainable Energy, Grids and Networks (2016), 5

This article proposes an open-source testbed to simulate interaction models governing the exchange ...

Imitative Learning for Online Planning in Microgrids

; ; ; et al

; ; ; et al

in Woon, Wei Lee; Zeyar, Aung; Stuart, Madnick (Eds.) Data Analytics for Renewable Energy Integration (2015, December 15)

This paper aims to design an algorithm dedicated to operational planning for microgrids in the ...

How to Discount Deep Reinforcement Learning: Towards New Dynamic Strategies

; ;

; ;

in NIPS 2015 Workshop on Deep Reinforcement Learning (2015, December)

Using deep neural nets as function approximator for reinforcement learning tasks have recently been ...

La Russie, ce dangereux ami pour lutter contre le djihadisme wahhabiste

;

;

Article for general public (2015)

Global capacity announcement of electrical distribution systems: A pragmatic approach

; ; ;

; ; ;

in Sustainable Energy, Grids and Networks (2015), 4

We propose a pragmatic procedure to facilitate the connection process of Distributed Generation (DG ...

Sequential decision-making approach for quadrangular mesh generation

; ;

; ;

in Engineering with Computers (2015), 31(4), 729-735

A new indirect quadrangular mesh generation algorithm which relies on sequential decision-making ...

Reinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market

; ; ; et al

; ; ; et al

in IEEE Transactions on Smart Grid (2015), 6(4), 1795-1805

This paper addresses the problem of defining a day-ahead consumption plan for charging a fleet of ...

Graph matching for reconciling SCADA and GIS of a distribution network

; ; ;

; ; ;

in Proceedings of the International Conference on Electricity Distribution, CIRED 2015 (2015, June)

This article deals with the problem of automatically es- tablishing a correspondence between two ...

A process to address electricity distribution sector challenges: the GREDOR project approach

; ; ;

; ; ;

in Proceedings of the International Conference on Electricity Distribution, CIRED 2015 (2015, June)

This paper presents a general process set in the GREDOR (French acronym for “Gestion des Réseaux ...

Macroscopic analysis of interaction models for the provision of flexibility in distribution systems

; ;

; ;

in Proceedings of the International Conference on Electricity Distribution, CIRED 2015 (2015, June)

To ease the transition towards the future of distribution grid management, regulators must revise ...

Artificial Intelligence in Video Games: Towards a Unified Framework

; ;

; ;

in International Journal of Computer Games Technology (2015), 2015

With modern video games frequently featuring sophisticated and realistic environments, the need for ...

L'arme de la transition énergétique pour combattre les djihadistes

;

;

Article for general public (2015)

Electricity storage with liquid fuels in a zone powered by 100% variable renewables

; ; ; et al

; ; ; et al

Conference (2015)

Electricity storage with liquid fuels in a zone powered by 100% variable renewables

; ; ; et al

; ; ; et al

in Proceedings of the 12th International Conference on the European Energy Market - EEM15 (2015)

In this work, an electricity zone with 100% renewables is simulated to determine the optimal sizing ...

Optimal Assignment of Off-Peak Hours to Lower Curtailments in the Distribution Network

; ; ;

; ; ;

in Proceedings of the 5th European Innovative Smart Grid Technologies (ISGT) (2015)

We consider a price signal with two settings: off-peak tariff and on-peak tariff. Some loads are ...

Le sabotage sophistiqué de Doel 4 et l’intrigant survol de centrales nucléaires par des drones: l’hypothèse pas folle d’un intérêt d’Etat ?

;

;

Article for general public (2014)

Using approximate dynamic programming for estimating the revenues of a hydrogen-based high-capacity storage device

; ;

; ;

in IEEE Symposium Series on Computational Intelligence (2014)

This paper proposes a methodology to estimate the maximum revenue that can be generated by a ...

Mathematical Modeling of HIV Dynamics After Antiretroviral Therapy Initiation: A Review

; ; ; et al

; ; ; et al

in BioResearch Open Access (2014), 3(5), 233-241

This review shows the potential ground-breaking impact that mathematical tools may have in the ...

Mathematical modeling of HIV dynamics after antiretroviral therapy initiation: A clinical research study

; ; ; et al

; ; ; et al

in AIDS Research and Human Retroviruses (2014), 30(9), 831-834

Immunological failure is identified from the estimation of certain parameters of a mathematical ...

Global power grids for harnessing world renewable energy

; ;

; ;

in Jones, Lawrence (Ed.) Renewable Energy Integration: Practical Management of Variability, Uncertainty and Flexibility in Power Grids (2014)

The Global Grid advocates the connection of all regional power systems into one electricity ...

Relaxations for multi-period optimal power flow problems with discrete decision variables

; ; ;

; ; ;

in Proceedings of the 18th Power Systems Computation Conference (PSCC'14) (2014, August)

We consider a class of optimal power flow (OPF) applications where some loads offer a modulation ...

A quantitative analysis of the effect of flexible loads on reserve markets

; ; ;

; ; ;

in Proceedings of the 18th Power Systems Computation Conference (PSCC) (2014, August)

We propose and analyze a day-ahead reserve market model that handles bids from flexible loads. This ...

Distributed Model-free Control of Photovoltaic Units for Mitigating Overvoltages in Low-Voltage Networks

; ; ; et al

; ; ; et al

in Proc. of CIRED 2014 workshop (2014, June)

In this paper, a distributed model-free control scheme to mitigate overvoltage problems caused by ...

Bayes Adaptive Reinforcement Learning versus Off-line Prior-based Policy Search: an Empirical Comparison

; ;

; ;

in Proceedings of the 23rd annual machine learning conference of Belgium and the Netherlands (BENELEARN 2014) (2014, June)

This paper addresses the problem of decision making in unknown finite Markov decision processes ...

Simple connectome inference from partial correlation statistics in calcium imaging

; ; ; et al

; ; ; et al

in Soriano, Jordi; Battaglia, Demian; Guyon, Isabelle; Lemaire, Vincent (Eds.) et al Neural Connectomics Challenge (2014)

In this work, we propose a simple yet effective solution to the problem of connectome inference in ...

Apprentissage par renforcement bayésien versus recherche directe de politique hors-ligne en utilisant une distribution a priori: comparaison empirique

; ;

; ;

in Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage (2014, May)

Cet article aborde le problème de prise de décision séquentielle dans des processus de déci- sion ...

Estimating the revenues of a hydrogen-based high-capacity storage device: methodology and results

; ;

; ;

in Proceedings des 9èmes Journée Francophones de Planification, Décision et Apprentissage (2014, May)

This paper proposes a methodology to estimate the maximum revenue that can be generated by a ...

Gestion active d’un réseau de distribution d’électricité : formulation du problème et benchmark

; ;

; ;

in Proceedings des 9èmes Journées Francophones de Planification, Décision et Apprentissage (2014, May)

Afin d’opérer un réseau de distribution d’électricité de manière fiable et efficace, c’est-à-dire ...

Toggling a genetic switch using reinforcement learning

; ; ; et al

; ; ; et al

in Proceedings of the 9th French Meeting on Planning, Decision Making and Learning (2014, May)

In this paper, we consider the problem of optimal exogenous control of gene regulatory networks ...

Optimized look-ahead tree policies: a bridge between look-ahead tree policies and direct policy search

; ; ;

; ; ;

in International Journal of Adaptive Control and Signal Processing (2014), 28(3-5), 255-289

Direct policy search (DPS) and look-ahead tree (LT) policies are two popular techniques for solving ...

A learning procedure for sampling semantically different valid expressions

; ; ;

; ; ;

in International Journal of Artificial Intelligence (2014), 12(1), 18-35

A large number of problems can be formalized as finding the best symbolic expression to maximize a ...

L'invité - Damien Ernst - "Nous allons vers une globalisation du marché de l'électricité"

Article for general public (2014)

En décembre 2013, Damien Ernst, Professeur à l’ULG, a donné une conférence au CESW intitulée ...

Lipschitz robust control from off-policy trajectories

; ; ;

; ; ;

in Proceedings of the 53rd IEEE Conference on Decision and Control (IEEE CDC 2014) (2014)

We study the minmax optimization problem introduced in [Fonteneau et al. (2011), ``Towards min max ...

Apprentissage par renforcement batch fondé sur la reconstruction de trajectoires artificielles

; ; ;

; ; ;

in Proceedings of the 9èmes Journées Francophones de Planification, Décision et Apprentissage (JFPDA 2014) (2014)

Cet article se situe dans le cadre de l’apprentissage par renforcement en mode batch, dont le ...

Power system transient stability preventive and emergency control

; ; ; et al

; ; ; et al

in Savulescu, Savu (Ed.) Real-Time Stability in Power Systems 2nd Edition (2014)

A general approach to real-time transient stability control is described, yielding various ...

On periodic reference tracking using batch-mode reinforcement learning with application to gene regulatory network control

; ; ; et al

; ; ; et al

in Proceedings of the 52nd Annual Conference on Decision and Control (CDC 2013) (2013, December)

In this paper, we consider the periodic reference tracking problem in the framework of batch-mode ...

An efficient algorithm for the provision of a day-ahead modulation service by a load aggregator

; ;

; ;

in Proceedings of the 4th European Innovative Smart Grid Technologies (ISGT) (2013, October)

This article studies a decision making problem faced by an aggregator willing to offer a load ...

The global grid

; ;

; ;

in Renewable Energy (2013), 57

This paper puts forward the vision that a natural future stage of the electricity network could be ...

Batch mode reinforcement learning based on the synthesis of artificial trajectories

; ; ;

; ; ;

in Annals of Operations Research (2013), 208(1), 383-416

Monte Carlo search algorithm discovery for single-player games

; ;

; ;

in IEEE Transactions on Computational Intelligence and AI in Games (2013), 5(3), 201-213

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms ...

Optimal discovery with probabilistic expert advice: finite time analysis and macroscopic optimality

; ;

; ;

in Journal of Machine Learning Research (2013), 14

We consider an original problem that arises from the issue of security analysis of a power system ...

Outbound SPIT Filter with Optimal Performance Guarantees

; ; ; et al

; ; ; et al

in Computer Networks (2013), 57(7), 16301643

This paper presents a formal framework for identifying and filtering SPIT calls (SPam in Internet ...

Scenario Trees and Policy Selection for Multistage Stochastic Programming Using Machine Learning

; ;

; ;

in INFORMS Journal on Computing (2013), 25(3), 488-501

In the context of multistage stochastic optimization problems, we propose a hybrid strategy for ...

Généralisation Min Max pour l'Apprentissage par Renforcement Batch et Déterministe : Relaxations pour le Cas Général T Etapes

; ; ;

; ; ;

in 8èmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA'13) (2013)

Cet article aborde le problème de généralisation minmax dans le cadre de l'apprentissage par ...

Min max generalization for deterministic batch mode reinforcement learning: relaxation schemes

; ; ;

; ; ;

in SIAM Journal on Control and Optimization (2013), 51(5), 33553385

We study the min max optimization problem introduced in Fonteneau et al. [Towards min max ...

Stratégies d'échantillonnage pour l'apprentissage par renforcement batch

; ; ;

; ; ;

in Revue d'Intelligence Artificielle (2013), 27(2), 171-194

We propose two strategies for experiment selection in the context of batch mode reinforcement ...

Active network management: planning under uncertainty for exploiting load modulation

; ; ;

; ; ;

in Proceedings of the 2013 IREP Symposium - Bulk Power Systems Dynamics and Control - IX (2013)

This paper addresses the problem faced by a distribution system operator (DSO) when planning the ...

Optimized Look-Ahead Trees: Extensions to Large and Continuous Action Spaces

; ;

; ;

in Proc. of IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL'13) (2013)

This paper studies look-ahead tree based control policies from the viewpoint of online decision ...

Meta-learning of Exploration/Exploitation Strategies: The Multi-Armed Bandit Case

; ;

; ;

in Filipe, Joaquim; Fred, Ana (Eds.) Agents and Artificial Intelligence: 4th International Conference, ICAART 2012, Vilamoura, Portugal, February 6-8, 2012. Revised Selected Papers (2013)

The exploration/exploitation (E/E) dilemma arises naturally in many subﬁelds of Science. Multi ...

Biorthogonalization Techniques for Least Squares Temporal Difference Learning

;

;

Poster (2012, December 07)

We consider Markov reward processes and study OLS-LSTD, a framework for selecting basis functions ...

Optimal discovery with probabilistic expert advice

; ;

; ;

in Proceedings of the 51st IEEE Conference on Decision and Control (CDC 2012) (2012, December)

Motivated by issues of security analysis for power systems, we analyze a new problem, called ...

Cooperative frequency control with a multi-terminal high-voltage DC network

; ; ;

; ; ;

in Automatica (2012), 48(12), 31283134

We consider frequency control in power systems made of several non-synchronous AC areas connected ...

A computationally efficient algorithm for the provision of a day-ahead modulation service by a load aggregator

; ; ;

; ; ;

Poster (2012, October 08)

We study a decision making problem faced by an aggregator willing to offer a load modulation ...

Policy search in a space of simple closed-form formulas: towards interpretability of reinforcement learning

; ; ;

; ; ;

in Discovery Science 15th International Conference, DS 2012, Lyon, France, October 29-31, 2012. Proceedings (2012, October)

In this paper, we address the problem of computing interpretable solutions to reinforcement ...

Contextual Multi-armed Bandits for the Prevention of Spam in VoIP Networks

; ; ;

; ; ;

E-print/Working paper (2012)

In this paper we argue that contextual multi-armed bandit algorithms could open avenues for ...

Généralisation min max pour l'apprentissage par renforcement batch et déterministe : schémas de relaxation

; ; ;

; ; ;

in Septièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2012) (2012, May)

On s’intéresse au problème de généralisation min max dans le cadre de l’apprentissage par ...

Coordinated primary frequency control among non-synchronous systems connected by a multi-terminal high-voltage direct current grid

; ; ;

; ; ;

in IET Generation, Transmission and Distribution (2012), 6(2), 99-108

The authors consider a power system composed of several non-synchronous AC areas connected by a ...

Learning to play K-armed bandit problems

; ;

; ;

in Proceedings of the 4th International Conference on Agents and Artificial Intelligence (ICAART 2012) (2012, February)

We propose a learning approach to pre-compute K-armed bandit playing policies by exploiting prior ...

Learning exploration/exploitation strategies for single trajectory reinforcement learning

; ; ;

; ; ;

in Proceedings of the 10th European Workshop on Reinforcement Learning (EWRL 2012) (2012)

We consider the problem of learning high-performance Exploration/Exploitation (E/E) strategies for ...

Imitative Learning for Real-Time Strategy Games

; ; ;

; ; ;

in Proceedings of the 2012 IEEE Conference on Computational Intelligence and Games (2012)

Over the past decades, video games have become increasingly popular and complex. Virtual worlds ...

Contextual Multi-armed Bandits for Web Server Defense

; ; ;

; ; ;

in Hussein, Abbas (Ed.) Proceedings of 2012 International Joint Conference on Neural Networks (IJCNN) (2012)

In this paper we argue that contextual multi-armed bandit algorithms could open avenues for ...

SPRT for SPIT: Using the Sequential Probability Ratio Test for Spam in VoIP Prevention

; ; ;

; ; ;

in Proc. of 6th International Conference on Autonomous Infrastructure, Management and Security (2012)

This paper presents the first formal framework for identifying and filtering SPIT calls (SPam in ...

Comparison of Different Selection Strategies in Monte-Carlo Tree Search for the Game of Tron

; ; ;

; ; ;

in IEEE Conference on Computational and Intelligence in Games 2012 (2012)

Monte-Carlo Tree Search (MCTS) techniques are essentially known for their performance on turn-based ...

Relaxation schemes for min max generalization in deterministic batch mode reinforcement learning

; ; ;

; ; ;

in 4th International NIPS Workshop on Optimization for Machine Learning (OPT 2011) (2011, December)

We study the min max optimization problem introduced in [Fonteneau, 2011] for computing policies ...

Artificial intelligence design for real-time strategy games

; ;

; ;

in NIPS Workshop on Decision Making with Multiple Imperfect Decision Makers (2011, December)

For now over a decade, real-time strategy (RTS) games have been challenging intelligence, human and ...

Ancillary services and operation of multi-terminal HVDC grids

;

;

in Proceedings of the International Workshop on Transmission Networks for Offshore Wind Power as well as on Transmission Networks for Offshore Wind Power Farms Plants (2011, October)

This paper addresses the problem of ancillary services in ac systems interconnected by a multi ...

Model predictive control of HVDC power ﬂow to improve transient stability in power systems

; ;

; ;

in Proceedings of the Second IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm) (2011, October)

This paper addresses the problem of HVDC control using real-time information to avoid loss of ...

Apprentissage actif par modification de la politique de décision courante

; ; ;

; ; ;

in Sixièmes Journées Francophones de Planification, Décision et Apprentissage pour la conduite de systèmes (JFPDA 2011) (2011, June)

Estimation Monte Carlo sans modèle de politiques de décision

; ; ;

; ; ;

in Revue d'Intelligence Artificielle (2011), 25

Approximate reinforcement learning: an overview

; ; ;

; ; ;

in Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11) (2011, April)

Reinforcement learning (RL) allows agents to learn how to optimally interact with complex ...

Active exploration by searching for experiments that falsify the computed control policy

; ; ;

; ; ;

in Proceedings of the 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11) (2011, April)

We propose a strategy for experiment selection - in the context of reinforcement learning - based ...

Cross-entropy optimization of control policies with adaptive basis functions

; ; ;

; ; ;

in IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics (2011), 41(1), 196-209

This paper introduces an algorithm for direct search of control policies in continuous-state ...

Multistage stochastic programming: A scenario tree based approach to planning under uncertainty

; ;

; ;

in Sucar, L. Enrique; Morales, Eduardo F.; Hoey, Jesse (Eds.) Decision Theory Models for Applications in Artificial Intelligence: Concepts and Solutions (2011)

In this chapter, we present the multistage stochastic programming framework for sequential decision ...

Towards min max generalization in reinforcement learning

; ; ;

; ; ;

in Filipe, Joaquim; Fred, Ana; Sharp, Bernadette (Eds.) Agents and Artificial Intelligence: International Conference, ICAART 2010, Valencia, Spain, January 2010, Revised Selected Papers (2011)

In this paper, we introduce a min max approach for addressing the generalization problem in ...

Voltage control in an HVDC system to share primary frequency reserves between non-synchronous areas

; ; ;

; ; ;

in Proceedings of the 17th Power Systems Computation Conference (PSCC-11) (2011)

This paper addresses the problem of frequency control for non-synchronous AC areas connected by a ...

Automatic discovery of ranking formulas for playing with multi-armed bandits

; ;

; ;

in Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011) (2011)

We propose an approach for discovering in an automatic way formulas for ranking arms while playing ...

Optimized look-ahead tree policies

; ;

; ;

in Proceedings of the 9th European Workshop on Reinforcement Learning (EWRL 2011) (2011)

We consider in this paper look-ahead tree techniques for the discrete-time control of a ...

Optimal sample selection for batch-mode reinforcement learning

; ; ;

; ; ;

in Proceedings of the 3rd International Conference on Agents and Artificial Intelligence (ICAART 2011) (2011)

We introduce the Optimal Sample Selection (OSS) meta-algorithm for solving discrete-time Optimal ...

Impact of delays on a consensus-based primary frequency control scheme for AC systems connected by a multi-terminal HVDC grid

; ; ;

; ; ;

in Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII (2010, August)

This paper addresses the problem of sharing primary frequency control reserves among nonsynchronous ...

Consequence driven decomposition of large-scale power system security analysis

; ; ; et al

; ; ; et al

in Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII (2010, August)

This paper presents an approach for assessing, in operation planning studies, the security of a ...

Coordination of voltage control in a power system operated by multiple transmission utilities

; ;

; ;

in Proceedings of the 2010 IREP Symposium - Bulk Power Systems Dynamics and Control - VIII (2010, August)

This paper addresses the problem of coordinating voltage control in a large-scale power system ...

Using prior knowledge to accelerate online least-squares policy iteration

; ; ;

; ; ;

in Proceedings of the 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (2010, May)

Reinforcement learning (RL) is a promising paradigm for learning optimal control. Although RL is ...

Approximate dynamic programming with a fuzzy parameterization

; ; ;

; ; ;

in Automatica (2010), 46(5), 804-814

Dynamic programming (DP) is a powerful paradigm for general, nonlinear optimal control. Computing ...

Generating informative trajectories by using bounds on the return of control policies

; ; ;

; ; ;

in Proceedings of the Workshop on Active Learning and Experimental Design 2010 (in conjunction with AISTATS 2010) (2010, May)

We propose new methods for guiding the generation of informative trajectories when solving discrete ...

Model-free Monte Carlo-like policy evaluation

; ; ;

; ; ;

in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (AISTATS 2010) (2010, May)

We propose an algorithm for estimating the finite-horizon expected return of a closed loop control ...

Model-free Monte Carlo–like policy evaluation

; ; ;

; ; ;

in Proceedings of Conférence Francophone sur l'Apprentissage Automatique (CAp) 2010 (2010, May)

We propose an algorithm for estimating the finite-horizon expected return of a closed loop control ...

Upper confidence bound based decision making strategies and dynamic spectrum access

; ; ;

; ; ;

in Proceedings of the 2010 IEEE International Conference on Communications (2010, May)

In this paper, we consider the problem of exploiting spectrum resources for a secondary user (SU ...

Reinforcement Learning and Dynamic Programming using Function Approximators

; ; ;

; ; ;

Book published by CRC Press (2010)

A cautious approach to generalization in reinforcement learning

; ; ;

; ; ;

in Proceedings of the 2nd International Conference on Agents and Artificial Intelligence (2010, January)

In the context of a deterministic Lipschitz continuous environment over continuous state spaces ...

Exploiting policy knowledge in online least-squares policy iteration: An empirical study

; ; ;

; ; ;

in Automation, Computers, Applied Mathematics (2010), 19(4), 521-529

Reinforcement learning (RL) is a promising paradigm for learning optimal control. Traditional RL ...

Online least-squares policy iteration for reinforcement learning control

; ; ;

; ; ;

in Proceedings of the 2010 American Control Conference (2010)

Reinforcement learning is a promising paradigm for learning optimal control. We consider policy ...

Voronoi model learning for batch mode reinforcement learning

;

;

Report (2010)

We consider deterministic optimal control problems with continuous state spaces where the ...

Computing bounds for kernel-based policy evaluation in reinforcement learning

; ; ;

; ; ;

Report (2010)

This technical report proposes an approach for computing bounds on the finite-time return of a ...

Model-free Monte Carlo-like policy evaluation

; ; ;

; ; ;

in 29th Benelux Meeting on Systems and Control (2010)

Multi-armed bandit based policies for cognitive radio's decision making issues

; ; ;

; ; ;

in Proceedings of the 3rd International Conference on Signals, Circuits and Systems (SCS) (2009, November)

We suggest in this paper that many problems related to Cognitive Radio’s (CR) decision making ...

Apoptosis characterizes immunological failure of HIV infected patients

; ; ; et al

; ; ; et al

in Control Engineering Practice (2009), 17(7), 798-804

This paper studies the influence of apoptosis in the dynamics of the HIV infection. A new modeling ...

Pseudo-geographical representations of power system buses by multidimensional scaling

; ;

; ;

in Proceedings of the 15th International Conference on Intelligent System Applications to Power Systems (ISAP 2009) (2009)

Graphical representations of power systems are systematically used for planning and operation. The ...

A rare-event approach to build security analysis tools when N-k (k > 1) analyses are needed (as they are in large-scale power systems)

; ;

; ;

in Proceedings of the 2009 IEEE Bucharest PowerTech (2009)

We consider the problem of performing N − k security analyses in large scale power systems. In such ...

Policy search with cross-entropy optimization of basis functions

; ; ;

; ; ;

in Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (2009)

This paper introduces a novel algorithm for approximate policy search in continuous-state, discrete ...

Apprentissage par renforcement appliqué à la commande des systèmes électriques

; ; ;

; ; ;

in Proceedings of "Les Journées Electrotechnique du Futur 2009" (2009)

Cet article propose une revue de littérature concernant les applications de l’apprentissage par ...

Bounds for Multistage Stochastic Programs using Supervised Learning Strategies

; ;

; ;

in Watanabe, Osamu; Zeugmann, Thomas (Eds.) Stochastic Algorithms: Foundations and Applications (2009)

We propose a generic method for obtaining quickly good upper bounds on the minimal value of a ...

Planning under uncertainty, ensembles of disturbance trees and kernelized discrete action spaces

; ;

; ;

in Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (2009)

Optimizing decisions on an ensemble of incomplete disturbance trees and aggregating their first ...

Reinforcement learning versus model predictive control: a comparison on a power system problem

; ; ;

; ; ;

in IEEE Transactions on Systems, Man and Cybernetics. Part B, Cybernetics (2009), 33(2), 517-519

This paper compares reinforcement learning (RL) with model predictive control (MPC) in a unified ...

What is the likely future of real-time transient stability ?

; ;

; ;

in Proceedings of the 2009 IEEE/PES Power Systems Conference & Exposition (PSCE 2009) (2009)

Despite very intensive research efforts in the field of transient stability during the last five ...

Inferring bounds on the performance of a control policy from a sample of one-step system transitions

; ; ;

; ; ;

in 28th Benelux Meeting on Systems and Control (2009)

Inferring bounds on the performance of a control policy from a sample of trajectories

; ; ;

; ; ;

in Proceedings of the IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) (2009)

We propose an approach for inferring bounds on the finite-horizon return of a control policy from ...

HVDC control strategies to improve transient stability in interconnected power systems

; ;

; ;

in Proceedings of the 2009 IEEE Bucharest PowerTech (2009)

This paper presents three HVDC modulation strategies to improve transient stability in an ...

Decentralized reactive power dispatch for a time-varying multi-TSO system

; ; ;

; ; ;

in Proceedings of the 42nd Hawaii International Conference on System Sciences (HICSS-42) (2009)

This paper addresses the problem of reactive power dispatch in a power system partitioned into ...

A fair method for centralized optimization of multi-TSO power systems

; ; ;

; ; ;

in International Journal of Electrical Power and Energy Systems (2009), 31

This paper addresses the problem of centralized optimization of an interconnected power system ...

Evaluation of network equivalents for voltage optimization in multi-area power systems

; ; ; et al

; ; ; et al

in IEEE Transactions on Power Systems (2009), 24(2), 729-743

The paper addresses the problem of decentralized optimization for a power system partitioned into ...

Research and Education Activities in Electric Power Systems at the University of Liège

; ; ;

; ; ;

in Revue E: Revue d'Electricité et d'Electronique Industrielle (2008), (4), 54-59

This paper presents research and education activities of the power systems group of the Department ...

Variable selection for dynamic treatment regimes: a reinforcement learning approach

; ;

; ;

in The annual machine learning conference of Belgium and the Netherlands (BeNeLearn 2008) (2008, May)

Modelling the influence of activation-induced apoptosis of CD4+ and CD8+ T-cells on the immune system response of a HIV-infected patient

; ; ; et al

; ; ; et al

in IET Systems Biology (2008), 2(2), 94-102

On the basis of the human immunodeficiency virus (HIV) infection dynamics model proposed by Adams ...

Analyzing transient instability phenomena beyond the classical stability boundary

; ; ; et al

; ; ; et al

in Proceedings of the 40th North American Power Symposium (NAPS 2008) (2008)

We consider power systems for which the amount of power produced by their individual power plants ...

Cross-entropy based rare-event simulation for the identification of dangerous events in power systems

; ;

; ;

in Proceedings of the 10th International Conference on Probabilistic Methods Applied to Power Systems (PMAPS-08) (2008)

We propose in this paper a novel approach for identifying rare events that may endanger power ...

Consistency of fuzzy model-based reinforcement learning

; ; ;

; ; ;

in Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-08) (2008)

Reinforcement learning (RL) is a widely used paradigm for learning control. Computing exact RL ...

Fuzzy partition optimization for approximate fuzzy Q-iteration

; ; ;

; ; ;

in Proceedings of the 17th IFAC World Congress (IFAC-08) (2008)

Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. Because exact ...

Continuous-state reinforcement learning with fuzzy approximation

; ; ;

; ; ;

in Tuyls, K.; Nowé, A.; Guessoum, Z.; Kudenko, D. (Eds.) Adaptive Agents and Multi-Agent Systems III, Adaptation and Multi-Agent Learning (2008)

Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. There exist ...

Lazy planning under uncertainty by optimizing decisions on an ensemble of incomplete disturbance trees

; ;

; ;

in Defourny, Boris; Ernst, Damien; Wehenkel, Louis (Eds.) Recent Advances in Reinforcement Learning (2008)

This paper addresses the problem of solving discrete-time optimal sequential decision making ...

Risk-aware decision making and dynamic programming

; ;

; ;

Conference (2008)

This paper considers sequential decision making problems under uncertainty, the tradeoff between ...

Variable selection for dynamic treatment regimes

; ;

; ;

in 27th Benelux Meeting on Systems and Control (2008)

Variable selection for dynamic treatment regimes: a reinforcement learning approach

; ;

; ;

Conference (2008)

Dynamic treatment regimes (DTRs) can be inferred from data collected through some randomized ...

How compatible is perfect competition with transmission loss allocation methods?

; ; ;

; ; ;

in Proceedings of the 5th International Conference on the European Electricity Market (EEM-08) (2008)

This paper addresses the problem of transmission loss allocation in a power system where the ...

On the fairness of centralised decision-making strategies in multi-area power systems

; ; ;

; ; ;

in Proceedings of the 16th Power Systems Computation Conference (PSCC-08) (2008)

In this paper, we consider an interconnected power system, where the different Transmission System ...

Contingency filtering techniques for preventive security-constrained optimal power flow

; ; ;

; ; ;

in IEEE Transactions on Power Systems (2007), 22(4), 1690-1697

This paper focuses on contingency filtering to accelerate the iterative solution of preventive ...

Estimation of rotor angles of synchronous machines using artificial neural networks and local PMU-based quantities

; ; ; et al

; ; ; et al

in Neurocomputing (2007), 70(16-18), 2668-2678

This paper investigates a possibility for estimating rotor angles in the time frame of transient ...

Interior-point based algorithms for the solution of optimal power flow problems

; ; ;

; ; ;

in Electric Power Systems Research (2007), 77(5-6), 508-517

Interior-point method (IPM) is a very appealing approach to the optimal power flow (OPF) problem ...

Nash equilibrium as the minimum of a function. Application to electricity markets with large number of actors

; ; ;

; ; ;

in Proceedings of the 2007 Power Tech (2007)

We introduce in this paper a new approach for efficiently identifying Nash equilibria for games ...

Continuous-state reinforcement learning with fuzzy approximation

; ; ;

; ; ;

in Proceedings of the 7th European Symposium on Adaptive Learning Agents and Multi-Agent Systems (ALAMAS-07) (2007)

Reinforcement learning (RL) is a widely used learning paradigm for adaptive agents. Well-understood ...

Fuzzy approximation for convergent model-based reinforcement learning

; ; ;

; ; ;

in Proceedings of the 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-07) (2007)

Reinforcement learning (RL) is a learning control paradigm that provides well-understood algorithms ...

Model predictive control and reinforcement learning as two complementary frameworks

; ; ;

; ; ;

in International Journal of Tomography and Statistics (2007), 6

Model predictive control (MPC) and reinforcement learning (RL) are two popular families of methods ...

The cross-entropy method for power system combinatorial optimization problems

; ; ; et al

; ; ; et al

in Proceedings of the 2007 Power Tech (2007)

We present an application of a cross-entropy based combinatorial optimization method for solving ...

E-SIME- A method for transient stability closed-loop emergency control: achievements and prospects

; ; ; et al

; ; ; et al

in Proceedings of 2007 IREP Symposium - Bulk Power Systems Dynamics and Control - VII (2007)

A general response-based technique is presented for closed-loop transient stability emergency ...

A collaborative framework for multi-area dynamic security assessment of large scale systems

; ;

; ;

in Proceedings of the 2007 Power Tech (2007)

In this paper we propose a collaborative framework to carry out multi-area dynamic security ...

A comparison of Nash equilibria analysis and agent-based modelling for power markets

; ; ; et al

; ; ; et al

in International Journal of Electrical Power and Energy Systems (2006), 28(9), 599-607

In this paper we compare Nash equilibria analysis and agent-based modelling for assessing the ...

Extremely randomized trees

; ;

; ;

in Machine Learning (2006), 63(1), 3-42

This paper proposes anew tree-based ensemble method for supervised classification and regression ...

Reference transmission network: A game theory approach

; ; ; et al

; ; ; et al

in IEEE Transactions on Power Systems (2006), 21(1), 249-259

The transmission network plays a key role in an oligopolistic electricity market. In fact, the ...

Applications of security-constrained optimal power flows

; ; ;

; ; ;

in In Proceedings of Modern Electric Power Systems Symposium, MEPS06 (2006)

This paper proposes to formulate security control as a sequential decision making problem and ...

Model predictive control and reinforcement learning as two complementary frameworks

; ; ;

; ; ;

in Proceedings of the 13th IFAC Workshop on Control Applications of Optimisation (2006)

Model predictive control (MPC) and reinforcement learning (RL) are two popular families of methods ...

Reinforcement learning with raw image pixels as input state

; ;

; ;

in Advances in machine vision, image processing & pattern analysis (Lecture notes in computer science, Vol. 4153) (2006)

We report in this paper some positive simulation results obtained when image pixels are directly ...

Clinical data based optimal STI strategies for HIV: a reinforcement learning approach

; ; ;

; ; ;

in Proceedings of the 45th IEEE Conference on Decision and Control (CDC 2006) (2006)

This paper addresses the problem of computing optimal structured treatment interruption strategies ...

Clinical data based optimal STI strategies for HIV: a reinforcement learning approach

; ; ;

; ; ;

in Proceedings of the 15th Annual Machine Learning Conference of Belgium and The Netherlands (Benelearn 2006) (2006)

This paper addresses the problem of computing optimal structured treatment interruption strategies ...

Damping control by fusion of reinforcement learning and control Lyapunov functions

; ;

; ;

in Proceedings of the 38th North American Power Symposium (NAPS 2006) (2006)

The main idea behind the concept, proposed in the paper, is the opportunity to make control systems ...

Ensembles of extremely randomized trees and some generic applications

; ;

; ;

in Proceedings of Robust Methods for Power System State Estimation and Load Forecasting (2006)

In this paper we present a new tree-based ensemble method called “Extra-Trees”. This algorithm ...

Multi-area security assessment: results using efficient bounding method

; ;

; ;

in Proceedings of the 38th North American Power Symposium (NAPS 2006) (2006)

We present our recent results on using previously introduced framework for multi-area security ...

On multi-area security assessment of large interconnected power systems

; ;

; ;

in Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry (2006)

The paper introduces a framework for information exchange and coordination of security assessment ...

About automatic learning for advanced sensing, monitoring and control of electric power systems

; ; ;

; ; ;

in Proceedings of the Second Carnegie Mellon Conference in Electric Power Systems: Monitoring, Sensing, Software and its Valuation for the Changing electric Power Industry (2006)

The paper considers the possible uses of automatic learning for improving power system performance ...

Automatic learning of sequential decision strategies for dynamic security assessment and control

; ; ;

; ; ;

in Proceedings of the IEEE Power Engineering Society General Meeting 2006 (2006)

This paper proposes to formulate security control as a sequential decision making problem and ...

A reinforcement learning based discrete supplementary control for power system transient stability enhancement

; ;

; ;

in Engineering Intelligent Systems for Electrical Engineering and Communications (2005), 13(2 Sp. Iss. SI), 81-88

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a ...

Tree-based batch mode reinforcement learning

; ;

; ;

in Journal of Machine Learning Research (2005), 6

Reinforcement learning aims to determine an optimal control policy from interaction with a system ...

Combining a stability and a performance-oriented control in power systems

; ;

; ;

in IEEE Transactions on Power Systems (2005), 20(1), 525-526

This paper suggests that the appropriate combination of a stability-oriented and a performance ...

Application of an advanced transient stability assessment and control method to a realistic power system

; ; ; et al

; ; ; et al

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

The paper presents a technical overview of a large research project on Dynamic Security Assessment ...

Selecting concise sets of samples for a reinforcement learning agent

in Proceedings of the 3rd International Conference on Computational Intelligence, Robotics and Autonomous Systems (CIRAS 2005) (2005)

We derive an algorithm for selecting from the set of samples gathered by a reinforcement learning ...

Approximate value iteration in the reinforcement learning context. Application to electrical power system control

; ; ;

; ; ;

in International Journal of Emerging Electrical Power Systems (2005), 3(1),

In this paper we explain how to design intelligent agents able to process the information acquired ...

A comparison of Nash equilibria analysis and agent-based modelling for power markets

; ; ; et al

; ; ; et al

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

In this paper we compare Nash equilibria analysis and agent-based modelling for assessing the ...

New developments in the application of automatic learning to power system control

; ;

; ;

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

In this paper we present the basic principles of supervised learning and reinforcement learning as ...

Preventive and emergency control of power systems

; ; ;

; ; ;

in Real Time Stability in Power Systems - Techniques for Early Detection of the Risk of Blackout (2005)

A general approach to real-time transient stability control is described, yielding various ...

On multi-area control in electric power systems

;

;

in Proceedings of the 15th Power System Computation Conference (PSCC 2005) (2005)

In this paper we study the concept of electric power system control, when the responsibility for ...

Power systems stability control: Reinforcement learning framework

; ;

; ;

in IEEE Transactions on Power Systems (2004), 19(1), 427-435

In this paper, we explore how a computational approach to learning from interactions, called ...

Market dynamics driven by the decision-making power producers

; ;

; ;

in Proceedings of 2004 IREP Symposium - Bulk Power System Dynamics and Control - VI (2004)

In this paper we consider a tool for analyzing the market outcomes when competitive agents (power ...

Nash equilibria and reinforcement learning for active decision maker modelling in power markets

; ; ; et al

; ; ; et al

in Proceedings of the 6th IAEE European Conference: Modelling in Energy Economics and Policy (2004)

In this paper, we study the behavior of power suppliers who submit their bids to the market place ...

Market dynamics driven by the decision-making of both power producers and transmission owners

; ;

; ;

in Proceedings of the IEEE Power Engineering Society General Meeting 2004 (2004)

In this paper we consider an electricity market in which not only the power producers but also the ...

Iteratively extending time horizon reinforcement learning

; ;

; ;

in Machine Learning: ECML 2003, 14th European Conference on Machine Learning (2003)

Reinforcement learning aims to determine an (infinite time horizon) optimal control policy from ...

A reinforcement learning based discrete supplementary control for power system transient stability enhancement

; ;

; ;

in Proceedings of the 12th Intelligent Systems Application to Power Systems Conference (ISAP 2003) (2003)

This paper proposes an application of a Reinforcement Learning (RL) method to the control of a ...

Transient stability emergency control combining open-loop and closed-loop technique

; ;

; ;

in Proceedings of the IEEE Power Engineering Society General Meeting, 2003 (2003)

An on-line transient stability emergency control approach is proposed, which couples an open-loop ...

Closure of "a unified approach to transient stability contingency filtering, ranking, and assessment"

; ; ; et al

; ; ; et al

in IEEE Transactions on Power Systems (2002), 17(2), 528-529

FACTS devices controlled by means of reinforcement learning algorithms

;

;

in Proceedings of the 14th Power Systems Computation Conference (PSCC 2002) (2002)

Reinforcement learning consists of a collection of methods for approximating solutions to ...

A unified approach to transient stability contingency filtering, ranking and assessment

; ; ; et al

; ; ; et al

in IEEE Transactions on Power Systems (2001), 16(3), 435-443

This paper proposes a unified approach to contingency filtering, ranking and assessment in power ...

Reinforcement learning applied to power system oscillations damping

in Proceedings of the 40th Conference on Decision and Control (CDC 2001) (2001)

A control strategy for controllable series capacitor in electric power systems

; ; ;

; ; ;

in Automatica (2001), 37

It has been veri"ed that a controllable series capacitor with a suitable control scheme can improve ...

An approach to modal analysis of power system angle stability

; ; ; et al

; ; ; et al

in Proceedings of IEEE Powertech 2001 (2001)

An approach to modal analysis and modal identification is proposed, capable of complementing the ...

On-line transient stability constrained ATC calculations

; ; ;

; ; ;

in Proceedings of the IEEE Power Engineering Society Summer Meeting 2000 - Volume 2 (2000)

Transient Stability Assessment, preventive control measures and dynamic A X calculations are ...

Application of reinforcement learning to electrical power system closed-loop emergency control

; ;

; ;

in Principles of Data Mining and Knowledge Discovery, 4th European Conference, PKDD 2000 (2000)

This paper investigates the use of reinforcement learning in electric power system emergency ...

Closed-loop transient stability emergency control

;

;

in Proceedings of the IEEE Power Engineering Society Winter Meeting 2000 (2000)

The question of transient stability control is revisited, various types of controls are identified ...

Preventive and emergency transient stability control

; ;

; ;

in Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000) (2000)

A unified approach to transient stability closed-loop control is presented. It relies on the ...

Transient Stability of Power Systems: A Unified Approach to Assessment and Control

; ;

; ;

Book published by Kluwer Academic Publishers (2000)

A contingency filtering, ranking and assessment technique for on-line transient stability studies

; ; ; et al

; ; ; et al

in Proceedings of International Conference on Electric Utility Deregulation and Restructing and Power Technologies 2000 (2000)

Preventive countermeasures for transient stability-constrained power systems

; ;

; ;

in Proceedings of the VII Symposium of Specialists in Electric Operational and Expansion Planning (SEPOPE 2000) (2000)

A general transient stability control technique is applied to the design of preventive ...

A general framework for power system transient stability control

; ;

; ;

in IEEE Power Engineering Society Letters (1999), 19(10), 45-46

Transient stability-constrained optimal power flow

; ; ; et al

; ; ; et al

in Proceedings of the IEEE Power Tech'99 (1999)

This paper proposes a new approach able to maximize the interface flow limits in power systems and ...

Transient stability-constrained generation rescheduling

; ; ; et al

; ; ; et al

in Proceedings of 1998 IREP Symposium - Bulk Power System Dynamics and Control - IV (1998, August)

Real-time transient stability emergency control of the South-Southeast Brazilian system

; ; ; et al

; ; ; et al

in Proceedings of SEPOPE 1998 (1998)

A method is proposed for during transients emergency control which predicts the evolution of a ...

Compensation schemes for transient stability assessment and control

; ; ; et al

; ; ; et al

in Proceedings of LESCOPE 98 (1998)

An approach to real-time transient stability assessment and control

; ; ;

; ; ;

in Techniques for stability limit search - Publication IEEE : TP-138-0 (1997)