Paper published in a book (Scientific congresses and symposiums)
Policy search in a space of simple closed-form formulas: towards interpretability of reinforcement learning
Maes, Francis; Fonteneau, Raphaël; Wehenkel, Louis et al.
2012In Discovery Science 15th International Conference, DS 2012, Lyon, France, October 29-31, 2012. Proceedings
Peer reviewed
 

Files


Full Text
Maes2012Ds.pdf
Publisher postprint (221.45 kB)
Download
Annexes
Maes2012DSSlides.pdf
Publisher postprint (4.88 MB)
This is a fun comic-book like presentation of this paper !
Download

All documents in ORBi are protected by a user license.

Send to



Details



Keywords :
Reinforcement Learning; Formula Discovery; Interpretability
Abstract :
[en] In this paper, we address the problem of computing interpretable solutions to reinforcement learning (RL) problems. To this end, we propose a search algorithm over a space of simple losed-form formulas that are used to rank actions. We formalize the search for a high-performance policy as a multi-armed bandit problem where each arm corresponds to a candidate policy canonically represented by its shortest formula-based representation. Experiments, conducted on standard benchmarks, show that this approach manages to determine both efficient and interpretable solutions.
Disciplines :
Computer science
Author, co-author :
Maes, Francis ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Fonteneau, Raphaël ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Wehenkel, Louis  ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Ernst, Damien  ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Smart grids
Language :
English
Title :
Policy search in a space of simple closed-form formulas: towards interpretability of reinforcement learning
Publication date :
October 2012
Event name :
The Fifteenth International Conference on Discovery Science (DS 2012)
Event date :
29-31 October, 2012
Audience :
International
Main work title :
Discovery Science 15th International Conference, DS 2012, Lyon, France, October 29-31, 2012. Proceedings
Publisher :
Springer, Berlin, Germany
ISBN/EAN :
978-3-642-33491-7
Pages :
37-51
Peer reviewed :
Peer reviewed
Available on ORBi :
since 30 November 2012

Statistics


Number of views
99 (14 by ULiège)
Number of downloads
466 (7 by ULiège)

Scopus citations®
 
16
Scopus citations®
without self-citations
15
OpenCitations
 
10

Bibliography


Similar publications



Contact ORBi