Other (Reports)
A feature-based approach for best arm identification in the case of the Monte Carlo search algorithm discovery for one-player games
Taralla, David
2013
 

Files


Full Text
rapport.pdf
Publisher postprint (1.98 MB)
Download
Annexes
presentation.pdf
Publisher postprint (882.15 kB)
The supporting slides of this internship defense.
Download

All documents in ORBi are protected by a user license.

Send to



Details



Keywords :
monte carlo tree search; optimisation; mcts; best arm identification
Abstract :
[en] The field of reinforcement learning recently received the contribution by Ernst et al. (2013) "Monte carlo search algorithm discovery for one player games" who introduced a new way to conceive completely new algorithms. Moreover, it brought an automatic method to find the best algorithm to use in a particular situation using a multi-arm bandit approach. We address here the problem of best arm identification. The main problem is that the generated algorithm space (ie. the arm space) can be quite large as the depth of the generated algorithms increases, so we just can't sample each algorithm the right number of times to be confident enough on the final choice (ie., to be sure the regret is minimized). We need therefore an optimized, scalable method for selecting the best algorithm from bigger spaces. The main idea is to see the reward of pulling an arm as a function of its features rather than directly exploring the algorithm space to find the best arm. This way, we demonstrate we are able to design a confident best arm identification algorithm, without suffering from the size of the space.
Disciplines :
Computer science
Author, co-author :
Taralla, David ;  Université de Liège - ULiège > 2e an. master ingé. civ. info., fin. appr.
Language :
English
Title :
A feature-based approach for best arm identification in the case of the Monte Carlo search algorithm discovery for one-player games
Publication date :
December 2013
Available on ORBi :
since 03 February 2015

Statistics


Number of views
150 (25 by ULiège)
Number of downloads
173 (6 by ULiège)

Bibliography


Similar publications



Contact ORBi