Paper published in a book (Scientific congresses and symposiums)
Embedding Monte Carlo search of features in tree-based ensemble methods
Maes, Francis; Geurts, Pierre; Wehenkel, Louis
2012In Flach, Peter; De Bie, Tijl; Cristianini, Nello (Eds.) Machine Learning and Knowledge Discovery in Data Bases
Peer reviewed
 

Files


Full Text
Maes2012Ecml.pdf
Author preprint (534.67 kB)
Download

All documents in ORBi are protected by a user license.

Send to



Details



Keywords :
Embedded Feature Generation; Monte Carlo Search; Decision Trees; Random Forests; Tree Boosting
Abstract :
[en] Feature generation is the problem of automatically constructing good features for a given target learning problem. While most feature generation algorithms belong either to the filter or to the wrapper approach, this paper focuses on embedded feature generation. We propose a general scheme to embed feature generation in a wide range of tree-based learning algorithms, including single decision trees, random forests and tree boosting. It is based on the formalization of feature construction as a sequential decision making problem addressed by a tractable Monte Carlo search algorithm coupled with node splitting. This leads to fast algorithms that are applicable to large-scale problems. We empirically analyze the performances of these tree-based learners combined or not with the feature generation capability on several standard datasets.
Disciplines :
Computer science
Author, co-author :
Maes, Francis ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Geurts, Pierre ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Wehenkel, Louis  ;  Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Systèmes et modélisation
Language :
English
Title :
Embedding Monte Carlo search of features in tree-based ensemble methods
Publication date :
September 2012
Event name :
European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases
Event place :
Bristol, United Kingdom
Event date :
from 24-09-2012 to 28-09-2012
Audience :
International
Main work title :
Machine Learning and Knowledge Discovery in Data Bases
Editor :
Flach, Peter
De Bie, Tijl
Cristianini, Nello
Publisher :
Springer
Collection name :
Lecture Notes in Artificial Intelligence
Pages :
191-206
Peer reviewed :
Peer reviewed
Available on ORBi :
since 19 September 2012

Statistics


Number of views
105 (8 by ULiège)
Number of downloads
124 (10 by ULiège)

Scopus citations®
 
2
Scopus citations®
without self-citations
2

Bibliography


Similar publications



Contact ORBi