Deep Reinforcement Learning; Temporal Difference Learning
Abstract :
[en] We introduce a novel Deep Reinforcement Learning (DRL) algorithm called Deep
Quality-Value (DQV) Learning. DQV uses temporal-difference learning to train
a Value neural network and uses this network for training a second Quality-value
network that learns to estimate state-action values. We first test DQV’s update rules
with Multilayer Perceptrons as function approximators on two classic RL problems,
and then extend DQV with the use of Deep Convolutional Neural Networks,
‘Experience Replay’ and ‘Target Neural Networks’ for tackling four games of the
Atari Arcade Learning environment. Our results show that DQV learns significantly
faster and better than Deep Q-Learning and Double Deep Q-Learning, suggesting
that our algorithm can potentially be a better performing synchronous temporal
difference algorithm than what is currently present in DRL.
Disciplines :
Computer science
Author, co-author :
Sabatelli, Matthia ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Algorith. des syst. en interaction avec le monde physique
Louppe, Gilles ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Big Data
Geurts, Pierre ; Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Algorith. des syst. en interaction avec le monde physique
Wiering, Marco
Language :
English
Title :
Deep Quality Value (DQV) Learning
Publication date :
07 December 2018
Journal title :
Advances in Neural Information Processing Systems
ISSN :
1049-5258
Publisher :
Morgan Kaufmann Publishers, San Mateo, United States - California
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.