• Classified by Topic • Classified by Publication Type • Sorted by Date • Sorted by First Author Last Name • Classified by Funding Source •
Source Task Creation for Curriculum Learning.
Sanmit Narvekar, Jivko Sinapov, Matteo Leonetti,
and Peter Stone.
In Proceedings of the 15th International Conference
on Autonomous Agents and Multiagent Systems (AAMAS 2016), May 2016.
[PDF]630.0kB [slides.pdf]10.2MB
Transfer learning in reinforcement learning has been an active area of research over the past decade. In transfer learning, training on a source task is leveraged to speed up or otherwise improve learning on a target task. This paper presents the more ambitious problem of curriculum learning in reinforcement learning, in which the goal is to design a sequence of source tasks for an agent to train on, such that final performance or learning speed is improved. We take the position that each stage of such a curriculum should be tailored to the current ability of the agent in order to promote learning new behaviors. Thus, as a first step towards creating a curriculum, the trainer must be able to create novel, agent-specific source tasks. We explore how such a space of useful tasks can be created using a parameterized model of the domain and observed trajectories on the target task. We experimentally show that these methods can be used to form components of a curriculum and that such a curriculum can be used successfully for transfer learning in 2 challenging multiagent reinforcement learning domains.
@InProceedings{AAMAS16-Narvekar,
author = {Sanmit Narvekar and Jivko Sinapov and Matteo Leonetti and Peter Stone},
title = {Source Task Creation for Curriculum Learning},
booktitle = {Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016)},
location = {Singapore},
month = {May},
year = {2016},
abstract = {
Transfer learning in reinforcement learning has been an active
area of research over the past decade. In transfer learning, training
on a source task is leveraged to speed up or otherwise improve learning
on a target task. This paper presents the more ambitious problem of
curriculum learning in reinforcement learning, in which the goal
is to design a sequence of source tasks for an agent to train on,
such that final performance or learning speed is improved. We
take the position that each stage of such a curriculum should be
tailored to the current ability of the agent in order to promote
learning new behaviors. Thus, as a first step towards creating a
curriculum, the trainer must be able to create novel, agent-specific
source tasks. We explore how such a space of useful tasks can be
created using a parameterized model of the domain and
observed trajectories on the target task. We experimentally show that
these methods can be used to form components of a curriculum and that
such a curriculum can be used successfully for transfer learning in 2
challenging multiagent reinforcement learning domains.
},
}
Generated by bib2html.pl (written by Patrick Riley ) on Wed Apr 17, 2024 18:42:53