Peter Stone's Selected Publications

Classified by TopicClassified by Publication TypeSorted by DateSorted by First Author Last NameClassified by Funding Source


Source Task Creation for Curriculum Learning

Sanmit Narvekar, Jivko Sinapov, Matteo Leonetti, and Peter Stone. Source Task Creation for Curriculum Learning. In Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016), May 2016.

Download

[PDF]630.0kB  [slides.pdf]10.2MB  

Abstract

Transfer learning in reinforcement learning has been an active area of research over the past decade. In transfer learning, training on a source task is leveraged to speed up or otherwise improve learning on a target task. This paper presents the more ambitious problem of curriculum learning in reinforcement learning, in which the goal is to design a sequence of source tasks for an agent to train on, such that final performance or learning speed is improved. We take the position that each stage of such a curriculum should be tailored to the current ability of the agent in order to promote learning new behaviors. Thus, as a first step towards creating a curriculum, the trainer must be able to create novel, agent-specific source tasks. We explore how such a space of useful tasks can be created using a parameterized model of the domain and observed trajectories on the target task. We experimentally show that these methods can be used to form components of a curriculum and that such a curriculum can be used successfully for transfer learning in 2 challenging multiagent reinforcement learning domains.

BibTeX Entry

@InProceedings{AAMAS16-Narvekar,
  author = {Sanmit Narvekar and Jivko Sinapov and Matteo Leonetti and Peter Stone},
  title = {Source Task Creation for Curriculum Learning},
  booktitle = {Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016)},
  location = {Singapore},
  month = {May},
  year = {2016},
  abstract = {
    Transfer learning in reinforcement learning has been an active
    area of research over the past decade.  In transfer learning, training
    on a source task is leveraged to speed up or otherwise improve learning
    on a target task. This paper presents the more ambitious problem of
    curriculum learning in reinforcement learning, in which the goal
    is to design a sequence of source tasks for an agent to train on,
    such that final performance or learning speed is improved. We
    take the position that each stage of such a curriculum should be
    tailored to the current ability of the agent in order to promote
    learning new behaviors. Thus, as a first step towards creating a
    curriculum, the trainer must be able to create novel, agent-specific
    source tasks. We explore how such a space of useful tasks can be
    created using a parameterized model of the domain and
    observed trajectories on the target task. We experimentally show that
    these methods can be used to form components of a curriculum and that
    such a curriculum can be used successfully for transfer learning in 2 
    challenging multiagent reinforcement learning domains.
  },
}

Generated by bib2html.pl (written by Patrick Riley ) on Fri Jun 14, 2019 11:36:26