UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Representation Transfer for Reinforcement Learning (2007)
Matthew E. Taylor
and
Peter Stone
Transfer learning problems are typically framed as leveraging knowledge learned on a source task to improve learning on a related, but different, target task. Current transfer learning methods are able to successfully transfer knowledge from a source reinforcement learning task into a target task, reducing learning time. However, the complimentary task of transferring knowledge between agents with different internal representations has not been well explored The goal in both types of transfer problems is the same: reduce the time needed to learn the target with transfer, relative to learning the target without transfer. This work defines representation transfer, contrasts it with task transfer, and introduces two novel algorithms. Additionally, we show representation transfer algorithms can also be successfully used for task transfer, providing an empirical connection between the two problems. These algorithms are fully implemented in a complex multiagent domain and experiments demonstrate that transferring the learned knowledge between different representations is both possible and beneficial.
View:
PDF
,
PS
,
HTML
Citation:
In
AAAI 2007 Fall Symposium on Computational Approaches to Representation Change during Learning and Development
, November 2007.
Bibtex:
@InProceedings{AAAI07-Symposium-Taylor, title={Representation Transfer for Reinforcement Learning}, author={Matthew E. Taylor and Peter Stone}, booktitle={AAAI 2007 Fall Symposium on Computational Approaches to Representation Change during Learning and Development}, month={November}, url="http://www.cs.utexas.edu/users/ai-lab?AAAI07-Symposium-Taylor", year={2007} }
People
Peter Stone
Faculty
pstone [at] cs utexas edu
Matthew Taylor
Ph.D. Alumni
taylorm [at] eecs wsu edu
Areas of Interest
Other Areas
Reinforcement Learning
Transfer Learning
Labs
Learning Agents