UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Value-Function-Based Transfer for Reinforcement Learning Using Structure Mapping (2006)
Yaxin Liu
and
Peter Stone
Transfer learning concerns applying knowledge learned in one task (the source) to improve learning another related task (the target). In this paper, we use structure mapping, a psychological and computational theory about analogy making, to find mappings between the source and target tasks and thus construct the transfer functional automatically. Our structure mapping algorithm is a specialized and optimized version of the structure mapping engine and uses heuristic search to find the best maximal mapping. The algorithm takes as input the source and target task specifications represented as qualitative dynamic Bayes networks, which do not need probability information. We apply this method to the Keepaway task from RoboCup simulated soccer and compare the result from automated transfer to that from handcoded transfer.
View:
PDF
,
PS
,
HTML
Citation:
In
Proceedings of the Twenty-First National Conference on Artificial Intelligence
, pp. 415-20, July 2006.
Bibtex:
@InProceedings{AAAI06-yaxin, title={Value-Function-Based Transfer for Reinforcement Learning Using Structure Mapping}, author={Yaxin Liu and Peter Stone}, booktitle={Proceedings of the Twenty-First National Conference on Artificial Intelligence}, month={July}, pages={415-20}, url="http://www.cs.utexas.edu/users/ai-lab?AAAI06-yaxin", year={2006} }
People
Yaxin Liu
Postdoctoral Alumni
Peter Stone
Faculty
pstone [at] cs utexas edu
Areas of Interest
Other Areas
Reinforcement Learning
Transfer Learning
Labs
Learning Agents