UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Continuous-domain reinforcement learning using a learned qualitative state representation (2008)
Jonathan Mugan
and
Benjamin Kuipers
We present a method that allows an agent to learn a qualitative state representation that can be applied to reinforcement learning. By exploring the environment the agent is able to learn an abstraction that consists of landmarks that break the space into qualitative regions, and rules that predict changes in qualitative state. For each predictive rule the agent learns a context consisting of qualitative variables that predicts when the rule will be successful. The regions of this context in which the rule is likely to succeed serve as a natural goals for reinforcement learning. The reinforcement learning problems created by the agent are simple because the learned abstraction provides a mapping from the continuous input and motor variables to discrete states that aligns with the dynamics of the environment.
View:
PDF
Citation:
In
22nd International Workshop on Qualitative Reasoning (QR-08)
2008.
Bibtex:
@inproceedings{Mugan-qrws-08, title={Continuous-domain reinforcement learning using a learned qualitative state representation}, author={Jonathan Mugan and Benjamin Kuipers}, booktitle={22nd International Workshop on Qualitative Reasoning (QR-08)}, url="http://www.cs.utexas.edu/users/ai-lab?Mugan-qrws-08", year={2008} }
People
Benjamin Kuipers
Formerly affiliated Faculty
kuipers [at] cs utexas edu
Jonathan Mugan
Ph.D. Alumni
jmugan [at] cs utexas edu
Areas of Interest
Bootstrap Learning
Robotics