UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
A modular reinforcement learning model for human visuomotor behavior in a driving task (2011)
Brian Sullivan
,
Leif Johnson
,
Dana Ballard
and Mary Hayhoe
We present a task scheduling framework for studying human eye movements in a realistic 3D driving simulation. Human drivers are modeled using a reinforcement learning algorithm with "task modules" that make learning tractable and provide a cost metric for behaviors. Eye movement scheduling is simulated with a loss minimization strategy that incorporates expected reward estimates given uncertainty about the state of environment. This work extends a previous model that was applied to a simulation of walking; we extend this approach using a more dynamic state space and adding task modules that reflect the greater complexity in driving. We also discuss future work in applying this model to navigation and fixation data from human drivers.
View:
PDF
Citation:
Proceedings of the AISB 2011 Symposium on Architectures for Active Vision.
(2011), pp. 33-40.
Bibtex:
@article{sullivan:aisb11, title={A modular reinforcement learning model for human visuomotor behavior in a driving task}, author={Brian Sullivan and Leif Johnson and Dana Ballard and Mary Hayhoe}, booktitle={Proceedings of the AISB 2011 Symposium on Architectures for Active Vision.}, pages={33-40}, url="http://www.cs.utexas.edu/users/ai-lab?sullivan:aisb11", year={2011} }
People
Dana Ballard
Faculty
dana [at] cs utexas edu
Leif Johnson
Ph.D. Alumni
leif [at] cs utexas edu
Brian T. Sullivan
Ph.D. Alumni
brians [at] mail utexas edu
Areas of Interest
Cognitive Science
Motor Control
Reinforcement Learning
Virtual Reality
Labs
Embodied Cognition Lab