UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
How Humans Teach Agents: A New Experimental Perspective (2012)
W. Bradley Knox
, Brian D. Glass, Bradley C. Love, W. Todd Maddox, and
Peter Stone
Human beings are a largely untapped source of in-the-loop knowledge and guidance for computational learning agents, including robots. To effectively design agents that leverage available human expertise, we need to understand how people naturally teach. In this paper, we describe two experiments that ask how differing conditions affect a human teacher's feedback frequency and the computational agent's learned performance. The first experiment considers the impact of a self-perceived teaching role in contrast to believing one is merely critiquing a recording. The second considers whether a human trainer will give more frequent feedback if the agent acts less greedily (i.e., choosing actions believed to be worse) when the trainer's recent feedback frequency decreases. From the results of these experiments, we draw three main conclusions that inform the design of agents. More broadly, these two studies stand as early examples of a nascent technique of using agents as highly specifiable social entities in experiments on human behavior.
View:
PDF
,
HTML
Citation:
International Journal of Social Robotics
, Vol. 4 (2012), pp. 409-421. Springer Netherlands.
Bibtex:
@article{IJSR12-knox, title={How Humans Teach Agents: A New Experimental Perspective}, author={W. Bradley Knox and Brian D. Glass and Bradley C. Love and W. Todd Maddox and Peter Stone}, volume={4}, journal={International Journal of Social Robotics}, publisher={Springer Netherlands}, pages={409-421}, url="http://www.cs.utexas.edu/users/ai-lab?IJSR12-knox", year={2012} }
People
W. Bradley Knox
Ph.D. Alumni
bradknox [at] mit edu
Peter Stone
Faculty
pstone [at] cs utexas edu
Projects
Teaching an Agent Manually via Evaluative Reinforcement (TAMER)
2008 - Present
Areas of Interest
Reinforcement Learning
Social Agents
Demos
Teaching an Agent Manually via Evaluative Reinforcement (TAMER)
W. Bradley Knox and Peter Stone
2009
Labs
Learning Agents