UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
A Social Reinforcement Learning Agent (2001)
Charles Lee Isbell, Christian R. Shelton, Michael Kearns, Satinder Singh, and
Peter Stone
We report on our reinforcement learning work on Cobot, a software agent that resides in the well-known online chat community LambdaMOO. Our initial work on Cobot provided him with the ability to collect social statistics report them to users in a reactive manner. Here we describe our application of reinforcement learning to allow Cobot to proactively take actions in this complex social environment, and adapt his behavior from multiple sources of human reward. After 5 months of training, Cobot has received 3171 reward and punishment events from 254 different LambdaMOO users, and has learned nontrivial preferences for a number of users. Cobot modifies his behavior based on his current state in an attempt to maximize reward. Here we describe LambdaMOO and the state and action spaces of Cobot, and report the statistical results of the learning experiment.
View:
PDF
,
PS
,
HTML
Citation:
In
Proceedings of the Fifth International Conference on Autonomous Agents
, pp. 377--384 2001.
Bibtex:
@InProceedings{socialRL2001, title={A Social Reinforcement Learning Agent}, author={Charles Lee Isbell and Christian R. Shelton and Michael Kearns and Satinder Singh and Peter Stone}, booktitle={Proceedings of the Fifth International Conference on Autonomous Agents}, pages={377--384}, url="http://www.cs.utexas.edu/users/ai-lab?socialRL2001", year={2001} }
People
Peter Stone
Faculty
pstone [at] cs utexas edu
Areas of Interest
Reinforcement Learning
Social Agents
Labs
Learning Agents