UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Reward (Mis)design for autonomous driving (2023)
W. Bradley Knox
, Alessandro Allievi, Holger Banzhaf, Felix Schmitt, and
Peter Stone
This article considers the problem of diagnosing certain common errors in reward design. Its insights are also applicable to the design of cost functions and performance metrics more generally. To diagnose common errors, we develop 8 simple sanity checks for identifying flaws in reward functions. We survey research that is published in top-tier venues and focuses on reinforcement learning (RL) for autonomous driving (AD). Specifically, we closely examine the reported reward function in each publication and present these reward functions in a complete and standardized format in the appendix. Wherever we have sufficient information, we apply the 8 sanity checks to each surveyed reward function, revealing near-universal flaws in reward design for AD that might also exist pervasively across reward design for other tasks. Lastly, we explore promising directions that may aid the design of reward functions for AD in subsequent research, following a process of inquiry that can be adapted to other domains.
View:
PDF
Citation:
Artificial Intelligence
, Vol. 316 (2023).
Bibtex:
@article{AIJ23-KNOX, title={Reward (Mis)design for autonomous driving}, author={W. Bradley Knox and Alessandro Allievi and Holger Banzhaf and Felix Schmitt and Peter Stone}, volume={316}, journal={Artificial Intelligence}, month={January}, url="http://www.cs.utexas.edu/users/ai-lab?AIJ23-KNOX", year={2023} }
People
W. Bradley Knox
Ph.D. Alumni
bradknox [at] mit edu
Peter Stone
Faculty
pstone [at] cs utexas edu
Areas of Interest
Autonomous Driving
Machine Learning
Reinforcement Learning
Robotics
Labs
Learning Agents