The UT^2 Game Bot Judged More Human Than Humans
“The idea of the competition is to evaluate how we can make game bots, non-player characters (NPCs) controlled by AI algorithms, appear as human as possible,” explains Risto. “It is generally recognized that NPCs are relatively weak in most video games: their behavior is predictable and mechanical, and they often make mistakes that human players would be unlikely to make. Players often enjoy playing against other humans, because it provides a more interesting game experience. The goal of the competition is to promote more research in human-like bots, as well as evaluate how well we are currently doing in this area."
The UTCS team has participated in all six competitions since 2008. Over time, their bot design has changed significantly. To help guide their research and improvements, they ran a human subject study to determine what human judges base their decisions on. The winning entry consisted of a prioritized list of behaviors such as getting unstuck, shooting at the enemy, picking up an object, and running around the environment. The simplest of these behaviors were designed by hand, as scripts, but the most complex behaviors were learned using human traces and neuroevolution.
The battle behavior was learned using neuroevolution. Neural networks were used to control the movement, weapon selection, and shooting during close combat with an opponent. Instead of training the network using human behavior as targets, the team used evolutionary computation (genetic algorithms) to search for a network that would perform well. “In this case we found that a network that was evolved to be good also acted much like humans do, so a secondary objective of being similar to recorded human traces was not necessary,” explains Risto.
The UT^2 bot is the first winning bot in the history of the Humanlike Bot Competition to be judged as human more often than half the human players participating in the evaluation. “That is a significant milestone in the competition,” says Risto. While in the first several competitions, there was a persistent gap between all humans and all bots, that gap has now closed. “There is still much we can improve, and the competition will continue, with the next one scheduled for later this year.”
- Awards & Honors
- About Us
- Student Engagement and Support
- Masters Program
- Ph.D. Program
- Financial Information
- Prospective Students
- Incoming Students
- Current Students
- Curricular Practical Training
- Grad Student Talks
- UTCS Direct