UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Evolving Opponent Models for Texas Hold 'Em (2008)
Alan J Lockett
and
Risto Miikkulainen
Opponent models allow software agents to assess a multi-agent environment more accurately and therefore improve the agent's performance. This paper makes use of coarse approximations to game-theoretic player representations to improve the performance of software players in Limit Texas Hold 'Em poker. A 10-parameter model, intended to model a combination, or mixture, of various strategies is developed to represent the opponent. A 'mixture identifier' is then evolved using the NEAT neuroevolution method to estimate values of these parameters for arbitrary opponents. To evaluate this approach, two poker players, represented as neural networks, were evolved under the same conditions, one with the mixture identifier, and one without. The player trained with access to the identifier achieved consistently higher and more stable fitness during evolution compared with the player without the identifier. Further, the player with the identifier outplays the other in a heads-up match after training, winning on average 60% of the money at the table. These results demonstrate that opponent modeling is effective even with low-dimensional models and conveys an advantage to players trained to use these models.
View:
PDF
Citation:
In
IEEE Conference on Computational Intelligence in Games
, Perth, Australia 2008.
Bibtex:
@inproceedings{lockett:cig08, title={Evolving Opponent Models for Texas Hold 'Em}, author={Alan J Lockett and Risto Miikkulainen}, booktitle={IEEE Conference on Computational Intelligence in Games}, address={Perth, Australia}, url="http://www.cs.utexas.edu/users/ai-lab?lockett:cig08", year={2008} }
People
Alan J. Lockett
Ph.D. Alumni
alan lockett [at] gmail com
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Projects
Constructing Intelligent Agents in Simulated Worlds
2008 - 2010
Areas of Interest
Game Playing
Neuroevolution
Labs
Neural Networks