The RoboCup 2D simulation domain has served as a platform for research in AI, machine learning, and multiagent systems for more than two decades. However, for the researcher looking to quickly prototype and evaluate different algorithms, the full RoboCup task presents a cumbersome prospect, as it can take several weeks to set up the desired testing environment. The complexity owes in part to the coordination of several agents, each with a multi-layered control hierarchy, and which must balance offensive and defensive goals. This paper introduces a new open source benchmark, based on the Half Field Offense (HFO) subtask of soccer, as an easy-to-use platform for experimentation. While retaining the inherent challenges of soccer, the HFO environment constrains the agent's attention to decision-making, providing standardized interfaces for interacting with the environment and with other agents, and standardized tools for evaluating performance. The resulting testbed makes it convenient to test algorithms for single and multiagent learning, ad hoc teamwork, and imitation learning. Along with a detailed description of the HFO environment, we present benchmark results for reinforcement learning agents on a diverse set of HFO tasks. We also highlight several other challenges that the HFO environment opens up for future research.

PDF, HTML

In AAMAS Adaptive Learning Agents (ALA) Workshop, Singapore, May 2016.

@inproceedings{ALA16-hausknecht, title={Half Field Offense: An Environment for Multiagent Learning and Ad Hoc Teamwork}, author={Matthew Hausknecht and Prannoy Mupparaju and Sandeep Subramanian and Shivaram Kalyanakrishnan and Peter Stone}, booktitle={AAMAS Adaptive Learning Agents (ALA) Workshop}, month={May}, address={Singapore}, url="http://www.cs.utexas.edu/users/ai-lab?hausknecht:aamasws16", year={2016} }