Learning Agents
Director: Peter Stone
The learning agents research group is led by Prof. Peter Stone. Our aim is to understand how we can best create complete intelligent agents. We consider both adaptation and interaction to be essential capabilites of such agents. Thus, our research focuses mainly on machine learning, multiagent systems, and robotics. Application domains include robot soccer, autonomous bidding agents, traffic management, and autonomic computing.
     [Expand to show all 11][Minimize]
Katie Genter Ph.D. Student katie [at] cs utexas edu
Josiah Hanna Ph.D. Student jphanna [at] cs utexas edu
Matthew Hausknecht Ph.D. Student mhauskn [at] cs utexas edu
Piyush Khandelwal Ph.D. Student piyushk [at] cs utexas edu
Elad Liebman Ph.D. Student eladlieb [at] cs utexas edu
Patrick MacAlpine Ph.D. Student patmac [at] cs utexas edu
Jacob Menashe Ph.D. Student jmenashe [at] cs utexas edu
Sanmit Narvekar Ph.D. Student sanmit [at] cs utexas edu
Jivko Sinapov Postdoctoral Fellow jsinapov [at] cs utexas edu
Peter Stone Faculty pstone [at] cs utexas edu
Shiqi Zhang Postdoctoral Fellow szhang [at] cs utexas edu
     [Expand to show all 343][Minimize]
A Study of Layered Learning Strategies Applied to Individual Behaviors in Robot Soccer 2016
David L. Leottau, Javier Ruiz-del-Solar, Patrick MacAlpine, and Peter Stone, In {R}obo{C}up-2015: Robot Soccer World Cup {XIX}, Luis Almeida and Jianmin Ji and Gerald Steinbauer and Sean Luke (Eds.), Berlin, Germany 2016. Springer Verlag.
Ad Hoc Teamwork Behaviors for Influencing a Flock 2016
Katie Genter and Peter Stone, Acta Polytechnica (2016).
Adaptation of Surrogate Tasks for Bipedal Walk Optimization 2016
Patrick MacAlpine, Elad Liebman, and Peter Stone, In GECCO Surrogate-Assisted Evolutionary Optimisation (SAEOpt) Workshop, Denver, Colorado, USA, July 2016.
Adding Influencing Agents to a Flock 2016
Katie Genter and Peter Stone, In Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS-16), Singapore, Singapore, May 2016.
An MDP-Based Winning Approach to Autonomous Power Trading: Formalization and Empirical Analysis 2016
Daniel Urieli and Peter Stone, In Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), May 2016.
Autonomous Electricity Trading using Time-Of-Use Tariffs in a Competitive Market 2016
Daniel Urieli and Peter Stone, In Proceedings of the 30th Conference on Artificial Intelligence (AAAI 2016), Phoenix, AZ, USA, February 2016.
Deep Imitation Learning for Parameterized Action Spaces 2016
Matthew Hausknecht, Yilun Chen, and Peter Stone, In AAMAS Adaptive Learning Agents (ALA) Workshop, Singapore, May 2016.
Deep Reinforcement Learning in Parameterized Action Space 2016
Matthew Hausknecht and Peter Stone, In Proceedings of the International Conference on Learning Representations (ICLR), San Juan, Puerto Rico, May 2016.
Dynamically Constructed (PO)MDPs for Adaptive Robot Planning 2016
Shiqi Zhang, Piyush Khandelwal, and Peter Stone, In IJCAI'16 Workshop on Autonomous Mobile Service Robots, New York City, USA, July 2016.
Half Field Offense: An Environment for Multiagent Learning and Ad Hoc Teamwork 2016
Matthew Hausknecht, Prannoy Mupparaju, Sandeep Subramanian, Shivaram Kalyanakrishnan, and Peter Stone, In AAMAS Adaptive Learning Agents (ALA) Workshop, Singapore, May 2016.
Learning Multi-Modal Grounded Linguistic Semantics by Playing "I Spy" 2016
Jesse Thomason, Jivko Sinapov, Maxwell Svetlik, Peter Stone, and Raymond J. Mooney, In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI-16), pp. 3477--3483, New York City 2016.
Machine Learning Capabilities of a Simulated Cerebellum 2016
Matthew Hausknecht, Wen-Ke Li, Michael Mauk, and Peter Stone, IEEE Transactions on Neural Networks and Learning Systems (2016).
Minimum Cost Matching for Autonomous Carsharing 2016
Josiah P. Hanna, Michael Albert, Donna Chen, and Peter Stone, In Proceedings of the 9th IFAC Symposium on Intelligent Autonomous Vehicles (IAV 2016), Leipzig, Germany, June 2016.
Multirobot Symbolic Planning under Temporal Uncertainty 2016
Shiqi Zhang, Yuqian Jiang, Guni Sharon, and Peter Stone, In IJCAI'16 Workshop on Autonomous Mobile Service Robots, New York City, USA, July 2016.
Prioritized Role Assignment for Marking 2016
Patrick MacAlpine and Peter Stone, In {R}obo{C}up 2016: Robot Soccer World Cup {XX}, Sven Behnke and Daniel D. Lee and Sanem Sariel and Raymond Sheh (Eds.), Berlin 2016. Springer Verlag.
Robot Scavenger Hunt: A Standardized Framework for Evaluating Intelligent Mobile Robots 2016
Shiqi Zhang, Dongcai Lu, Xiaoping Chen, and Peter Stone, In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), New York City, USA, July 2016.
Source Task Creation for Curriculum Learning 2016
Sanmit Narvekar, Jivko Sinapov, Matteo Leonetti, and Peter Stone, In Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016), Singapore, May 2016.
State Aggregation through Reasoning in Answer Set Programming 2016
Ginevra Gaudioso, Matteo Leonetti, and Peter Stone, In Proceedings of the IJCAI Workshop on Autonomous Mobile Service Robots (WSR 16), New York City, NY, USA, July 2016.
Bin-Based Estimation of the Amount of Effort for Embedded Software Development Projects with Support Vector Machines 2016
Kazunori Iwata, Elad Liebman, Peter Stone, Toyoshiro Nakashima, Yoshiyuki Anan, and Naohiro Ishii, In {C}omputer and {I}nformation {S}cience , Roger Lee (Eds.), Berlin 2016. Springer Verlag.
Impact of Music on Decision Making in Quantitative Tasks 2016
Elad Liebman, Peter Stone, and Corey N. White, In 17th International Society for Music Information retrieval Conference (ISMIR), NYC, USA, August 2016.
UT Austin Villa RoboCup 3D Simulation Base Code Release 2016
Patrick MacAlpine and Peter Stone, In {R}obo{C}up 2016: Robot Soccer World Cup {XX}, Sven Behnke and Daniel D. Lee and Sanem Sariel and Raymond Sheh (Eds.), Berlin 2016. Springer Verlag.
UT Austin Villa: RoboCup 2015 3D Simulation League Competition and Technical Challenges Champions 2016
Patrick MacAlpine, Josiah Hanna, Jason Liang, and Peter Stone, In {R}obo{C}up-2015: Robot Soccer World Cup {XIX}, Luis Almeida and Jianmin Ji and Gerald Steinbauer and Sean Luke (Eds.), Berlin, Germany 2016. Springer Verlag.
Autonomous Intersection Management for Semi-Autonomous Vehicles 2015
Tsz-Chiu Au, Shun Zhang and Peter Stone, In Handbook of Transportation, May 2015.
Autonomous Trading in Modern Electricity Markets 2015
Daniel Urieli, PhD Thesis, Department of Computer Sciences, The University of Texas at Austin. Code and binaries available at: http://www.cs.utexas.edu/~urieli/thesis.
Benchmarking Robot Cooperation without Pre-Coordination in the RoboCup Standard Platform League Drop-In Player Competition 2015
Katie Genter, Tim Laue, and Peter Stone, In Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-15), Hamburg, Germany, September 2015.
Cooperating with Unknown Teammates in Complex Domains: A Robot Soccer Case Study of Ad Hoc Teamwork 2015
Samuel Barrett and Peter Stone, In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 2015.
CORPP: Commonsense Reasoning and Probabilistic Planning, as Applied to Dialog with a Mobile Robot 2015
Shiqi Zhang and Peter Stone, In Proceedings of the 29th Conference on Artificial Intelligence (AAAI), January 2015.
Deep Recurrent Q-Learning for Partially Observable MDPs 2015
Matthew Hausknecht and Peter Stone, In AAAI Fall Symposium on Sequential Decision Making for Intelligent Agents (AAAI-SDMIA15), Arlington, Virginia, USA, November 2015.
Determining Placements of Influencing Agents in a Flock 2015
Katie Genter, Shun Zhang, and Peter Stone, In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems (AAMAS-15), Istanbul, Turkey, May 2015.
DJ-MC: A Reinforcement-Learning Agent for Music Playlist Recommendation 2015
Elad Liebman, Maytal Saar-Tsechansky, and Peter Stone, In Proceedings of the 14th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Istanbul, Turkey, May 2015.
Framing reinforcement learning from human reward: Reward positivity, temporal discounting, episodicity, and performance 2015
W. Bradley Knox and Peter Stone, Artificial Intelligence, Vol. 225 (2015).
How Music Alters Decision Making: Impact of Music Stimuli on Emotional Classification 2015
Elad Liebman, Peter Stone, and Corey N. White, In 16th International Society for Music Information Retrieval Conference (ISMIR), Malaga, Spain, October 2015.
Intrinsically motivated model learning for developing curious robots 2015
Todd Hester and Peter Stone, Artificial Intelligence (2015). Elsevier.
Keyframe Sampling, Optimization, and Behavior Integration: Towards Long-Distance Kicking in the RoboCup 3D Simulation League 2015
Mike Depinet, Patrick MacAlpine, and Peter Stone, In {R}obo{C}up-2014: Robot Soccer World Cup {XVIII}, H. Levent Akin and Reinaldo A. C. Bianchi and Subramanian Ramamoorthy and Komei Sugiura (Eds.) 2015. Springer Verlag.
Leading the Way: An Efficient Multi-robot Guidance System 2015
Piyush Khandelwal, Samuel Barrett, and Peter Stone, In International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Istanbul, Turkey, May 2015.
Learning Inter-Task Transferability in the Absence of Target Task Samples 2015
Jivko Sinapov, Sanmit Narvekar, Matteo Leonetti, and Peter Stone, In Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Istanbul, Turkey, May 2015.
Learning to Interpret Natural Language Commands through Human-Robot Dialog 2015
Jesse Thomason, Shiqi Zhang, Raymond Mooney, and Peter Stone, In Proceedings of the 2015 International Joint Conference on Artificial Intelligence (IJCAI), pp. 1923--1929, Buenos Aires, Argentina, July 2015.
Mobile Robot Planning using Action Language BC with an Abstraction Hierarchy 2015
Shiqi Zhang, Fangkai Yang, Piyush Khandelwal, and Peter Stone, In Proceedings of the 13th International Conference on Logic Programming and Non-monotonic Reasoning (LPNMR), Lexington, KY, USA, September 2015.
Monte Carlo Heirarchical Model Learning 2015
Jacob Menashe and Peter Stone, In Proceedings of the 14th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Istanbul, Turkey, May 2015.
Representative Selection in Nonmetric Datasets 2015
Elad Liebman, Benny Chor, and Peter Stone, Applied Artificial Intelligence, Vol. 29, 8 (2015), pp. 807--838.
Robot-centric Activity Recognition "in the Wild" 2015
Gori, I., Sinapov, J., Khante, P., Stone, P., and Aggarwal, J.K., In Proceedings of the International Conference on Social Robotics (ICSR), October 2015.
The Impact of Determinism on Learning Atari 2600 Games 2015
Matthew Hausknecht and Peter Stone, In AAAI Workshop on Learning for General Competency in Video Games, Austin, Texas, USA, January 2015.
SCRAM: Scalable Collision-avoiding Role Assignment with Minimal-makespan for Formational Positioning 2015
Patrick MacAlpine, Eric Price, and Peter Stone, In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI), January 2015.
UT Austin Villa 2014: RoboCup 3D Simulation League Champion via Overlapping Layered Learning 2015
Patrick MacAlpine, Mike Depinet, and Peter Stone, In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI), January 2015.
UT Austin Villa: RoboCup 2014 3D Simulation League Competition and Technical Challenge Champions 2015
Patrick MacAlpine, Mike Depinet, Jason Liang, and Peter Stone, In {R}obo{C}up-2014: Robot Soccer World Cup {XVIII}, H. Levent Akin and Reinaldo A. C. Bianchi and Subramanian Ramamoorthy and Komei Sugiura (Eds.) 2015. Springer Verlag.
Communicating with Unknown Teammates 2014
Samuel Barrett, Noa Agmon, Noam Hazon, Sarit Kraus, and Peter Stone, In Proceedings of the Twenty-First European Conference on Artificial Intelligence, August 2014.
Cooperating with Unknown Teammates in Robot Soccer 2014
Samuel Barrett and Peter Stone, In AAMAS Autonomous Robots and Multirobot Systems Workshop (ARMS 2014), May 2014.
Cooperating with Unknown Teammates in Robot Soccer 2014
Samuel Barrett and Peter Stone, In AAAI Workshop on Multiagent Interaction without Prior Coordination (MIPC 2014), July 2014.
Influencing a Flock via Ad Hoc Teamwork 2014
Katie Genter and Peter Stone, In Proceedings of the Ninth International Conference on Swarm Intelligence (ANTS 2014), September 2014.
Mobile Robot Planning using Action Language BC with Hierarchical Domain Abstractions 2014
Shiqi Zhang, Fangkai Yang, Piyush Khandelwal, and Peter Stone, In The 7th Workshop on Answer Set Programming and Other Computing Paradigms (ASPOCP), July 2014.
Modeling Uncertainty in Leading Ad Hoc Teams 2014
Noa Agmon, Samuel Barrett, and Peter Stone, In Proc. of 13th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS), May 2014.
Multi-robot Human Guidance using Topological Graphs 2014
Piyush Khandelwal and Peter Stone, In AAAI Spring 2014 Symposium on Qualitative Representations for Robots (AAAI-SSS), March 2014.
Orienting a Flock via Ad Hoc Teamwork 2014
Katie Genter and Peter Stone, In Proceedings of the 13th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014), May 2014.
Planning in Action Language BC while Learning Action Costs for Mobile Robots 2014
Piyush Khandelwal, Fangkai Yang, Matteo Leonetti, Vladimir Lifschitz, and Peter Stone, In International Conference on Automated Planning and Scheduling (ICAPS), June 2014.
Planning in Answer Set Programming while Learning Action Costs for Mobile Robots 2014
Fangkai Yang, Piyush Khandelwal, Matteo Leonetti, and Peter Stone,
TacTex'13: A Champion Adaptive Power Trading Agent 2014
Daniel Urieli and Peter Stone, In Proceedings of the Twenty-Eighth Conference on Artificial Intelligence (AAAI 2014), July 2014.
The RoboCup 2013 Drop-In Player Challenges: A Testbed for Ad Hoc Teamwork 2014
Patrick MacAlpine, Katie Genter, Samuel Barrett, and Peter Stone, In Proc. of 13th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS), May 2014. Accompanying videos at
SCRAM: Scalable Collision-avoiding Role Assignment with Minimal-makespan for Formational Positioning 2014
Patrick MacAlpine, Eric Price, and Peter Stone, In Proc. of 13th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS), May 2014. Accompanying videos at
TacTex AA Binary The binary version of our 2009 TacTex AA agent, along with many other teams' agents, are available at the ... 2009

TacTex SCM Binaries Binary versions of all TacTex SCM (2005-2008) agents, along with many other teams' agents, are available at the ... 2008

TacTex SCM Starter Agent The purpose of this agent is to serve as a starting point for new participants in the TAC SCM competition. The agent is ... 2006

Keepaway player framework source code, version 0.6 The Keepaway player framework is an implementation of all the low- and mid-level keepaway behaviors described in the pub...