CS378: Autonomous Multiagent Systems -- Spring 2005: Resources Page

Resources for Autonomous Multiagent Systems (cs378)

Week 1 (1/18,20)

  • Initial and final slides from Tuesday, 1/18: (pdf). The slides on RoboCup.
  • Slides from Thursday, 1/20: (pdf).
  • Austin Villa robot soccer team with some links to videos from previous competitions such as the one I showed in class.

    • Week 2 (1/25,27): Autonomous agents

  • Slides from Tuesday, 1/25: (pdf).
  • Slides from Thursday, 1/27: (pdf).

    • Week 3 (2/1,3): Agent architectures

  • Slides from Tuesday, 2/1: (pdf). The ones on planning.
  • Slides from Thursday, 2/3: (pdf).
  • A journal article with more details on the initial subsumption implementation:
    Brooks, R. A. "A Robust Layered Control System for a Mobile Robot", IEEE Journal of Robotics and Automation, Vol. 2, No. 1, March 1986, pp. 1423; also MIT AI Memo 864, September 1985. The detail slides from that article.
  • Pengo

    • Week 4 (2/8,10): Multiagent systems

  • Slides from Tuesday, 2/8: (pdf).
  • Slides from Thursday, 2/10: (pdf).
  • AAMAS 2005 workshop on Safety and Security in Multi-Agent Systems (SASEMAS). There will be a RoboCup rescue competition there.

    • Week 5 (2/15,17): Agent communication and Teamwork

  • Slides from Tuesday, 2/15: (pdf). The ones on the pursuit domain(ps).
  • Slides from Thursday, 2/17: (pdf). The ones on the communication paradigm for RoboCup(ps).
  • Additional readings on communication:
  • Textbook: chapter 8
    **OR**
    Sections 2.1 and 2.2 (pages 1-19) of Multiagent Systems and Societies of Agents. (get cached copy from upper right corner)
    Michael N. Huhns and Larry M. Stephens.
    Chapter 2 in Multiagent Systems, G. Weiss (ed.), MIT Press, 1998.
  • Desiderata for Agent Communication Languages.
    James Mayfield, Yannis Labrou, and Tim Finin.
    Proceedings of the AAAI Symposium on Information Gathering from Heterogeneous, Distributed Environments, AAAI-95 Spring Symposium, Stanford University, Stanford, CA. March 27-29, 1995.
  • Additional readings on teamwork:
  • Towards Flexible Teamwork.
     Tambe, M.
    Journal of Artificial Intelligence Research (JAIR), Volume 7, pages 83-124, 1997.
  • Regarding ontologies, Cyc and its open-source version, OpenCyc.
  • The Suggested Upper Merged Ontology (SUMO).
  • FIPA sample applications
  • FIPA ACL in XML
  • A paper on evoving communication languages: Talking Helps: Evolving Communicating Agents for the Predator-Prey Pursuit Problem by Jim and Giles
  • A paper on an ACL for soccer agents: CommLang: Communication for Coachable Agents by Divan, Riley, and Veloso.

    • Week 6 (2/22,24): RoboCup case studies

  • Slides from Tuesday, 2/22: (pdf). Some more(ps).
  • Slides from Thursday, 2/24: (pdf). (on genetic algorithms - from Tom Mitchell's book Machine Learning)
  • The undergraduate writing center
  • Reactive Deliberation: An Architecture for Real-time Intelligent Control in Dynamic Environments. (If the link doesn't work for you, pdf version is also available from citeseer - top right corner)
     Michael K. Sahota.
    Proceedings of the Twelfth National Conference on Artificial Intelligence, 1994.
    (From the group that invented robotic soccer: pre-RoboCup)
  • Co-evolving Soccer Softbot Team Coordination with Genetic Programming.
     Sean Luke, Charles Hohn, Jonathan Farris, Gary Jackson, and James Hendler.
    in Kitano (ed.) RoboCup-97: Robot Soccer World Cup I. Springer Verlag, Berlin, 1998
    (1997 evolutionary learning approach)
  • A Role-Based Decision-Mechanism for Teams of Reactive and Coordinating Agents.
     Slivia Coradeschi and Lars Karlsson.
    in Kitano (ed.) RoboCup-97: Robot Soccer World Cup I. Springer Verlag, Berlin, 1998
    (an early, successful approach)
  • AT Humboldt -- Development, Practice and Theory.
     Hans-Dieter Burkhard, Markus Hannebauer, Jan Wendler.
    in Kitano (ed.) RoboCup-97: Robot Soccer World Cup I. Springer Verlag, Berlin, 1998
    (1997 champion)
  • Behavior Networks for Continuous Domains using Situation-Dependent Motivations.
     Klaus Dorer.
    Proceedings of the 16th International Joint Conference on Artificial Intelligence, 1999.
    (1999 runner-up)
  • FC Portugal Team Description: RoboCup 2000 Simulation League Champion.
     Luis Paulo Reis and Nuno Lau.
    in Stone, Balch, Kraetzschmarr (eds.) RoboCup-2000: Robot Soccer World Cup IV. Springer Verlag, Berlin, 2001.
    (2000 champion)
  • Behavior Classification with Self-Organizing Maps.
    M. Wunstel, D. Polani, T. Uthmann, and J. Perl.
    In: P. Stone, T.Balch, and G. Ktaetzschmar (eds.): RoboCup 2000: Robot Soccer World Cup IV. Berlin, Heidelberg, New York (Springer-Verlag), pages 108-118, 2000. (Lecture Notes in computer science Vol. 2019: Lecture notes in artificial intelligence)
  • Learning Situation Dependent Success Rates of Actions in a RoboCup Scenario.
     Sebastian Buck, Martin Riedmiller.
    Pacific Rim International Coference on Artificial Intelligence, 2000.
    (2000 and 2001 runner-up)
  • An Empirical Study of Coaching..
     Patrick Riley, Manuela Veloso, and Gal Kaminka.
    In H. Asama, T. Arai, T. Fukuda, and T. Hasegawa, editors, Distributed Autonomous Robotic Systems 5,pp. 215-224, Springer-Verlag, 2002.
    (2001 coach competition champion)
  • Global Planning from Local Perspective: An Implementation of Observation-based Plan Coordination in RoboCup Simulation Games.
     Cai Yunpeng, Chen Jiang, Yao Jinyi, and Li Shi.
    Pre-print available on-line, 2002.
    (2001, 2002 champion)
  • Language Design for Rescue Agents.
     Itsuki Noda , Tomoichi Takahashi, Shuji Morita, Tetsuhiko Koto, Satoshi Tadokoro
    in Digital Cities II : Second Kyoto Workshop on Digital Cities, Kyoto, Japan, October 18-20, 2001
  • RoboCup-2005 Simulation league and the SSIL qualification.
  • US Open 2005

    • Week 7 (3/1,3): Swarms and self-organization

  • Slides from Tuesday, 3/1: (pdf).
  • Slides from Thursday, 3/3: (pdf). Some more (on neural networks - from Tom Mitchell's book Machine Learning)
  • Sven Koenig's Ant Robotics page, including a link to a java applet illustrating node counting.
  • Soccer server internet league
  • Team repository (up to 2002)
  • Team binaries from 2003 (click on "binaries" at the bottom left).
  • Team binaries from 2004 (click on "binaries" at the bottom left).
  • Demos of many agents steering to avoid one another based on simple local rules. (see in particular the ones under "combined behaviors and groups)
  • A paper on pair programming.
  • RoboCup Rescue 2003 team descriptions.
  • RoboCup Rescue 2004 team descriptions.
  • A paper from previous years on swarm robotics
  • Blazing a trail: insect-inspired resource transportation by a robot team.
    Richard T. Vaughan, Kasper Stoy, Gaurav S. Sukhatme and Maja J Mataric.
    In Proceedings of the International Symposium on Distributed Autonomous Robot Systems, 2000.
    •

    • Week 8 (3/8,10): Applications

  • Slides from Tuesday, 3/8: (pdf).
  • Slides from Thursday, 3/10: (pdf). The ones on Intersection control.
  • Some applications papers read during previous years:
  • Improving Elevator Performance Using Reinforcement Learning. (If the link doesn't work for you, it's also available from citeseer - cached copy in top right corner)
    R. Crites and A. Barto.
    In Advances in Neural Information Processing Systems 8 (NIPS8), D. S. Touretzky, M. C. Mozer, and M. E. Hasslemo (Eds.), Cambridge, MA: MIT Press, 1996, pp. 1017-1023.
  • Electric Elves : Applying Agent Technology to Support Human Organizations.
     Chalupsky, H., Gil, Y., Knoblock, C. A., Lerman, K., Oh, J., Pynadath, D., Russ, T. A., and Tambe, M.
    In proceedings of the International Conference of Innovative Application of Artificial Intelligence (IAAI'01), 2001.
  • ARCHON: A Distributed Artificial Intelligence System for Industrial Applications.
     D. Cockburn and N. R. Jennings.
    in Foundations of Distributed Artificial Intelligence (eds. G. M. P. O'Hare and N. R. Jennings)
    Wiley, 1996, 319-344.
  • Trafficopter: A Distributed Collection System for Traffic Information.
     Alexandros Moukas1 Konstantinos Chandrinos, and Pattie Maes.
    in (M. Klusch, G. Weiss eds.) Cooperative Information Agents II, Springer Verlag, 1998.
  • A follow-up paper on the traffic management stuff.
  • The article in Wired that Tarang mentioned.

    • Week 9 (3/22,24): Game Theory

  • Slides from Tuesday, 3/22: (pdf).
  • Game theory slides from the course textbook.
  • gametheory.net
  • Some useful slides (part C) from Michael Bowling on game theory, stochastic games, correlated equilibria; and (Part D) from Michael Littman with more on stochastic games.

    • Week 10 (3/29,3/31): Game theory II + Statistical Measurement

  • Slides from Tuesday, 3/29: (pdf).
  • Slides from Thursday, 3/31: (pdf).
  • Prisoner's dilemma contest
  • RoShamBo (rock-paper-scissors) contest
  • U. of Alberta page on automated poker.
  • On-line calculators of t-test and student's t-test
  • Many more statistical resources

    • Week 11 (4/5,7): Agent modeling

  • Slides from Tuesday, 4/5: (pdf).
  • Greg's slides from Thursday, 4/7:(pdf).
  • On behavior classification in adversarial environments.
     Patrick Riley and Manuela Veloso.
    In Proceedings of the Fifth International Symposium on Distributed Autonomous Robotic Systems (DARS-2000), 2000.
  • Implicit Negotiation in Repeated Games.
     Michael L. Littman and Peter Stone.
    In Proceedings of The Eighth International Workshop on Agent Theories, Architectures, and Languages (ATAL-2001), pp. 393-404, August 2001.
  • A Concise Introduction to Multiagent Systems and Distributed AI by Nikos Vlassis. It was written for a course similar to this one.
  • The General Game Playing competition.

    • Week 12 (4/12,14): Distributed Rational Decision Making

  • Slides from Tuesday, 4/12: (pdf).
  • Slides from Thursday, 4/14: (pdf).
  • Condorcet voting example
  • Types of tactical voting

    • Week 13 (4/19,21): Auctions

  • Slides from Tuesday, 4/19: (pdf).
  • Slides from Thursday, 4/21: (pdf). (includes many slides I didn't get to)
  • Some writing tips. Some more (with more detail).
  • My class on Agent-Based E-Commerce from Fall 2003.
  • One of the introductory readings from that class:
    Auctions and Bidding: A Primer.
    Paul Milgrom.
    The Journal of Economic Perspectives, Vol. 3, No. 3. (Summer, 1989), pp. 3-22.
    Note: The above link works from UTCS machines, but may not work from an off-campus computer.
  • A couple links about bidding rings on eBay:
  • A high-profile painting-based ring was busted.
  • Another later ring for glass.
  • Making More from Less: Strategic Demand Reduction in the FCC Spectrum Auctions.
    Robert J. Weber.
    The Journal of Economics and Management Strategy 6(3), 1997.
  • Self-enforcing Strategic Demand Reduction..
    Paul S. A. Reitsma, Peter Stone, Janos Csirik, and Michael L. Littman.
    In Agent Mediated Electronic Commerce IV: Designing Mechanisms and Systems, Lecture Notes in Artificial Intelligence, Springer Verlag, 2002.
  • Decision-Theoretic Bidding Based on Learned Density Models in Simultaneous, Interacting Auctions.
    Peter Stone, Robert E. Schapire, Michael L. Littman, Janos A. Csirik, and David McAllester.
    Journal of Artificial Intelligence Research, 19:209-242, 2003.
  • SICS Trading Agent Competition (TAC)

    • Week 14 (4/26,28): Entertainment Agents

  • Elaine Rich's slides from Tuesday, 4/26: (ppt).
  • Slides from Thursday, 4/28: (pdf). Some more on entertainment agents in general (ppt) (by Vinay Sampath Kumar). The cobot ones (ps.gz) (by Charles Isbell).
  • An Architecture for Action, Emotion, and Social Behavior.
     Joseph Bates, A. Bryan Loyall, and W. Scott Reilly.
    in Artificial Social Systems: Fourth European Workshop on Modeling Autonomous Agents in a Multi-Agent World, Springer-Verlag, Berlin, 1994.
    This is a paper on the Oz project
  • Creatures: Artificial Life Autonomous Software Agents for Home Entertainment.
     Stephen Grand, Dave Cliff, and Anil Malhotra.
    Millenium technical report 9601, 1996.
  • Alice recently played the Turing Original Imitation Game. See also a Slashdot article on it.

    • Week 15 (5/3,5): Multiagent Learning

  • Slides from Tuesday, 5/3: (pdf). Some more on layered learning: (postscript). Some more (on reinforcement learning - from Tom Mitchell's book Machine Learning)
  • Slides from Thursday, 5/5: (pdf).
  • Concurrent Layered Learning.
     Shimon Whiteson and Peter Stone.
    In Second International Joint Conference on Autonomous Agents and Multiagent Systems, July 2003.
  • Layered Learning on Physical Robots
  • My course last semester on reinforcement learning

    • The tournament! (5/13)

  • The slides presented during the tourney, including results: (pdf).
  • Pictures from the tournament.

    • [Back to Department Homepage]

    Page maintained by Peter Stone
    Questions? Send me mail