Nick Jong

Research

• Abstraction Discovery for Reinforcement Learning
  • Nicholas K. Jong and Peter Stone. Towards Learning to Ignore Irrelevant State Variables. In The AAAI-2004 Workshop on Learning and Planning in Markov Processes — Advances and Challenges, July 2004. [pdf] [slides (pdf)]
  • Nicholas K. Jong and Peter Stone. State Abstraction Discovery from Irrelevant State Variables. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, August 2005. To appear. [pdf]
• Model-Based Reinforcement Learning
  • Nicholas K. Jong and Peter Stone. Kernel-Based Models for Reinforcement Learning. In The ICML-2006 Workshop on Kernel Methods in Reinforcement Learning, June 2006. [pdf] [ps] [slides (pdf)]
• Autonomic Computing
  • Gerald Tesauro, Nicholas K. Jong, Rajarshi Das, and Mohamed N. Bennani. In Proceedings of the Third International Conference on Autonomic Computing. [pdf]
• Predictive State Representations
  • Satinder Singh, Michael L. Littman, Nicholas K. Jong, David Pardoe, and Peter Stone. Learning Predictive State Representations. In Proceedings of the Twentieth International Conference on Machine Learning. [pdf] [ps]
• Map Learning for Robot Navigation
• Patrick Beeson, Nicholas K. Jong, and Benjamin Kuipers. Towards autonomous place detection using the extended Voronoi graph. In IEEE International Conference on Robotics and Automation, April 2005. To appear. [pdf]
• Robot Soccer
  • Peter Stone, Kurt Dresner, Peggy Fidelman, Nicholas K. Jong, Nate Kohl, Gregory Kuhlmann, Mohan Sridharan, Daniel Stronger. The UT Austin Villa 2004 RoboCup Four-Legged Team: Coming of Age. Technical Report UT-AI-TR-04-313, The University of Texas at Austin, Department of Computer Sciences, AI Laboratory, 2004. [pdf]
  • Peter Stone, Kurt Dresner, Selim T. Erdogan, Peggy Fidelman, Nicholas K. Jong, Nate Kohl, Gregory Kuhlmann, Ellie Lin, Mohan Sridharan, Daniel Stronger, and Gurushyam Hariharan. UT Austin Villa 2003: A New RoboCup Four-Legged Team. In Daniel Polani, Brett Browning, Andrea Bonarini, and Kazuo Yoshida, editors, RoboCup-2003: Robot Soccer World Cup VII, Springer Verlag, Berlin, 2004. [pdf]
  • UT Austin Villa
  • Official RoboCup site

Useful Links

Programming language references

GNU make documentation

Getting it on with make

The C++ Standard Template Library

When you forget how to use std::map

W3Schools' HTML reference

The page that made this page possible

Java API pages

This Java stuff is confusing

Scientific tools (besides programming languages)

CiteSeer

Taking the legwork out of literature searches

JAMA: A Java Matrix Package

Let someone else do the dirty work

The Jakarta Mathematics Library

Java implementations of important probability distributions! YAY!

Weka

The machine learning toolkit of choice at UTCS (more Java)

Introduction to GnuPlot

No one will believe you if you don't have a nifty graph