Research Interests

Todd I am a PhD student in the Department of Computer Science at the University of Texas at Austin studying artificial intelligence. My advisor is Peter Stone and I am a member of the Learning Agents Research Group at UT. I am also a part of the UT Austin Villa robot soccer team, which won the 2009 US Open in the Standard Platform League. I am researching reinforcement learning and robotics, specifically looking to make reinforcement learning apply to very large domains and applying it to make curious robots.

Before coming to UT, I worked in the Motion Analysis Laboratory at Spaulding Rehabiliation Hospital in Boston. There I worked on methods to evaluate the mobility of stroke, arthritis, and Parkinson's patients using wearable sensors. We used machine learning techniques to analyze wearable sensor data and quantify the quality of the patients' movements. I've also worked on a number of projects on my own, including building my own robot from scratch, writing a program to predict the scores of NFL football games based on machine learning techniques, and writing a 3D Connect Four game.

Robot Soccer

I have been a member of the UT Austin Villa robot soccer team since 2006 and participated in the Legged League and Standard Platform League at RoboCup. In 2009, we won the US Open Championship and came in 4th place in the internation competition. My research focus on robot soccer started with localization (See ICRA paper), but has moved on to encompass all parts of the robot soccer code, including, vision, locomotion, behaviors, coordination, and debug (See team paper).

Reinforcement Learning

Reinforcement Learning is a learning method where an agent can learn to act optimally by interacting with its environment. The agent is in some state and chooses from a set of available actions. Its action leads it to a new state and gives it some reward, which it tries to optimize over time. I am specifically focused on model-based reinforcement learning, where an agent learns a model of its environment and can learn a policy by simulating actions in its model. My research attempts to extend these model-based approaches to larger domains by incorporating generalization into the learning of the model (See AAMAS paper, ICRA paper, and video). In addition, I am examining the problem of exploration versus exploitation, looking at when the agent should exploit what it thinks it knows compared to when it should explore more of the environment.

Links:

Personal Home Page
Curriculum Vitae
University of Texas Dept of Computer Science

Contact Info:

Office: ENS32NE (Robotics Lab)
E-mail: todd AT cs DOT utexas DOT edu

Teaching

In the Fall 2009 semester, I was the TA for CS393R: Autonomous Robotics. I won the department's Outstanding TA Award.

In Spring 2009, I was a TA for CS307 Foundations of Computing..

Publications

Journal Articles

Book Chapters

Refereed Conferences

Refereed Workshop Papers

Technical Reports

Videos

Learning to Score Penalty Kicks via Reinforcement Learning

The accompanying video for our ICRA 2010 paper, where we learn to score penalty kicks via a novel model-based reinforcement learning method.

2009 RoboCup Highlights

Highlights of TT-UT Austin Villa at the 2009 RoboCup Standard Platform League. TT-UT Austin Villa finished in 4th place, losing to only two teams during the tournament.

2009 US Open Highlights

Highlights of TT-UT Austin Villa at the 2009 US Open. TT-UT Austin Villa won the 2009 US Open with a finals win over UPenn (1-1 tie, 3-2 in penalty kicks).

Aibo Highlights

This video shows highlights (both shots and saves) from demonstrations held during Explore UT on March 7, 2009.