UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Instance-Based Action Models for Fast Action Planning (2008)
Mazda Ahmadi
and
Peter Stone
Two main challenges of robot action planning in real domains are uncertain action effects and dynamic environments. In this paper, an instance-based action model is learned empirically by robots trying actions in the environment. Modeling the action planning problem as a Markov decision process, the action model is used to build the transition function. In static environments, standard value iteration techniques are used for computing the optimal policy. In dynamic environments, an algorithm is proposed for fast replanning, which updates a subset of state-action values computed for the static environment. As a test-bed, the goal scoring task in the RoboCup 4-legged scenario is used. The algorithms are validated in the problem of planning kicks for scoring goals in the presence of opponent robots. The experimental results both in simulation and on real robots show that the instance-based action model boosts performance over using parametric models as done previously, and also incremental replanning significantly improves over original off-line planning.
View:
PDF
,
PS
,
HTML
Citation:
In
RoboCup-2007: Robot Soccer World Cup XI
, Ubbo Visser and Fernando Ribeiro and Takeshi Ohashi and Frank Dellaert (Eds.), Vol. 5001, pp. 1-16, Berlin 2008. Springer Verlag.
Bibtex:
@incollection{LNAI2007-ahmadi, title={Instance-Based Action Models for Fast Action Planning}, author={Mazda Ahmadi and Peter Stone}, booktitle={RoboCup-2007: Robot Soccer World Cup XI}, volume={5001}, editor={Ubbo Visser and Fernando Ribeiro and Takeshi Ohashi and Frank Dellaert}, series={Lecture Notes in Artificial Intelligence}, address={Berlin}, publisher={Springer Verlag}, pages={1-16}, url="http://www.cs.utexas.edu/users/ai-lab?LNAI2007-ahmadi", year={2008} }
People
Mazda Ahmadi
Formerly affiliated Ph.D. Student
mazda [at] cs utexas edu
Peter Stone
Faculty
pstone [at] cs utexas edu
Areas of Interest
Other Areas
Planning
Quadruped Robots
Reinforcement Learning
Labs
Learning Agents