UT Austin Villa Publications

Sorted by DateClassified by Publication TypeClassified by TopicSorted by First Author Last Name

Policy Gradient Reinforcement Learning for Fast Quadrupedal Locomotion

Nate Kohl and Peter Stone. Policy Gradient Reinforcement Learning for Fast Quadrupedal Locomotion. In Proceedings of the IEEE International Conference on Robotics and Automation, May 2004.
Some videos of walking robots referenced in the paper.
ICRA 2004

Download

[PDF]301.5kB  [postscript]3.2MB  

Abstract

This paper presents a machine learning approach to optimizing a quadrupedal trot gait for forward speed. Given a parameterized walk designed for a specific robot, we propose using a form of policy gradient reinforcement learning to automatically search the set of possible parameters with the goal of finding the fastest possible walk. We implement and test our approach on a commercially available quadrupedal robot platform, namely the Sony Aibo robot. After about three hours of learning, all on the physical robots and with no human intervention other than to change the batteries, the robots achieved the fastest walk known for the Aibo, significantly outperforming a variety of existing hand-coded and learned solutions.

BibTeX

@InProceedings(icra04,
        author="Nate Kohl and Peter Stone",
        title="Policy Gradient Reinforcement Learning for Fast Quadrupedal Locomotion",
        year="2004",month="May",
        booktitle="Proceedings of the {IEEE} International Conference on Robotics and Automation",
        abstract={
                 This paper presents a machine learning approach to
                 optimizing a quadrupedal trot gait for forward speed.
                 Given a parameterized walk designed for a specific
                 robot, we propose using a form of policy gradient
                 reinforcement learning to automatically search the
                 set of possible parameters with the goal of finding
                 the fastest possible walk.  We implement and test our
                 approach on a commercially available quadrupedal
                 robot platform, namely the Sony Aibo robot.  After
                 about three hours of learning, all on the physical
                 robots and with no human intervention other than to
                 change the batteries, the robots achieved the fastest
                 walk known for the Aibo, significantly outperforming
                 a variety of existing hand-coded and learned
                 solutions.
        },
        wwwnote={Some <a href="http://www.cs.utexas.edu/users/AustinVilla/legged/learned-walk/">videos of walking robots</a> referenced in the paper.<br>
                 <a href="http://www.egr.msu.edu/ralab/icra2004/">ICRA 2004</a>},
)

Generated by bib2html.pl (written by Patrick Riley ) on Sun Apr 14, 2024 10:25:23