Peter Stone's Selected Publications

Classified by TopicClassified by Publication TypeSorted by DateSorted by First Author Last NameClassified by Funding Source


Grounded Action Transformation for Robot Learning in Simulation

Grounded Action Transformation for Robot Learning in Simulation.
Josiah Hanna and Peter Stone.
In Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI), February 2017.

Download

[PDF]1.3MB  [slides.pdf]1.3MB  

Abstract

Robot learning in simulation is a promising alternative to the prohibitive sample cost of learning in the physical world. Unfortunately, policies learned in simulation often perform worse than hand-coded policies when applied on the physical robot. Grounded simulation learning (GSL) promises to address this issue by altering the simulator to better match the real world. This paper proposes a new algorithm for GSL -- Grounded Action Transformation -- and applies it to learning of humanoid bipedal locomotion. Our approach results in a 43.27\% improvement in forward walk velocity compared to a state-of-the art hand-coded walk. We further evaluate our methodology in controlled experiments using a second, higher-fidelity simulator in place of the real world. Our results contribute to a deeper understanding of grounded simulation learning and demonstrate its effectiveness for learning robot control policies.

BibTeX Entry

@InProceedings{AAAI17-Hanna,
  author = {Josiah Hanna and Peter Stone},
  title = {Grounded Action Transformation for Robot Learning in Simulation},
  booktitle = {Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI)},
  location = {San Francisco, CA},
  month = {February},
  year = {2017},
  abstract = {
Robot learning in simulation is a promising alternative to the prohibitive sample cost of learning in the physical world. Unfortunately, policies learned in simulation often perform worse than hand-coded policies when applied on the physical robot. Grounded simulation learning (GSL) promises to address this issue by altering the simulator to better match the real world.  This paper proposes a new algorithm for GSL -- Grounded Action Transformation -- and applies it to learning of humanoid bipedal locomotion.  Our approach results in a 43.27\% improvement in forward walk velocity compared to a state-of-the art hand-coded walk. We further evaluate our methodology in controlled experiments using a second, higher-fidelity simulator in place of the real world. Our results contribute to a deeper understanding of grounded simulation learning and demonstrate its effectiveness for learning robot control policies. 
  },
}

Generated by bib2html.pl (written by Patrick Riley ) on Sun Apr 14, 2024 10:20:48