• Classified by Topic • Classified by Publication Type • Sorted by Date • Sorted by First Author Last Name • Classified by Funding Source •
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin Hart, Peter Stone, and Raymond J. Mooney. Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog. In Proceedings of the RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18), Robotics: Science and Systems (RSS), June 2018.
Natural language understanding in robots needs to be robust to a wide-range of both human speakers and human environments. Rather than force humans to use language that robots can understand, robots in human environments should dynamically adapt---continuously learning new language constructions and perceptual concepts as they are used in context. In this work, we present methods for parsing natural language to underlying meanings, and using robotic sensors to create multi-modal models of perceptual concepts. We combine these steps towards language understanding into a holistic agent for jointly improving parsing and perception on a robotic platform through human-robot dialog. We train and evaluate this agent on Amazon Mechanical Turk, then demonstrate it on a robotic platform initialized from conversational data gathered from Mechanical Turk. Our experiments show that improving both parsing and perception components from conversations improves communication quality and human ratings of the agent.
@inproceedings{MRHRC18-thomason,
title={Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog},
author={Jesse Thomason and Aishwarya Padmakumar and Jivko Sinapov and Nick Walker and Yuqian Jiang and Harel Yedidsion and Justin Hart and Peter Stone and Raymond J. Mooney},
booktitle={Proceedings of the RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18)},
publisher={Robotics: Science and Systems (RSS)},
location={Pittsburg, PA},
month={June},
year={2018},
abstract={Natural language understanding in robots needs to be robust to a wide-range of both human speakers and human environments.
Rather than force humans to use language that robots can understand, robots in human environments should dynamically adapt---continuously learning new language constructions and perceptual concepts as they are used in context.
In this work, we present methods for parsing natural language to underlying meanings, and using robotic sensors to create multi-modal models of perceptual concepts.
We combine these steps towards language understanding into a holistic agent for jointly improving parsing and perception on a robotic platform through human-robot dialog.
We train and evaluate this agent on Amazon Mechanical Turk, then demonstrate it on a robotic platform initialized from conversational data gathered from Mechanical Turk.
Our experiments show that improving both parsing and perception components from conversations improves communication quality and human ratings of the agent.}
}
Generated by bib2html.pl (written by Patrick Riley ) on Fri Jul 24, 2020 15:39:11