Learning Language from Perceptual Context: A Challenge Problem for AI (2006)
We present the problem of learning to understand natural language from examples of utterances paired only with their relevant real-world context as an important challenge problem for AI. Machine learning has been adopted as the most effective way of developing natural-language processing systems; however, currently, complex annotated corpora are required for training. By learning language from perceptual context, the need for laborious annotation is removed and the system's resulting understanding is grounded in its perceptual experience.
In Proceedings of the 2006 AAAI Fellows Symposium, Boston, MA, July 2006.

Raymond J. Mooney Faculty mooney [at] cs utexas edu