UTCS Connecting Language Acquisition with Machine Perception

[ Meeting Schedule | Members | Proposed Readings | Previous Discussions | Subscribe to Email List ]

Fall 2011 Meeting Time & Place

Back to Top

Scheduled Meetings

DateTimePlacePaper

* Future meetings subject to rearrangement.
* Please send in suggestions for new papers to discuss, or vote for a paper from the currently proposed papers.

Past Meetings

DateTimePlacePaper
12/1/2011 4PM ENS 32NEA Siming Li, Girish Kulkarni, Tamara Berg, Alex Berg and Yejin Choi
Composing Simple Image Descriptions using Web-scale N-grams, Computational Natural Language Learning (CoNLL), 2011
11/10/2011 4PM ENS 32NEA Girish Kulkarni, Visruth Premraj, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C. Berg, and Tamara Berg
Baby Talk: Understanding and Generating Image Descriptions , Computer Vision and Pattern Recognition (CVPR), 2011
10/27/2011 4PM ENS 32NEA E. Bruni, G.B. Tran and M. Baroni
Distributional semantics from text and images , Proceedings of the EMNLP 2011 Geometrical Models for Natural Language Semantics (GEMS 2011) Workshop, East Stroudsburg PA: ACL, 22-32
10/13/2011 4PM ENS 32NEA Richard Socher, Cliff C. Lin, Andrew Y. Ng, and Christopher D. Manning
Parsing Natural Scenes and Natural Language with Recursive Neural Networks , ICML, 2011
09/29/2011 4PM ENS 32NEA Benjamin Borschinger, Bevan K. Jones and Mark Johnson
Reducing Grounded Learning Tasks To Grammatical Inference, EMNLP, 2011
09/01/2011 4PM ENS 32NEA Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew R. Walter, Ashis Gopal Banerjee, Seth Teller, Nicholas Roy
Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation, AAAI, 2011

* For older discussions, see Previous Discussions

Members

Back to Top

Faculty

Student

Previous Members

Faculty

Student

Proposed Readings

Back to Top
1.

Percy Liang, Michael I. Jordan, Dan Klein. Learning dependency-based compositional semantics. ACL, 2011. (pdf)
(10 points: 10 up, 0 down)
2.

Steven T. Piantadosi, Noah D. Goodman, Benjamin A. Ellis, and Joshua B. Tenenbaum. A Bayesian Model of the Acquisition of Compositional Semantics. CogSci, 2008. (pdf)
(7 points: 9 up, 2 down)
3.

Richard Socher, Cliff C. Lin, Andrew Y. Ng, and Christopher D. Manning. Parsing Natural Scenes and Natural Language with Recursive Neural Networks. ICML, 2011. (url)
(3 points: 3 up, 0 down)
4.

Cynthia Matuszek, Dieter Fox, and Karl Koscher. Following Directions Using Statistical Machine Translation. ACM/IEEE International Conference on Human-Robot Interaction, 2010. (pdf)
(3 points: 3 up, 0 down)
5.

Michael Fleischman, Deb Roy. Intentional Context in Situated Natural Language Learning. CoNLL, 2005. (pdf)
(3 points: 3 up, 0 down)
6.

Sven Wachsmuth, Gerhard Sagerer. Bayesian Networks for Speech and Image Integration. AAAI, 2002. (url)
(3 points: 3 up, 0 down)
7.

Gabor Angeli, Percy Liang, and Dan Klein. A simple domain-independent probabilistic approach to generation. EMNLP, 2010. (pdf)
(2 points: 2 up, 0 down)
8.

Steve R. Howell, Damian Jankowicz and Suzanna Becker. A model of grounded language acquisition: Sensorimotor features improve lexical and grammatical learning. Journal of Memory and Language, 2005. (url)
(2 points: 2 up, 0 down)
9.

E. Bruni, G.B. Tran and M. Baroni. Distributional semantics from text and images. Proceedings of the EMNLP 2011 Geometrical Models for Natural Language Semantics (GEMS 2011) Workshop, East Stroudsburg PA: ACL, 22-32, 2011. (pdf)
(1 points: 1 up, 0 down)
10.

Dan Goldwasser and Dan Roth. Learning from Natural Instructions. IJCAI, 2011. (pdf)
(1 points: 1 up, 0 down)
11.

Paul Vogt and Elena Lieven. Verifying Theories of Language Acquisition Using Computer Models of Language Evolution. Adaptive Behavior, 2010. (url)
(1 points: 1 up, 0 down)
12.

L. Steels and M. Spranger. How experience of the body shapes language about space. IJCAI, 2009. (pdf)
(1 points: 1 up, 0 down)
13.

Pia Knoeferle and Matthew Crocker. The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking. Cognitive Science; 30(3):481-529, 2006. (pdf)
(1 points: 1 up, 0 down)
14.

Paul Vogt. The emergence of compositional structures in perceptually grounded language games. Artificial Intelligence; 167(1-2):206-242, Connecting Language to the World, September, 2005. (url)
(1 points: 1 up, 0 down)
15.

Erik B. Sudderth, Antonio Torralba, William T. Freeman, and Alan S. Willsky. Learning Hierarchical Models of Scenes, Objects, and Parts. ICCV, 2005. (pdf)
(1 points: 1 up, 0 down)
16.

Chen Yu, Dana H. Ballard. A Multimodal Learning Interface for Grounding Spoken Language in Sensory Perceptions. ACM Transactions on Applied Perception, 2004. (pdf)
(1 points: 1 up, 0 down)
17.

Tamara L. Berg, Alexander C. Berg, Jaety Edwards, Michael Maire, Ryan White, Yee-Whye Teh, Erik Learned-Miller and D. A. Forsyth. Name and Faces in the News. CVPR, 2004. (pdf)
(1 points: 1 up, 0 down)
18.

Luc Steels. Evolving grounded communication for robots. Trends in CognitiveScience, 2003. (pdf)
(1 points: 2 up, 1 down)
19.

A. Kovashka and K. Grauman. Learning a Hierarchy of Discriminative Space-Time Neighborhood Features for Human Action Recognition. CVPR, 2010. (pdf)
(0 points: 0 up, 0 down)
20.

Brandon C. Roy, Michael C. Frank, and Deb Roy. Exploring Word Learning in a High-Density Longitudinal Corpus. Cognitive Science Society, 2009. (pdf)
(0 points: 0 up, 0 down)
21.

J. Bleys, M. Loetzsch, M. Spranger, and L. Steels. The grounded colour naming game. Spoken Dialogue and Human-Robot Interaction workshop at RoMan, 2009. (pdf)
(0 points: 0 up, 0 down)
22.

Verena Rieser and Oliver Lemon. Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation. ACL, 2008. (pdf)
(0 points: 0 up, 0 down)
23.

Shaolin Qu, and Joyce Y. Chai. Incorporating Temporal and Semantic Information with Eye Gaze for Automatic Word Acquisition in Multimodal Conversational Systems. EMNLP, 2008. (pdf)
(0 points: 0 up, 0 down)
24.

J. Allen, N. Chambers, G. Ferguson, L. Galescu, H. Jung, M. Swift, W. Taysom. PLOW: A Collaborative Task Learning Agent. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
25.

Brian Harrington, Stephen Clark. ASKNet: Automated Semantic Knowledge Network. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
26.

Matthew Klenk and Kenneth D. Forbus. Measuring the Level of Transfer Learning by an AP Physics Problem-Solver. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
27.

Andrew Lovett, Morteza Dehghani, Kenneth Forbus. Incremental Learning of Perceptual Categories for Open-Domain Sketch Recognition. IJCAI, 2007. (pdf)
(0 points: 0 up, 0 down)
28.

Michael Levit and Deb Roy. Interpretation of Spatial Language in a Map Navigation Task. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 2007. (pdf)
(0 points: 0 up, 0 down)
29.

M. Yamamoto, H. Mitomi, F. Fujiwara, and T. Sato. Bayesian Classification of Task-Oriented Actions Based on Stochastic Context-Free Grammar. International Conference on Automatic Face and Gesture Recognition, Southampton, UK, April 10-12, 2006. (pdf)
(0 points: 0 up, 0 down)
30.

Mike Perkowitz, Matthai Philipose, Donald Patterson, and Kenneth P. Fishkin. Mining Models of Human Activities from the Web. WWW, 2004. (pdf)
(0 points: 0 up, 0 down)
31.

Deb K. Roy. Learning Visually-Grounded Words and Syntax for a Scene Description Task. Computer Speech and Language, 2002. (pdf)
(0 points: 1 up, 1 down)
32.

P. Duygulu, K. Barnard, JFG de Freitas, D.A. Forsyth. Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. ECCV, 2002. (url)
(0 points: 0 up, 0 down)
33.

G. Herzog, P. Wazinski. VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions. Artificial Intelligence Review, 1994. (pdf)
(0 points: 0 up, 0 down)
34.

Shaolin Qu, and Joyce Y. Chai. The Role of Interactivity in Human-Machine Conversation for Automatic Word Acquisition. Submitted for SIGDIAL, 2009.
(-1 points: 1 up, 2 down)
35.

Jeff Orkin and Deb Roy. The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online. Journal of Game Development, 2007. (pdf)
(-1 points: 0 up, 1 down)
36.

Yansong Feng and Mirella Lapata. Topic Models for Image Annotation and Text Illustration. NAACL, 2010. (pdf)
(-2 points: 0 up, 2 down)
37.

Yansong Feng and Mirella Lapata. Visual Information in Semantic Representation. NAACL, 2010. (pdf)
(-2 points: 0 up, 2 down)
38.

Shinichi Satoh, Yuichi Nakamura, Takeo Kanade. Name-It: Naming and Detecting Faces in Video by the Integration of Image and Natural Language Processing. IJCAI, 1997. (url)
(-2 points: 0 up, 2 down)

If you find a certain paper interesting and would like to recommend reading, please feel free to let us know during the meeting or e-mail David Chen.

Subscribe to Email List

Back to Top
Google Groups
Subscribe to UT Connecting Language Acquisition with Machine Perception group
Email: