UTCS Connecting Language Acquisition with Machine Perception

[ Meeting Schedule | Members | Proposed Readings | Previous Discussions | Subscribe to Email List ]

Fall 2009 Meeting Time & Place

Back to Top

Scheduled Meetings

DateTimePlacePaper
12/3/2009 11AM ACES 5.444 Donna Byron, Alexander Koller, Kristina Striegnitz, Justine Cassell, Robert Dale, Johanna Moore, and Jon Oberlander
Report on the First NLG Challenge on Generating Instructions in Virtual Environments (GIVE), ENLG, 2009
For more information about the challenge and the individual systems, visit the GIVE Challenge website

* Future meetings subject to rearrangement.
* Please send in suggestions for new papers to discuss, or vote for a paper from the currently proposed papers.

Past Meetings

DateTimePlacePaper
11/12/2009 11AM ACES 5.444 Benjamin Snyder, and Regina Barzilay
Database-Text Alignment via Structured Multilabel Classification, IJCAI, 2007
10/29/2009 11AM ACES 5.444 T. Regier, and L. Carlson
Grounding spatial language in perception: An empirical and computational investigation, Journal of Experimental Psychology, 2001
10/15/2009 11AM ACES 5.444 Patrick Buehler, Mark Everingham, and Andrew Zisserman
Learning sign language by watching TV (using weakly aligned subtitles), CVPR, 2009
10/1/2009 11AM ACES 5.444 Percy Liang, Michael I. Jordan, and Dan Klein
Learning semantic correspondences with less supervision, ACL-IJCNLP, 2009
9/17/2009 11AM ACES 5.444 Tessa Lau, Clemens Drews, and Jeffrey Nichols
Interpreting Written How-To Instructions, IJCAI, 2009
9/3/2009 11AM ACES 5.444 S.R.K. Branavan, Harr Chen, Luke S. Zettlemoyer, and Regina Barzilay
Reinforcement Learning for Mapping Instructions to Actions, ACL-IJCNLP, 2009

* For older discussions, see Previous Discussions

Members

Back to Top

Faculty

Student

Previous Members

Faculty

Student

Proposed Readings

Back to Top
1.

Sven Wachsmuth, Gerhard Sagerer. Bayesian Networks for Speech and Image Integration. AAAI, 2002. (url)
(1 points: 1 up, 0 down)
2.

Deb K. Roy. Learning Visually-Grounded Words and Syntax for a Scene Description Task. Computer Speech and Language, 2002. (pdf)
(1 points: 1 up, 0 down)
3.

Luc Steels. Evolving grounded communication for robots. Trends in CognitiveScience, 2003. (pdf)
(1 points: 1 up, 0 down)
4.

Chen Yu, Dana H. Ballard. A Multimodal Learning Interface for Grounding Spoken Language in Sensory Perceptions. ACM Transactions on Applied Perception, 2004. (pdf)
(1 points: 1 up, 0 down)
5.

Michael Fleischman, Deb Roy. Intentional Context in Situated Natural Language Learning. CoNLL, 2005. (pdf)
(1 points: 1 up, 0 down)
6.

Steve R. Howell, Damian Jankowicz and Suzanna Becker. A model of grounded language acquisition: Sensorimotor features improve lexical and grammatical learning. Journal of Memory and Language, 2005. (url)
(1 points: 1 up, 0 down)
7.

Erik B. Sudderth, Antonio Torralba, William T. Freeman, and Alan S. Willsky. Learning Hierarchical Models of Scenes, Objects, and Parts. ICCV, 2005. (pdf)
(1 points: 1 up, 0 down)
8.

Stefanie Tellex and Deb Roy. Grounding Spatial Prepositions for Video Search. ICMI, 2009. (pdf)
(1 points: 1 up, 0 down)
9.

G. Herzog, P. Wazinski. VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions. Artificial Intelligence Review, 1994. (pdf)
(0 points: 0 up, 0 down)
10.

Shinichi Satoh, Yuichi Nakamura, Takeo Kanade. Name-It: Naming and Detecting Faces in Video by the Integration of Image and Natural Language Processing. IJCAI, 1997. (url)
(0 points: 0 up, 0 down)
11.

P. Duygulu, K. Barnard, JFG de Freitas, D.A. Forsyth. Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. ECCV, 2002. (url)
(0 points: 0 up, 0 down)
12.

Tamara L. Berg, Alexander C. Berg, Jaety Edwards, Michael Maire, Ryan White, Yee-Whye Teh, Erik Learned-Miller and D. A. Forsyth. Name and Faces in the News. CVPR, 2004. (pdf)
(0 points: 0 up, 0 down)
13.

Mike Perkowitz, Matthai Philipose, Donald Patterson, and Kenneth P. Fishkin. Mining Models of Human Activities from the Web. WWW, 2004. (pdf)
(0 points: 0 up, 0 down)
14.

Paul Vogt. The emergence of compositional structures in perceptually grounded language games. Artificial Intelligence; 167(1-2):206-242, Connecting Language to the World, September, 2005. (url)
(0 points: 0 up, 0 down)
15.

Pia Knoeferle and Matthew Crocker. The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking. Cognitive Science; 30(3):481-529, 2006. (pdf)
(0 points: 0 up, 0 down)
16.

M. Yamamoto, H. Mitomi, F. Fujiwara, and T. Sato. Bayesian Classification of Task-Oriented Actions Based on Stochastic Context-Free Grammar. International Conference on Automatic Face and Gesture Recognition, Southampton, UK, April 10-12, 2006. (pdf)
(0 points: 0 up, 0 down)
17.

J. Allen, N. Chambers, G. Ferguson, L. Galescu, H. Jung, M. Swift, W. Taysom. PLOW: A Collaborative Task Learning Agent. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
18.

Brian Harrington, Stephen Clark. ASKNet: Automated Semantic Knowledge Network. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
19.

Matthew Klenk and Kenneth D. Forbus. Measuring the Level of Transfer Learning by an AP Physics Problem-Solver. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
20.

Andrew Lovett, Morteza Dehghani, Kenneth Forbus. Incremental Learning of Perceptual Categories for Open-Domain Sketch Recognition. IJCAI, 2007. (pdf)
(0 points: 0 up, 0 down)
21.

Steven T. Piantadosi, Noah D. Goodman, Benjamin A. Ellis, and Joshua B. Tenenbaum. A Bayesian Model of the Acquisition of Compositional Semantics. CogSci, 2008. (pdf)
(0 points: 0 up, 0 down)
22.

Verena Rieser and Oliver Lemon. Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation. ACL, 2008. (pdf)
(0 points: 0 up, 0 down)
23.

Shaolin Qu, and Joyce Y. Chai. Incorporating Temporal and Semantic Information with Eye Gaze for Automatic Word Acquisition in Multimodal Conversational Systems. EMNLP, 2008. (pdf)
(0 points: 0 up, 0 down)
24.

Nobuyuki Shimizu, and Andrew Haas. Learning to Follow Navigational Route Instructions. IJCAI, 2009. (pdf)
(0 points: 0 up, 0 down)
25.

Nicholas Morsillo, Christopher Pal, and Randal Nelson. Semi-Supervised Learning of Visual Classifiers from Web Images and Text. IJCAI, 2009. (pdf)
(0 points: 0 up, 0 down)
26.

Jeff Orkin and Deb Roy. The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online. Journal of Game Development, 2007. (pdf)
(-1 points: 0 up, 1 down)
27.

Shaolin Qu, and Joyce Y. Chai. The Role of Interactivity in Human-Machine Conversation for Automatic Word Acquisition. Submitted for SIGDIAL, 2009.
(-1 points: 0 up, 1 down)

If you find a certain paper interesting and would like to recommend reading, please feel free to let us know during the meeting or e-mail David Chen.

Subscribe to Email List

Back to Top
Google Groups
Subscribe to UT Connecting Language Acquisition with Machine Perception group
Email: