UTCS Connecting Language Acquisition with Machine Perception

[ Meeting Schedule | Members | Proposed Readings | Previous Discussions | Subscribe to Email List ]

Fall 2012 Meeting Time & Place

Back to Top

Scheduled Meetings

DateTimePlacePaper
4/23/2013 1PM GDC 3.416 Michaela Regneri, Marcus Rohrbach, Dominikus Wetzel, Stefan Thater, Bernt Schiele, Manfred Pinkal
Grounding Action Descriptions in Videos, TACL, 2013

* Future meetings subject to rearrangement.
* Please send in suggestions for new papers to discuss, or vote for a paper from the currently proposed papers.

Past Meetings

DateTimePlacePaper
4/9/2013 1PM GDC 3.416 Yoav Artzi and Luke Zettlemoyer
Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions, TACL, 2013
3/26/2013 1PM GDC 3.416 C. Liu, R. Fang, and J. Y. Chai
Towards Mediating Shared Perceptual Basis in Situated Dialogue, SIGDIAL Meeting on Discourse and Dialogue, 2012
3/5/2013 1PM GDC 3.416 Richard Socher, Milind Ganjoo, Hamsa Sridhar, Osbert Bastani, Christopher D. Manning, Andrew Y. Ng
Zero-Shot Learning Through Cross-Modal Transfer, arXiv, 2013.
2/19/2013 1PM GDC 3.516 Y. Jia, M. Salzmann, and T. Darrell
Learning Cross-modality Similarity for Multinomial Data , ICCV, 2011.
2/5/2013 1PM GDC 3.416 Barbu, A. and Bridge, A. and Burchill, Z. and Coroian, D. and Dickinson, S. and Fidler, S. and Michaux, A. and Mussman, S. and Narayanaswamy, S. and Salvi, D. and others.
Video In Sentences Out. , UAI, 2012.
1/22/2013 1PM ENS 32NEA Hannaneh Hajishirzi, Julia Hockenmaier, Erik T. Mueller, and Eyal Amir.
Reasoning about RoboCup Soccer Commentaries., UAI, 2011.

* For older discussions, see Previous Discussions

Members

Back to Top

Faculty

Student

Previous Members

Faculty

Student

Proposed Readings

Back to Top

Sort by Vote   |   Sort by Year

1.

Steven T. Piantadosi, Noah D. Goodman, Benjamin A. Ellis, and Joshua B. Tenenbaum. A Bayesian Model of the Acquisition of Compositional Semantics. CogSci, 2008. (pdf)
(7 points: 14 up, 7 down)
2.

Michael Fleischman, Deb Roy. Intentional Context in Situated Natural Language Learning. CoNLL, 2005. (pdf)
(5 points: 5 up, 0 down)
3.

L. Steels and M. Spranger. How experience of the body shapes language about space. IJCAI, 2009. (pdf)
(3 points: 3 up, 0 down)
4.

Sven Wachsmuth, Gerhard Sagerer. Bayesian Networks for Speech and Image Integration. AAAI, 2002. (url)
(3 points: 3 up, 0 down)
5.

Michaela Regneri, Marcus Rohrbach, Dominikus Wetzel, Stefan Thater, Bernt Schiele, Manfred Pinkal. Grounding Action Descriptions in Videos. TACL, 2013. (pdf)
(2 points: 2 up, 0 down)
6.

Jayant Krishnamurthy, Thomas Kollar. Jointly Learning to Parse and Perceive: Connecting Natural Language to the Physical World. TACL, 2013. (pdf)
(2 points: 2 up, 0 down)
7.

Carina Silberer and Mirella Lapata. Grounded Models of Semantic Representation. EMNLP, 2012. (pdf)
(2 points: 2 up, 0 down)
8.

Packer, B. and Saenko, K. and Koller, D.. A combined pose, object, and feature model for action understanding. CVPR, 2012. (pdf)
(2 points: 2 up, 0 down)
9.

Bruni, E., G. Boleda, M. Baroni, N. K. Tran. Distributional semantics in technicolor. ACL, 2012. (pdf)
(2 points: 2 up, 0 down)
10.

M. Rohrbach, M. Regneri, M. Andriluka, S. Amin, M. Pinkal and B. Schiele. Script Data for Attribute-based Recognition of Composite Activities. ECCV, 2012. (pdf)
(2 points: 2 up, 0 down)
11.

Shane Bergsma, Benjamin Van Durme. Learning Bilingual Lexicons using the Visual Similarity of Labeled Web Images. IJCAI, 2011. (pdf)
(2 points: 2 up, 0 down)
12.

Gabor Angeli, Percy Liang, and Dan Klein. A Simple Domain-Independent Probabilistic Approach to Generation. EMNLP, 2010. (pdf)
(2 points: 2 up, 0 down)
13.

Nazli Ikizler-Cinbis, Stan Sclaroff. Object, Scene and Actions: Combining Multiple Features for Human Action Recognition. ECCV, 2010. (pdf)
(2 points: 2 up, 0 down)
14.

J. Bleys, M. Loetzsch, M. Spranger, and L. Steels. The grounded colour naming game. Spoken Dialogue and Human-Robot Interaction workshop at RoMan, 2009. (pdf)
(2 points: 2 up, 0 down)
15.

Pia Knoeferle and Matthew Crocker. The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking. Cognitive Science; 30(3):481-529, 2006. (pdf)
(2 points: 2 up, 0 down)
16.

Paul Vogt. The emergence of compositional structures in perceptually grounded language games. Artificial Intelligence; 167(1-2):206-242, Connecting Language to the World, September, 2005. (url)
(2 points: 2 up, 0 down)
17.

Luc Steels. Evolving grounded communication for robots. Trends in CognitiveScience, 2003. (pdf)
(2 points: 3 up, 1 down)
18.

Tessa Lau, Luciana Benotti, Martin Villalba and Julian Cerruti. Corpus-based interpretation of instructions in virtual environments. ACL, 2012. (pdf)
(1 points: 1 up, 0 down)
19.

Aida Nematzadeh, Afsaneh Fazly, Suzanne Stevenson. A Computational Model of Memory, Attention, and Word Learning. CICL, 2012. (pdf)
(1 points: 1 up, 0 down)
20.

Hannaneh Hajishirzi, Mohammad Rastegari, Ali Farhadi, and Jessica K. Hodgins. Semantic Understanding of Professional Soccer Commentaries. UAI, 2012. (pdf)
(1 points: 1 up, 0 down)
21.

J. Hoffman, B. Kulis, T. Darrell, K. Saenko. Discovering Latent Domains for Multisource Domain Adaptation. ECCV, 2012. (pdf)
(1 points: 1 up, 0 down)
22.

T. Althoff, H. O. Song, T. Darrell. Detection Bank: An Object Detection Based Video Representation for Multimedia Event Recognition. ACM MM, 2012. (pdf)
(1 points: 1 up, 0 down)
23.

Vicente Ordonez, Girish Kulkarni, Tamara L. Berg. Im2Text: Describing Images Using 1 Million Captioned Photographs. NIPS, 2011. (pdf)
(1 points: 1 up, 0 down)
24.

Y. Jia, M. Salzmann, and T. Darrell. Learning Cross-modality Similarity for Multinomial Data. ICCV, 2011. (pdf)
(1 points: 1 up, 0 down)
25.

Paul Vogt and Elena Lieven. Verifying Theories of Language Acquisition Using Computer Models of Language Evolution. Adaptive Behavior, 2010. (url)
(1 points: 1 up, 0 down)
26.

Brandon C. Roy, Michael C. Frank, and Deb Roy. Exploring Word Learning in a High-Density Longitudinal Corpus. Cognitive Science Society, 2009. (pdf)
(1 points: 1 up, 0 down)
27.

J. Allen, N. Chambers, G. Ferguson, L. Galescu, H. Jung, M. Swift, W. Taysom. PLOW: A Collaborative Task Learning Agent. AAAI, 2007. (pdf)
(1 points: 1 up, 0 down)
28.

Andrew Lovett, Morteza Dehghani, Kenneth Forbus. Incremental Learning of Perceptual Categories for Open-Domain Sketch Recognition. IJCAI, 2007. (pdf)
(1 points: 1 up, 0 down)
29.

Kevin Gold, Marek Doniec, and Brian Scassellati. Learning Grounded Semantics With Word Trees: Prepositions and Pronouns. ICDL, 2007. (pdf)
(1 points: 1 up, 0 down)
30.

Erik B. Sudderth, Antonio Torralba, William T. Freeman, and Alan S. Willsky. Learning Hierarchical Models of Scenes, Objects, and Parts. ICCV, 2005. (pdf)
(1 points: 1 up, 0 down)
31.

Chen Yu, Dana H. Ballard. A Multimodal Learning Interface for Grounding Spoken Language in Sensory Perceptions. ACM Transactions on Applied Perception, 2004. (pdf)
(1 points: 1 up, 0 down)
32.

Tamara L. Berg, Alexander C. Berg, Jaety Edwards, Michael Maire, Ryan White, Yee-Whye Teh, Erik Learned-Miller and D. A. Forsyth. Name and Faces in the News. CVPR, 2004. (pdf)
(1 points: 2 up, 1 down)
33.

Deb K. Roy. Learning Visually-Grounded Words and Syntax for a Scene Description Task. Computer Speech and Language, 2002. (pdf)
(1 points: 2 up, 1 down)
34.

Song Feng, Longfei Xing, Anupam Gogar and Yejin Choi. Distributional Footprints of Deceptive Product Reviews. AAAI Conference on Weblogs and Social Media. (ICWSM), 2012. (pdf)
(0 points: 0 up, 0 down)
35.

C. Liu, R. Fang, and J. Y. Chai. Towards Mediating Shared Perceptual Basis in Situated Dialogue. SIGDIAL Meeting on Discourse and Dialogue, 2012. (pdf)
(0 points: 0 up, 0 down)
36.

A. Kovashka and K. Grauman. Learning a Hierarchy of Discriminative Space-Time Neighborhood Features for Human Action Recognition. CVPR, 2010. (pdf)
(0 points: 0 up, 0 down)
37.

Shaolin Qu, and Joyce Y. Chai. The Role of Interactivity in Human-Machine Conversation for Automatic Word Acquisition. Submitted for SIGDIAL, 2009.
(0 points: 2 up, 2 down)
38.

Verena Rieser and Oliver Lemon. Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation. ACL, 2008. (pdf)
(0 points: 0 up, 0 down)
39.

Shaolin Qu, and Joyce Y. Chai. Incorporating Temporal and Semantic Information with Eye Gaze for Automatic Word Acquisition in Multimodal Conversational Systems. EMNLP, 2008. (pdf)
(0 points: 0 up, 0 down)
40.

Brian Harrington, Stephen Clark. ASKNet: Automated Semantic Knowledge Network. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
41.

Matthew Klenk and Kenneth D. Forbus. Measuring the Level of Transfer Learning by an AP Physics Problem-Solver. AAAI, 2007. (pdf)
(0 points: 0 up, 0 down)
42.

Michael Levit and Deb Roy. Interpretation of Spatial Language in a Map Navigation Task. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 2007. (pdf)
(0 points: 0 up, 0 down)
43.

M. Yamamoto, H. Mitomi, F. Fujiwara, and T. Sato. Bayesian Classification of Task-Oriented Actions Based on Stochastic Context-Free Grammar. International Conference on Automatic Face and Gesture Recognition, Southampton, UK, April 10-12, 2006. (pdf)
(0 points: 0 up, 0 down)
44.

Mike Perkowitz, Matthai Philipose, Donald Patterson, and Kenneth P. Fishkin. Mining Models of Human Activities from the Web. WWW, 2004. (pdf)
(0 points: 0 up, 0 down)
45.

P. Duygulu, K. Barnard, JFG de Freitas, D.A. Forsyth. Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. ECCV, 2002. (url)
(0 points: 0 up, 0 down)
46.

G. Herzog, P. Wazinski. VIsual TRAnslator: Linking Perceptions and Natural Language Descriptions. Artificial Intelligence Review, 1994. (pdf)
(0 points: 0 up, 0 down)
47.

Jeff Orkin and Deb Roy. The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online. Journal of Game Development, 2007. (pdf)
(-1 points: 0 up, 1 down)
48.

Yansong Feng and Mirella Lapata. Topic Models for Image Annotation and Text Illustration. NAACL, 2010. (pdf)
(-2 points: 0 up, 2 down)
49.

Shinichi Satoh, Yuichi Nakamura, Takeo Kanade. Name-It: Naming and Detecting Faces in Video by the Integration of Image and Natural Language Processing. IJCAI, 1997. (url)
(-2 points: 0 up, 2 down)

If you find a certain paper interesting and would like to recommend reading, please feel free to let us know during the meeting or e-mail Joohyun Kim.

Subscribe to Email List

Back to Top
Google Groups
Subscribe to UT Connecting Language Acquisition with Machine Perception group
Email: