[ Meeting Schedule | Members | Proposed Papers | Previous Discussions | Subscribe to Email List ]

Previous Discussions

[ Fall 2013 | Spring 2013 | Fall 2012 | Spring 2012 | Fall 2011 | Spring 2011 | Fall 2010 | Spring 2010 | Fall 2009 | Spring 2009 | Fall 2008 | Summer 2008 | Spring 2008 | Fall 2007 | Summer 2007 ]

Fall 2013

Back to Top
DateTimePlacePaper
12/06/2013 12:00pm GDC 3.816 Elia Bruni, Gemma Boleda, Marco Baroni, Nam-Khan Tran
Distributional Semantics in Technicolor, ACL 2012
11/22/2013 12:00pm GDC 3.516 Carina Silberer, Vittorio Ferrari, Mirella Lapata
Models of Semantic Representation with Visual Attributes, ACL 2013
11/8/2013 12:00pm GDC 3.516 Andrew J. Anderson, Elia Bruni, Ulisse Bordignon, Massimo Poesio, and Marco Baroni
Of words, eyes and brains: Correlating image-based distributional semantic models with neural representations of concepts, EMNLP 2013
10/25/2013 12:00pm GDC 3.516 Haonan Yu and Jeffrey Mark Siskind
Grounded Language Learning from Video Described with Sentences, ACL 2013 (best paper award)

Spring 2013

Back to Top
DateTimePlacePaper
4/23/2013 1PM GDC 3.416 Michaela Regneri, Marcus Rohrbach, Dominikus Wetzel, Stefan Thater, Bernt Schiele, Manfred Pinkal
Grounding Action Descriptions in Videos, TACL, 2013
4/9/2013 1PM GDC 3.416 Yoav Artzi and Luke Zettlemoyer
Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions, TACL, 2013
3/26/2013 1PM GDC 3.416 C. Liu, R. Fang, and J. Y. Chai
Towards Mediating Shared Perceptual Basis in Situated Dialogue, SIGDIAL Meeting on Discourse and Dialogue, 2012
3/5/2013 1PM GDC 3.416 Richard Socher, Milind Ganjoo, Hamsa Sridhar, Osbert Bastani, Christopher D. Manning, Andrew Y. Ng
Zero-Shot Learning Through Cross-Modal Transfer, arXiv, 2013.
2/19/2013 1PM GDC 3.516 Y. Jia, M. Salzmann, and T. Darrell
Learning Cross-modality Similarity for Multinomial Data , ICCV, 2011.
2/5/2013 1PM GDC 3.416 Barbu, A. and Bridge, A. and Burchill, Z. and Coroian, D. and Dickinson, S. and Fidler, S. and Michaux, A. and Mussman, S. and Narayanaswamy, S. and Salvi, D. and others.
Video In Sentences Out. , UAI, 2012.
1/22/2013 1PM ENS 32NEA Hannaneh Hajishirzi, Julia Hockenmaier, Erik T. Mueller, and Eyal Amir.
Reasoning about RoboCup Soccer Commentaries., UAI, 2011.

Fall 2012

Back to Top
DateTimePlacePaper
12/04/2012 1PM ENS 32NEA Cynthia Matuszek, Evan Herbst, Luke Zettlemoyer, Dieter Fox.
Learning to Parse Natural Language Commands to a Robot Control System., ISER, 2012.
11/20/2012 1PM ENS 32NEA Yezhou Yang, Ching Lik Teo, Hal Daume III, and Yiannis Aloimonos
Corpus-Guided Sentence Generation of Natural Images, EMNLP 2011
11/06/2012 1PM ENS 32NEA Frank, M. C., Goodman, N. D., and Tenenbaum, J. B.
Using Speakers' Referential Intentions to Model Early Cross-Situational Word Learning, Psychological Science 20, 578-585, 2009.
10/23/2012 1PM ENS 32NEA Mark Johnson, Katherine Demuth, Michael Frank and Bevan Jones
Synergies in Learning Words and Their Referents, In Proceedings of NIPS 2010.
10/09/2012 1PM ENS 32NEA Mark Johnson, Katherine Demuth and Michael Frank
Exploiting Social Information In Grounded Language Learning Via Grammatical Reduction, In Proceedings of ACL 2012.
09/25/2012 1PM ENS 32NEA Polina Kuznetsova, Vicente Ordonez, Alexander Berg, Tamara Berg and Yejin Choi
Collective Generation of Natural Image Descriptions, In Association for Computational Linguistics (ACL), 2012.
09/11/2012 1PM ENS 32NEA C. Matuszek and N. FitzGerald and L. Zettlemoyer and L. Bo and D. Fox
A Joint Model of Language and Perception for Grounded Attribute Learning, In International Conference on Machine Learning (ICML), July 2012.

Spring 2012

Back to Top
DateTimePlacePaper
04/03/2012 3PM ENS 32NEA Chao, C.; Cakmak, M.; Thomaz, A.L
Towards grounding concepts for transfer in goal learning from demonstration, Development and Learning (ICDL), 2011 IEEE International Conference on , vol.2, no., pp.1-6, 24-27 Aug. 2011
03/20/2012 3PM ENS 32NEA Tanvi Motwani and Raymond Mooney
Improving Video Activity Recognition using Object Recognition and Text Mining, Submitted to ECAI,2012
02/28/2012 3PM ENS 32NEA Chee Wee Leong and Rada Mihalcea
Going Beyond Text: A Hybrid Image-Text Approach for Measuring Word Relatedness, in Proceedings of the International Joint Conference on Natural Language Processing (IJCNLP 2011), Chiang Mai, Thailand, November 2011
02/14/2012 3PM ENS 32NEA K, Saenko and T. Darrell
Unsupervised Learning of Visual Sense Models for Polysemous Words, Proc. NIPS, December 2008, Vancouver, Canada

Fall 2011

Back to Top
DateTimePlacePaper
12/1/2011 4PM ENS 32NEA Siming Li, Girish Kulkarni, Tamara Berg, Alex Berg and Yejin Choi
Composing Simple Image Descriptions using Web-scale N-grams, Computational Natural Language Learning (CoNLL), 2011
11/10/2011 4PM ENS 32NEA Girish Kulkarni, Visruth Premraj, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C. Berg, and Tamara Berg
Baby Talk: Understanding and Generating Image Descriptions , Computer Vision and Pattern Recognition (CVPR), 2011
10/27/2011 4PM ENS 32NEA E. Bruni, G.B. Tran and M. Baroni
Distributional semantics from text and images , Proceedings of the EMNLP 2011 Geometrical Models for Natural Language Semantics (GEMS 2011) Workshop, East Stroudsburg PA: ACL, 22-32
10/13/2011 4PM ENS 32NEA Richard Socher, Cliff C. Lin, Andrew Y. Ng, and Christopher D. Manning
Parsing Natural Scenes and Natural Language with Recursive Neural Networks , ICML, 2011
09/29/2011 4PM ENS 32NEA Benjamin Borschinger, Bevan K. Jones and Mark Johnson
Reducing Grounded Learning Tasks To Grammatical Inference, EMNLP, 2011
09/01/2011 4PM ENS 32NEA Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew R. Walter, Ashis Gopal Banerjee, Seth Teller, Nicholas Roy
Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation, AAAI, 2011

Spring 2011

Back to Top
DateTimePlacePaper
5/12/2010 4PM ENS 32NEA S.R.K. Branavan, David Silver, and Regina Barzilay
Learning to Win by Reading Manuals in a Monte-Carlo Framework, ACL, 2011
4/28/2010 4PM ENS 32NEA Antoine Bordes, Nicolas Usunier, and Jason Weston
Label Ranking under Ambiguous Supervision for Learning Semantic Correspondences, ICML, 2010
4/14/2010 4PM ENS 32NEA Hilke Reckman, Jeff Orkin, and Deb Roy
Learning meanings of words and constructions, grounded in a virtual game, 10th Conference on Natural Language Processing (KONVENS), 2010
3/31/2010 4PM ENS 32NEA Michael C. Frank, Noah D. Goodman, and Joshua B. Tenenbaum
Using Speakers' Referential Intentions to Model Early Cross-Situational Word Learning, Psychological Science, 2009
3/3/2010 4PM ENS 32NEA K. Prabhakar, S. Oh, P. Wang, G. Abowd, and J. M. Rehg
Temporal Causality for the Analysis of Visual Events, CVPR 2010, Oral presentation
2/3/2010 4PM ENS 32NEA David L. Chen and Raymond J. Mooney
Learning to Interpret Natural Language Navigation Instructions from Observations, Under Submission
1/20/2010 4PM ENS 32NEA Dave Golland, Percy Liang, Dan Klein
A game-theoretic approach to generating spatial descriptions, EMNLP, 2010

Fall 2010

Back to Top
DateTimePlacePaper
12/9/2010 3PM ACES 5.444 Yansong Feng and Mirella Lapata
How Many Words is a Picture Worth? Automatic Caption Generation for News Images, ACL, 2010
Tuesday, 11/23/2010 3PM ACES 5.444 T. Kollar, S. Tellex, D. Roy, and N. Roy
Toward Understanding Natural Language Directions, International Conference on Human-Robot Interaction, 2010
11/11/2010 3PM ACES 5.444 A Farhadi, M Hejrati, M A Sadeghi, P Young, C Rashtchian1, J Hockenmaier, D. A. Forsyth
Every Picture Tells a Story: Generating Sentences from Images, ECCV, 2010
10/28/2010 3PM ACES 5.444 Adam Vogel and Dan Jurafsky
Learning to Follow Navigational Directions, ACL, 2010

Spring 2010

Back to Top
DateTimePlacePaper
5/26/2010 3PM ACES 3.116 Joo Hyun Kim, and Raymond J. Mooney
Generative Alignment and Semantic Parsing for Learning from Ambiguous Supervision, Under submission to Coling 2010
5/13/2010 4PM ACES 3.116 S. Qu and J. Y. Chai
Context-based Word Acquisition for Situated Dialogue in a Virtual World, JAIR, 2010
4/29/2010 4PM ACES 3.116 Stefanie Tellex and Deb Roy
Grounding Spatial Prepositions for Video Search, ICMI, 2009
4/15/2010 4PM ACES 3.116 Kristy Elizabeth Boyer, Robert Phillips, Amy Ingram, Eun Young Ha, Michael Wallis, Mladen Vouk, and James Lester
Characterizing the Effectiveness of Tutorial Dialogue with Hidden Markov Models, International Conference on Intelligent Tutoring Systems, 2010
3/11/2010 4PM ACES 3.116 Nobuyuki Shimizu, and Andrew Haas
Learning to Follow Navigational Route Instructions, IJCAI, 2009
2/25/2010 4PM ACES 3.116 Jeff Orkin and Deb Roy
Automatic Learning and Generation of Social Behavior from Collective Human Gameplay, AAMAS, 2009
2/11/2010 4PM ACES 3.116 Anton Leuski, and David Traum
A Statistical Approach for Text Processing in Virtual Humans, Army Science Conference, 2008
1/28/2010 4PM ACES 3.116 Nicholas Morsillo, Christopher Pal, and Randal Nelson
Semi-Supervised Learning of Visual Classifiers from Web Images and Text, IJCAI, 2009

Fall 2009

Back to Top
DateTimePlacePaper
12/3/2009 11AM ACES 5.444 Donna Byron, Alexander Koller, Kristina Striegnitz, Justine Cassell, Robert Dale, Johanna Moore, and Jon Oberlander
Report on the First NLG Challenge on Generating Instructions in Virtual Environments (GIVE), ENLG, 2009
For more information about the challenge and the individual systems, visit the GIVE Challenge website
11/12/2009 11AM ACES 5.444 Benjamin Snyder, and Regina Barzilay
Database-Text Alignment via Structured Multilabel Classification, IJCAI, 2007
10/29/2009 11AM ACES 5.444 T. Regier, and L. Carlson
Grounding spatial language in perception: An empirical and computational investigation, Journal of Experimental Psychology, 2001
10/15/2009 11AM ACES 5.444 Patrick Buehler, Mark Everingham, and Andrew Zisserman
Learning sign language by watching TV (using weakly aligned subtitles), CVPR, 2009
10/1/2009 11AM ACES 5.444 Percy Liang, Michael I. Jordan, and Dan Klein
Learning semantic correspondences with less supervision, ACL-IJCNLP, 2009
9/17/2009 11AM ACES 5.444 Tessa Lau, Clemens Drews, and Jeffrey Nichols
Interpreting Written How-To Instructions, IJCAI, 2009
9/3/2009 11AM ACES 5.444 S.R.K. Branavan, Harr Chen, Luke S. Zettlemoyer, and Regina Barzilay
Reinforcement Learning for Mapping Instructions to Actions, ACL-IJCNLP, 2009

Spring 2009

Back to Top
DateTimePlacePaper
5/15/2009 1PM ACES 5.444 Matt MacMahon, Brian Stankiewicz, and Benjamin Kuipers
Walk the Talk: Connecting Language, Knowledge, and Action in Route Instructions
AAAI, 2006
5/1/2009 1PM ACES 5.444 Sonal Gupta and Raymond J. Mooney
Using Closed Captions to Train Activity Recognizers that Improve Video Retrieval
Under submission to ACM Multimedia 2009
Workshop version
4/24/2009 1PM ACES 5.444 Ivan Laptev, Marcin Marszalek, Cordelia Schmid and Benjamin Rosenfeld
Learning realistic human actions from movies, CVPR, 2008
Note: Cordelia Schmid is giving a talk on Monday (4/27)
4/10/2009 1PM ACES 5.444 Kevin Gold, and Brian Scassellati
A Robot That Uses Existing Vocabulary to Infer Non-Visual Word Meanings from Observation, AAAI, 2007
3/6/2009 1PM ACES 5.444 A. Gupta and L. Davis
Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers, ECCV, 2008
2/20/2009 1PM ACES 5.444 Wesley Kerr, Paul R. Cohen, and Yu-Han Chang
Learning and Playing in Wubble World, AIIDE, 2008
2/6/2009 1PM ACES 5.444 T. Cour, C. Jordan, E. Miltsakaki, and B. Taskar
Movie/Script: Alignment and Parsing of Video and Text Transcription, ECCV, 2008

Fall 2008

Back to Top
DateTimePlacePaper
11/13/2008 4PM ACES 5.444 Noboru Babaguchi, Yoshihiko Kawai, Tadahiro Kitahashi
Event Based Indexing of Broadcasted Sports Video by Intermodal Collaboration , IEEE Transactions on Multimedia, 2002
10/16/2008 4PM ACES 5.444 Michael Fleischman and Deb Roy
Grounded Language Modeling for Automatic Speech Recognition of Sports Video, ACL-08:HLT
10/02/2007 4PM ACES 5.444 Rama Bindiganavale, William Schuler, Jan M. Allbeck, Norman I. Badler, Aravind K. Joshi, Martha Palmer
Dynamically Altering Agent Behaviors Using Natural Language Insctructions, Conference on Autonomous Agents, 2000
09/04/2007 4PM ACES 3.116 Practice talk for Sonal
Sonal Gupta, Joohyun Kim, Kristen Grauman and Raymond Mooney
Watch, Listen & Learn: Co-training on Captioned Images and Videos , ECML, 2008

Summer 2008

Back to Top
DateTimePlacePaper
05/30/2008 2PM ENS 32NEA J Wang, L Duan, L Xu, H Lu, JS Jin
TV Ad Video Categorization with Probabilistic Latent Concept Learning, Workshop on Multimedia Information Retrieval, 2007

Spring 2008

Back to Top
DateTimePlacePaper
05/02/2008 10AM ENS 32NEA M.R. Everingham, J. Sivic, and A. Zisserman
"Hello! My name ... Buffy" - Automatic Naming of Characters in TV Video, BMVC, 2006
04/18/2008 10AM ENS 32NEA Fleischman, M. and Roy, D.
Situated Models of Meaning for Sports Video Retrieval, HLT/NAACL, 2007
04/04/2008 10AM ENS 32NEA Kobus Barnard, Pinar Duygulu, David Forsyth, Nando de Freitas, David M. Blei, Michael I. Jordan
Matching Words and Pictures, JMLR, 2003
03/07/2008 10AM ENS 32NEA M. Jamieson A. Fazly, S. Dickinson, S. Stevenson, S. Wachsmuth
Learning Structured Appearance Models from Captioned Images of Cluttered Scenes, IEEE International Conference on Computer Vision (ICCV), 2007
02/22/2008 *11AM ENS 32NEA Sonal Gupta, Joo Hyun Kim, and Raymond J. Mooney
Co-training with Images and Text Captions, Under submission to ICML 2008
02/08/2008 10AM ENS 32NEA David L. Chen and Raymond J. Mooney
Learning to Sportscast: A Test of Grounded Language Acquisition, Under submission to ICML 2008
01/25/2008 10AM ENS 32NEA K. Forbus, C. Riesbeck, L. Birnbaum, K. Livingston, A. Sharma, L. Ureel
Integrating Natural Language, Knowledge Representation and Reasonin\ g, and Analogical Processing to Learn by Reading, AAAI, 2007

Fall 2007

Back to Top
DateTimePlacePaper
11/28/2007 1PM ACES 5.444 L. Zhu, Y. Chen, and A.L. Yuille
Unsupervised Learning of a Probabilistic Grammar for Object Detection and Parsing, NIPS, 2006
11/14/2007 1PM ACES 5.444 J. K.Aggarwal and Sangho Park
Human Motion: Modeling and Recognition of Actions and Interactions, 3D Data Processing, Visualization and Transmission, 2004
10/31/2007 1PM ACES 5.444 Jeffrey M. Siskind
A computational study of cross-situational techniques for learning word-to-meaning mappings, Cognition, 1996

10/17/2007 1PM ACES 5.444 Peter Gorniak, Deb Roy
Speaking with your Sidekick: Understanding Situated Speech in Computer Role Playing Games, AIIDE, 2005

10/3/2007 1PM ACES 5.444 Geert-Jan M. Kruijff, Hendrik Zender, Patric Jensfelt, and Henrik I. Christensen
Situated dialogue and spatial organization: What, where... and why?, International Journal of Advanced Robotic Systems, 4(2), 2007

09/19/2007 1PM ACES 5.444 Deb K. Roy, Alex P. Pentland
Learning words from sights and sounds: a computational model, Cognitive Science, 2002
09/05/2007 1PM ACES 5.444 Xiaojin Zhu, Andrew B. Goldberg, Mohamed Eldawy, Charles R. Dyer, Bradley Strock
A Text-to-Picture Synthesis System for Augmenting Communication, AAAI, 2007

Summer 2007

Back to Top
DateTimePlacePaper
07/30/2007 4PM ACES 5.444 Chen Yu, Dana Ballard, Richard Aslin
The Role of Embodied Intention in Early Lexical Acquisition, Cognitive Science, 2005

07/16/2007 4PM ACES 5.444 Deb Roy and Ehud Reiter
Connecting language to the world, AIJ, Volume 167, Issues 1-2, September 2005, Pages 1-12
Kobus Barnard and Matthew Johnson
Word sense disambiguation with pictures, AIJ, Volume 167, Issues 1-2, September 2005, Pages 13-30
07/02/2007 3PM ACES 5.444 D. Marocco and S. Nolfi
Emergence of communication in embodied agents evolved for the ability to solve a collective navigation problem
Connection Science, 19(1):53-74, March 2007.
06/11/2007 3PM ACES 5.444 Sudheendra Narasimhan, Pushkala Iyer, and Kristen Grauman
Keywords to Visual Categories: Multiple-Instance Learning for Unsupervised Object Recognition, Under submission to NIPS, 2007
05/29/2007
*TUESDAY
3PM ACES 5.444 Tamara L. Berg, Alexander C. Berg, Jaety Edwards, and D. A. Forsyth
Who's in the Picture, NIPS, 2004
Rohini K. Srihari and Debra T. Burhans
Visual Semantics: Extracting Visual Information from Text Accompanying Pictures, AAAI, 1994