CS 395T:
Grounded Natural Language Processing

Instructor

Raymond J. Mooney

Teaching Assistant

Jeffery Cochran

Time and Place

Spring 2021, Mon & Wed, 2-3:30pm, Zoom link on Canvas

Office Hours

General Course Information

This course will be a graduate research seminar in grounded natural language processing (GNLP), a subarea of AI that studies the connection between natural language and perception and action in the world. It makes connections between natural language processing (NLP) and computer vision, robotics, and computer graphics. Almost all work in the area uses machine learning to learn the connection between language and perception and/or action from some form of multi-modal training data.

The class will mostly revolve around reading both seminal and recent research papers in the area. Each student will be required to prepare organized oral presentations of papers and participate in class discussion about these papers. Many of the papers will be selected from the ones that have been covered in the local CLAMP reading group over the last 12 years.

Finally, it will involve conducting an original research project in the area, writing a paper on this project suitable for submitting to a research conference, and presenting an oral presentation on the project.

Course Details

Lecture Slides