UTCS Artificial Intelligence
courses
talks/events
demos
people
projects
publications
software/data
labs
areas
admin
Incremental Nonmonotonic Parsing through Semantic Self-Organization (2003)
Marshall R. Mayberry III
Subsymbolic systems have been successfully used to model several aspects of human language processing. Subsymbolic parsers are appealing because they allow combining syntactic, semantic, and thematic constraints in sentence interpretation and nonmonotonically revising that interpretation while incrementally processing a sentence. Such parsers are also cognitively plausible: processing is robust and multiple interpretations are simultaneously activated when the input is ambiguous. Yet, it has proven very difficult to scale them up to realistic language. They have limited memory capacity, training takes a long time, and it is difficult to represent linguistic structure. A new connectionist model, INSOMNet, scales up the subsymbolic approach by utilizing semantic self-organization. INSOMNet was trained on semantic dependency graph representations from the recently-released LinGO Redwoods HPSG Treebank of sentences from the VerbMobil project. The results show that INSOMNet accurately learns to represent these semantic dependencies and generalizes to novel structures. Further evaluation of INSOMNet on the original VerbMobil sentences transcribed with annotations for spoken language demonstrates robust parsing of noisy input, while graceful degradation in performance from adding noise to the network weights underscores INSOMNet's tolerance to damage. Finally, the cognitive plausibility of the model is shown on a standard psycholinguistic benchmark, in which INSOMNet demonstrates expectations and defaults, coactivation of multiple interpretations, nonmonotonicity, and semantic priming.
View:
PDF
Citation:
PhD Thesis, Department of Computer Sciences, the University of Texas at Austin. Technical Report AI-TR-04-310.
Bibtex:
@phdthesis{mayberry:phd03, title={Incremental Nonmonotonic Parsing through Semantic Self-Organization}, author={Marshall R. Mayberry III}, school={Department of Computer Sciences, the University of Texas at Austin}, address={Austin, TX}, note={Technical Report AI-TR-04-310}, url="http://www.cs.utexas.edu/users/ai-lab?mayberry:phd03", year={2003} }
People
Marshall R. Mayberry III
Ph.D. Alumni
marty mayberry [at] gmail com
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Areas of Interest
Applications
Cognitive Science
Natural Language Processing (Cognitive)
Labs
Neural Networks