Broad-Coverage Parsing with Neural Networks (2005)
Subsymbolic systems have been successfully used to model several aspects of human language processing. Such parsers are appealing because they allow revising the interpretation as words are incrementally processed. Yet, it has been very hard to scale them up to realistic language due to training time, limited memory, and the difficulty of representing linguistic structure. In this study, we show that it is possible to keep track of long-distance dependencies and to parse into deeper structures than before based on two techniques: a localist encoding of the input sequence and a dynamic unrolling of the network according to the parse tree. With these techniques, the system can nonmonotonically parse a corpus of realistic sentences into parse trees labelled with grammatical tags from a broadcoverage Head-driven Phrase Structure Grammar of English.
View:
PDF
Citation:
Neural Processing Letters, Vol. 21 (2005), pp. 121--143.
Bibtex:

Marshall R. Mayberry III Ph.D. Alumni martym at coli dot uni-sb dot
Risto Miikkulainen Faculty risto [at] cs utexas edu
MIR Sentence Processing Package The MIR Sentence Processing package contains the C source code for the MIR system, as well as a selection of scripts wi... 1998