Natural Language Processing (Cognitive)
Our research in cognitive models of natural language processing aims at bridging the gap between subsymbolic representations and complex high-level behavior. The models are based on subsymbolic mechanisms but aim at explaining how people learn word meanings, organize their lexicon, understand sentences and stories, and answer questions about them. An important aspect of this research is also understanding linguistic disorders, and most recently, the evolution of language.
People
     [Expand to show all 24][Minimize]
Nora E. Aguirre-Celis Ph.D. Alumni naguirre [at] cs utexas edu
Shlomo Bentin Formerly affiliated Collaborator shlomo bentin [at] huji ac il
Dennis J. A. Bijwaard Formerly affiliated Visitor
Yonatan Bisk Undergraduate Alumni ybisk [at] yo-tech com
Bobby D. Bryant Ph.D. Alumni bdbryant [at] cse unr edu
Chun-Chi Chen Undergraduate Alumni
Igor Farkas Postdoctoral Alumni farkas [at] fmph uniba sk
Peggy Fidelman Formerly affiliated Ph.D. Student peggyf [at] cs utexas edu
Uli Grasemann Postdoctoral Alumni uli [at] cs utexas edu
Patrick Haley Undergraduate Alumni
Ralph E. Hoffman Formerly affiliated Collaborator ralph hoffman [at] yale edu
Kay E. Holekamp Formerly affiliated Collaborator holekamp [at] msu edu
Daniel L. James Undergraduate Alumni
Swathi Kiran Collaborator kirans [at] bu edu
Marshall R. Mayberry III Ph.D. Alumni marty mayberry [at] gmail com
Risto Miikkulainen Faculty risto [at] cs utexas edu
Claudia Penaloza Collaborator claudia_penaloza [at] ub edu
Melissa Redford Postdoctoral Alumni redford [at] cs utexas edu
Yaron Silberman Ph.D. Alumni yarons [at] alice nc huji ac il
Lappoon R. Tang Ph.D. Alumni ltang [at] utb edu
Gert Westermann Formerly affiliated Visitor gwestermann [at] brookes ac uk
Paul Williams Undergraduate Alumni pwilly [at] cs utexas edu
Cameron R. Wolfe Undergraduate Alumni wolfe cameron [at] utexas edu
Hong Ming Yeh Formerly affiliated Ph.D. Student hongming [at] cs utexas edu
Publications
     [Expand to show all 64][Minimize]
Modeling Bilingualism as a Dynamic Phenomenon in Healthy and Neurologically Affected Speakers Across the Lifespan (Commentary) 2023
Claudia Penaloza, Uli Grasemann, Risto Miikkulainen, Swathi Kiran, Language Learning, Vol. . (2023). https://doi.org/10.1111/lang.12566.
What AI Can Do for Neuroscience: Understanding How the Brain Represents Word Meanings 2023
Nora Aguirre-Celis and Risto Miikkulainen, In What AI Can Do: Strengths and Limitations of Artificial Intelligence, Manuel Cebral-Loureda, Elvira G. Rincon-Flores, and Gildardo Sanchez-Ante (Eds.), pp. 401-417, 2023. CRC Press.
Constructing Individualized Computational Models for Dementia Patients 2022
Peggy Fidelman, Uli Grasemann, Claudia Penaloza, Michael Scimeca, Yakeel T. Quiroz, Swathi Kiran, Risto Miikkulainen, In Proceedings of the 44th Annual Meeting of the Cognitive Science Society, 2022.
How the Brain Dynamically Constructs Sentence-Level Meanings From Word-Level Features 2022
Nora Aguirre-Celis and Risto Miikkulainen, Frontiers in Artificial Intelligence (2022).
From Words to Sentences and Back: Characterizing Context-dependent Meaning Representations in the Brain 2021
Nora Aguirre-Celis a.k.a. Nora E. Aguirre Sampayo, PhD Thesis, Instituto Tecnologico y de Estudios Superiores de Monterrey.
Predicting language treatment response in bilingual aphasia using neural network-based patient models 2021
Uli Grasemann, Claudia Peñaloza, Maria Dekhtyar, Risto Miikkulainen, and Swathi Kiran , Scientific Reports, Vol. 11, 10497 (2021), pp. 1-11.
Understanding the Semantic Space: How Word Meanings Dynamically Adapt in the Context of a Sentence 2021
Nora Aguirre-Celis and Risto Miikkulainen, In Proceedings of the Workshop on Semantic Spaces at the Intersection of NLP, Physics, and Cognitive Science , Groningen, Netherlands, June 2021.
Characterizing Dynamic Word Meaning Representations in the Brain 2020
Nora Aguirre-Celis and Risto Miikkulainen, In Proceedings of the 6th Workshop on Cognitive Aspects of the Lexicon (CogALex-VI), Barcelona, ES, December 2020.
Characterizing the Effect of Sentence Context on Word Meanings: Mapping Brain to Behavior 2020
Nora Aguirre-Celis and Risto Miikkulainen, arXiv:2007.13840 (2020).
From Nodes to Networks: Evolving Recurrent Neural Networks 2020
Aditya Rawal, Risto Miikkulainen, In Deep Neural Evolution: Deep Learning with Evolutionary Computation, H. Iba and N. Noman (Eds.), pp. 233-251 2020. Springer. (also arxiv:1803.04439).
BiLex: A computational approach to the effects of age of acquisition and language exposure on bilingual lexical access 2019
Claudia Peñaloza, Uli Grasemann, Maria Dekhtyar, Risto Miikkulainen, and Swathi Kiran, Brain and Language, Vol. 195, 104643 (2019).
Data Augmentation for Deep Transfer Learning 2019
Cameron R. Wolfe and Keld T. Lundgaard, No other information
Evolving Deep Neural Networks 2019
Risto Miikkulainen, Jason Liang, Elliot Meyerson, Aditya Rawal, Dan Fink, Olivier Francon, Bala Raju, Hormoz Shahrzad, Arshak Navruzyan, Nigel Duffy, and Babak Hodjat, In Artificial Intelligence in the Age of Neural Networks and Brain Computing, Robert Kozma, Cesare Alippi, Yoonsuck Choe, and Francesco Carlo Morabito (Eds.), pp. 293-312 2019. Amsterdam: Elsev...
Quantifying the Conceptual Combination Effect on Word Meanings 2019
Nora Aguirre-Celis and Risto Miikkulainen, In Proceedings of the 41th Annual Meeting of the Cognitive Science Society, Montreal, CA, July 2019.
Combining fMRI Data and Neural Networks to Quantify Contextual Effects in the Brain 2018
Nora Aguirre-Celis and Risto Miikkulainen, In Brain Informatics. BI 2018. Lectures Notes in Computer Sciences, Shouyi Wang, Vicky Yamamoto, Jianzhong Su, Yang Yang, Eric Jones, Leon Iasemidis, Tom Mitchell (Eds.), Vol. 11309, pp. 129-14...
Evolving Artificial Language Through Evolutionary Reinforcement Learning 2016
Xun Li and Risto Miikkulainen, In Proceedings of the Fifteenth International Conference on the Synthesis and Simulation of Living Systems, Cambridge, MA, 2016. MIT Press.
The Evolution of Language Groups among Cooperating Digital Predators 2016
Patrick Haley, Technical Report HR-16-06, Department of Computer Science, The University of Texas at Austin.
A Computational Account of Bilingual Aphasia Rehabilitation 2013
Swathi Kiran, Uli Grasemann, Chaleece Sandberg, and Risto Miikkulainen, Bilingualism: Language and Cognition, Vol. 16 (2013), pp. 325-342.
Modeling Acute and Compensated Language Disturbance in Schizophrenia 2011
Uli Grasemann, Ralph Hoffman and Risto Miikkulainen, In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society 2011.
Using Computational Patients to Evaluate Illness Mechanisms in Schizophrenia 2011
Ralph E. Hoffman, Uli Grasemann, Ralitza Gueorguieva, Donald Quinlan, Douglas Lane, and Risto Miikkulainen, Biological Psychiatry, Vol. 69 (2011), pp. 997--1005.
A Computational Model of Language Pathology in Schizophrenia 2010
Uli Grasemann, PhD Thesis, Department of Computer Science, The University of Texas at Austin. 147 pages. Technical report TR-11-11.
Modeling the Bilingual Lexicon of an Individual Subject 2009
Risto Miikkulainen and Swathi Kiran, In Proceedings of the Workshop on Self-Organizing Maps (WSOM'09), Berlin 2009. Springer.
The Necessity of Separating Control and Logic When Grounding Language Using Neuroevolution 2009
Yonatan Bisk, Technical Report HR-09-05, Department of Computer Sciences, The University of Texas at Austin.
Incremental Nonmonotonic Sentence Interpretation through Semantic Self-Organization 2008
Marshall R. Mayberry III and Risto Miikkulainen, Technical Report AI08-12, Department of Computer Sciences, University of Texas at Austin.
A Subsymbolic Model of Language Pathology in Schizophrenia 2007
Uli Grasemann, Risto Miikkulainen, Ralph Hoffman, In Proceedings of the 29th Annual Conference of the Cognitive Science Society, pp. 311-316, Hillsdale, NJ 2007. Erlbaum.
Semantic Boost on Episodic Associations: An Empirically Based Computational Model 2007
Yaron Silberman, Shlomo Bentin, and Risto Miikkulainen, Cognitive Science, Vol. 31 (2007), pp. 645--671.
Grounding Language in Descriptions of Scenes 2006
Paul Williams and Risto Miikkulainen, In Proceedings of the 28th Annual Meeting of the Cognitive Science Society 2006.
A Subsymbolic Model of Complex Story Understanding 2005
Peggy Fidelman, Risto Miikkulainen and Ralph Hoffman, In Proceedings of the 27th Annual Meeting of the Cognitive Science Society 2005.
Associating Unseen Events: Semantically Mediated Formation of Episodic Associations 2005
Yaron Silberman, Risto Miikkulainen, and Shlomo Bentin, Psychological Science, Vol. 16 (2005), pp. 161-166.
Broad-Coverage Parsing with Neural Networks 2005
Marshall R. Mayberry III and Risto Miikkulainen, Neural Processing Letters, Vol. 21 (2005), pp. 121--143.
Learning Visual Scene Descriptions: An Approach to Symbol Grounding 2005
Paul Williams, Technical Report TR-06-01, Department of Computer Science, The University of Texas at Austin.
Characteristics of Forming Episodic Associations Between Words 2004
Yaron Silberman, PhD Thesis, The Hebrew University of Jerusalem.
Incremental Nonmonotonic Parsing through Semantic Self-Organization 2003
Marshall R. Mayberry III, PhD Thesis, Department of Computer Sciences, the University of Texas at Austin. Technical Report AI-TR-04-310.
Incremental Nonmonotonic Parsing through SemanticSelf-Organization 2003
Marshall R. Mayberry III and Risto Miikkulainen, In Proceedings of the 25th Annual Conference of the Cognitive Science Society 2003.
Text and Discourse Understanding: The DISCERN System 2002
Risto Miikkulainen, In A Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text, R. Dale, H. Moisl and H. Somers (Eds.), pp. 905--919, New York 2002.
Abrupt And Gradual Sound Change In An Expanding Lexicon 2001
Melissa A. Redford and Risto Miikkulainen, Technical Report AI01-289, Department of Computer Sciences, The University of Texas at Austin.
Constrained Emergence Of Universals And Variation In Syllable Systems 2001
Melissa A. Redford, Chun Chi Chen, and Risto Miikkulainen, Language and Speech (2001), pp. 27-56. Manuscript.
From Word Stream To Gestalt: A Direct Semantic Parse For Complex Sentences 2001
Bobby D. Bryant and Risto Miikkulainen, Technical Report AI98-274, AI Lab, University of Texas at Austin.
Semantic Effect On Episodic Associations 2001
Yaron Silberman, Risto Miikkulainen, and Shlomo Bentin, In Proceedings of the 23rd Annual Conference of the Cognitive Science Society, pp. 934-939 2001.
Disambiguation And Grammar As Emergent Soft Constraints 1999
Risto Miikkulainen and Marshall R. Mayberry III, In Workshop on Thought and Language, Brian J. MacWhinney (Eds.), pp. 20-31, Iizuka, Japan 1999. Department of Artificial Intelligence, Kyushu Institute of Technology.
SARDSRN: A Neural Network Shift-Reduce Parser 1999
Marshall R. Mayberry III and Risto Miikkulainen, In Proceedings of the 16th Annual International Joint Conference on Artificial Intelligence (IJCAI-99), pp. 820-825, Stockholm, Sweden 1999. San Francisco, CA: Kaufmann.
Using a Sequential SOM to Parse Long-Term Dependencies 1999
Marshall R. Mayberry III and Risto Miikkulainen, In Proceedings of the 21st Annual Conference of the Cognitive Science Society, Martin Hahn and Scott C. Stoness (Eds.), pp. 367-372 1999. Hillsdale, NJ: Erlbaum.
Modeling The Emergence Of Syllable Systems 1998
Melissa A. Redford, Chun Chi Chen, and Risto Miikkulainen, In Proceedings of the 20th Annual Conference of the Cognitive Science Society, Morton Ann Gernsbacher and Sharon J. Derry (Eds.), pp. 882-886 1998. Hillsdale, NJ: Erlbaum.
Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon 1997
Risto Miikkulainen, Brain and Language (1997), pp. 334-366.
Natural Language Processing With Subsymbolic Neural Networks 1997
Risto Miikkulainen, In Neural Network Perspectives on Cognition and Adaptive Robotics, Antony Browne (Eds.), pp. 120-139, Bristol, UK; Philadelphia, PA 1997. Institute of Physics Publishing.
Subsymbolic Case-Role Analysis Of Sentences With Embedded Clauses 1996
Risto Miikkulainen, Cognitive Science, Vol. 20 (1996), pp. 47-73.
SARDNET: A Self-Organizing Feature Map For Sequences 1995
Daniel L. James and Risto Miikkulainen, In Advances in Neural Information Processing Systems 7 (NIPS'94), G. Tesauro, D. S. Touretzky, and T. K. Leen (Eds.), pp. 577--584, Denver, CO 1995. Cambridge, MA: MIT Press.
Script-Based Inference And Memory Retrieval In Subsymbolic Story Processing 1995
Risto Miikkulainen, Applied Intelligence (1995), pp. 137-163.
Visualizing High-Dimensional Structure with the Incremental Grid Growing Network 1995
Justine Blackmore, Masters Thesis, Department of Computer Sciences, The University of Texas at Austin. Technical Report AI95-238.
Visualizing High-Dimensional Structure With The Incremental Grid Growing Neural Network 1995
Justine Blackmore and Risto Miikkulainen, In Machine Learning: Proceedings of the 12th Annual Conference, Armand Prieditis and Stuart Russell (Eds.), pp. 55-63, Austin, TX 1995. San Francisco, CA: Morgan Kaufmann. 55-63. Technical Repo...
A Connectionist Corpus-Based Approach to the Building of Word Representations 1994
Rupert L. Tang, Technical Report HR-94-01, Department of Computer Science, The University of Texas at Austin.
Integrated Connectionist Models: Building AI Systems on Subsymbolic Foundations 1994
Risto Miikkulainen, Artificial Intelligence and Neural Networks: Steps Toward Principled IntegrationHonavar, V., and Uhr, L. (Eds.) (1994), pp. 483--508.
Lexical Disambiguation Based on Distributed Representations of Context Frequency 1994
Marshall R. Mayberry III and Risto Miikkulainen, In Proceedings of the 16th Annual Conference of the Cognitive Science Society, Ashwin Ram and Kurt Eiselt (Eds.), pp. 601-606 1994. Hillsdale, NJ: Erlbaum.
Parsing Embedded Clauses with Distributed Neural Networks 1994
Risto Miikkulainen and Dennis Bijwaard, In Proceedings of the Twelfth National Conference on Artificial Intelligence, pp. 858-864, January 1994.
Parsing Embedded Clauses with Distributed Neural Networks 1994
Risto Miikkulainen and Dennis Bijwaard, In Proceedings of the Twelfth National Conference on Artificial Intelligence, pp. 858-864, January 1994.
Verb Inflections in German Child Language: A Connectionist Account 1994
Gert Westermann and Risto Miikkulainen, In Proceedings of the 16th Annual Conference of the Cognitive Science Society, Ashwin Ram and Kurt Eiselt (Eds.), pp. 928-933 1994. Hillsdale, NJ: Erlbaum.
Multi-Level Neural Network Language Translator 1993
James A. Bednar, Technical Report HR-93-01, Department of Computer Sciences, The University of Texas at Austin.
Subsymbolic Natural Language Processing: An Integrated Model Of Scripts, Lexicon, And Memory 1993
Risto Miikkulainen, , MIT Press, Cambridge, MA 1993. MIT Press.
Trace Feature Map: A Model Of Episodic Associative Memory 1992
Risto Miikkulainen, Biological Cybernetics, Vol. 66 (1992), pp. 273--282.
Natural Language Processing With Modular PDP Networks And Distributed Lexicon 1991
Risto Miikkulainen and Michael G. Dyer, Cognitive Science, Vol. 15 (1991), pp. 343-399.
A PDP Architecture For Processing Sentences With Relative Clauses 1990
Risto Miikkulainen, In Proceedings of the 13th International Conference on Computational Linguistics (COLING-90), pp. 201--206, Helsinki, Finland: Yliopistopaino 1990.
DISCERN: A Distributed Artificial Neural Network Model Of Script Processing And Memory 1990
Risto Miikkulainen, PhD Thesis, University of California. 334.
Distributed Connectionist Knowledge Representations in Script/Goal-Based Story Understanding 1990
Geunbae Lee and Risto Miikkulainen, In Proceedings of Seoul International Conference on Natural Language Processing (SICONLP-90), pp. 339-350, Seoul, Korea 1990. Seoul National University Language Research Institute.
Script Recognition With Hierarchical Feature Maps 1990
Risto Miikkulainen, Connection Science, Vol. 2 (1990), pp. 83-101.
Projects
     [Expand to show all 12][Minimize]
Software/Data
BiLex Download at GitHub.

A self-organizing map model of bilingual aphasia. ...

2021
CHILL CHILL (Constructive Heuristics Induction for Language Learning) is a general approach to the problem of inducing natural... 2000
MIR Sentence Processing Package The MIR Sentence Processing package contains the C source code for the MIR system, as well as a selection of scripts wi... 1998
DISLEX

This package contains the C-code and data for training and testing the DISLEX model of the lexicon, which is also par...

1994
FGREPNET The FGREPNET package contains the C-code and data for training and testing an FGREP network in developing distributed re... 1994
HFM The HFM package contains the C-code and data for training and testing the HFM memory organization and hierarchical class... 1994
PROC The PROC package contains the C-code and data for training and testing the story processing modules of the DISCERN syste... 1994
SPEC The SPEC package contains the C-code and data for training and testing the SPEC system for processing complex sentences ... 1994
DISCERN DISCERN is a large, modular neural network system for reading, paraphrasing and answering questions about stereotypical ... 1993
Demos
A Subsymbolic Model of Schizophrenic LanguageUli Grasemann2010
Labs
Neural Networks