Unsupervised Learning, Clustering, and Self-Organization
Unsupervised learning does not require annotation or labeling from a human teacher; the idea is to learn the structure of the data from unlabeled examples. The most common unsupervised learning task is clustering, i.e. grouping instances into a discovered set of categories containing similar instances. Self-organizing maps in addition visualize the topology of the clusters on a map. Our work in this area includes applications on lexical semantics, topic modeling, and discovering latent class models, as well as methods for laterally connected, hierarchical, sequential-input, and growing self-organizing maps.
People
     [Expand to show all 11][Minimize]
Shruti Bhosale Formerly affiliated Masters Student shruti [at] cs utexas edu
Justine Blackmore Masters Alumni jblackmorehlista [at] yahoo com
Yoonsuck Choe Ph.D. Alumni choe [at] tamu edu
Daniel L. James Undergraduate Alumni
Elad Liebman Ph.D. Student eladlieb [at] cs utexas edu
Stephen Roller Ph.D. Alumni roller [at] cs utexas edu
Vito Ruiz Masters Alumni
Bryan Silverthorn Ph.D. Alumni bsilvert [at] cs utexas edu
Joseph Sirosh Ph.D. Alumni joseph sirosh [at] gmail com
Yiu Fai Sit Ph.D. Alumni yfsit [at] cs utexas edu
Austin Waters Ph.D. Alumni austin [at] cs utexas edu
Publications
     [Expand to show all 34][Minimize]
Predicting language treatment response in bilingual aphasia using neural network-based patient models 2021
Uli Grasemann, Claudia Peñaloza, Maria Dekhtyar, Risto Miikkulainen, and Swathi Kiran , Scientific Reports, Vol. 11, 10497 (2021), pp. 1-11.
The Traveling Observer Model: Multi-task Learning Through Spatial Variable Embeddings 2021
Elliot Meyerson and Risto Miikkulainen, To Appear In International Conference on Learning Representations, 2021.
The Traveling Observer Model: Multi-task Learning Through Spatial Variable Embeddings 2020
Elliot Meyerson and Risto Miikkulainen, arxiv:2010.02354 (2020).
BiLex: A computational approach to the effects of age of acquisition and language exposure on bilingual lexical access 2019
Claudia Peñaloza, Uli Grasemann, Maria Dekhtyar, Risto Miikkulainen, and Swathi Kiran, Brain and Language, Vol. 195, 104643 (2019).
Faster Training by Selecting Samples Using Embeddings 2019
Santiago Gonzalez, Joshua Landgraf, and Risto Miikkulainen, Proceedings of the 2019 International Joint Conference on Neural Networks (2019), pp. 1-7.
Continually Improving Grounded Natural Language Understanding through Human-Robot Dialog 2018
Jesse Thomason, PhD Thesis, Department of Computer Science, The University of Texas at Austin.
Discovering Gated Recurrent Neural Network Architectures 2018
Aditya Rawal, PhD Thesis, Department of Computer Science, The University of Texas at Austin.
Sensorimotor Embedding: A Developmental Approach to Learning Geometry 2015
Jeremy Stober, PhD Thesis, Department of Computer Sciences, The University of Texas at Austin.
Unsupervised Code-Switching for Multilingual Historical Document Transcription 2015
Dan Garrette, Hannah Alpert-Abrams, Taylor Berg-Kirkpatrick, and Dan Klein , In Proceedings the 2015 Conference of the North American Chapter of the Association for Computational Linguistics -- Human Language Technologies (NAACL HLT 2015), pp. 1036--1041, Denver, Colora...
Infinite-Word Topic Models for Digital Media 2014
Austin Waters, PhD Thesis, Department of Computer Science, The University of Texas at Austin.
A Mixture Model with Sharing for Lexical Semantics 2010
Joseph Reisinger and Raymond J. Mooney, In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2010), pp. 1173--1182, MIT, Massachusetts, USA, October 9--11 2010.
Cross-cutting Models of Distributional Lexical Semantics 2010
Joseph S. Reisinger, unpublished. Ph.D. proposal, Department of Computer Sciences, University of Texas at Austin.
Latent Class Models for Algorithm Portfolio Methods 2010
Bryan Silverthorn and Risto Miikkulainen, In Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence 2010.
Spherical Topic Models 2010
Joseph Reisinger, Austin Waters, Bryan Silverthorn, and Raymond J. Mooney, In Proceedings of the 27th International Conference on Machine Learning (ICML 2010) 2010.
Spherical Topic Models 2009
Joseph Reisinger, Austin Waters, Bryan Silverthorn, and Raymond Mooney, In NIPS'09 workshop: Applications for Topic Models: Text and Beyond 2009.
Temporal Convolution Machines for Sequence Learning 2009
Alan J Lockett and Risto Miikkulainen, Technical Report AI-09-04, Department of Computer Sciences, the University of Texas at Austin.
Self-Organizing Distinctive State Abstraction Using Options 2007
Jefferson Provost, Benjamin J. Kuipers, and Risto Miikkulainen, In Proceedings of the 7th International Conference on Epigenetic Robotics 2007.
Self-Organization of Hierarchical Visual Maps with Feedback Connections 2006
Yiu Fai Sit and Risto Miikkulainen, Neurocomputing, Vol. 69 (2006), pp. 1309-1312.
Associating Unseen Events: Semantically Mediated Formation of Episodic Associations 2005
Yaron Silberman, Risto Miikkulainen, and Shlomo Bentin, Psychological Science, Vol. 16 (2005), pp. 161-166.
Model-based Overlapping Clustering 2005
A. Banerjee, C. Krumpelman, S. Basu, Raymond J. Mooney and Joydeep Ghosh, In Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-05) 2005.
Characteristics of Forming Episodic Associations Between Words 2004
Yaron Silberman, PhD Thesis, The Hebrew University of Jerusalem.
The Role of Postsynaptic Potential Decay Rate in Neural Synchrony 2003
Yoonsuck Choe and Risto Miikkulainen, Neurocomputing, Vol. 52-54 (2003), pp. 707-712.
A Neural Network Model of Topographic Reorganization Following Cortical Lesions 1996
Joseph Sirosh and Risto Miikkulainen, In Computational Medicine, Public Health and Biotechnology: Building a Man in the Machine - Proceedings of the First World Congress Part II, M. Witten (Eds.), pp. 887-901, 1996. Teaneck, NJ: ...
Introduction: The Emerging Understanding of Lateral Interactions in the Cortex 1996
Risto Miikkulainen and Joseph Sirosh, In Lateral Interactions in the Cortex: Structure and Function, Sirosh, J., Miikkulainen, R., and Choe, Y. (Eds.) 1996. Electronic book, http://nn.cs.utexas.edu/web-pubs/htmlbook96.
Lateral Interactions In The Cortex: Structure And Function 1996
Joseph Sirosh, Risto Miikkulainen, and Yoonsuck Choe (editors), Electronic book, ISBN 0-9647060-0-8, http://nn.cs.utexas.edu/web-pubs/htmlbook96/. Austin, TX: The UTCS Neural Networks Research Group
Laterally Interconnected Self-Organizing Maps In Hand-Written Digit Recognition 1996
Yoonsuck Choe, Joseph Sirosh, and Risto Miikkulainen, In Advances in Neural Information Processing Systems 8, David S. Touretzky and Michael C. Mozer and Michael E. Hasselmo (Eds.), pp. 736-742 1996. Cambridge, MA: MIT Press.
Laterally Interconnected Self-Organizing Feature Map In Handwritten Digit Recognition 1995
Yoonsuck Choe, Masters Thesis, Department of Computer Sciences, The University of Texas at Austin. 65. Technical Report AI95-236.
SARDNET: A Self-Organizing Feature Map For Sequences 1995
Daniel L. James and Risto Miikkulainen, In Advances in Neural Information Processing Systems 7 (NIPS'94), G. Tesauro, D. S. Touretzky, and T. K. Leen (Eds.), pp. 577--584, Denver, CO 1995. Cambridge, MA: MIT Press.
Visualizing High-Dimensional Structure with the Incremental Grid Growing Network 1995
Justine Blackmore, Masters Thesis, Department of Computer Sciences, The University of Texas at Austin. Technical Report AI95-238.
Visualizing High-Dimensional Structure With The Incremental Grid Growing Neural Network 1995
Justine Blackmore and Risto Miikkulainen, In Machine Learning: Proceedings of the 12th Annual Conference, Armand Prieditis and Stuart Russell (Eds.), pp. 55-63, Austin, TX 1995. San Francisco, CA: Morgan Kaufmann. 55-63. Technical Repo...
How Lateral Interaction Develops In A Self-Organizing Feature Map 1993
Joseph Sirosh and Risto Miikkulainen, In Proceedings of the IEEE International Conference on Neural Networks (San Francisco, CA), pp. 1360-1365 1993. Piscataway, NJ: IEEE.
Incremental Grid Growing: Encoding High-Dimensional Structure Into A Two-Dimensional Feature Map 1993
Justine Blackmore and Risto Miikkulainen, In Proceedings of the IEEE International Conference on Neural Networks (San Francisco, CA), pp. 450-455 1993. Piscataway, NJ: IEEE.
Self-Organizing Process Based On Lateral Inhibition And Synaptic Resource Redistribution 1991
Risto Miikkulainen, In Proceedings of the 1991 International Conference on Artificial Neural Networks, Teuvo Kohonen and Kai M{"a}kisara and Olli Simula and Jari Kangas (Eds.), pp. 415-420 1991. Amsterdam: North-H...
Script Recognition With Hierarchical Feature Maps 1990
Risto Miikkulainen, Connection Science, Vol. 2 (1990), pp. 83-101.
Projects
Computational modeling of language impairment and control in bilingual individuals with post-stroke aphasia and neurodegenerative disorders 2023 - 2028
SARDNET: Forming Maps of Sequences 1994 - 1994
IGG: Visualization with Incremental Grid Growing 1993 - 1995
HFM: Hierarchical Features Maps 1989 - 1994
LISSOM: Laterally Interconnected Self-Organizing Maps 1987 - 1997
Software/Data
BiLex Download at GitHub.

A self-organizing map model of bilingual aphasia. ...

2021
LISSOM

The LISSOM package contains the C++, Python, and Scheme source code and examples for training and testing firing-rate...

2004
SOFM The SOFM package contains C- and TK/TCL-code (integrated through SWIG) for the standard feature map algorithm for formi... 2002
HFM The HFM package contains the C-code and data for training and testing the HFM memory organization and hierarchical class... 1994
Demos
Handwritten Digit Recognition Utilizing Evolved Pattern GeneratorsVinod Valsalam2007
Labs
Machine Learning Neural Networks