Developing Complex Systems Using Evolved Pattern Generators
Active from 2004 - 2006
Self-organization of connection patterns within brain areas of animals begins prenatally, and has been shown to depend on internally generated patterns of neural activity. The neural structures continue to develop postnatally through externally driven patterns, when the sensory systems are exposed to stimuli from the environment. The internally generated patterns have been proposed to give the neural system an appropriate bias so that it can learn reliably from complex environmental stimuli. This project evaluates the hypothesis that complex artificial learning systems can benefit from a similar approach, consisting of initial training with patterns from an evolved pattern generator, followed by training with the actual training set. Preliminary experiments to test this hypothesis involved training competitive learning networks for recognizing handwritten digits. The results demonstrate how the approach can improve learning performance by discovering the appropriate initial weight biases, thereby compensating for weaknesses of the learning algorithm.
Vinod Valsalam Ph.D. Student (Alumni) vkv@alumni.utexas.net
James A. Bednar Postdoc (Alumni) jbednar@inf.ed.ac.uk
Risto Miikkulainen Professor risto@cs.utexas.edu
Developing Complex Systems Using Evolved Pattern Generators 2007
Vinod K. Valsalam, James A. Bednar and Risto Miikkulainen
Establishing an Appropriate Learning Bias Through Development 2006
Vinod K. Valsalam, James A. Bednar, and Risto Miikkulainen
Constructing Good Learners Using Evolved Pattern Generators 2005
Vinod K. Valsalam, James A. Bednar, and Risto Miikkulainen