Neuroevolution
Neuroevolution is a method for optimizing neural network weights and topologies using evolutionary computation. It is particularly useful in sequential decision tasks that are partially observable (i.e. POMDP) and where the state and action spaces are large (or continuous). Our work focuses on theory, algorithms, and applications of neuroevolution as described in numerous papers and demos in this site.
People
Adrian Agogino Collaborator adrian@email.arc.nasa.gov
Matthew Alden Ph.D. Student (Alumni) malden@cs.utexas.edu
Timothy Andersen Undergraduate Student (Alumni) andert@rpi.edu
Erkin Bahceci Ph.D. Student erkin@cs.utexas.edu
Joseph Bruce Former Member
Bobby Bryant Ph.D. Student (Alumni) bdbryant@cse.unr.edu
Chun-Chi Chen Undergraduate Student (Alumni)
Alex Conradie visitor aconradi@ing.sun.ac.za
Ryan Cornelius Undergraduate Student (Alumni) rccorn@gmail.com
Thomas D'Silva Masters Student (Alumni) twdsilva@gmail.com
James Jumin Fan Alumni (Alumni) jfan@cs.utexas.edu
Brad Fullmer Undergraduate Student (Alumni)
Aliza Gold Collaborator aliza@icc.utexas.edu
Faustino Gomez Postdoc (Alumni) inaki@cs.utexas.edu
Brian Greer Undergraduate Student (Alumni)
Todd Greer Undergraduate Student (Alumni)
Nabil Hewahi visitor nhewahi@iugaza.edu.ps
Igor V. Karpov Ph.D. Student ikarpov@cs.utexas.edu
Nate Kohl Ph.D. Student (Alumni) nate@cs.utexas.edu
Alan J Lockett Ph.D. Student (Alumni) alan.lockett@gmail.com
Alex Lubberts visitor
Paul H. McQuesten Ph.D. Student (Alumni) Paul_McQuesten@redlands.edu
Risto Miikkulainen Professor risto@cs.utexas.edu
German Monroy Masters Student (Alumni) gmonroy@cs.utexas.edu
David E. Moriarty Ph.D. Student (Alumni) moriarty@alumni.utexas.net
Andres Santiago Perez-Bergquist Undergraduate Student (Alumni) aspb@mapache.org
Daniel Polani Postdoc (Alumni) d.polani@herts.ac.uk
Melissa Redford Postdoc (Alumni) redford@cs.utexas.edu
Joseph Reisinger Alumni joeraii@cs.utexas.edu
Norman Richards Undergraduate Student (Alumni) orb@toki.dhs.org
Juergen Schmidhuber Collaborator juergen@idsia.ch
Jacob Schrum Ph.D. Student schrum2@cs.utexas.edu
Yiu Fai Sit Ph.D. Student (Alumni) yfsit@cs.utexas.edu
Kenneth Stanley Postdoc (Alumni) kstanley@cs.ucf.edu
Vinod Valsalam Ph.D. Student (Alumni) vkv@alumni.utexas.net
Shimon Whiteson Alumni (Alumni) s.a.whiteson@uva.nl
Chern Han Yong Masters Student (Alumni) cherny@nus.edu.sg
Publications (122)
Effective Diversity Maintenance in Deceptive Domains 2013
Joel Lehman, Kenneth O. Stanley and Risto Miikkulainen
IJCNN-2013 Tutorial on Evolution of Neural Networks 2013
Risto Miikkulainen
Accelerating Evolution via Egalitarian Social Learning 2012
Wesley Tansey, Eliana Feasley, and Risto Miikkulainen
Constructing Controllers for Physical Multilegged Robots using the ENSO Neuroevolution Approach 2012
Vinod K. Valsalam, Jonathan Hiller, Robert MacCurdy, Hod Lipson and Risto Miikkulainen
Evaluating Modular Neuroevolution in Robotic Keepaway Soccer 2012
Anand Subramoney
Evaluation Methods for Active Human-Guided Neuroevolution in Games 2012
Igor Karpov, Leif Johnson, Vinod Valsalam and Risto Miikkulainen
Evolution of a Communication Code in Cooperative Tasks 2012
Aditya Rawal, Padmini Rajagopalan, Risto Miikkulainen and Kay Holekamp
Evolving Multimodal Networks for Multitask Games 2012
Jacob Schrum and Risto Miikkulainen
General-Purpose Optimization Through Information-Maximization 2012
Alan J lockett
Humanlike Combat Behavior via Multiobjective Neuroevolution 2012
Jacob Schrum, Igor V. Karpov and Risto Miikkulainen
Multiagent Learning through Neuroevolution 2012
Risto Miikkulainen, Eliana Feasley, Leif Johnson, Igor Karpov, Padmini Rajagopalan, Aditya Rawal, and Wesley Tansey
Task decomposition with neuroevolution in extended predator-prey domain 2012
Ashish Jain, Anand Subramoney, Risto Miikkulainen
An Integrated Neuroevolutionary Approach to Reactive Control and High-level Strategy 2011
Nate Kohl, Risto Miikkulainen
Assisting Machine Learning Through Shaping, Advice and Examples 2011
Igor Karpov, Vinod Valsalam and Risto Miikkulainen
Creating Intelligent Agents through Shaping of Coevolution 2011
Adam Dziuk and Risto Miikkulainen
Evolving Multimodal Networks for Multitask Games 2011
Jacob Schrum and Risto Miikkulainen
Evolving Symmetry for Modular System Design 2011
Vinod K. Valsalam and Risto Miikkulainen
Human-Assisted Neuroevolution Through Shaping, Advice and Examples 2011
Igor V. Karpov, Vinod K. Valsalam and Risto Miikkulainen
The Role of Reward Structure, Coordination Mechanism and Net Return in the Evolution of Cooperation 2011
Padmini Rajagopalan, Aditya Rawal, Risto Miikkulainen, Marc A. Wiseman and Kay E. Holekamp
UT^2: Human-like Behavior via Neuroevolution of Combat Behavior and Replay of Human Traces 2011
Jacob Schrum, Igor V. Karpov and Risto Miikkulainen
Coevolution of Role-Based Cooperation in Multi-Agent Systems 2010
Chern Han Yong and Risto Miikkulainen
Constructing Competitive and Cooperative Agent Behavior Using Coevolution 2010
Aditya Rawal, Padmini Rajagopalan and Risto Miikkulainen
Evolving Agent Behavior In Multiobjective Domains Using Fitness-Based Shaping 2010
Jacob Schrum and Risto Miikkulainen
Neuroevolution 2010
Risto Miikkulainen
Utilizing Symmetry in Evolutionary Design 2010
Vinod Valsalam
Evolving Multi-modal Behavior in NPCs 2009
Jacob Schrum and Risto Miikkulainen
Evolving Neural Networks for Strategic Decision-Making Problems 2009
Nate Kohl and Risto Miikkulainen
Evolving Symmetric and Modular Neural Network Controllers for Multilegged Robots 2009
Vinod K. Valsalam and Risto Miikkulainen
Evolving Symmetric and Modular Neural Networks for Distributed Control 2009
Vinod K. Valsalam and Risto Miikkulainen
Learning Dynamic Obstacle Avoidance for a Robot Arm Using Neuroevolution 2009
Thomas D'Silva, Risto Miikkulainen
Learning in Fractured Problems for Constructive Neural Network Algorithms 2009
Nate Kohl
Accelerated Neural Evolution through Cooperatively Coevolved Synapses 2008
Faustino Gomez, Juergen Schmidhuber, and Risto Miikkulainen
Constructing Complex NPC Behavior via Multi-Objective Neuroevolution 2008
Jacob Schrum and Risto Miikkulainen
Evolving Controllers for Simulated Car Racing using Neuroevolution 2008
Aravind Gowrisankar
Evolving Neural Networks for Fractured Domains 2008
Nate Kohl and Risto Miikkulainen
Evolving Opponent Models for Texas Hold 'Em 2008
Alan J Lockett and Risto Miikkulainen
Modular Neuroevolution for Multilegged Locomotion 2008
Vinod K. Valsalam and Risto Miikkulainen
Transfer of Evolved Pattern-Based Heuristics in Games 2008
Erkin Bahceci and Risto Miikkulainen
Acquiring Evolvability through Adaptive Representations 2007
Joseph Reisinger and Risto Miikkulainen
Acquiring Visibly Intelligent Behavior with Example-Guided Neuroevolution 2007
Bobby D. Bryant and Risto Miikkulainen
Coevolution of Role-Based Cooperation in Multi-Agent Systems 2007
Chern Han Yong and Risto Miikkulainen
Coevolving Strategies for General Game Playing 2007
Joseph Reisinger, Erkin Bahceci, Igor Karpov and Risto Miikkulainen
Evolving Explicit Opponent Models for Game Play 2007
Alan Lockett, Charles Chen, and Risto Miikkulainen
Coevolution of Neural Networks using a Layered Pareto Archive 2006
German A. Monroy, Kenneth O. Stanley, Risto Miikkulainen
Comparing Evolutionary and Temporal Difference Methods for Reinforcement Learning 2006
Matthew Taylor and Shimon Whiteson and Peter Stone
Computational Intelligence in Games 2006
Risto Miikkulainen, Bobby D. Bryant, Ryan Cornelius, Igor V. Karpov, Kenneth O. Stanley, and Chern Han Yong
Creating Intelligent Agents in Games 2006
Risto Miikkulainen
Efficient Non-Linear Control through Neuroevolution 2006
Faustino Gomez, Juergen Schmidhuber, and Risto Miikkulainen
Evolving a Real-World Vehicle Warning System 2006
Nate Kohl, Kenneth Stanley, Risto Miikkulainen, Michael Samples, and Rini Sherony
Evolving Robot Arm Controllers Using the NEAT Neuroevolution Method 2006
Thomas W. D'Silva
Evolving Stochastic Controller Networks for Intelligent Game Agents 2006
Bobby D. Bryant and Risto Miikkulainen
Evolving Visibly Intelligent Behavior for Embedded Game Agents 2006
Bobby D. Bryant
Incorporating Advice into Neuroevolution of Adaptive Agents 2006
Chern Han Yong, Kenneth O. Stanley, Risto Miikkulainen, and Igor V. Karpov
Integration and Evaluation of Exploration-Based Learning in Games 2006
Igor V. Karpov, Thomas D'Silva, Craig Varrichio, Kenneth O. Stanley, Risto Miikkulainen
On-Line Evolutionary Computation for Reinforcement Learning in Stochastic Domains 2006
Shimon Whiteson and Peter Stone
Real-Time Evolution of Neural Networks in the NERO Video Game 2006
Kenneth O. Stanley, Bobby D. Bryant, Igor Karpov, Risto Miikkulainen
Sample-Efficient Evolutionary Function Approximation for Reinforcement Learning 2006
Shimon Whiteson and Peter Stone
Academic AI and Video Games: A Case Study of Incorporating Innovative Academic Research into a Video Game Prototype 2005
Aliza Gold
Automatic Feature Selection via Neuroevolution 2005
Shimon Whiteson and Peter Stone and Kenneth O. Stanley and Risto Miikkulainen and Nate Kohl
Coevolution of Neural Networks Using a Layered Pareto Archive 2005
German A. Monroy
Constructing Good Learners Using Evolved Pattern Generators 2005
Vinod K. Valsalam, James A. Bednar, and Risto Miikkulainen
Evolving Keepaway Soccer Players through Task Decomposition 2005
Shimon Whiteson and Nate Kohl and Risto Miikkulainen and Peter Stone
Evolving Neural Network Agents in the NERO Video Game 2005
Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen
Evolving Neural Network Ensembles for Control Problems 2005
David Pardoe, Michael Ryoo, and Risto Miikkulainen
Improving Prescripted Agent Behavior with Neuroevolution 2005
Ryan Cornelius, Risto Miikkulainen
Incorporating Advice into Evolution of Neural Networks 2005
Chern Han Yong, Kenneth O. Stanley, and Risto Miikkulainen
Learning Basic Navigation for Personal Satellite Assistant Using Neuroevolution 2005
Yiu Fai Sit and Risto Miikkulainen
Neuroevolution of an Automobile Crash Warning System 2005
Kenneth Stanley, Nate Kohl, Rini Sherony, and Risto Miikkulainen
Real-Time Learning in the NERO Video Game 2005
Kenneth O. Stanley, Ryan Cornelius, Risto Miikkulainen, Thomas D'Silva, and Aliza Gold
Real-time Neuroevolution in the NERO Video Game 2005
Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen
Retaining Learned Behavior During Real-Time Neuroevolution 2005
Thomas D'Silva, Roy Janik, Michael Chrien, Kenneth O. Stanley and Risto Miikkulainen
A Neurocontrol Paradigm for Intelligent Process Control using Evolutionary Reinforcement Learning 2004
Alex van Eck Conradie
Competitive Coevolution through Evolutionary Complexification 2004
Kenneth O. Stanley and Risto Miikkulainen
Efficient Allele Fitness Assignment with Self-organizing Multi-agent System 2004
Adrian Agogino and Risto Miikkulainen
Efficient Evolution of Neural Networks Through Complexification 2004
Kenneth O. Stanley
Evolving a Roving Eye for Go 2004
Kenneth O. Stanley and Risto Miikkulainen
Evolving Reusable Neural Modules 2004
Joseph Reisinger, Kenneth O. Stanley, and Risto Miikkulainen
Exploiting Morphological Conventions for Genetic Reuse 2004
Kenneth O. Stanley, Joseph Reisinger, and Risto Miikkulainen
Transfer of Neuroevolved Controllers in Unstable Domains 2004
Faustino J. Gomez and Risto Miikkulainen
A Taxonomy for Artificial Embryogeny 2003
Kenneth O. Stanley and Risto Miikkulainen
Achieving High-Level Functionality through Evolutionary Complexification 2003
Kenneth O. Stanley and Risto Miikkulainen
Active Guidance for a Finless Rocket Using Neuroevolution 2003
Faustino J. Gomez and Risto Miikkulainen
Evolving Adaptive Neural Networks with and Without Adaptive Synapses 2003
Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen
Neuroevolution for Adaptive Teams 2003
Bobby D. Bryant and Risto Miikkulainen
PhD Thesis: Robust Non-Linear Control through Neuroevolution 2003
Faustino J. Gomez
Robust Non-Linear Control through Neuroevolution 2003
Faustino J. Gomez
Utilizing Domain Knowledge in Neuroevolution 2003
James Fan, Raymond Lau, and Risto Miikkulainen
Adaptive Control Utilising Neural Swarming 2002
Alex v. E. Conradie, Risto Miikkulainen, and Christiaan Aldrich
Continual Coevolution Through Complexification 2002
Kenneth O. Stanley and Risto Miikkulainen
Cultural Enhancement Of Neuroevolution 2002
Paul H. McQuesten
Efficient Evolution Of Neural Network Topologies 2002
Kenneth O. Stanley and Risto Miikkulainen
Efficient Reinforcement Learning Through Evolving Neural Network Topologies 2002
Kenneth O. Stanley and Risto Miikkulainen
Evolving Neural Networks Through Augmenting Topologies 2002
Kenneth O. Stanley and Risto Miikkulainen
Intelligent Process Control Utilizing Symbiotic Memetic Neuro-Evolution 2002
Alex v. E. Conradie, Risto Miikkulainen, and Christiaan Aldrich
Numerical Optimization With Neuroevolution 2002
Brian Greer, Henri Hakonen, Risto Lahdelma, and Risto Miikkulainen
The Dominance Tournament Method of Monitoring Progress in Coevolution 2002
Kenneth O. Stanley and Risto Miikkulainen
A Neuroevolution Method For Dynamic Resource Allocation On A Chip Multiprocessor 2001
Faustino J. Gomez, Doug Burger, and Risto Miikkulainen
Applying ESP And Region Specialists To Neuro-Evolution For Go 2001
Andres Santiago Perez-Bergquist
Co-Evolving A Go-Playing Neural Network 2001
Alex Lubberts and Risto Miikkulainen
Cooperative Coevolution Of Multi-Agent Systems 2001
Chern Han Yong and Risto Miikkulainen
Creating Melodies With Evolving Recurrent Neural Networks 2001
Chun-Chi J. Chen and Risto Miikkulainen
Evolving Populations Of Expert Neural Networks 2001
Joseph Bruce and Risto Miikkulainen
Eugenic Neuro-Evolution For Reinforcement Learning 2000
Daniel Polani and Risto Miikkulainen
Neuro-Evolution And Natural Deduction 2000
Nirav S. Desai and Risto Miikkulainen
Online Interactive Neuro-Evolution 2000
Adrian Agogino, Kenneth O. Stanley, and Risto Miikkulainen
Solving Non-Markovian Control Tasks With Neuroevolution 1999
Faustino J. Gomez and Risto Miikkulainen
2-D Pole Balancing With Recurrent Evolutionary Networks 1998
Faustino Gomez and Risto Miikkulainen
Evolving Neural Networks To Play Go 1998
Norman Richards, David Moriarty, and Risto Miikkulainen
Hierarchical Evolution Of Neural Networks 1998
David E. Moriarty and Risto Miikkulainen
Culling And Teaching In Neuro-Evolution 1997
Paul McQuesten and Risto Miikkulainen
Forming Neural Networks Through Efficient And Adaptive Coevolution 1997
David E. Moriarty and Risto Miikkulainen
Incremental Evolution Of Complex General Behavior 1997
Faustino Gomez and Risto Miikkulainen
Symbiotic Evolution Of Neural Networks In Sequential Decision Tasks 1997
David E. Moriarty
Efficient Reinforcement Learning Through Symbiotic Evolution 1996
David E. Moriarty and Risto Miikkulainen
Evolving Obstacle Avoidance Behavior In A Robot Arm 1996
David E. Moriarty and Risto Miikkulainen
Discovering Complex Othello Strategies Through Evolutionary Neural Networks 1995
David E. Moriarty and Risto Miikkulainen
Learning Sequential Decision Tasks 1995
David E. Moriarty and Risto Miikkulainen
Evolutionary Neural Networks For Value Ordering In Constraint Satisfaction Problems 1994
David E. Moriarty and Risto Miikkulainen
Evolving Neural Networks To Focus Minimax Search 1994
David E. Moriarty and Risto Miikkulainen
Grounding Robotic Control With Genetic Neural Networks 1994
Diane Law and Risto Miikkulainen
Searle, Subsymbolic Functionalism And Synthetic Intelligence 1994
Diane Law
Using Marker-Based Genetic Encoding Of Neural Networks To Evolve Finite-State Behaviour 1991
Brad Fullmer and Risto Miikkulainen
Projects
Evolving Controllers for Physical Multilegged Robots 2010 - 2011
The OpenNERO AI Research and Education Platform 2009 - Present
Learning Strategic Behavior in Sequential Decision Tasks 2009 - 2012
Coevolution of Competitive and Cooperative Agent Behavior 2009 - Present
Constructing Intelligent Agents in Simulated Worlds 2008 - 2010
Evolving Locomotion Controllers for Multilegged Robots 2008 - 2010
Human-like Bots in Unreal Tournament 2008 - 2012
Utilizing Symmetry in Evolutionary Design 2007 - 2010
NEAT: Evolving Vehicle Warning Systems 2004 - 2006
NERO: NeuroEvolving Robotic Operatives 2003 - 2009
Controlling a Finless Rocket Through Neuroevolution 2002 - 2003
Diverse Behavior in Teams of Homogeneous Agents 2001 - 2007
Refinement and On-Line Adaptation of Neurocontrollers Through Particle swarming 2001 - 2002
Nonlinear, Adaptive Process Control 2001 - 2002
Dynamic Resource Allocation on a Multiprocessor Chip 2000 - 2002
Cooperative Coevolution of Multi-Agent Systems 2000 - 2007
NEAT: Evolving Increasingly Complex Neural Network Topologies 2000 - 2011
Evolving Confident Neural Networks 2000 - 2002
Creating Melodies with Evolving Recurrent Networks 2000 - 2001
Natural Deduction 1999 - 2000
Modeling the Emergence of Syllable Systems 1998 - 2001
Optimizing a Manufacturing Process 1998 - 2002
Utilizing Population Culture in Neuroevolution 1998 - 2000
Eugenic Evolution: The EuA, EuSANE, and TEAM 1998 - 2002
Playing Go 1998 - 2001
Real-time Interactive Gaming 1997 - 1999
Solving Non-Markov Control Tasks 1996 - 2006
Controlling Chaos 1995 - 1997
Symbiotic Evolution: The SANE System 1994 - 1997
Robot Control 1994 - 1997
Playing Othello 1994 - 1997
Marker-Based Encoding of Neural Networks 1991 - 1995
Software/Data
UT^2: Winning Botprize 2012 Entry The Botprize Competition is an annual competition to program bots that appear human-l... 2012
ENSO This package contains software implementing the ENSO approach for evolving symmetric modular neural networks. It also in... 2010
NEAT C++ The NEAT package contains source code implementing the NeuroEvolution of Augmenting Topologies method. The source code i... 2010
OpenNERO OpenNERO is a general research and education platform for artificial intelligence. The platform is based on a simulatio... 2010
rtNEAT C++ The rtNEAT package contains source code implementing the real-time NeuroEvolution of Augmenting Topologies method. In ad... 2006
NEAT: ANJI (Another NEAT Java Implementation) The ANJI package contains Java source code for the NeuroEvolution of Augmenting Topologies method (see the original 2004
NEAT C# The SharpNEAT package contains C# source code for the NeuroEvolution of Augmenting Topologies method (see the original <... 2003
NEAT Delphi The Delphi NEAT package contains Delphi source code for the NeuroEvolution of Augmenting Topologies method (see the orig... 2003
NEAT Matlab The Matlab NEAT package contains Matlab source code for the NeuroEvolution of Augmenting Topologies method (see the orig... 2003
ESP JAVA 1.1 The ESP package contains the source code for the Enforced Sup-Populations system written in Java. This package is a near... 2002
NEAT C++ for Microsoft Windows The Windows NEAT package contains C++ source code for the NeuroEvolution of Augmenting Topologies method (see the origin... 2002
NEAT Java (JNEAT) The JNEAT package contains Java source code for the NeuroEvolution of Augmenting Topologies method (see the original 2002
TEAM The TEAM package contains C++ implementations of both EuA (The Eugenic Algorithm) and TEAM (The Eugenic Algorithm with M... 2002
ESP C++ The ESP package contains the source code for the Enforced Sup-Populations system written in C++. ESP is an extension t... 2000
JavaSANE The JavaSANE package contains the source code for the Hierarchical SANE system, based on SANE-C, but rewritten extensive... 1998
SANE-C The SANE-C package contains the source code for the Hierarchical SANE system, written in C. This package has been rewrit... 1997
Polebalancing This simulator contains the code used to compare (neuron-level) SANE to one- and two-layer adaptive heuristic critics in... 1995
Demos
UT^2: Winner of 2012 BotPrize in Unreal Tournament 2004Jacob Schrum, Igor Karpov2012
Multi-modal Approaches to Evolving Behavior for Multi-task GamesJacob Schrum2011
Evolving Controllers for Physical Multilegged RobotsVinod Valsalam2011
Fitness-based Shaping in Multi-objective DomainsJacob Schrum2010
Evolving Controller Symmetry for Multilegged RobotsVinod Valsalam2010
Multi-modal Behavior in NPCsJacob Schrum2009
Learning in Fractured DomainsNate Kohl2009
Multi-objective Neuroevolution of NPCsJacob Schrum2008
Modular Neuroevolution for Multilegged LocomotionVinod Valsalam2008
Evolving Cooperation in Multiagent SystemsChern Yong2007
Neuro-Evolving Robotic Operatives (NERO)Kenneth Stanley2007
Adaptive Teams of Agents in the Legion II gameBobby Bryant2006
Evolving Vehicle Warning SystemsNate Kohl2006
Finless Rocket ControlFaustino Gomez2003
Neuroevolution of Augmenting Topologies DemosKenneth Stanley2003
Double Pole Balancing with ESPFaustino Gomez1999
Labs
Neural Networks Learning Agents