Efficient Non-Linear Control through Neuroevolution (2006)
Faustino Gomez, Juergen Schmidhuber, and Risto Miikkulainen
Many complex control problems are not amenable to traditional controller design. Not only is it difficult to model real systems, but often it is unclear what kind of behavior is required. Reinforcement learning (RL) has made progress through direct interaction with the task environment, but it has been difficult to scale it up to large and partially observable state spaces. In recent years, neuroevolution, the artificial evolution of neural networks, has shown promise in tasks with these two properties. This paper introduces a novel neuroevolution method called CoSyNE that evolves networks at the level of weights. In the most extensive comparison of RL methods to date, it was tested in difficult versions of the pole-balancing problem that involve large state spaces and hidden state. CoSyNE was found to be significantly more efficient and powerful than the other methods on these tasks, forming a promising foundation for solving challenging real-world control tasks.
View:
PDF
Citation:
In Proceedings of the European Conference on Machine Learning, pp. 654-662, Berlin 2006. Springer.
Bibtex:

Faustino Gomez Postdoctoral Alumni tino [at] idsia ch
Risto Miikkulainen Faculty risto [at] cs utexas edu