Using Evolution to Improve Neural Network Learning: Pitfalls and Solutions

John Bullinaria

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Autonomous neural network systems typically require fast learning and good generalization performance, and there is potentially a trade-off between the two. The use of evolutionary techniques to improve the learning abilities of neural network systems is now widespread. However, there are a range of different evolutionary approaches that could be applied, and no systematic investigation has been carried out to find which work best. In this paper, such an investigation is presented, and it is shown that a range of evolutionary techniques can generate high performance networks, but they often lead to unwanted side effects, such as occasional instances of very poor performance. The nature of these problems are explored further, and it is shown how the evolution of age dependent plasticities and/or the use of ensemble techniques can alleviate them. A range of techniques are thus identified, with differing properties, that can be matched to the specific requirements of each application.
Original languageEnglish
Pages (from-to)209-226
Number of pages18
JournalNeural Computing and Applications
Volume16
Issue number3
Early online date15 Feb 2007
DOIs
Publication statusPublished - 8 May 2007

Fingerprint

Dive into the research topics of 'Using Evolution to Improve Neural Network Learning: Pitfalls and Solutions'. Together they form a unique fingerprint.

Cite this