Evolutionary random neural ensembles based on negative correlation learning

Huanhuan Chen, Xin Yao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Citations (Scopus)


This paper proposes to incorporate bootstrap of data, random feature subspace and evolutionary algorithm with negative correlation learning to automatically design accurate and diverse ensembles. The algorithm utilizes both bootstrap of training data and random feature subspace techniques to generate an initial and diverse ensemble and evolves the ensemble with negative correlation learning. The idea of generating ensemble by simultaneous randomization of data and feature is to promote the diversity within the ensemble and encourage different individual NNs in the ensemble to learn different parts or aspects of the training data so that the ensemble can learn better the entire training data. Evolving the ensemble with negative correlation learning emphasizes not only the accuracy of individual NNs but also the cooperation among different individual NNs and thus improves the generalization. As a byproduct of bootstrap, out-of-bag (OOB) estimation, which can estimate the generalization performance without any extra data points, serves another benefit of this algorithm. The proposed algorithm is evaluated by several benchmark problems and in these cases the performance of our algorithm is better than the performance of other ensemble algorithms.
Original languageEnglish
Title of host publication IEEE Congress on Evolutionary Computation, 2007. CEC 2007.
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages7
ISBN (Electronic)978-1-4244-1340-9
ISBN (Print)978-1-4244-1339-3
Publication statusPublished - 1 Sept 2007
EventIEEE Congress on Evolutionary Computation, 2007 (CEC 2007) - Singapore, Singapore
Duration: 25 Sept 200728 Sept 2007


ConferenceIEEE Congress on Evolutionary Computation, 2007 (CEC 2007)


Dive into the research topics of 'Evolutionary random neural ensembles based on negative correlation learning'. Together they form a unique fingerprint.

Cite this