Ordinal regression neural networks based on concentric hyperspheres

Research output: Contribution to journalArticle

Authors

  • Pedro Antonio Gutiérrez
  • Peter Tino
  • César Hervás-martínez

Colleges, School and Institutes

Abstract

Threshold models are one of the most common approaches for ordinal regression, based on projecting patterns to the real line and dividing this real line in consecutive intervals, one interval for each class. However, finding such one-dimensional projection can be too harsh an imposition for some datasets. This paper proposes a multidimensional latent space representation with the purpose of relaxing this projection, where the different classes are arranged based on concentric hyperspheres, each class containing the previous classes in the ordinal scale. The proposal is implemented through a neural network model, each dimension being a linear combination of a common set of basis functions. The model is compared to a nominal neural network, a neural network based on the proportional odds model and to other state-of-the-art ordinal regression methods for a total of 12 datasets. The proposed latent space shows an improvement on the two performance metrics considered, and the model based on the three-dimensional latent space obtains competitive performance when compared to the other methods.

Details

Original languageEnglish
Pages (from-to)51-60
JournalNeural Networks
Volume59
Early online date11 Jul 2014
Publication statusPublished - Nov 2014

Keywords

  • Ordinal regression, Ordinal classification, Neural networks, Latent variable