A version of Geiringer-like theorem for decision making in the environments with randomness and incomplete information

Boris Mitavskiy, Jonathan Rowe, Christopher Cannings

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)
15 Downloads (Pure)

Abstract

Purpose – The purpose of this paper is to establish a version of a theorem that originated from population genetics and has been later adopted in evolutionary computation theory that will lead to novel Monte-Carlo sampling algorithms that provably increase the AI potential.

Design/methodology/approach – In the current paper the authors set up a mathematical framework, state and prove a version of a Geiringer-like theorem that is very well-suited for the development of Mote-Carlo sampling algorithms to cope with randomness and incomplete information to make decisions.

Findings – This work establishes an important theoretical link between classical population genetics, evolutionary computation theory and model free reinforcement learning methodology. Not only may the theory explain the success of the currently existing Monte-Carlo tree sampling methodology, but it also leads to the development of novel Monte-Carlo sampling techniques guided by rigorous mathematical foundation.

Practical implications – The theoretical foundations established in the current work provide guidance for the design of powerful Monte-Carlo sampling algorithms in model free reinforcement learning, to tackle numerous problems in computational intelligence.

Originality/value – Establishing a Geiringer-like theorem with non-homologous recombination was a long-standing open problem in evolutionary computation theory. Apart from overcoming this challenge, in a mathematically elegant fashion and establishing a rather general and powerful version of the theorem, this work leads directly to the development of novel provably powerful algorithms for decision making in the environment involving randomness, hidden or incomplete information.
Original languageEnglish
Pages (from-to)36-90
JournalInternational Journal of Intelligent Computing and Cybernetics
Volume5
Issue number1
DOIs
Publication statusPublished - 2012

Keywords

  • Decision making
  • Evolutionary computation theory
  • Geiringer theorem
  • Markov chains
  • Reinforcement learning
  • Markov processes
  • Monte Carlo methods
  • Monte Carlo tree search
  • Partially observable Markov decision processes
  • Programming and algorithm theory

Fingerprint

Dive into the research topics of 'A version of Geiringer-like theorem for decision making in the environments with randomness and incomplete information'. Together they form a unique fingerprint.

Cite this