Learning micro-management skills in RTS games by imitating experts

Jay Young, Nick Hawes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

We investigate the problem of learning the control of small groups of units in combat situations in Real Time Strategy (RTS) games. AI systems may acquire such skills by observing and learning from expert players, or other AI systems performing those tasks. However, access to training data may be limited, and representations based on metric information - position, velocity, orientation etc. - may be brittle, difficult for learning mechanisms to work with, and generalise poorly to new situations. In this work we apply qualitative spatial relations to compress such continuous, metric state-spaces into symbolic states, and show that this makes the learning problem easier, and allows for more general models of behaviour. Models learnt from this representation are used to control situated agents, and imitate the observed behaviour of both synthetic (pre-programmed) agents, as well as the behaviour of human-controlled agents on a number of canonical micromanagement tasks. We show how a Monte-Carlo method can be used to decompress qualitative data back in to quantitative data for practical use in our control system. We present our work applied to the popular RTS game Starcraft.

Original languageEnglish
Title of host publicationProceedings of the 10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014
PublisherAAAI Press
Pages195-201
Number of pages7
ISBN (Print)9781577356813
Publication statusPublished - 2014
Event10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014 - Raleigh, United States
Duration: 3 Oct 20147 Oct 2014

Conference

Conference10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014
Country/TerritoryUnited States
CityRaleigh
Period3/10/147/10/14

ASJC Scopus subject areas

  • Artificial Intelligence
  • Visual Arts and Performing Arts

Fingerprint

Dive into the research topics of 'Learning micro-management skills in RTS games by imitating experts'. Together they form a unique fingerprint.

Cite this