The 2019 comparison of tools for the analysis of quantitative formal models (QComp 2019 competition report)

Research output: Chapter in Book/Report/Conference proceedingConference contribution


  • Ernst Moritz Hahn
  • Arnd Hartmanns
  • Christian Hensel
  • Michaela Klauck
  • Joachim Klein
  • Jan Kretínský
  • Tim Quatmann
  • Enno Ruijters
  • Marcel Steinmetz

Colleges, School and Institutes

External organisations

  • Queen's University, Belfast
  • Chinese Academy of Sciences
  • University of Twente
  • RWTH Aachen University
  • University of Saarland, Saarbrucken, Germany.
  • Technische Universität Dresden, Germany
  • Technische Universität München, Munich, Germany


Quantitative formal models capture probabilistic behaviour, real-time aspects, or general continuous dynamics. A number of tools support their automatic analysis with respect to dependability or performance properties. QComp 2019 is the first, friendly competition among such tools. It focuses on stochastic formalisms from Markov chains to probabilistic timed automata specified in the Jani model exchange format, and on probabilistic reachability, expected-reward, and steady-state properties. QComp draws its benchmarks from the new Quantitative Verification Benchmark Set. Participating tools, which include probabilistic model checkers and planners as well as simulation-based tools, are evaluated in terms of performance, versatility, and usability. In this paper, we report on the challenges in setting up a quantitative verification competition, present the results of QComp 2019, summarise the lessons learned, and provide an outlook on the features of the next edition of QComp.


Original languageEnglish
Title of host publicationTools and Algorithms for the Construction and Analysis of Systems. TACAS 2019
EditorsD. Beyer, M. Huisman, F. Kordon, B. Steffen
Publication statusE-pub ahead of print - 4 Apr 2019
EventTOOLympics at TACAS 2019: 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems - Prague, Czech Republic
Duration: 6 Apr 20197 Apr 2019

Publication series

NameLecture Notes in Computer Science
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


ConferenceTOOLympics at TACAS 2019
CountryCzech Republic
Internet address