The 2019 comparison of tools for the analysis of quantitative formal models (QComp): 2019 competition report

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Authors

  • Ernst Moritz Hahn
  • Arnd Hartmanns
  • Christian Hensel
  • Michaela Klauck
  • Joachim Klein
  • Jan Kretínský
  • Tim Quatmann
  • Enno Ruijters
  • Marcel Steinmetz

Colleges, School and Institutes

External organisations

  • Queen's University, Belfast
  • Institute of Software, Chinese Academy of Sciences, Beijing, China.
  • University of Twente, Enschede, The Netherlands
  • RWTH Aachen University, Germany
  • Saarland University, Saarbrücken, Germany
  • Technische Universität Dresden, Germany
  • Technische Universität München, Munich, Germany

Abstract

Quantitative formal models capture probabilistic behaviour, real-time aspects, or general continuous dynamics. A number of tools support their automatic analysis with respect to dependability or performance properties. QComp 2019 is the first, friendly competition among such tools. It focuses on stochastic formalisms from Markov chains to probabilistic timed automata specified in the Jani model exchange format, and on probabilistic reachability, expected-reward, and steady-state properties. QComp draws its benchmarks from the new Quantitative Verification Benchmark Set. Participating tools, which include probabilistic model checkers and planners as well as simulation-based tools, are evaluated in terms of performance, versatility, and usability. In this paper, we report on the challenges in setting up a quantitative verification competition, present the results of QComp 2019, summarise the lessons learned, and provide an outlook on the features of the next edition of QComp

Details

Original languageEnglish
Title of host publicationProceedings of the 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS '19)
Subtitle of host publicationTOOLympics at TACAS 2019
Publication statusAccepted/In press - 15 Mar 2019
EventTOOLympics at TACAS 2019: 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems - Prague, Czech Republic
Duration: 6 Apr 20197 Apr 2019
http://qcomp.org/competition/2019/index.html#timeline

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceTOOLympics at TACAS 2019
CountryCzech Republic
CityPrague
Period6/04/197/04/19
Internet address