Summarising and validating test accuracy results across multiple studies for use in clinical practice

Richard D Riley, Ikhlaaq Ahmed, Thomas P A Debray, Brian H Willis, J Pieter Noordzij, Julian P T Higgins, Jonathan J Deeks

Research output: Contribution to journalArticlepeer-review

28 Citations (Scopus)
168 Downloads (Pure)

Abstract

Following a meta-analysis of test accuracy studies, the translation of summary results into clinical practice is potentially problematic. The sensitivity, specificity and positive (PPV) and negative (NPV) predictive values of a test may differ substantially from the average meta-analysis findings, because of heterogeneity. Clinicians thus need more guidance: given the meta-analysis, is a test likely to be useful in new populations, and if so, how should test results inform the probability of existing disease (for a diagnostic test) or future adverse outcome (for a prognostic test)? We propose ways to address this. Firstly, following a meta-analysis, we suggest deriving prediction intervals and probability statements about the potential accuracy of a test in a new population. Secondly, we suggest strategies on how clinicians should derive post-test probabilities (PPV and NPV) in a new population based on existing meta-analysis results and propose a cross-validation approach for examining and comparing their calibration performance. Application is made to two clinical examples. In the first example, the joint probability that both sensitivity and specificity will be >80% in a new population is just 0.19, because of a low sensitivity. However, the summary PPV of 0.97 is high and calibrates well in new populations, with a probability of 0.78 that the true PPV will be at least 0.95. In the second example, post-test probabilities calibrate better when tailored to the prevalence in the new population, with cross-validation revealing a probability of 0.97 that the observed NPV will be within 10% of the predicted NPV.

Original languageEnglish
Pages (from-to)2081-2103
Number of pages23
JournalStatistics in Medicine
Volume34
Issue number13
DOIs
Publication statusPublished - 15 Jun 2015

Bibliographical note

© 2015 The Authors. Statistics in Medicine Published by John Wiley & Sons Ltd.

Fingerprint

Dive into the research topics of 'Summarising and validating test accuracy results across multiple studies for use in clinical practice'. Together they form a unique fingerprint.

Cite this