Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension

Research output: Contribution to journalReview articlepeer-review

Authors

  • SPIRIT-AI and CONSORT-AI Working Group

Colleges, School and Institutes

External organisations

  • The Medical School, University of Birmingham, Birmingham, UK.
  • University of Ottawa
  • Ottawa Hospital Research Institute
  • Community Information and Epidemiological Technologies, Institute of Population Health; University of Ottawa; Ottawa; Canada

Abstract

The CONSORT 2010 statement provides minimum guidelines for reporting randomised trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders), and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human–AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret, and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.

Details

Original languageEnglish
Pages (from-to)E537-E548
Number of pages12
JournalThe Lancet Digital Health
Volume2
Issue number10
Early online date9 Sep 2020
Publication statusPublished - Oct 2020