Projects per year
Abstract
Background
Historically controlled studies are commonly undertaken in paediatric oncology, despite their potential biases. Our aim was to compare the outcome of the control group in randomised controlled trials (RCTs) in paediatric oncology with those anticipated in the sample size calculations in the protocols. Our rationale was that, had these RCTs been performed as historical control studies instead, the available outcome data used to calculate the sample size in the RCT would have been used as the historical control outcome data.
Methods
A systematic search was undertaken for published paediatric oncology RCTs using the Cochrane Central Register of Controlled Trials (CENTRAL) database from its inception up to July 2013. Data on sample size assumptions and observed outcomes (timetoevent and proportions) were extracted to calculate differences between randomised and historical control outcomes, and a one-sample t-test was employed to assess whether the difference between anticipated and observed control groups differed from zero.
Results
Forty-eight randomised questions were included. The median year of publication was 2005, and the range was from 1976 to 2010. There were 31 superiority and 11 equivalence/noninferiority randomised questions with time-to-event outcomes. The median absolute difference between observed and anticipated control outcomes was 5.0% (range: -23 to +34), and the mean difference was 3.8% (95% CI: +0.57 to +7.0; P = 0.022).
Conclusions
Because the observed control group (that is, standard treatment arm) in RCTs performed better than anticipated, we found that historically controlled studies that used similar assumptions for the standard treatment were likely to overestimate the benefit of new treatments, potentially leading to children with cancer being given ineffective therapy that may have additional toxicity.
Historically controlled studies are commonly undertaken in paediatric oncology, despite their potential biases. Our aim was to compare the outcome of the control group in randomised controlled trials (RCTs) in paediatric oncology with those anticipated in the sample size calculations in the protocols. Our rationale was that, had these RCTs been performed as historical control studies instead, the available outcome data used to calculate the sample size in the RCT would have been used as the historical control outcome data.
Methods
A systematic search was undertaken for published paediatric oncology RCTs using the Cochrane Central Register of Controlled Trials (CENTRAL) database from its inception up to July 2013. Data on sample size assumptions and observed outcomes (timetoevent and proportions) were extracted to calculate differences between randomised and historical control outcomes, and a one-sample t-test was employed to assess whether the difference between anticipated and observed control groups differed from zero.
Results
Forty-eight randomised questions were included. The median year of publication was 2005, and the range was from 1976 to 2010. There were 31 superiority and 11 equivalence/noninferiority randomised questions with time-to-event outcomes. The median absolute difference between observed and anticipated control outcomes was 5.0% (range: -23 to +34), and the mean difference was 3.8% (95% CI: +0.57 to +7.0; P = 0.022).
Conclusions
Because the observed control group (that is, standard treatment arm) in RCTs performed better than anticipated, we found that historically controlled studies that used similar assumptions for the standard treatment were likely to overestimate the benefit of new treatments, potentially leading to children with cancer being given ineffective therapy that may have additional toxicity.
| Original language | English |
|---|---|
| Article number | 481 |
| Journal | Trials |
| Volume | 15 |
| Issue number | 1 |
| DOIs | |
| Publication status | Published - 10 Dec 2014 |
Keywords
- Bias
- Historically controlled studies
- Paediatric oncology
- Rare diseases
Access to Document
- Moroz_et_al_Comparison_anticipated_actual_control_group_outcomes_Trials_2014
Eligibility for repository : checked 02/02/2015
Fingerprint
Dive into the research topics of 'Comparison of anticipated and actual control group outcomes in randomised trials in paediatric oncology provides evidence that historically controlled studies are biased in favour of the novel treatment'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Linked to a/c DMAB.RRAK14731 Midland Hub for Trials Methodology Research at University of Birmingham
Billingham, L. (Principal Investigator), Bryan, S. (Co-Investigator), Calvert, M. (Co-Investigator), Deeks, J. (Co-Investigator), Delaney, B. (Co-Investigator), Freemantle, N. (Co-Investigator), Gray, R. (Co-Investigator), Hobbs, R. (Co-Investigator), Johnson, P. (Co-Investigator), Lilford, R. (Co-Investigator), Wheatley, K. (Co-Investigator), Zeegers, M. (Co-Investigator) & Wilson, S. (Co-Investigator)
1/06/09 → 31/05/14
Project: Research Councils
-
Linked to a/c DJAB RRAK13548 - Midland Hub for Trials Methodology Research at University of Birmingham
Billingham, L. (Principal Investigator), Bryan, S. (Co-Investigator), Calvert, M. (Co-Investigator), Deeks, J. (Co-Investigator), Delaney, B. (Co-Investigator), Freemantle, N. (Co-Investigator), Gray, R. (Co-Investigator), Hobbs, R. (Co-Investigator), Johnson, P. (Co-Investigator), Lilford, R. (Co-Investigator), Wheatley, K. (Co-Investigator) & Zeegers, M. (Co-Investigator)
1/06/09 → 31/05/14
Project: Research Councils