Inter-method reliability of school effectiveness measures: a comparison of value-added and regression discontinuity estimates

Research output: Contribution to journalArticle

Authors

Colleges, School and Institutes

Abstract

Value-added (VA) measures are currently the predominant approach used to compare the effectiveness of schools. Recent educational effectiveness research, however, has developed alternative approaches including the regression discontinuity (RD) design, which also allows estimation of absolute school effects. Initial research suggests RD a viable approach to measuring school effectiveness. The present study builds on this pioneering work by using RD and VA designs to estimate school effects at system- and school-level, comparing estimates from several measurement designs. The study uses a large English dataset (n=148,135) spanning 342 schools, 10 local authorities, 6 consecutive school year-groups (UK years 3-9) across 3 years. RD is found to be a suitable approach for system-level absolute school effect estimates. Cross-sectional and longitudinal measures are found to lead to markedly different estimates when comparing individual schools. The results also reinforce the need to treat measures based on a single cohort with extreme caution.

Details

Original languageEnglish
Pages (from-to)22-38
Number of pages17
JournalSchool Effectiveness and School Improvement
Volume28
Issue number1
Early online date4 Jul 2016
Publication statusPublished - 2017

Keywords

  • value-added, regression discontinuity, reliability, school effects