Computerized Assessment of Independent Reading: Effects of Implementation Quality on Achievement Gain

Multiple schools, Multiple cities, Alabama (AL), Arizona (AZ), Arkansas (AR), California (CA), Colorado (CO), Delaware (DE), Georgia (GA), Idaho (ID), Illinois (IL), Kentucky (KY), Louisiana (LA), Michigan (MI), Mississippi (MS), Missouri (MO), Nebraska (NE), New Mexico (NM), North Carolin

Abstract:

DETAILS: Location: 24 U.S. states; Design: Independent, correlational, peer-reviewed; Sample: 50,823 students in grades 1-12 at 139 schools; Measure: Star Reading; Duration: 1 school year.

RESULTS: This study elaborated on the "what works?" question by exploring the effects of variability in program implementation quality on achievement. Particularly, the effects of computerized assessment in reading on achievement were investigated, analyzing data on students who read more than 3 million books. When minimum implementation quality criteria were met, the positive effect of computerized assessment was higher in the earlier grades and for lower achieving students. Implementation quality tended to decline at higher grade levels. With higher implementation quality, reading achievement gains were higher for students of all levels of achievement and across all grades, but especially in the upper grades. Very high gains and effect sizes were evident with very high implementation quality, particularly in grades 1-4. Implications for practice, the interpretation of research, and policy were noted.

PLEASE NOTE: Email research@renaissance.com to rquest a copy of this peer-reviewed journal article: Topping, K. J., Samuels, J., & Paul, T. (2007). Computerized assessment of independent reading: Effects of implementation quality on achievement gain. School Effectiveness and School Improvement, 18(2), 191-208.

Publication Date:
06/01/2007