From the Executive Summary: "The goal of this study was to assess the validity of IXL’s Real-Time Diagnostic in both math and reading using a new criterion measure: the Star Assessment. We analyzed math and reading data from students in grades 1-8 attending public schools in a large, suburban Oklahoma district. Within each subject, we found: • Strong, positive correlations between IXL’s Diagnostic and Star performance (all rs = .70) • A high degree of overlap in student proficiency classifications by the IXL Diagnostic and Star Assessment"Citation: Schonberg, C. (2022). Assessing the predictive validity of the IXL Real-Time Diagnostic using Star Assessments as criterion. IXL Learning.The full technical report is available online: <https://ca.ixl.com/materials/us/research/Assessing_the_Predictive_Validity_of_the_IXL_Real-Time_Diagnostic_(Star).pdf>

Accelerated Reader is a progress-monitoring system that provides feedback on the comprehension of books and other materials that students have read. It also tracks student reading over time. Currently, more than 180,000 different Accelerated Reader quizzes have been developed and are in use. This report provides reliability and validity data for Accelerated Reader quizzes. The reliability analyses use a large database of nearly 1 million quiz records. Validity is established through correlations with scores from 24 standardized reading tests and through a study that confirms that the quizzes are effective at discriminating between instances of students having read the book versus not having read the book. The report also includes descriptions of the purpose and intended classroom use of Accelerated Reader, descriptions of the types of quizzes, and the processes for quiz development. The report is available online: <https://docs.renaissance.com/R35806>.

To develop Pathway to Proficiency reports for Oklahoma Star Reading Enterprise and Star Math Enterprise schools, we linked our scaled scores with the scaled scores from Oklahoma's achievement test. This technical report details the statistical method behind the process of linking Oklahoma's state test (OSTP) and Star Reading and Star Math scaled scores. The full report is available online: <https://docs.renaissance.com/R53774>.

DETAILS: Location: 24 U.S. states; Design: Analysis of Reading Practice Database; Sample: 50,823 students in grades 1-12 at 139 schools; Measure: Star Reading; Duration: 1 school year. RESULTS: This study of Accelerated Reader indicated that increased time spent reading leads to gains in reading achievement for all students regardless of prior ability, but only when the reading is highly successful. Regression analysis revealed that the single most important factor influencing both time spent reading and average percent correct is a student's teacher. Students in 2nd- through 8th-grade Renaissance Model- and Master-certified classrooms consistently outperformed students in non-certified classrooms and low-implementing classrooms. Email research@renaissance.com to request a copy of the Full Report. Information about a newly updated version of the report is available online: <http://research.renaissance.com/research/474.asp>.

DETAILS: Location: AL, TX, OK, KS, NV, NC, OH, and PA; Design: Independent, assessment research; Sample: Staff from 12 schools in 8 states; Measures: Direct costs, opportunity costs. RESULTS: Christensen Associates conducted a study to determine the true costs associated with widely used early literacy, reading, and mathematics assessments: Star Early Literacy, Star Reading, Star Math, Dynamic Indicators of Basic Early Literacy Skills (DIBELS), Wireless Generation mCLASS DIBELS, AIMSweb, and the Texas Primary Reading Inventory (TPRI). The researchers interviewed staff from 12 schools in 8 states to calculate the average costs of using the tests. Two types of costs were measured: direct costs (the price of testing materials, licensing fees, and/or fees for access to scoring and reporting services), and opportunity costs (time to administer, score, and report results; time that could be spent on instruction if testing was not taking place). The results confirmed, both in terms of direct costs and opportunity costs, that Star Early Literacy, Star Reading, and Star Math, computer-adaptive assessments, are much more cost effective than DIBELS, other assessments; ranging from approximately one-half the cost of AIMSweb and about one-sixth the cost of paper TPRI. AUTHOR: Laurits R. Christensen Associates.Email research@renaissance.com to request a copy of this study or summary from the Renaissance Research Department.

DETAILS: Location: 24 U.S. states; Design: Independent, correlational, peer-reviewed; Sample: 45,670 students in grades 1-12 at 139 schools; Measure: Star Reading; Duration: 1 school year. RESULTS: To explore whether different balances of fiction/nonfiction reading and challenge might help explain differences in reading achievement between genders, data on students who independently read more than 3 million books were analyzed. Moderate (rather than high or low) levels of challenge were positively associated with achievement gain, but nonfiction was generally more challenging than fiction. Nonfiction reading was negatively correlated with successful comprehension and reading achievement gain. Overall, boys appeared to read less than girls, but proportionately more nonfiction. In the upper grades, boys also had lower reading achievement than girls. Differences between classes in promoting successful comprehension of nonfiction were evident, suggesting intervention could improve achievement. Implications for research and practice were explored. PLEASE NOTE: Email research@renaissance.com to request a copy of this peer-reviewed journal article: Topping, K. J., Samuels, J., & Paul, T. (2008). Independent reading: The relationship of challenge, non-fiction and gender to achievement. British Educational Research Journal, 34(4), 505-524.

DETAILS: Location: 24 U.S. states; Design: Independent, correlational, peer-reviewed; Sample: 50,823 students in grades 1-12 at 139 schools; Measure: Star Reading; Duration: 1 school year. RESULTS: This study elaborated on the "what works?" question by exploring the effects of variability in program implementation quality on achievement. Particularly, the effects of computerized assessment in reading on achievement were investigated, analyzing data on students who read more than 3 million books. When minimum implementation quality criteria were met, the positive effect of computerized assessment was higher in the earlier grades and for lower achieving students. Implementation quality tended to decline at higher grade levels. With higher implementation quality, reading achievement gains were higher for students of all levels of achievement and across all grades, but especially in the upper grades. Very high gains and effect sizes were evident with very high implementation quality, particularly in grades 1-4. Implications for practice, the interpretation of research, and policy were noted. PLEASE NOTE: Email research@renaissance.com to rquest a copy of this peer-reviewed journal article: Topping, K. J., Samuels, J., & Paul, T. (2007). Computerized assessment of independent reading: Effects of implementation quality on achievement gain. School Effectiveness and School Improvement, 18(2), 191-208.

DETAILS: Location: 24 U.S. states; Design: Independent, correlational, peer-reviewed; Sample: 45,670 students in grades 1-12 at 139 schools Measure: Star Reading; Duration: 1 school year. RESULTS: Does reading practice make perfect? Or is reading achievement related to the quality of practice as well as the quantity? To answer these questions, data for students who read more than 3 million books were analyzed. Measures largely of quantity (engaged reading volume) and purely of quality (success in reading comprehension) showed a positive relationship with achievement gain at all levels of achievement. However, both high quantity and high quality in combination were necessary for high achievement gains, especially for older students. Both were weakly associated with student initial reading achievement, but more strongly associated with the class in which the student was enrolled, possibly suggesting the properties of teacher intervention in guiding independent reading were important. Implications for theory building, research, and practice were explored. PLEASE NOTE: Email research@renaissance.com to request a copy of this peer-reviewed journal article: Topping, K. J., Samuels, J., & Paul, T. (2007). Does practice make perfect? Independent reading quantity, quality and student achievement. Learning and Instruction, 17, 253-264.

DETAILS: Location: 24 U.S. states; Design: Independent, correlational; Sample: 50,823 students in grades 1-12 at 139 schools; Measure: Star Reading; Duration: 1 school year. RESULTS: This study is an independent evaluation of the data from Paul, 2003, available online: <http://research.renaissance.com/research/172.asp>. In the elementary grades, students in classrooms implementing Accelerated Reader with best practices showed statistically significant improvements in overall achievement level. In middle and high school, teachers who promoted a greater overall reading success rate were able to improve achievement results. Higher average percent correct on Accelerated Reader quizzes and reading at levels above the initial zone of proximal development (ZPD) were linked to greater outcomes. Additionally, even after using rigorous statistical controls for students' initial reading skill levels, reading success rate, and challenge of reading material, the amount of text read was a key predictor of later literacy development. AUTHORS: Geoffrey D. Borman, PhD and N. Maritza Dowling, PhD. The Summary of this study is available online: <https://docs.renaissance.com/R34537>. The Full Report is also available online: <https://docs.renaissance.com/R40524>.

DETAILS: Location: Throughout the US; Design: Independent, hierarchical linear modeling; Sample: Data from more than 3,000 classrooms using Accelerated Reader and best practices with 25 different reading curricula; Measures: Accelerated Reader, Star Reading. RESULTS: Results from an independent analysis demonstrates that when implemented according to Renaissance's recommended best classroom practices, Accelerated Reader enhances over 25 currently published reading curricula and leads to improved student outcomes. The more successful, guided independent reading students engage in, the higher their reading gains. AUTHOR: Daniel Bolt, PhD. A pdf of this report is not available. Email the Renaissance Research Department at research@renaissance.com for additional information.