Research & Validation | Scholastic Literacy

SCHOLASTIC LITERACY

5

Literacy. The data included in the Similar Schools Report included MAP Reading scores from fall 2022 (BOY) and spring 2023 (EOY), as well as relevant summary statistics for the virtual comparison group. As students are matched with their virtual comparison counterparts and are otherwise similar in terms of prior achievement and demographics, dependent t-tests were conducted by CRRE to examine differences in MAP Reading growth between Scholastic Literacy students and virtual comparison students. Results Achievement analyses In this section, we describe the results of a quasi-experimental study (QED) comparing student MAP Reading test growth from fall 2022 to spring 2023 in the intervention school district with that of similar students who did not use Scholastic Literacy. As described in the methods section, each student who used Scholastic Literacy was matched with a set of comparison students from NWEA’s database of student scores. Comparison students were selected by NWEA on the basis of similarity on a number of variables, including prior MAP Reading achievement, type of school, FARMS status, and ethnicity. MAP Reading gain scores for treatment and virtual comparison students in Grades 2-5, both overall and by grade level and subgroup, are examined in these analyses. Baseline equivalence on MAP Reading scores is shown in Appendix A; as students were matched by NWEA on prior achievement, this requirement is essentially trivial, and baseline differences did not exceed 0.01 standard deviations on any grade-level comparison. We first descriptively examine MAP Reading achievement score trends for Grades 2-5 Scholastic Literacy students across the 2022-23 school year. It is important to note that these are scores for treatment students only in the selected public school district in South Carolina. We only included students with non-missing spring 2023 (EOY) and fall 2022 (BOY) scores in this analysis, as these two timepoints were of most interest across our achievement analyses. Table 3 displays MAP Reading score trends by grade across each test administration. Table 3 MAP Reading Scores, by Grade Grade Fall 2022 Winter 2023 Spring 2023 Fall-to-Spring Gain 2 nd ( n = 663) 165.20 174.39 181.00 15.81 3 rd ( n = 681) 179.46 186.26 190.70 11.24 4 th ( n = 689) 190.53 196.46 199.61 9.07 5 th ( n = 632) 199.34 204.76 206.94 7.60

© Johns Hopkins University, 2023

Made with FlippingBook - Online catalogs