Table 2b. Number of Students and Schools per Grade and Condition
Number of Students
Number of Schools
Grade
Condition
Treatment
34
7
1stGrade
Comparison
53
5
Treatment
33
10
2ndGrade
Comparison
101
7
Treatment
60
12
3rdGrade
Comparison
98
7
Treatment
23
6
4thGrade
Comparison
37
5
Treatment
18
5
5thGrade
Comparison
41
7
Treatment
168
19
Overall
Comparison
330
7
Matching Procedures
To ensure baseline equivalence, LXD Research applied Propensity Score Matching (PSM) procedures to construct a matched sample of students from the full comparison group, using PSM procedures in the PSM plug-in for SPSS Version 28.0 (Bertsekas & Tseng, 1988; Hansen, 2004: Ho, Imai, King, & Stuart, 2011; Thoemmes & Liao, 2013). PSM is based on logistic regression, with the outcome specifed as a dichotomous indicator of whether or not a student was in the treatment condition. PSM procedures were conducted separately for grades 1 and 2 because the tests for these grades have diferent subtests at the start of the year for each grade level. PSM was conducted for grades 3-5 together because all students took FAST, which has grade-agnostic scale scores 2 . The propensity 2 Combining the grades created a larger overall treatment group to support evaluating 3-5 in this study. Like FAST, RISE instructional levels are based on student skill level and not grade level. In other words, the assessment scores students based on their abilities using a unifed score across grades. Analysis confrmed that each student in a grade had at least one other student in their grade in the sample. Additionally, each grade level BOY scores were statistically similar.
LXD Research -RISE and RISE UP Winter 2022-Spring 2023 Report
11
Made with FlippingBook - Online catalogs