Target Sample Student assessment. RMC Research targeted all students participating in LitCamp for the student assessment sample. The district provided enrollment and demographic data for 971 students in kindergarten through Grade 6 and included spring 2018 assessment scores for 884 of those students. The district created a statistically similar matched comparison group for a subset of LitCamp students who had both a spring and fall 2018 AIMSweb assessment score ( n = 266). 16 The final assessment sample included 266 LitCamp students (27% of all 971 enrolled LitCamp students) and 266 comparison students. Comparison students were statistically similar to LitCamp students on demographic characteristics and spring 2018 assessment scores. Student surveys. RMC Research targeted a subset of grades across all four sites for the student survey sample, and the district provided enrollment data for 395 students in those grades (Grades 3–5). The final targeted sample included 358 students in Grades 3–5 due to 37 students who were enrolled but did not attend.
Teacher surveys. The targeted teacher survey sample included all 80 teachers who taught LitCamp to students in kindergarten through Grade 6.
Teacher classroom observation and focus groups. RMC Research invited kindergarten through Grade 5 teachers to participate in a classroom observation and focus group at each site with the goal of recruiting four teachers per site for classroom observations and six to eight teachers per site for focus groups. 17 Family interviews . RMC Research invited a small subsample of students ( n = 4) and their families (i.e., parents and other LitCamp siblings) from two of four Summer Enrichment Program sites to participate in face-to-face interviews. Site leaders nominated the families to participate in the family interviews. Data Collection Procedures RMC Research utilized a combination of surveys, classroom observations, focus groups, and interviews to gather data for the evaluation. In addition, RMC Research worked with district staff to obtain student demographic and reading assessment data. RMC Research provided a designated leader at each site with detailed instructions for the survey administration. At the beginning of each survey administration period, the site leaders distributed student survey materials to teachers of Grades 3–5 and teacher surveys to each teacher. At the end of each survey administration period the site leaders collected the materials from teachers and returned them to RMC Research using the prepaid shipping label provided by RMC Research.
16 The district changed assessments between spring and fall 2018, and the district only tested approximately one-third of all Summer Enrichment Program students on AIMSweb in fall 2018. Tested students were those who scored in the lowest tier in spring 2018. 17 The study did not target Grade 6 because few Grade 6 students participated in the Summer Enrichment Program and only at one site.
SCHOLASTIC RESEARCH & VALIDATION 22
Made with FlippingBook - Online catalogs