Research Overview RMC Research conducted the evaluation in summer 2018, the district’s second summer implementing LitCamp, using a mixed-methods design that involved collecting quantitative data through student and teacher surveys; qualitative data through focus groups, classroom observations, and family interviews; and student reading achievement data from the district. Student and teacher surveys were administered during the first and last weeks of the Summer Enrichment Program, generating baseline (at the beginning of LitCamp) and follow-up (after participating in LitCamp) data that were used to assess changes in attitudes over time and capture students’ and teachers’ perceptions of the program. RMC Research visited all four Summer Enrichment Program sites to observe how LitCamp was being implemented in classrooms and conduct teacher focus groups and family interviews to obtain in-depth information about their respective experiences with LitCamp. A detailed description of the evaluation methodology appears in Appendix B. Student Sample In summer 2018, a total of 971 students were enrolled in the Summer Enrichment Program. RMC Research administered student surveys to a subset of LitCamp students—students in Grades 3–5 only. The survey sample is comprised of 205 students from this subset who completed both a baseline survey (at the beginning of LitCamp) and a follow-up survey (after participating in LitCamp). To further explore student outcomes, RMC Research requested demographic and spring and fall assessment data for all students (Grades K–6 9 ) who participated in the districtwide Summer Enrichment Program (“LitCamp students”; n = 266) and a statistically similar matched comparison group (“Comparison students”; n = 266) comprising the assessment sample . 10 Teacher Sample In summer 2018, a total of 80 teachers implemented LitCamp in kindergarten through Grade 6. RMC Research administered a survey to all LitCamp teachers to gather information about how they implemented LitCamp and their impressions of LitCamp. A subsample of 50 teachers completed an end-of-session survey at the end of LitCamp (comprising the survey end-of-session sample ). RMC Research also conducted classroom observations and teacher focus groups at each of the four sites. In total, RMC Research observed 11 classrooms at different grade levels and spoke with 21 teachers spanning kindergarten through Grade 5 during focus groups. 11
9 Grade corresponds to grade level completed in spring 2018. 10 The district changed assessments between spring and fall 2018, and the district only administered AIMSweb ® to approximately one-third of all students in fall 2018. Tested students were those who scored in the lowest tier in spring 2018 and are represented in the 266 students who make up the LitCamp student assessment sample and 266 students who make up the Comparison student assessment sample. 11 The study did not target Grade 6 because few Grade 6 students participated in the Summer Enrichment Program and only at one site.
6
SCHOLASTIC RESEARCH & VALIDATION
Made with FlippingBook - Online catalogs