Final Report: Implementation and Pilot Study
41
Pilot Study Findings and Recommendations The pilot study yielded significant insights into the associations between student and contextual characteristics, being exposed to PKOMW, and several student outcomes. As described above, we found similarities between students in PKOMW and comparison groups in certain demographic aspects, such as age, sex, and ethnicity. But we also found some differences in English language screener scores, income, and parental education levels, favoring those in the PKOMW group. But results also showed that those in the comparison group, when restricting the sample to only include students who are DLLs, had higher scores in the preLAS 2000. Classroom settings also differed, with PKOMW classrooms having fewer students. Initial analyses, which included all children in both groups, revealed that students in PKOMW classrooms outperformed those in the comparison group in receptive and expressive vocabulary and math. However, these differences disappeared when controlling for household income, parents’ level of education, number of students in the classroom, and DLL status. Notably, after restricting the sample to only include dual language learners (DLLs), results showed that these students in PKOMW classrooms scored higher in expressive and receptive vocabulary and math when compared to the comparison group, even after controlling for household income, parents’ education level, and number of students in the classroom.
Recommendations stemming from the pilot study include:
1. The restricted sample size hampers our capacity to generalize findings and provide precise estimates. To address this constraint, we propose augmenting recruitment efforts through a collaborative approach with teachers. Enhancing our recruitment strategy is imperative to boost student participation in the pilot study. Recognizing the need to enhance our recruitment strategies for the forthcoming impact study, it is imperative to address the challenges encountered during the pilot study, where we fell short of our target, receiving only 33 consent forms out of the intended 100. Considering this, a comprehensive and collaborative approach, particularly involving teachers, can significantly improve our recruitment outcomes. To augment our recruitment efforts, it is recommended that we collaborate closely with teachers who play a pivotal role in disseminating and collecting consent forms. Establishing a strong partnership with educators can involve providing them with clear and concise information about the study's objectives, benefits, and relevance to the students. Additionally, offering support materials for teachers to share with parents, such as informational pamphlets or short presentations, can facilitate better communication. Regular check- ins and feedback sessions with teachers can also help address any concerns or queries they may have, fostering a more effective collaboration that ultimately leads to increased participation from parents. By engaging teachers as key allies in our recruitment process, we can leverage their influence and support to achieve a more successful outcome for the study.
Made with FlippingBook - Online catalogs