Appendix A. Evaluation Methodology
In this section, we describe MEF’s approach to conducting the ACCM Pilot Program Evaluation, including descriptions of:
The Community Advisory Committee,
Evaluation Research Questions,
Administrative Data Analysis Methodology, and
Focus Group Methodology.
Community Advisory Committee
MEF convened the Community Advisory Committee (CAC) to ensure that the evaluation design benefited from feedback from community members with lived experience with the ACCM Pilot Program. The CAC was comprised of three members of the early education and care workforce who participated in the ACCM Pilot Program (one was also a parent who participated in the ACCM Pilot Program), two parents of children who participated in the ACCM Pilot program, a representative from the evaluation’s funder (Eden Hall Foundation), and a representative from a local workforce development organization. Staff from DCI and staff from the Region 5 ELRC who worked directly with child care providers and parents in Allegheny County also occasionally attended CAC meetings. Over the course of the evaluation, MEF facilitated three meetings to update CAC members on evaluation progress and to gather feedback from CAC members on the evaluation design and findings. The timing and content of these meetings are presented in Exhibit A.1. Each meeting was one-hour long, and early education workforce members and parents received a $100 electronic gift card for each meeting they attended.
Exhibit A.1. Community Advisory Committee Meetings Meeting Focus Timing
Meeting Description
CAC members were introduced to the ACCM Pilot Program Evaluation. They were also given an overview of the role of the CAC and the activities they would be supporting throughout the evaluation. CAC members participated in an activity where they brainstormed questions they had about the ACCM Pilot Program and compared these to the planned research questions. The results from this activity were used to refine the research question. CAC group members heard updates on the evaluation. The group was introduced to the plan for the focus groups and participated in an activity where they reviewed and provided feedback about the focus group protocols. Feedback from this activity was used to refine the focus group protocols. CAC group members heard updates on the evaluation. The evaluation team shared preliminary findings from analyses of administrative data and focus groups with the CAC. The CAC shared their reactions to the findings.
Introduction to the ACCM Pilot Evaluation, the CAC, and reviewing research questions
December 2024
Refining focus group protocols
January 2025
Reviewing preliminary findings
May 2025
24
Made with FlippingBook Digital Proposal Creator