EDUCATION MATTERS
HARMONIZATION TOPICS UNDERWAY Several initiatives are already in progress:
CONCLUSION AND OUTLOOK The IEA Harmonization Project represents a strategic investment in institutional coherence. Through structured dialogue, cross-functional collaboration, and focused implementation, the initiative is paving the way toward more consistent, efficient, and high-quality international assessments. ■
• Project Management – Communication Infrastructure & Tools: Harmonization of SharePoint site structures used for IEA (and other international) studies has started and will continue in future. • Sampling & Weighting – Sampling Design and Definitions: Improvements have been suggested to international study directors to make IEA studies more inclusive and to reduce within-school level exclusions. This will reflect definitions of exclusions in diverse survey operational manuals and listing and tracking forms. • Survey Operations – Operational Manuals: Work has started to compare different operational manuals, beginning with the one for school coordinators. Suggestions are currently developed on how to modularize the manual and where to replace or supplement key processes by other than forms than written descriptions. • Instrument Development – Questionnaire Content Coherence: Efforts include comparison of demographic questions across the different study and respondents’ questionnaires and the inclusion of AI-related questions across studies is explored. • Data Processing – Data Quality, Logging & Cleaning: Data processing consistency checks are currently evaluated across studies to identify where checks can be standardized. • Analysis & Reporting – Reporting Standards & Documentation: Work has started to draft how violations from study standards could be reported; in addition, experiences with a newly used tool for writing technical reports for one study is reviewed to see if there is potential to use it for other study publications or whether it should be discarded. • Dissemination – Dissemination Formats & User Experience: Exchange has taken place with the TIMSS team with regards to presenting results online. Several tables of the ICILS 2023 results are currently being prepared to be posted online at the IEA website so more alignment can be reached in terms of presenting study outcomes. • Dissemination – Handling of Restricted Materials: Discussions are underway to improve access to restricted-use materials. Exchange included international study directors, but also standing committee members.
51
Made with FlippingBook - PDF hosting