IEA INSIDER 2024
Data in Action: Status Update on Data Collection and Data Processing in IEA’s International Studies
BY EVA FERON
IEA is increasingly moving away from paper-and-pencil administration, and transitioning to computer-based international large-scale assessments (see Figure 1). Computer-based assessments offer several advantages: they improve the test taking experience for students, simplify data collection, allow collection of process and log data, allow faster access to scoring, enhance test administration uniformity, and provide increased flexibility and cost-effectiveness. However, this switch requires adequate processes and is a key driver behind recent changes in IEA's data collection and processing methods. MOVING TO NEW TOOLS FOR DATA COLLECTION IEA utilizes several software tools to collect and process data from its international assessments. To reduce dependency on external partners and increase flexibility in meeting specific study requirements, IEA has developed its own data collection platform: IEA StudyExpert . This platform supports the creation, implementation, and management of computer-based assessments, both online and offline. The IEA StudyExpert has already been used in different national and international studies (see Figure 2). After having used the IEA StudyExpert successfully in the field trials and data collections of over 60 participating education systems in TALIS 2024, it is now planned to use the platform to administer the background questionnaires for PIRLS 2026 and TIMSS 2027, as well as for both assessment and background questionnaires for ICCS 2027 and ICILS 2028.
schools. We are exploring the use of an online tool already employed in national studies. This new tool aims to offer a generic platform with study-specific customization options, enhanced user communication, improved convenience by eliminating installation requirements, more efficient data handling, and a reduced workload for national data managers by enabling school coordinators to handle more tasks directly. ADVANCING OUR DATA PROCESSING Realizing the potential of computer-based assessment and data collection brings several challenges, including integrating data from diverse sources, managing complex study designs, handling increased variables and larger data sizes, and integrating process and log data. To address these issues, the International Studies unit is developing a new data processing tool using R. This tool will enhance automation and flexibility, speed up processing, and enable a stronger focus on statistical methods. By using statistics to identify patterns in the data, the tool will improve our understanding and the quality of the data we provide to countries. Developing new tools for data collection and processing marks a significant shift in our way of working, offering a unique opportunity to design solutions that are well- integrated and user-friendly. This transition involves establishing new workflows and training staff to adapt to these tools and processes. We are confident in our team's expertise and dedication to managing these changes and look forward to reporting on our progress in this area next year. ■
IEA is also considering renewing its within-school sampling software, which lists, samples, and tracks students in selected
36
Made with FlippingBook Online newsletter maker