DATA IN ACTION
The IQB pilot study highlights the importance of meticulous preparation, including clear instructions, extensive communication with schools, and in-person training sessions for test administrators, to ensure successful implementation. Despite these efforts, some sources of error in data collection remain unpredictable, underscoring the critical role of pilot studies in refining procedures for digital assessments. ■
monitoring by technically skilled IEA staff, despite limited control over schools' adherence to requirements.
The decentralized administrative management structure and varying IT infrastructure across schools in Germany complicated the organization of the internet-based survey. Unlike IEA-owned devices, school-owned devices (mainly iPads in primary schools) lacked uniform settings, necessitating intensive planning and communication with schools to adjust default settings or deactivate youth filters before test sessions. Availability and condition of devices were also critical considerations, with test administrators often facing unpredictability regarding device storage, availability, and charging status. The transition from paper- to computer-based assessments is inevitable in school performance studies, and the use of school-owned devices is expected to increase. This shift raises demands on test administrators, requiring enhanced technical expertise and pedagogical skills to address potential challenges that younger students may face with digital tools and test applications.
“The pilot study presented significant challenges for
project staff, school personnel, test administrators, and primary school students in particular due to varying technical equipment and survey settings in schools.”
43
Made with FlippingBook Online newsletter maker