IEA INSIDER 2024
instruments begins at least four years before main survey data collection. The first cycle of ICILS began when social media, collaborative workspaces, and cloud computing were in their infancy. As content is developed for what were “futures” in 2013 and 2018, we have needed to predict both what is likely to be relevant and in use, but also to consider how the CIL (and later CT) knowledge, technical skills, and critical thinking skills can be operationalized in future-ready assessment content. Maintaining this connection between relevant up-to-date digital technologies and platforms, and the core CIL and CT constructs that are measured and reported on in ICILS is fundamental to the study. The most recent game-changing innovation is of course the rapid expansion in use of generative AI tools. Chat-GPT, which for now remains arguably the most widely recognized generative AI tool in the public domain, was released at the same time as we provided the ICILS 2023 main survey instruments to countries. In the next few months, the use of generative AI tools became so pervasive that we took the extraordinary measure of offering countries the chance to include a ‘late addition’ to ICILS 2023—a set of questions for school principals relating to their experiences of generative AI in their schools and their perceptions of the potential future consequences of the use of generative AI on the work of teachers and students in their schools. Twelve ICILS countries were able to take up this option, and as an addendum to the ICILS 2023 International Report, we will report on these data. This is another ‘first,’ for a study that is built around establishing ‘firsts.’ Artificial intelligence is an essential theme as we begin planning for ICILS 2028. It is both pervasive in the present and a portent of the future. We plan to integrate AI into all instruments in ICILS 2028. The questionnaires, which gather information about students’ learning contexts will include questions relating to, for example, how AI is provided and regulated through policy, how it is regarded and used in teaching and learning in schools, and what support is provided to teachers and students about the use of AI. In the CIL and CT assessments, the new test content will include students’ interactions with AI agents to support them in planning and completing their tasks, but also students’ evaluation of the quality of this support and capacities to refine their prompts and instructions to AI agents to improve the quality of their output. ICILS will continue its ongoing commitment to being a future-ready study to support future-ready students. ■
PUBLICATIONS RELATED TO ICILS
ICILS 2023 Assessment Framework Authors: Julian Fraillon, Mojca Rožman, Daniel Duckworth, Sara Dexter, Jeppe Bundsgaard, Wolfram Schulz Download via: https:/ www.iea.nl/publications/icils-2023- assessment-framework
Upcoming: IEA International Computer and Information Literacy Study 2023 International Report
To be released 12 November 2024
28
Made with FlippingBook Online newsletter maker