In every quarterly newsletter, IEA Updates, we share a summary of how IEA studies have progressed in recent months. This includes an overview of IEA's flagship studies and other studies that IEA is a part of. You can also subscribe here to receive our future newsletter updates.
IEA Study Updates | May 2022
The data cleaning and the field test item analyses for the Botswana Educational Achievement Monitoring (BEAM) project have now been completed in collaboration with the Botswana Examination Council (BEC). The final steps in this project for IEA and the National Foundation for Educational Research (NFER) include offering workshops to support the item selection for the main study phase, reviewing the main study manuals, guidelines, and test administration scrips, and creating a simple item database.
German National Studies
In the national field, more and more studies are finishing their spring data collections, including the field trials for TIMSS 2023 and ICILS 2023. The PISA main survey will have its last testing sessions end of May; then we will have conducted approximately 1100 testing sessions, achieving an important milestone. Most recently, the Inclusion in Secondary School Level I in Germany study (INSIDE) also entered the field for the new (and third) measuring point of the longitudinal study. In addition, school recruiting for NEPS has proceeded with unabated energy in order to reach an acceptable number of schools for the initial survey. The first measurement point is planned for the second half of 2022, which will be partly computer-based for the first time.
The IEA Capacity Building team also continues working with Haiti. Here, our support was requested for the implementation of their national evaluation (end of May), and we are now preparing tracking forms and labels for more than 2,300 schools for this, creating the data structure, and giving consultancy on sampling, technology, and project organization.
The implementation of the main survey data collection for IEA's International Civic and Citizenship Education Study (ICCS) 2022 has already commenced. Several countries have now fully completed their data collection, other countries are well underway, and Southern Hemisphere countries are preparing for their data collection from September 2022. Furthermore, the ICCS 2022 Assessment Framework will be available soon, and the publication will also become available via Springer before the end of the year.
The field trial for International Computer and Information Literacy Study (ICILS) 2023 began in April, with over 20 countries currently in the field. The 4th ICILS NRC Meeting is scheduled as an in-person meeting for the week of 19 September 2022, allowing sufficient time to finalize the source versions of the ICILS main survey instruments following the meeting.
An information package about a special administration of IEA's Literacy and Numeracy Study (LaNA) was sent out to invited countries in May. The special linking study will contribute to the validation of the LaNA assessment instruments by collecting sufficient data to establish a psychometrically sound linkage of the LaNA results to IEA's TIMSS and PIRLS achievement scales, allowing future LaNA participants to measure progress toward Sustainable Development Goal (SDG) 4. An information session about the special administration is planned for all interested countries on 14 June 2022.
Piloting of the four life skills (critical thinking, cooperation, resilience, and communication) in the three countries (Palestine, Tunisia, and Egypt) was successfully completed, and the evaluations were submitted to the Steering Committee and the Assessment Development Group as part of UNICEF's Life Skills and Citizenship Education (LSCE). The pilot used focus group discussions, in which the feedback from the participants was recorded and then reported using evaluation criteria in qualitative rubric tables. Based on the reports, the experts can now revise the instruments for phase three of the project, the field test.
The third and final wave of countries are concluding data collection, and progress has been made processing the data for first and second wave countries. The release of the international report for PIRLS 2021 is planned on 13 December 2022, and we look forward to sharing more about this event with countries in the coming months. The PIRLS 2021 Encyclopedia is also coming together and is expected to be released publicly in November 2022.
Alongside the revised edition of the Responses to Educational Disruption Survey (REDS) International Report, a new Students' Home Resources and Socioeconomic Background Scale for REDS is available and has been added to the REDS User Guide and International Database here. The IERI Large Scale Assessment in Education Journal special issue call has now closed, and we would like to thank those who submitted. An IERI REDS Academy is scheduled for June and is open for anyone interested in conducting secondary analysis using REDS data. More information about the Academy can be found on the IEA website here.
Both the PASEC (Programme d'analyse des systems èducatifs de la confemen) and ERCE (Estudio Regional Comparativo y Explicativo) IEA Rosetta Stone concordance tables and accompanying technical reports have been concluded by our study partners at Boston College and there is much excitement for the release event which is being planned by UNESCO Institute for Statistics for June 2022. Further information about this event will be shared on the IEA website events page soon.
The OECD Teaching and Learning International Survey 2024 (TALIS) has now completed the Pilot Study and analysis. The Questionnaire Expert Groups for the different modules met in May to discuss the content and design of the field trial instruments based on experiences from the pilot. Furthermore, different experiments are planned for the field trial (e.g., position effects and its impact on completing the Teacher Knowledge Survey). The Technical Advisory Group also meets in May to discuss among others the scheduled Situational Judgement Tasks (SJTs) and their implementation in the TALIS Core and Starting Strong questionnaires.
Trends in International Mathematics and Science Study (TIMSS) 2023 field test administration began in March, and countries are expected to conclude field testing by the end of May 2022. IEA's Coding Unit released the CodingExpert in early May and the participating countries can now score the open-ended achievement items. The next TIMSS 2023 NRC meeting is planned as an online meeting for the week of 12 September 2022.