Idea in Brief
Background
Identifying the success and challenges of education systems, policies, and programs heavily relies on the evidence provided by empirical research studies. International Large-Scale Assessments (ILSAs), such as TIMSS, PIRLS, PISA, TALIS, PIAAC, and ICILS, aim at making visible key educational inputs, processes, and outcomes, including student achievement, classroom characteristics, and school climate, and thus inform educational practice and policy-making. In fact, given their wealth of variables and indicators and their sampling designs, ILSAs provide unique resources and opportunities for researchers to generate and test hypotheses about the relations among educationally relevant constructs, progress over time, and differences between groups of students, schools, or countries. However, given the complexity and the sheer size of ILSA data sets, standard approaches to analysing them and, ultimately, provide meaningful results face their limits.
Goals
- Develop and evaluate analytic approaches to synthesizing specific results of ILSAs using meta-analyses.
- Conduct meta-analyses that address educationally relevant research questions with ILSA data.
- Provide tools and guidelines for researchers who wish to synthesize the results of ILSAs for a specific research question.
Projects
- Principles and Practices to Synthesize Research Evidence from Complex Survey Data
- Principles and practices of including ILSA data in meta-analyses in education
- Meta-analysis of gender differences in digital literacy
- Meta-analysis of the relation between SES and digital literacy
- Synthesizing the relations among team innovativeness, teacher collaboration, job satisfaction, and instructional practices across 48 countries using TALIS 2018 data
Publications
- Scherer, R., & Siddiq, F. (2019). The relation between students’ socioeconomic status and ICT literacy: Findings from a meta-analysis. Computers & Education, 138, 13-32. https://doi.org/10.1016/j.compedu.2019.04.011
- Siddiq, F., & Scherer, R. (2019). Is there a gender gap? A meta-analysis of the gender differences in students' ICT literacy. Educational Research Review, 27, 205-217. https://doi.org/10.1016/j.edurev.2019.03.007
- Scherer, R., & Teo, T. (2020). A tutorial on the meta-analytic structural equation modeling of reliability coefficients. Psychological Methods, 25(6), 747-775. https://doi.org/10.1037/met0000261
- Blömeke, S., Nilsen, T., & Scherer, R. (2021). School innovativeness is associated with enhanced teacher collaboration, innovative classroom practices, and job satisfaction. Journal of Educational Psychology, http://dx.doi.org/10.1037/edu0000668
- Scherer, R., Siddiq, F., & Nilsen, T. (2021, October 24). The Potential of International Large-Scale Assessments for Meta-Analyses in Education. https://doi.org/10.31234/osf.io/bucf9
- Campos, D., Cheung, M. W., & Scherer, R. (2021, December 2). A Primer on Two-Stage Meta-Analysis with Individual Participant Data Obtained from Complex Sampling Surveys. https://doi.org/10.31234/osf.io/r9p62