Meta-Review of Systematic Reviews in Educational Research : Risk of Bias and Open Practices

As part of a larger meta-review project that aims to assess the quality of systematic reviews of educational intervention, this study provides a snapshot of reviews published between 2019 and 2021. Main goal was to assess the current state of literature and have the best studies published as CAMAs. We looked for reviews that investigated educational interventions’ effectiveness for the k-12 population using experimental designs (RCT, QED, SCD). We searched for systematic reviews in the ERIC database and four journals which publish educational reviews. Studies that were included in the full-text screening were assessed using the ROBIS (risk of bias in systematic reviews) tool, first by assessing if the PICOS fit ours, then moved on to first stage ROBIS screening, which was conducted for all articles included in the full-text reading phase. Preliminary results of the first stage ROBIS screening indicate the lack of preregistration and data sharing practice, no standardized approach in conducting searches and reporting results, and often absent quality check of studies included in the reviews