Michelle Dawson posts

Post published on Bluesky on 27 Jun 2026 12:34

Bluesky DOI work crossref Extract quoted in the post External link integrated into the post

The quality of systematic reviews in ABA journals, autism-relevant, free journals.plos.org/plosone/arti... "all eligible studies were rated as being of ‘critically low’ quality..." "The widespread absence of sufficiently comprehensive risk of bias assessment is... particularly concerning" etc

View on Bluesky

Structured cited links

1 cited resource

DOI work Fetched Post crossref

Richard May, Olivia Campbell, Magda Apanasionok, Josh Molina, Christopher Seel, Vaso Totsika, Aoife McTiernan, Alan Tennyson, et al. (2026). Evaluating the quality of systematic reviews and meta-analyses published in behaviour analysis journals: An umbrella review. PLOS One, 21(6), e0350142. Public Library of Science (PLoS).

Publication date
26 Jun 2026
Identifier
10.1371/journal.pone.0350142
Authors
Richard May, Olivia Campbell, Magda Apanasionok, Josh Molina, Christopher Seel, Vaso Totsika, Aoife McTiernan, Alan Tennyson, Corinna Grindle, Simon Dymond
Source
PLOS One
Details
21(6), e0350142
Reference type
article
Publisher
Public Library of Science (PLoS)
Metadata source
crossref

Abstract

High-quality systematic reviews and meta-analyses are essential for translating evidence into practice. We conducted an umbrella review to evaluate the methodological quality of systematic reviews and meta-analyses published in the field of behaviour analysis up to and including 2023. Eligible studies were identified through targeted searches of seven behaviour analysis journals using APA PsycINFO. Quality was assessed using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR 2) and Revised AMSTAR (R-AMSTAR) instruments. Temporal trends were analysed using Bayesian multilevel regression. The protocol was preregistered on the Open Science Framework (doi.org/10.17605/OSF.IO/U38Z4). We identified 64 reviews (16 of which included a meta-analysis), all of which were rated as ‘critically low’ quality using the AMSTAR 2 criteria. Methodological shortcomings included absent protocol registration, inadequate risk of bias assessment, and failure to assess publication bias. Mean R-AMSTAR adherence was 43.8% (range 11–66%) and increased by 1.08% per year (population-level average marginal effect from the multilevel logistic model (95% CI [0.59, 1.58]), indicating robust methodological improvement over time. Currently, many systematic reviews and meta-analyses in behaviour analysis do not yet meet contemporary standards of methodological rigour. Enhancing the quality, transparency, and consistency of evidence synthesis is vital if systematic reviews are to meaningfully inform practice.

Study authors in this cited reference