Temporal Changes in Effect Sizes of Studies Comparing Individuals With and Without Autism
This publication is included in the Autistic Autism Scholarship Project. one author of this publication is identified as autistic in the project.
About the autistic author markerRødgaard, E. M., Jensen, K., Vergnes, J. N., Soulières, I., & Mottron, L. (2019). Temporal Changes in Effect Sizes of Studies Comparing Individuals With and Without Autism. JAMA Psychiatry, 76(11), 1124. https://doi.org/10.1001/jamapsychiatry.2019.1956
This publication is integrated into AutiHub through:
Authors
Abstract
Importance: The definition and nature of autism have been highly debated, as exemplified by several revisions of the DSM (DSM-III, DSM-IIIR, DSM-IV, and DSM-5) criteria. There has recently been a move from a categorical view toward a spectrum-based view. These changes have been accompanied by a steady increase in the prevalence of the condition. Changes in the definition of autism that may increase heterogeneity could affect the results of autism research; specifically, a broadening of the population with autism could result in decreasing effect sizes of group comparison studies. Objective: To examine the correlation between publication year and effect size of autism-control group comparisons across several domains of published autism neurocognitive research. Data Sources: This meta-analysis investigated 11 meta-analyses obtained through a systematic search of PubMed for meta-analyses published from January 1, 1966, through January 27, 2019, using the search string autism AND (meta-analysis OR meta-analytic). The last search was conducted on January 27, 2019. Study Selection: Meta-analyses were included if they tested the significance of group differences between individuals with autism and control individuals on a neurocognitive construct. Meta-analyses were only included if the tested group difference was significant and included data with a span of at least 15 years. Data Extraction and Synthesis: Data were extracted and analyzed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline using fixed-effects models. Main Outcomes and Measures: Estimated slope of the correlation between publication year and effect size, controlling for differences in methods, sample size, and study quality. Results: The 11 meta-analyses included data from a total of 27 723 individuals. Demographic data such as sex and age were not available for the entire data set. Seven different psychological and neurologic constructs were analyzed based on data from these meta-analyses. Downward temporal trends for effect size were found for all constructs (slopes: -0.067 to -0.003), with the trend being significant in 5 of 7 cases: emotion recognition (slope: -0.028 [95% CI, -0.048 to -0.007]), theory of mind (-0.045 [95% CI, -0.066 to -0.024]), planning (-0.067 [95% CI, -0.125 to -0.009]), P3b amplitude (-0.048 [95% CI, -0.093 to -0.004]), and brain size (-0.047 [95% CI, -0.077 to -0.016]). In contrast, 3 analogous constructs in schizophrenia, a condition that is also heterogeneous but with no reported increase in prevalence, did not show a similar trend. Conclusions and Relevance: The findings suggest that differences between individuals with autism and those without the diagnosis have decreased over time and that possible changes in the definition of autism from a narrowly defined and homogenous population toward an inclusive and heterogeneous population may reduce our capacity to build mechanistic models of the condition.
Bibliography cited by this reference
Cited references are imported from external metadata sources when they are available. The list may be partial.
Cited bibliography overview
These indicators describe the bibliography cited by this publication. An author name is counted each time it appears in one cited reference, so the same person can be counted more than once. Names not yet linked to an author already present in AutiHub are treated as unknown, not as non-autistic. Last computed: 15 Sep 2026 07:45.
- With a DOI
- 60
- Without a DOI, from raw bibliography text
- 6
- References with detected author names
- 64 / 67 (95.5%)
- Without detected author names
- 3
- Without a structured title
- 2
- Without a stable identifier
- 3
- References with raw author names still to review
- 2
- References with external metadata lookup issues
- 0
- From DOI or external metadata
- 237
- From validated raw bibliography text
- 0
- Raw names already validated
- 0
- Raw names still to review
- 3
-
(2013). Handbook of Meta-analysis in Ecology and Evolution . Princeton University Press.OpenAlex
-
Léo Kanner (1943). Autistic disturbances of affective contact. Nerv Child, 2(3), 217.Type: Article OpenAlex: https://openalex.org/W2255119171Crossref OpenAlex
-
Brenna B. Maddox , Edward S. Brodkin , Monica E. Calkins , Kathleen Shea , Katherine Mullan , Jack Hostager et al. (2017). The Accuracy of the ADOS-2 in Identifying Autism among Adults with Complex Psychiatric Conditions . Journal of Autism and Developmental Disorders, 47(9), 2703-2709. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Mark W Russo (2007). How to review a meta-analysis. Gastroenterol Hepatol (N Y), 3(8), 637.Type: Article OpenAlex: https://openalex.org/W255385894Crossref OpenAlex
-
Sula Wolff (2004). The history of autism . European Child & Adolescent Psychiatry, 13(4), 201. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Timothy R. Levine , Kelli J. Asada , Chris Carpenter (2009). Sample Sizes and Effect Sizes are Negatively Correlated in Meta-Analyses: Evidence and Implications of a Publication Bias Against NonSignificant Findings . Communication Monographs, 76(3), 286-302. Informa UK Limited.Crossref OpenAlex OpenCitations
-
F. Samson , Thomas A. Zeffiro , J. Doyon , H. Benali , Laurent Mottron (2015). Speech acquisition predicts regions of enhanced cortical response to auditory stimulation in autism spectrum individuals . Journal of Psychiatric Research, 68, 285-292. Elsevier BV.Crossref OpenAlex OpenCitations
-
Benjamin Zablotsky , Lindsey I Black , Matthew J Maenner , Laura A Schieve , Stephen J Blumberg (2015). Estimated prevalence of autism and other developmental disabilities following questionnaire changes in the 2014 National Health Interview Survey. Natl Health Stat Report, (87), 1.Type: Article OpenAlex: https://openalex.org/W2404050358Crossref OpenAlex
-
David O. Black , Gregory L. Wallace , Jennifer L. Sokoloff , Lauren Kenworthy (2009). Brief Report: IQ Split Predicts Social Symptoms and Communication Abilities in High-Functioning Children with Autism Spectrum Disorders . Journal of Autism and Developmental Disorders, 39(11), 1613-1619. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Sue Fletcher-Watson , Fiona McConnell , Eirini Manola , Helen McConachie (2014). Interventions based on the Theory of Mind cognitive model for autism spectrum disorder (ASD) . Cochrane Database of Systematic Reviews, 2020(2), CD008785. Wiley.Crossref OpenAlex OpenCitations
-
Ka‐Yuet Liu , Marissa King , Peter S. Bearman (2010). Social influence and the autism epidemic. AJS, 115(5), 1387. University of Chicago Press.Crossref OpenAlex
-
Jo Moss , Patricia Howlin , Iliana Magiati , Chris Oliver (2012). Characteristics of autism spectrum disorder in Cornelia de Lange syndrome . Journal of Child Psychology and Psychiatry, 53(8), 883-891. Wiley.Crossref OpenAlex OpenCitations
-
Paul Shattuck (2006). The Contribution of Diagnostic Substitution to the Growing Administrative Prevalence of Autism in US Special Education . Pediatrics, 117(4), 1028-1037. American Academy of Pediatrics (AAP).Crossref OpenAlex OpenCitations
-
Mirko Uljarević , Antonia F. de C. Hamilton (2013). Recognition of Emotions in Autism: A Formal Meta-Analysis . Journal of Autism and Developmental Disorders, 43(7), 1517-1526. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Jason C. Simeone , Alexandra J. Ward , Philip Rotella , Jenna Collins , Ricarda Windisch (2015). An evaluation of variation in published estimates of schizophrenia prevalence from 1990─2013: a systematic literature review . BMC Psychiatry, 15(1), 193. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Katherine M Keyes , Ezra Susser , Keely Cheslack-Postava , Christine Fountain , Kayuet Liu , Peter S Bearman (2012). Cohort effects explain the increase in autism diagnosis among children born from 1992 to 2003 in California. Int J Epidemiol, 41(2), 495. Oxford University Press (OUP).Crossref OpenAlex
-
Roberto Sacco , Stefano Gabriele , Antonio M. Persico (2015). Head circumference and brain size in autism spectrum disorder: A systematic review and meta-analysis . Psychiatry Research: Neuroimaging, 234(2), 239-251. Elsevier BV.Crossref OpenAlex OpenCitations
-
Katherine M Keyes , Ezra Susser , Keely Cheslack-Postava , Christine Fountain , Kayuet Liu , Peter S Bearman (2012). Cohort effects explain the increase in autism diagnosis among children born from 1992 to 2003 in California . International Journal of Epidemiology, 41(2), 495-503. Oxford University Press (OUP).Type: Article DOI: 10.1093/ije/dyr193 10.7916/d8-8m71-9b75OpenCitations
-
Colin B. Begg , Madhuchhanda Mazumdar (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088. JSTOR.Crossref OpenAlex
-
Fombonne (2018). Editorial: the rising prevalence of autism. J Child Psychol Psychiatry, 59(7), 717. Wiley.Crossref OpenAlex
-
Tingkai Cui , Peizhong Peter Wang , Shengxin Liu , Xin Zhang (2017). P300 amplitude and latency in autism spectrum disorder: a meta-analysis . European Child & Adolescent Psychiatry, 26(2), 177-190. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Lorna Wing , Judith Gould (1979). Severe impairments of social interaction and associated abnormalities in children: Epidemiology and classification . Journal of Autism and Developmental Disorders, 9(1), 11-29. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Cynthia A. Molloy , Donna S. Murray , Rachel Akers , Terry Mitchell , Patricia Manning-Courtney (2011). Use of the Autism Diagnostic Observation Schedule (ADOS) in a clinical setting . Autism, 15(2), 143-162. SAGE Publications.Crossref OpenAlex OpenCitations
-
Chun Lun Eric Lai , Zoe Lau , Simon S. Y. Lui , Eugenia Lok , Venus Tam , Quinney Chan et al. (2017). Meta‐analysis of neuropsychological measures of executive functioning in children and adolescents with high‐functioning autism spectrum disorder . Autism Research, 10(5), 911-939. Wiley.Crossref OpenAlex OpenCitations
-
Havdahl (2017). The influence of parental concern on the utility of autism diagnostic instruments. Autism Res, 10(10), 1672.Type: Other DOI: 10.1002/aur.2017.10.issue-10Crossref
-
John P.A. Ioannidis , Thomas A. Trikalinos (2005). Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomized trials . Journal of Clinical Epidemiology, 58(6), 543-549. Elsevier BV.Crossref OpenAlex OpenCitations
-
Jonathan B. Koffel , Melissa L. Rethlefsen (2016). Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals: A Cross-Sectional Study . PLOS ONE, 11(9), e0163309. Public Library of Science (PLoS).Crossref OpenAlex OpenCitations
-
I. Kamp-Becker , K. Albertowski , J. Becker , M. Ghahreman , A. Langmann , T. Mingebach et al. (2018). Diagnostic accuracy of the ADOS and ADOS-2 in clinical practice . European Child & Adolescent Psychiatry, 27(9), 1193-1207. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Regina Taurines , Christina Schwenck , Eva Westerwald , Michael Sachse , Michael Siniatchkin , Christine Freitag (2012). ADHD and autism: differential diagnosis or overlapping traits? A selective review . ADHD Attention Deficit and Hyperactivity Disorders, 4(3), 115-139. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Élise B. Barbeau , Adrianna Mendrek , Laurent Mottron (2009). Are autistic traits autistic? British Journal of Psychology, 100(1), 23-28. Wiley.Crossref OpenAlex OpenCitations
-
Shaun M. Eack , Amber L. Bahorik , Summer A.F. McKnight , Susan S. Hogarty , Deborah P. Greenwald , Christina E. Newhill et al. (2013). Commonalities in social and non-social cognitive impairments in adults with autism spectrum disorder and schizophrenia . Schizophrenia Research, 148(1-3), 24-28. Elsevier BV.Crossref OpenAlex OpenCitations
-
René Westerhausen , Kristiina Kompus , Kenneth Hugdahl (2011). Impaired cognitive inhibition in schizophrenia: A meta-analysis of the Stroop interference effect . Schizophrenia Research, 133(1-3), 172-181. Elsevier BV.Crossref OpenAlex OpenCitations
-
Emre Bora , Murat Yucel , Christos Pantelis (2009). Theory of mind impairment in schizophrenia: Meta-analysis . Schizophrenia Research, 109(1-3), 1-9. Elsevier BV.Crossref OpenAlex OpenCitations
-
Yu Sun Chung , Deanna Barch , Michael Strube (2014). A Meta-Analysis of Mentalizing Impairments in Adults With Schizophrenia and Autism Spectrum Disorder . Schizophrenia Bulletin, 40(3), 602-616. Oxford University Press (OUP).Crossref OpenAlex OpenCitations
-
Andrew Pickles , ADRIAN ANGOLD (2003). Natural categories or fundamental dimensions: On carving nature at the joints and the rearticulation of psychopathology . Development and Psychopathology, 15(3), 529-551. Cambridge University Press (CUP).Crossref OpenAlex OpenCitations
-
Blythe A. Corbett , Laura J. Constantine , Robert L. Hendren , David Rocke , Sally Ozonoff (2009). Examining executive functioning in children with autism spectrum disorder, attention deficit hyperactivity disorder and typical development . Psychiatry Research, 166(2-3), 210-222. Elsevier BV.Crossref OpenAlex OpenCitations
-
Sally Ozonoff (1995). Reliability and validity of the Wisconsin Card Sorting Test in studies of autism. Neuropsychology, 9(4), 491-500. American Psychological Association (APA).Crossref OpenAlex OpenCitations
-
Francesca Happé (1994). An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults . Journal of Autism and Developmental Disorders, 24(2), 129-154. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Belinda A. Gargaro , Nicole Rinehart , John L. Bradshaw , Bruce Tonge , Dianne M. Sheppard (2011). Autism and ADHD: How far have we come in the comorbidity debate? Neuroscience & Biobehavioral Reviews, 35(5), 1081-1088. Elsevier BV.Crossref OpenAlex OpenCitations
-
Jenni Leppanen , Felicity Sedgewick , Janet Treasure , Kate Tchanturia (2018). Differences in the Theory of Mind profiles of patients with anorexia nervosa and individuals on the autism spectrum: A meta-analytic review . Neuroscience & Biobehavioral Reviews, 90, 146-163. Elsevier BV.Crossref OpenAlex OpenCitations
-
Kristen Bottema-Beutel , So Yoon Kim , Shannon Crowley LaPoint (2019). A systematic review and meta‐regression analysis of social functioning correlates in autism and typical development . Autism Research, 12(2), 152-175. Wiley.OpenAlex OpenCitations
-
Inmaculada Peñuelas-Calvo , Aditya Sareen , Julia Sevilla-Llewellyn-Jones , Pablo Fernández-Berrocal (2019). The “Reading the Mind in the Eyes” Test in Autism-Spectrum Disorders Comparison with Healthy Controls: A Systematic Review and Meta-analysis . Journal of Autism and Developmental Disorders, 49(3), 1048-1061. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
E A Demetriou , A Lampit , D S Quintana , S L Naismith , Y J C Song , J E Pye et al. (2018). Autism spectrum disorders: a meta-analysis of executive function . Molecular Psychiatry, 23(5), 1198-1204. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Linda M. E. Olde Dubbelink , Hilde M. Geurts (2017). Planning Skills in Autism Spectrum Disorder Across the Lifespan: A Meta-analysis and Meta-regression . Journal of Autism and Developmental Disorders, 47(4), 1148-1165. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Sander V. Haijma , Neeltje Van Haren , Wiepke Cahn , P. Cédric M. P. Koolschijn , Hilleke E. Hulshoff Pol , René S. Kahn (2013). Brain Volumes in Schizophrenia: A Meta-Analysis in Over 18 000 Subjects . Schizophrenia Bulletin, 39(5), 1129-1138. Oxford University Press (OUP).Crossref OpenAlex OpenCitations
-
Jonathan Green , Shruti Garg (2018). Annual Research Review: The state of autism intervention science: progress, target psychological and biological mechanisms and future prospects . Journal of Child Psychology and Psychiatry, 59(4), 424-443. Wiley.Crossref OpenAlex OpenCitations
-
Oriane Landry , Shems Al-Taie (2016). A Meta-analysis of the Wisconsin Card Sort Task in Autism . Journal of Autism and Developmental Disorders, 46(4), 1220-1235. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Ruth Van der Hallen , Kris Evers , Katrien Brewaeys , Wim Van den Noortgate , Johan Wagemans (2015). Global processing takes time: A meta-analysis on local–global visual processing in ASD. Psychological Bulletin, 141(3), 549-573. American Psychological Association (APA).Crossref OpenAlex OpenCitations
-
H. Westwood , D. Stahl , William Mandy , Kate Tchanturia (2016). The set-shifting profiles of anorexia nervosa and autism spectrum disorder using the Wisconsin Card Sorting Test: a systematic review and meta-analysis . Psychological Medicine, 46(9), 1809-1827. Cambridge University Press (CUP).Crossref OpenAlex OpenCitations
-
Paul Monsarrat , Jean-Noël Vergnes (2018). The intriguing evolution of effect sizes in biomedical research over time: smaller but more often statistically significant . GigaScience, 7(1), 1. Oxford University Press (OUP).Crossref OpenAlex OpenCitations
-
Geurts (2014). Prepotent response inhibition and interference control in autism spectrum disorders: two meta-analyses. Autism Res, 7(4), 407. Wiley.Crossref OpenAlex
-
Hilde M. Geurts , Sanne F. W. M. van den Bergh , Laura Ruzzano (2014). Prepotent Response Inhibition and Interference Control in Autism Spectrum Disorders: Two Meta‐Analyses . Autism Research, 7(4), 407-420. Wiley.OpenAlex OpenCitations
-
Herbert Roeyers , Ann Buysse , Koen Ponnet , Bert Pichal (2001). Advancing advanced mind-reading tests: empathic accuracy in adults with a pervasive developmental disorder. J Child Psychol Psychiatry, 42(2), 271-278. Wiley.Crossref OpenAlex
-
Karoline Alexandra Havdahl , Somer Bishop , Pål Surén , Anne‐Siri Øyen , Catherine Lord , Andrew Pickles et al. (2017). The influence of parental concern on the utility of autism diagnostic instruments . Autism Research, 10(10), 1672-1686. Wiley.OpenAlex OpenCitations
-
Ka‐Yuet Liu , Marissa King , Peter S. Bearman (2010). Social Influence and the Autism Epidemic . American Journal of Sociology, 115(5), 1387-1434. University of Chicago Press.Type: Article DOI: 10.1086/651448 10.7916/d80g3j0mOpenCitations
-
L Kanner (1968). Autistic disturbances of affective contact. Acta Paedopsychiatr, 35(4), 100.Type: Article OpenAlex: https://openalex.org/W2192638454OpenAlex
-
Laura Fusar-Poli , Natascia Brondino , Matteo Rocchetti , Cristina Panisi , Umberto Provenzani , Stefano Damiani et al. (2017). Diagnosing ASD in Adults Without ID: Accuracy of the ADOS-2 and the ADI-R . Journal of Autism and Developmental Disorders, 47(11), 3370-3379. Springer Science and Business Media LLC.Crossref OpenAlex OpenCitations
-
Julia Koricheva , Michael D. Jennions , Joseph Lau (2013). 15. Temporal Trends in Effect Sizes: Causes, Detection, and Implications . In Handbook of Meta-analysis in Ecology and Evolution (pp. 237-254). Princeton University Press.Crossref OpenAlex OpenCitations
-
Olof Arvidsson , Christopher Gillberg , Paul Lichtenstein , Sebastian Lundström (2018). Secular changes in the symptom level of clinically diagnosed autism . Journal of Child Psychology and Psychiatry, 59(7), 744-751. Wiley.OpenAlex OpenCitations
-
Éric Fombonne (2018). Editorial: The rising prevalence of autism . Journal of Child Psychology and Psychiatry, 59(7), 717-720. Wiley.OpenAlex OpenCitations
-
Bottema-Beutel (2019). A systematic review and meta-regression analysis of social functioning correlates in autism and typical development. Autism Res, 12(2), 152.Type: Other DOI: 10.1002/aur.2019.12.issue-2Crossref
-
Victor Lotter (1966). Epidemiology of autistic conditions in young children . Social Psychiatry, 1(3), 124-135. Springer Science and Business Media LLC.OpenCitations
-
Lotter (1966). Soc Psychiatry . Soc Psychiatry, 124.Type: OtherCrossref
-
(n.d.). Centers for Disease Control and Prevention. CDC estimates 1 in 68 children has been identified with autism spectrum disorder. https://www.cdc.gov/media/releases/2014/p0327-autism-spectrum-disorder.html . Published 2014. Accessed April 22, 2019.Type: OtherCrossref
-
(n.d.). WellsGA, SheaB, O’ConnellD,; The Ottawa Hospital Research Institute. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp . Published 2013. Accessed April 22, 2019.Type: OtherCrossref
-
Shephard (2017). Mid-childhood outcomes of infant siblings at familial high-risk of autism spectrum disorder. Autism Research, 10(10), 546. Wiley.OpenAlex
-
Dissanayake (2019). Cognitive and behavioral differences in toddlers with autism spectrum disorder from multiplex and simplex families. Autism Research, 12(2), 682. Wiley.OpenAlex