Temporal Changes in Effect Sizes of Studies Comparing Individuals With and Without Autism

This publication is included in the Autistic Autism Scholarship Project. one author of this publication is identified as autistic in the project.

About the autistic author marker

Rødgaard, E. M., Jensen, K., Vergnes, J. N., Soulières, I., & Mottron, L. (2019). Temporal Changes in Effect Sizes of Studies Comparing Individuals With and Without Autism. JAMA Psychiatry, 76(11), 1124. https://doi.org/10.1001/jamapsychiatry.2019.1956

Publication date: 21 Aug 2019 Added to AutiHub: 15 Sep 2026 Type: Article Article language: English

This publication is integrated into AutiHub through:

Authors

Publication authors
5
Publication authors identified as autistic
1 / 5 (20.0%)

Abstract

Importance: The definition and nature of autism have been highly debated, as exemplified by several revisions of the DSM (DSM-III, DSM-IIIR, DSM-IV, and DSM-5) criteria. There has recently been a move from a categorical view toward a spectrum-based view. These changes have been accompanied by a steady increase in the prevalence of the condition. Changes in the definition of autism that may increase heterogeneity could affect the results of autism research; specifically, a broadening of the population with autism could result in decreasing effect sizes of group comparison studies. Objective: To examine the correlation between publication year and effect size of autism-control group comparisons across several domains of published autism neurocognitive research. Data Sources: This meta-analysis investigated 11 meta-analyses obtained through a systematic search of PubMed for meta-analyses published from January 1, 1966, through January 27, 2019, using the search string autism AND (meta-analysis OR meta-analytic). The last search was conducted on January 27, 2019. Study Selection: Meta-analyses were included if they tested the significance of group differences between individuals with autism and control individuals on a neurocognitive construct. Meta-analyses were only included if the tested group difference was significant and included data with a span of at least 15 years. Data Extraction and Synthesis: Data were extracted and analyzed according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline using fixed-effects models. Main Outcomes and Measures: Estimated slope of the correlation between publication year and effect size, controlling for differences in methods, sample size, and study quality. Results: The 11 meta-analyses included data from a total of 27 723 individuals. Demographic data such as sex and age were not available for the entire data set. Seven different psychological and neurologic constructs were analyzed based on data from these meta-analyses. Downward temporal trends for effect size were found for all constructs (slopes: -0.067 to -0.003), with the trend being significant in 5 of 7 cases: emotion recognition (slope: -0.028 [95% CI, -0.048 to -0.007]), theory of mind (-0.045 [95% CI, -0.066 to -0.024]), planning (-0.067 [95% CI, -0.125 to -0.009]), P3b amplitude (-0.048 [95% CI, -0.093 to -0.004]), and brain size (-0.047 [95% CI, -0.077 to -0.016]). In contrast, 3 analogous constructs in schizophrenia, a condition that is also heterogeneous but with no reported increase in prevalence, did not show a similar trend. Conclusions and Relevance: The findings suggest that differences between individuals with autism and those without the diagnosis have decreased over time and that possible changes in the definition of autism from a narrowly defined and homogenous population toward an inclusive and heterogeneous population may reduce our capacity to build mechanistic models of the condition.

Bibliography cited by this reference

Cited references are imported from external metadata sources when they are available. The list may be partial.

Cited bibliography overview

These indicators describe the bibliography cited by this publication. An author name is counted each time it appears in one cited reference, so the same person can be counted more than once. Names not yet linked to an author already present in AutiHub are treated as unknown, not as non-autistic. Last computed: 15 Sep 2026 07:45.

Cited references
67
With a DOI
60
Without a DOI, from raw bibliography text
6
0 / 67 (0.0%) cited references include at least one author identified as autistic.
References with data to complete
3 / 67 (4.5%)
References with detected author names
64 / 67 (95.5%)
Without detected author names
3
Without a structured title
2
Without a stable identifier
3
References with raw author names still to review
2
References with external metadata lookup issues
0
These indicators apply to cited references displayed on this page, after technical duplicates have been merged. A reference without a DOI can still support author statistics when a title and author names are available.
Author names detected in the cited bibliography
237
From DOI or external metadata
237
From validated raw bibliography text
0
Raw names already validated
0
Raw names still to review
3
42 / 237 (17.7%) names are linked to an author already present in AutiHub. 195 / 237 (82.3%) names are not yet linked.
Names linked to a person identified as autistic
0 / 237 (0.0%)
Calculated across all author names detected in the cited bibliography. Among names linked to an author already present in AutiHub: 0 / 42 (0.0%). Distinct people identified as autistic: 0 / 229 (0.0%).
  1. (2013). Handbook of Meta-analysis in Ecology and Evolution . Princeton University Press.
    OpenAlex
  2. Léo Kanner (1943). Autistic disturbances of affective contact. Nerv Child, 2(3), 217.
    Type: Article OpenAlex: https://openalex.org/W2255119171
    Crossref OpenAlex
  3. Brenna B. Maddox , Edward S. Brodkin , Monica E. Calkins , Kathleen Shea , Katherine Mullan , Jack Hostager et al. (2017). The Accuracy of the ADOS-2 in Identifying Autism among Adults with Complex Psychiatric Conditions . Journal of Autism and Developmental Disorders, 47(9), 2703-2709. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  4. Mark W Russo (2007). How to review a meta-analysis. Gastroenterol Hepatol (N Y), 3(8), 637.
    Type: Article OpenAlex: https://openalex.org/W255385894
    Crossref OpenAlex
  5. Sula Wolff (2004). The history of autism . European Child & Adolescent Psychiatry, 13(4), 201. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  6. Timothy R. Levine , Kelli J. Asada , Chris Carpenter (2009). Sample Sizes and Effect Sizes are Negatively Correlated in Meta-Analyses: Evidence and Implications of a Publication Bias Against NonSignificant Findings . Communication Monographs, 76(3), 286-302. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  7. F. Samson , Thomas A. Zeffiro , J. Doyon , H. Benali , Laurent Mottron (2015). Speech acquisition predicts regions of enhanced cortical response to auditory stimulation in autism spectrum individuals . Journal of Psychiatric Research, 68, 285-292. Elsevier BV.
    Crossref OpenAlex OpenCitations
  8. Benjamin Zablotsky , Lindsey I Black , Matthew J Maenner , Laura A Schieve , Stephen J Blumberg (2015). Estimated prevalence of autism and other developmental disabilities following questionnaire changes in the 2014 National Health Interview Survey. Natl Health Stat Report, (87), 1.
    Type: Article OpenAlex: https://openalex.org/W2404050358
    Crossref OpenAlex
  9. David O. Black , Gregory L. Wallace , Jennifer L. Sokoloff , Lauren Kenworthy (2009). Brief Report: IQ Split Predicts Social Symptoms and Communication Abilities in High-Functioning Children with Autism Spectrum Disorders . Journal of Autism and Developmental Disorders, 39(11), 1613-1619. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  10. Sue Fletcher-Watson , Fiona McConnell , Eirini Manola , Helen McConachie (2014). Interventions based on the Theory of Mind cognitive model for autism spectrum disorder (ASD) . Cochrane Database of Systematic Reviews, 2020(2), CD008785. Wiley.
    Crossref OpenAlex OpenCitations
  11. Ka‐Yuet Liu , Marissa King , Peter S. Bearman (2010). Social influence and the autism epidemic. AJS, 115(5), 1387. University of Chicago Press.
    Type: Article DOI: 10.1086/651448 OpenAlex: https://openalex.org/W1993794333
    Crossref OpenAlex
  12. Jo Moss , Patricia Howlin , Iliana Magiati , Chris Oliver (2012). Characteristics of autism spectrum disorder in Cornelia de Lange syndrome . Journal of Child Psychology and Psychiatry, 53(8), 883-891. Wiley.
    Crossref OpenAlex OpenCitations
  13. Paul Shattuck (2006). The Contribution of Diagnostic Substitution to the Growing Administrative Prevalence of Autism in US Special Education . Pediatrics, 117(4), 1028-1037. American Academy of Pediatrics (AAP).
    Crossref OpenAlex OpenCitations
  14. Mirko Uljarević , Antonia F. de C. Hamilton (2013). Recognition of Emotions in Autism: A Formal Meta-Analysis . Journal of Autism and Developmental Disorders, 43(7), 1517-1526. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  15. Jason C. Simeone , Alexandra J. Ward , Philip Rotella , Jenna Collins , Ricarda Windisch (2015). An evaluation of variation in published estimates of schizophrenia prevalence from 1990─2013: a systematic literature review . BMC Psychiatry, 15(1), 193. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  16. Katherine M Keyes , Ezra Susser , Keely Cheslack-Postava , Christine Fountain , Kayuet Liu , Peter S Bearman (2012). Cohort effects explain the increase in autism diagnosis among children born from 1992 to 2003 in California. Int J Epidemiol, 41(2), 495. Oxford University Press (OUP).
    Crossref OpenAlex
  17. Roberto Sacco , Stefano Gabriele , Antonio M. Persico (2015). Head circumference and brain size in autism spectrum disorder: A systematic review and meta-analysis . Psychiatry Research: Neuroimaging, 234(2), 239-251. Elsevier BV.
    Crossref OpenAlex OpenCitations
  18. Katherine M Keyes , Ezra Susser , Keely Cheslack-Postava , Christine Fountain , Kayuet Liu , Peter S Bearman (2012). Cohort effects explain the increase in autism diagnosis among children born from 1992 to 2003 in California . International Journal of Epidemiology, 41(2), 495-503. Oxford University Press (OUP).
    OpenCitations
  19. Colin B. Begg , Madhuchhanda Mazumdar (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088. JSTOR.
    Type: Article DOI: 10.2307/2533446 OpenAlex: https://openalex.org/W1964435302
    Crossref OpenAlex
  20. Fombonne (2018). Editorial: the rising prevalence of autism. J Child Psychol Psychiatry, 59(7), 717. Wiley.
    Crossref OpenAlex
  21. Tingkai Cui , Peizhong Peter Wang , Shengxin Liu , Xin Zhang (2017). P300 amplitude and latency in autism spectrum disorder: a meta-analysis . European Child & Adolescent Psychiatry, 26(2), 177-190. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  22. Lorna Wing , Judith Gould (1979). Severe impairments of social interaction and associated abnormalities in children: Epidemiology and classification . Journal of Autism and Developmental Disorders, 9(1), 11-29. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  23. Cynthia A. Molloy , Donna S. Murray , Rachel Akers , Terry Mitchell , Patricia Manning-Courtney (2011). Use of the Autism Diagnostic Observation Schedule (ADOS) in a clinical setting . Autism, 15(2), 143-162. SAGE Publications.
    Crossref OpenAlex OpenCitations
  24. Chun Lun Eric Lai , Zoe Lau , Simon S. Y. Lui , Eugenia Lok , Venus Tam , Quinney Chan et al. (2017). Meta‐analysis of neuropsychological measures of executive functioning in children and adolescents with high‐functioning autism spectrum disorder . Autism Research, 10(5), 911-939. Wiley.
    Type: Article DOI: 10.1002/aur.1723 OpenAlex: https://openalex.org/W2550357178
    Crossref OpenAlex OpenCitations
  25. Havdahl (2017). The influence of parental concern on the utility of autism diagnostic instruments. Autism Res, 10(10), 1672.
    Type: Other DOI: 10.1002/aur.2017.10.issue-10
    Crossref
  26. John P.A. Ioannidis , Thomas A. Trikalinos (2005). Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomized trials . Journal of Clinical Epidemiology, 58(6), 543-549. Elsevier BV.
    Crossref OpenAlex OpenCitations
  27. Jonathan B. Koffel , Melissa L. Rethlefsen (2016). Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals: A Cross-Sectional Study . PLOS ONE, 11(9), e0163309. Public Library of Science (PLoS).
    Crossref OpenAlex OpenCitations
  28. I. Kamp-Becker , K. Albertowski , J. Becker , M. Ghahreman , A. Langmann , T. Mingebach et al. (2018). Diagnostic accuracy of the ADOS and ADOS-2 in clinical practice . European Child & Adolescent Psychiatry, 27(9), 1193-1207. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  29. Regina Taurines , Christina Schwenck , Eva Westerwald , Michael Sachse , Michael Siniatchkin , Christine Freitag (2012). ADHD and autism: differential diagnosis or overlapping traits? A selective review . ADHD Attention Deficit and Hyperactivity Disorders, 4(3), 115-139. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  30. Élise B. Barbeau , Adrianna Mendrek , Laurent Mottron (2009). Are autistic traits autistic? British Journal of Psychology, 100(1), 23-28. Wiley.
    Crossref OpenAlex OpenCitations
  31. Shaun M. Eack , Amber L. Bahorik , Summer A.F. McKnight , Susan S. Hogarty , Deborah P. Greenwald , Christina E. Newhill et al. (2013). Commonalities in social and non-social cognitive impairments in adults with autism spectrum disorder and schizophrenia . Schizophrenia Research, 148(1-3), 24-28. Elsevier BV.
    Crossref OpenAlex OpenCitations
  32. René Westerhausen , Kristiina Kompus , Kenneth Hugdahl (2011). Impaired cognitive inhibition in schizophrenia: A meta-analysis of the Stroop interference effect . Schizophrenia Research, 133(1-3), 172-181. Elsevier BV.
    Crossref OpenAlex OpenCitations
  33. Emre Bora , Murat Yucel , Christos Pantelis (2009). Theory of mind impairment in schizophrenia: Meta-analysis . Schizophrenia Research, 109(1-3), 1-9. Elsevier BV.
    Crossref OpenAlex OpenCitations
  34. Yu Sun Chung , Deanna Barch , Michael Strube (2014). A Meta-Analysis of Mentalizing Impairments in Adults With Schizophrenia and Autism Spectrum Disorder . Schizophrenia Bulletin, 40(3), 602-616. Oxford University Press (OUP).
    Crossref OpenAlex OpenCitations
  35. Andrew Pickles , ADRIAN ANGOLD (2003). Natural categories or fundamental dimensions: On carving nature at the joints and the rearticulation of psychopathology . Development and Psychopathology, 15(3), 529-551. Cambridge University Press (CUP).
    Crossref OpenAlex OpenCitations
  36. Blythe A. Corbett , Laura J. Constantine , Robert L. Hendren , David Rocke , Sally Ozonoff (2009). Examining executive functioning in children with autism spectrum disorder, attention deficit hyperactivity disorder and typical development . Psychiatry Research, 166(2-3), 210-222. Elsevier BV.
    Crossref OpenAlex OpenCitations
  37. Sally Ozonoff (1995). Reliability and validity of the Wisconsin Card Sorting Test in studies of autism. Neuropsychology, 9(4), 491-500. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  38. Francesca Happé (1994). An advanced test of theory of mind: Understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults . Journal of Autism and Developmental Disorders, 24(2), 129-154. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  39. Belinda A. Gargaro , Nicole Rinehart , John L. Bradshaw , Bruce Tonge , Dianne M. Sheppard (2011). Autism and ADHD: How far have we come in the comorbidity debate? Neuroscience & Biobehavioral Reviews, 35(5), 1081-1088. Elsevier BV.
    Crossref OpenAlex OpenCitations
  40. Jenni Leppanen , Felicity Sedgewick , Janet Treasure , Kate Tchanturia (2018). Differences in the Theory of Mind profiles of patients with anorexia nervosa and individuals on the autism spectrum: A meta-analytic review . Neuroscience & Biobehavioral Reviews, 90, 146-163. Elsevier BV.
    Crossref OpenAlex OpenCitations
  41. Kristen Bottema-Beutel , So Yoon Kim , Shannon Crowley LaPoint (2019). A systematic review and meta‐regression analysis of social functioning correlates in autism and typical development . Autism Research, 12(2), 152-175. Wiley.
    Type: Article DOI: 10.1002/aur.2055 OpenAlex: https://openalex.org/W2905651088
    OpenAlex OpenCitations
  42. Inmaculada Peñuelas-Calvo , Aditya Sareen , Julia Sevilla-Llewellyn-Jones , Pablo Fernández-Berrocal (2019). The “Reading the Mind in the Eyes” Test in Autism-Spectrum Disorders Comparison with Healthy Controls: A Systematic Review and Meta-analysis . Journal of Autism and Developmental Disorders, 49(3), 1048-1061. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  43. E A Demetriou , A Lampit , D S Quintana , S L Naismith , Y J C Song , J E Pye et al. (2018). Autism spectrum disorders: a meta-analysis of executive function . Molecular Psychiatry, 23(5), 1198-1204. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  44. Linda M. E. Olde Dubbelink , Hilde M. Geurts (2017). Planning Skills in Autism Spectrum Disorder Across the Lifespan: A Meta-analysis and Meta-regression . Journal of Autism and Developmental Disorders, 47(4), 1148-1165. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  45. Sander V. Haijma , Neeltje Van Haren , Wiepke Cahn , P. Cédric M. P. Koolschijn , Hilleke E. Hulshoff Pol , René S. Kahn (2013). Brain Volumes in Schizophrenia: A Meta-Analysis in Over 18 000 Subjects . Schizophrenia Bulletin, 39(5), 1129-1138. Oxford University Press (OUP).
    Crossref OpenAlex OpenCitations
  46. Jonathan Green , Shruti Garg (2018). Annual Research Review: The state of autism intervention science: progress, target psychological and biological mechanisms and future prospects . Journal of Child Psychology and Psychiatry, 59(4), 424-443. Wiley.
    Crossref OpenAlex OpenCitations
  47. Oriane Landry , Shems Al-Taie (2016). A Meta-analysis of the Wisconsin Card Sort Task in Autism . Journal of Autism and Developmental Disorders, 46(4), 1220-1235. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  48. Ruth Van der Hallen , Kris Evers , Katrien Brewaeys , Wim Van den Noortgate , Johan Wagemans (2015). Global processing takes time: A meta-analysis on local–global visual processing in ASD. Psychological Bulletin, 141(3), 549-573. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  49. H. Westwood , D. Stahl , William Mandy , Kate Tchanturia (2016). The set-shifting profiles of anorexia nervosa and autism spectrum disorder using the Wisconsin Card Sorting Test: a systematic review and meta-analysis . Psychological Medicine, 46(9), 1809-1827. Cambridge University Press (CUP).
    Crossref OpenAlex OpenCitations
  50. Paul Monsarrat , Jean-Noël Vergnes (2018). The intriguing evolution of effect sizes in biomedical research over time: smaller but more often statistically significant . GigaScience, 7(1), 1. Oxford University Press (OUP).
    Crossref OpenAlex OpenCitations
  51. Geurts (2014). Prepotent response inhibition and interference control in autism spectrum disorders: two meta-analyses. Autism Res, 7(4), 407. Wiley.
    Crossref OpenAlex
  52. Hilde M. Geurts , Sanne F. W. M. van den Bergh , Laura Ruzzano (2014). Prepotent Response Inhibition and Interference Control in Autism Spectrum Disorders: Two Meta‐Analyses . Autism Research, 7(4), 407-420. Wiley.
    Type: Article DOI: 10.1002/aur.1369 OpenAlex: https://openalex.org/W2141268338
    OpenAlex OpenCitations
  53. Herbert Roeyers , Ann Buysse , Koen Ponnet , Bert Pichal (2001). Advancing advanced mind-reading tests: empathic accuracy in adults with a pervasive developmental disorder. J Child Psychol Psychiatry, 42(2), 271-278. Wiley.
    Crossref OpenAlex
  54. Karoline Alexandra Havdahl , Somer Bishop , Pål Surén , Anne‐Siri Øyen , Catherine Lord , Andrew Pickles et al. (2017). The influence of parental concern on the utility of autism diagnostic instruments . Autism Research, 10(10), 1672-1686. Wiley.
    Type: Article DOI: 10.1002/aur.1817 OpenAlex: https://openalex.org/W2724063841
    OpenAlex OpenCitations
  55. Ka‐Yuet Liu , Marissa King , Peter S. Bearman (2010). Social Influence and the Autism Epidemic . American Journal of Sociology, 115(5), 1387-1434. University of Chicago Press.
    Type: Article DOI: 10.1086/651448 10.7916/d80g3j0m
    OpenCitations
  56. L Kanner (1968). Autistic disturbances of affective contact. Acta Paedopsychiatr, 35(4), 100.
    Type: Article OpenAlex: https://openalex.org/W2192638454
    OpenAlex
  57. Laura Fusar-Poli , Natascia Brondino , Matteo Rocchetti , Cristina Panisi , Umberto Provenzani , Stefano Damiani et al. (2017). Diagnosing ASD in Adults Without ID: Accuracy of the ADOS-2 and the ADI-R . Journal of Autism and Developmental Disorders, 47(11), 3370-3379. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  58. Julia Koricheva , Michael D. Jennions , Joseph Lau (2013). 15. Temporal Trends in Effect Sizes: Causes, Detection, and Implications . In Handbook of Meta-analysis in Ecology and Evolution (pp. 237-254). Princeton University Press.
    Crossref OpenAlex OpenCitations
  59. Olof Arvidsson , Christopher Gillberg , Paul Lichtenstein , Sebastian Lundström (2018). Secular changes in the symptom level of clinically diagnosed autism . Journal of Child Psychology and Psychiatry, 59(7), 744-751. Wiley.
    OpenAlex OpenCitations
  60. Éric Fombonne (2018). Editorial: The rising prevalence of autism . Journal of Child Psychology and Psychiatry, 59(7), 717-720. Wiley.
    OpenAlex OpenCitations
  61. Bottema-Beutel (2019). A systematic review and meta-regression analysis of social functioning correlates in autism and typical development. Autism Res, 12(2), 152.
    Type: Other DOI: 10.1002/aur.2019.12.issue-2
    Crossref
  62. Victor Lotter (1966). Epidemiology of autistic conditions in young children . Social Psychiatry, 1(3), 124-135. Springer Science and Business Media LLC.
    OpenCitations
  63. Lotter (1966). Soc Psychiatry . Soc Psychiatry, 124.
    Type: Other
    Crossref
  64. (n.d.). Centers for Disease Control and Prevention. CDC estimates 1 in 68 children has been identified with autism spectrum disorder. https://www.cdc.gov/media/releases/2014/p0327-autism-spectrum-disorder.html . Published 2014. Accessed April 22, 2019.
    Type: Other
    Crossref
  65. (n.d.). WellsGA, SheaB, O’ConnellD,; The Ottawa Hospital Research Institute. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp . Published 2013. Accessed April 22, 2019.
    Type: Other
    Crossref
  66. Shephard (2017). Mid-childhood outcomes of infant siblings at familial high-risk of autism spectrum disorder. Autism Research, 10(10), 546. Wiley.
    OpenAlex
  67. Dissanayake (2019). Cognitive and behavioral differences in toddlers with autism spectrum disorder from multiplex and simplex families. Autism Research, 12(2), 682. Wiley.
    OpenAlex