Assessing general and autism‐relevant quality of life in autistic adults: A psychometric investigation using item response theory

Williams, Z. J. & Gotham, K. (2021). Assessing general and autism‐relevant quality of life in autistic adults: A psychometric investigation using item response theory. Autism Research, 14(8), 1633-1644. https://doi.org/10.1002/aur.2519

Publication date: 19 Apr 2021 Added to AutiHub: 7 Jul 2026 Type: Article Article language: English

This publication is integrated into AutiHub through:

Authors

Publication authors
2
Publication authors identified as autistic
1 / 2 (50.0%)

Abstract

Although many interventions and services for autistic people have the ultimate goal of improving quality of life (QoL), there is relatively little research on how best to assess this construct in the autistic population, and existing scales designed for non-autistic individuals may not assess all meaningful facets of QoL in the autistic population. To address this need, the autism spectrum QoL form (ASQoL) was recently developed as a measure of the autism-relevant quality of life. However, the psychometrics of the ASQoL have not been examined beyond the authors' initial validation study, and important properties such as measurement invariance/differential item functioning (DIF) have not yet been tested. Using data from 700 autistic adults recruited from the Simons Foundation's SPARK cohort, the current study sought to perform a comprehensive independent psychometric evaluation of the ASQoL using item response theory, comparing its performance to a newly-proposed brief measure of general QoL (the WHOQOL-4). Our models revealed substantial DIF by sex and gender in the ASQoL, which caused ASQoL scores to grossly underestimate the self-reported QoL of autistic women. Based on a comparison of latent variable means, we demonstrated that observed sex/gender differences in manifest ASQoL scores were the result of statistical artifacts, a claim that was further supported by the lack of significant group differences on the sex/gender-invariant WHOQOL-4. Our findings indicate that the ASQoL composite score is psychometrically problematic in its current form, and substantial revisions may be necessary before valid and meaningful inferences can be made regarding autism-relevant aspects of QoL. LAY SUMMARY: Quality of life (QoL) is an extremely important outcome for autistic people, but many of the tools that are used to measure it does not take into account how QoL may be different for autistic people. Using data from 700 autistic adults, we examined the measurement properties of the autism spectrum quality of life form (ASQoL), a new measure of QoL designed specifically for autistic people. Our results indicate that the ASQoL shows a pronounced sex/gender bias, which causes it to underestimate QoL in autistic women. This bias needs to be eliminated before the ASQoL can be successfully used to measure QoL in the autistic population.

Bibliography cited by this reference

Cited references are imported from external metadata sources when they are available. The list may be partial.

Bibliography inclusion overview

These indicators describe the cited bibliography imported for this publication. Cited-reference metrics use the cited-reference total as denominator. Cited-author metrics state whether they use all cited-author occurrences or only occurrences linked to authors already integrated in the AutiHub database. They use cached links between cited authors and authors integrated in the AutiHub database. Last computed: 16 Aug 2026 11:31.

Cited references
75
Total cited references integrated for this publication.
Cited references with an identified autistic author
8 / 75 (10.7%)
Cited author occurrences identified as autistic
8 / 425 (1.9%)
Among occurrences linked to AutiHub author records: 8 / 68 (11.8%). Distinct cited authors identified as autistic: 3 / 401 (0.7%).
Cited author occurrences linked to AutiHub author records
68 / 425 (16.0%)
Distinct linked cited authors: 48 / 401 (12.0%)
Linked cited-author occurrences not identified as autistic
60 / 68 (88.2%)
Among linked cited-author occurrences only. Across all cited-author occurrences: 60 / 425 (14.1%). Distinct linked cited authors not identified as autistic: 45 / 48 (93.8%).
  1. Cheng-Hsien Li (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares . Behavior Research Methods, 48(3), 936-949. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  2. Michael Ayres , Jeremy R. Parr , Jacqui Rodgers , David Mason , Leah Avery , Darren Flynn (2018). A systematic review of quality of life of adults on the autism spectrum . Autism, 22(7), 774-783. SAGE Publications.
    Crossref OpenAlex OpenCitations
  3. Umberto Provenzani , Laura Fusar-Poli , Natascia Brondino , Stefano Damiani , Marco Vercesi , Nicholas Meyer et al. (2020). What are we targeting when we treat autism spectrum disorder? A systematic review of 406 clinical trials . Autism, 24(2), 274-284. SAGE Publications.
    Crossref OpenAlex OpenCitations
  4. Heidi Sivertsen , Guro Hanevold Bjørkløf , Knut Engedal , Geir Selbæk , Anne-Sofie Helvik (2015). Depression and Quality of Life in Older Persons: A Review . Dementia and Geriatric Cognitive Disorders, 40(5-6), 311-339. S. Karger AG.
    OpenAlex
  5. Yoav Benjamini , Yosef Hochberg (1995). Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing . Journal of the Royal Statistical Society Series B: Statistical Methodology, 57(1), 289-300. Oxford University Press (OUP).
    Crossref OpenAlex OpenCitations
  6. Andrew J. Tomarken , Niels G. Waller (2003). Potential problems with "well fitting" models. Journal of Abnormal Psychology, 112(4), 578-598. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  7. Anthony Rodriguez , Steven P. Reise , Mark G. Haviland (2016). Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures . Journal of Personality Assessment, 98(3), 223-237. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  8. Brown H. M. Dwyer P. S. R. Gassner D. L. Kapp S. K. Ne'eman A. Ryan J. G. Waisman T. &Williams Z. J. (2020). Introducing the Autistic Researcher Review Board of the Autism Intervention Research Network on Physical Health. Manuscript Submitted for Publication.
    Type: Other
    Crossref
  9. D. Oakes (1999). Direct Calculation of the Information Matrix via the EM Algorithm . Journal of the Royal Statistical Society Series B: Statistical Methodology, 61(2), 479-482. Oxford University Press (OUP).
    Crossref OpenAlex OpenCitations
  10. Yves Rosseel (2012). lavaan: An R Package for Structural Equation Modeling . Journal of Statistical Software, 48(2), 1. Foundation for Open Access Statistic.
    Crossref OpenAlex OpenCitations
  11. Audrey F. Burgess , Steven E. Gutstein (2007). Quality of Life for People with Autism: Raising the Standard for Evaluating Successful Outcomes . Child and Adolescent Mental Health, 12(2), 80-86. Wiley.
    Crossref OpenAlex OpenCitations
  12. Wen-Hung Chen , David Thissen (1997). Local Dependence Indexes for Item Pairs Using Item Response Theory . Journal of Educational and Behavioral Statistics, 22(3), 265-289. American Educational Research Association (AERA).
    Crossref OpenAlex OpenCitations
  13. R. Philip Chalmers (2012). mirt: A Multidimensional Item Response Theory Package for the R Environment . Journal of Statistical Software, 48(6). Foundation for Open Access Statistic.
    Crossref OpenAlex OpenCitations
  14. Cai L. &Monroe S. (2014). A new statistic for evaluating item response theory models for ordinal data(CRESST Report 839; pp. 1–28). University of California National Center for Research on Evaluation Standards and Student Testing (CRESST). https://eric.ed.gov/?id=ED555726
    Type: Other
    Crossref
  15. Guang Yong Zou (2007). Toward using confidence intervals to compare correlations. Psychological Methods, 12(4), 399-413. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  16. Mengyang Cao , Louis Tay , Yaowu Liu (2017). A Monte Carlo Study of an Iterative Wald Test Procedure for DIF Analysis . Educational and Psychological Measurement, 77(1), 104-118. SAGE Publications.
    Crossref OpenAlex OpenCitations
  17. David Felce , Jonathan Perry (1995). Quality of life: Its definition and measurement . Research in Developmental Disabilities, 16(1), 51-74. Elsevier BV.
    Crossref OpenAlex OpenCitations
  18. The WHOQOL-Dis Group , M. J. Power , A. M. Green (2010). Development of the WHOQOL disabilities module . Quality of Life Research, 19(4), 571-584. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  19. Birk Diedenhofen , Jochen Musch (2015). cocor: A Comprehensive Solution for the Statistical Comparison of Correlations . PLOS ONE, 10(4), e0121945. Public Library of Science (PLoS).
    Crossref OpenAlex OpenCitations
  20. R. Philip Chalmers (2018). Numerical approximation of the observed information matrix with Oakes' identity . British Journal of Mathematical and Statistical Psychology, 71(3), 415-436. Wiley.
    Crossref OpenAlex OpenCitations
  21. H. Thielen , C. R. Gillebert (2019). Sensory sensitivity: Should we consider attention in addition to prediction? Cognitive Neuroscience, 10(3), 158-160. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  22. Benjamin B. Lahey (2009). Public health significance of neuroticism. American Psychologist, 64(4), 241-256. American Psychological Association (APA).
    Type: Article DOI: 10.1037/a0015309 OpenAlex: https://openalex.org/W1982330837
    Crossref OpenAlex OpenCitations
  23. Valentina Tesio , Marialaura Di Tella , Ada Ghiggia , Annunziata Romeo , Fabrizio Colonna , Enrico Fusaro et al. (2018). Alexithymia and Depression Affect Quality of Life in Patients With Chronic Pain: A Study on 205 Patients With Fibromyalgia . Frontiers in Psychology, 9, 442-442. Frontiers Media SA.
    Crossref OpenAlex OpenCitations
  24. Adam W. Meade (2010). A taxonomy of effect size measures for the differential functioning of items and scales. Journal of Applied Psychology, 95(4), 728-743. American Psychological Association (APA).
    Type: Article DOI: 10.1037/a0018966 OpenAlex: https://openalex.org/W1986031600
    Crossref OpenAlex OpenCitations
  25. Jacob Cohen (1994). The earth is round (p <.05). American Psychologist, 49(12), 997-1003. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  26. Harsha N. Perera , Zahra Izadikhah , Peter O’Connor , Peter McIlveen (2018). Resolving Dimensionality Problems With WHOQOL-BREF Item Responses . Assessment, 25(8), 1014-1025. SAGE Publications.
    Crossref OpenAlex OpenCitations
  27. Fumi Samejima (1968). ESTIMATION OF LATENT ABILITY USING A RESPONSE PATTERN OF GRADED SCORES1 . ETS Research Bulletin Series, 1968(1). Wiley.
    OpenAlex
  28. Constantino J. N. (2012). Social Responsiveness Scale Second Edition (SRS-2): Manual . Social Responsiveness Scale–Second edition (SRS-2): Manual.
    Type: Other
    Crossref
  29. Alberto Maydeu-Olivares , Harry Joe (2014). Assessing Approximate Fit in Categorical Data Analysis . Multivariate Behavioral Research, 49(4), 305-328. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  30. Herbert W. Marsh , Kit-Tai Hau , Zhonglin Wen (2004). In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings . Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320-341. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  31. Marie K. Deserno , Denny Borsboom , Sander Begeer , Joost A. Agelink van Rentergem , Kawita Mataw , Hilde M. Geurts (2019). Sleep determines quality of life in autistic adults: A longitudinal study . Autism Research, 12(5), 794-801. Wiley.
    Type: Article DOI: 10.1002/aur.2103 OpenAlex: https://openalex.org/W2938277715
    Crossref OpenAlex OpenCitations
  32. Daniel McNeish , Ji An , Gregory R. Hancock (2018). The Thorny Relation Between Measurement Quality and Fit Index Cutoffs in Latent Variable Models . Journal of Personality Assessment, 100(1), 43-52. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  33. Robert D. Gibbons , R. Darrell Bock , Donald Hedeker , David J. Weiss , Eisuke Segawa , Dulal K. Bhaumik et al. (2007). Full-Information Item Bifactor Analysis of Graded Response Data . Applied Psychological Measurement, 31(1), 4-19. SAGE Publications.
    Crossref OpenAlex OpenCitations
  34. Louise Edgington , Vivian Hill , Elizabeth Pellicano (2016). The design and implementation of a CBT-based intervention for sensory processing difficulties in adolescents on the autism spectrum . Research in Developmental Disabilities, 59, 221-233. Elsevier BV.
    Crossref OpenAlex OpenCitations
  35. Susan E. Embretson (1996). The new rules of measurement. Psychological Assessment, 8(4), 341-349. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  36. Yan Xia , Yanyun Yang (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods . Behavior Research Methods, 51(1), 409-428. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  37. Kurt Kroenke , Robert L. Spitzer , Janet B.W. Williams , Bernd Löwe (2010). The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review . General Hospital Psychiatry, 32(4), 345-359. Elsevier BV.
    Crossref OpenAlex OpenCitations
  38. Asnat Bar-Haim Erez , Eynat Gal (2020). Quality of life: A universal or a disability specific concept? Canadian Journal of Occupational Therapy, 87(1), 4-11. SAGE Publications.
    Crossref OpenAlex OpenCitations
  39. Shulamite A. Green , Emily T. Wood (2019). The role of regulation and attention in atypical sensory processing . Cognitive Neuroscience, 10(3), 160-162. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  40. Mirko Uljarević , Grace T. Baranek , Giacomo Vivanti , Darren Hedley , Kristelle Hudry , Alison E. Lane (2017). Heterogeneity of sensory features in autism spectrum disorder: Challenges and perspectives for future research . Autism Research, 10(5), 703-710. Wiley.
    Type: Article DOI: 10.1002/aur.1747 OpenAlex: https://openalex.org/W2611111199
    Crossref OpenAlex OpenCitations
  41. Karen Kuhlthau , Felice Orlich , Trevor A. Hall , Darryn Sikora , Erica A. Kovacs , Jennifer Delahaye et al. (2010). Health-Related Quality of Life in Children with Autism Spectrum Disorders: Results from the Autism Treatment Network . Journal of Autism and Developmental Disorders, 40(6), 721-729. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  42. Pamela Feliciano , Amy M. Daniels , LeeAnne Green Snyder , Amy Beaumont , Alexies Camba , Amy Esler et al. (2018). SPARK: A US Cohort of 50,000 Families to Accelerate Autism Research . Neuron, 97(3), 488-493. Elsevier BV.
    Crossref OpenAlex OpenCitations
  43. Steven K. Kapp *Autistic author. Learn more… (2018). Social Support, Well-being, and Quality of Life Among Individuals on the Autism Spectrum . Pediatrics, 141(Supplement_4), S362-S368. American Academy of Pediatrics (AAP).
    AutiHub · Autistic Scholars Crossref OpenAlex OpenCitations
  44. Lewis R. Goldberg , John A. Johnson , Herbert W. Eber , Robert Hogan , Michael C. Ashton , C. Robert Cloninger et al. (2006). The international personality item pool and the future of public-domain personality measures . Journal of Research in Personality, 40(1), 84-96. Elsevier BV.
    Crossref OpenAlex OpenCitations
  45. Fumiko Samejima (1969). Estimation of Latent Ability Using a Response Pattern of Graded Scores . Psychometrika, 34(S1), 1-97. Cambridge University Press (CUP).
    Crossref OpenAlex OpenCitations
  46. Laura Graham Holmes , Casey J. Zampella , Caitlin Clements , Joseph P. McCleery , Brenna B. Maddox , Julia Parish‐Morris et al. (2020). A Lifespan Approach to Patient‐Reported Outcomes and Quality of Life for People on the Autism Spectrum . Autism Research, 13(6), 970-987. Wiley.
    Type: Article DOI: 10.1002/aur.2275 OpenAlex: https://openalex.org/W3012300037
    Crossref OpenAlex OpenCitations
  47. Kristian E. Markon (2019). Bifactor and Hierarchical Models: Specification, Inference, and Interpretation . Annual Review of Clinical Psychology, 15(1), 51-69. Annual Reviews.
    Crossref OpenAlex OpenCitations
  48. Robert J. Vandenberg , Charles E. Lance (2000). A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research . Organizational Research Methods, 3(1), 4-70. SAGE Publications.
    Crossref OpenAlex OpenCitations
  49. Milad Karimi , John Brazier (2016). Health, Health-Related Quality of Life, and Quality of Life: What is the Difference? PharmacoEconomics, 34(7), 645-649. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  50. Willem E. Saris , Albert Satorra , William M. van der Veld (2009). Testing Structural Equation Models or Detection of Misspecifications? Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 561-582. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  51. So Yoon Kim , Kristen Bottema‐Beutel (2019). A meta regression analysis of quality of life correlates in adults with ASD . Research in Autism Spectrum Disorders, 63, 23-33. Elsevier BV.
    Crossref OpenAlex OpenCitations
  52. T. A. M. McDonald (2017). Discriminative and Criterion Validity of the Autism Spectrum Identity Scale (ASIS) . Journal of Autism and Developmental Disorders, 47(10), 3018-3028. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  53. Barbara FC van Heijst , Hilde M. Geurts (2015). Quality of life in autism across the lifespan: A meta-analysis . Autism, 19(2), 158-167. SAGE Publications.
    Crossref OpenAlex OpenCitations
  54. The Whoqol Group (1998). The World Health Organization quality of life assessment (WHOQOL): Development and general psychometric properties . Social Science & Medicine, 46(12), 1569-1585. Elsevier BV.
    Crossref OpenAlex OpenCitations
  55. Alberto Maydeu-Olivares (2017). Assessing the Size of Model Misfit in Structural Equation Models . Psychometrika, 82(3), 533-558. Cambridge University Press (CUP).
    Crossref OpenAlex OpenCitations
  56. Ling-Yi Lin , Pai-Chuan Huang (2019). Quality of life and its related factors for adults with autism spectrum disorder . Disability and Rehabilitation, 41(8), 896-903. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  57. Helen McConachie , Colin Wilson , David Mason , Deborah Garland , Jeremy R. Parr , Alexia Rattazzi et al. (2020). What Is Important in Measuring Quality of Life? Reflections by Autistic Adults in Four Countries . Autism in Adulthood, 2(1), 4-12. SAGE Publications.
    Crossref OpenAlex OpenCitations
  58. Zachary J. Williams *Autistic author. Learn more… , Katherine Gotham (2021). Current and Lifetime Somatic Symptom Burden Among Transition-aged Autistic Young Adults . medRxiv. openRxiv.
    Crossref OpenAlex OpenCitations
  59. THE WHOQOL GROUP (1998). Development of the World Health Organization WHOQOL-BREF Quality of Life Assessment . Psychological Medicine, 28(3), 551-558. Cambridge University Press (CUP).
    Crossref OpenAlex OpenCitations
  60. Li Cai , Scott Monroe (2014). A New Statistic for Evaluating Item Response Theory Models for Ordinal Data. CRESST Report 839. National Center for Research on Evaluation, Standards, and Student Testing.
    Type: Article OpenAlex: https://openalex.org/W2468619180
    OpenAlex
  61. Victoria Savalei (2021). Improving Fit Indices in Structural Equation Modeling with Categorical Data . Multivariate Behavioral Research, 56(3), 390-407. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  62. Jelte M. Wicherts (2016). The importance of measurement invariance in neurocognitive ability testing . The Clinical Neuropsychologist, 30(7), 1006-1016. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  63. Helen McConachie , David Mason , Jeremy R. Parr , Deborah Garland , Colin Wilson , Jacqui Rodgers (2018). Enhancing the Validity of a Quality of Life Measure for Autistic People . Journal of Autism and Developmental Disorders, 48(5), 1596-1611. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  64. Angela M. Stover , Lori D. McLeod , Michelle M. Langer , Wen-Hung Chen , Bryce B. Reeve (2019). State of the psychometric methods: patient-reported outcome measure development and refinement using item response theory . Journal of Patient-Reported Outcomes, 3(1), 50-50. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  65. Michael D. Toland , Isabella Sulis , Francesca Giambona , Mariano Porcu , Jonathan M. Campbell (2017). Introduction to bifactor polytomous item response theory analysis . Journal of School Psychology, 60, 41-63. Elsevier BV.
    Crossref OpenAlex OpenCitations
  66. Joshua N. Pritikin (2017). A comparison of parameter covariance estimation methods for item response models in an expectation-maximization framework . Cogent Psychology, 4(1), 1279435. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  67. Bethany F. Oakley , Julian Tillmann , Jumana Ahmad , Daisy Crawley , Antonia San José Cáceres , Rosemary Holt et al. (2021). How do core autism traits and associated symptoms relate to quality of life? Findings from the Longitudinal European Autism Project . Autism, 25(2), 389-404. SAGE Publications.
    Crossref OpenAlex OpenCitations
  68. Dexin Shi , Alberto Maydeu-Olivares , Yves Rosseel (2020). Assessing Fit in Ordinal Factor Analysis Models: SRMR vs. RMSEA . Structural Equation Modeling: A Multidisciplinary Journal, 27(1), 1-15. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  69. Williams Z. J. (2021).irt_extra: Additional functions to supplement the mirt R package[R]. https://www.researchgate.net/publication/340846037_irt_extra_Additional_Functions_to_Supplement_the_mirt_R_Package
    Type: Other
    Crossref