Interrater Reliability of Early Childhood Education Professionals Involved in Developmental Surveillance for Autism Spectrum Disorder and Related Conditions

This publication is included in the Autistic Autism Scholarship Project. one author of this publication is identified as autistic in the project.

About the autistic author marker

Mozolic-Staunton, B., Donelly, M., Yoxall, J., & Barbaro, J. (2017). Interrater Reliability of Early Childhood Education Professionals Involved in Developmental Surveillance for Autism Spectrum Disorder and Related Conditions. Australasian Journal of Early Childhood, 42(2), 61-68. https://doi.org/10.23965/ajec.42.2.08

Publication date: 1 Jun 2017 Added to AutiHub: 7 Sep 2026 Type: Article Article language: English

This publication is integrated into AutiHub through:

Authors

Publication authors
4
Publication authors identified as autistic
1 / 4 (25.0%)

Abstract

VALID AND RELIABLE TOOLS have recently been developed to accurately detect early signs of Autism Spectrum Disorder (ASD) and other developmental challenges in children as young as 12 months of age. Translation of research findings to practice and policy through routine implementation of evidence-based tools in the community, particularly early childhood education and childcare settings, is limited. This study establishes that the interrater reliability (IRR) of early childhood educators in administering the Social Attention and Communication Surveillance System (SACS-R) is very high (k = 0.909). This paper reports the results of the first step in the Right Kids, Right Time, Right Services project—a prospective cohort study that aims to implement and evaluate routine developmental surveillance for early signs of social and communication challenges in young children in childcare settings.

Bibliography cited by this reference

Cited references are imported from external metadata sources when they are available. The list may be partial.

Cited bibliography overview

These indicators describe the bibliography cited by this publication. An author name is counted each time it appears in one cited reference, so the same person can be counted more than once. Names not yet linked to an author already present in AutiHub are treated as unknown, not as non-autistic. Last computed: 12 Sep 2026 17:55.

Cited references
72
With a DOI
39
Without a DOI, from raw bibliography text
31
3 / 72 (4.2%) cited references include at least one author identified as autistic.
References with data to complete
24 / 72 (33.3%)
References with detected author names
49 / 72 (68.1%)
Without detected author names
23
Without a structured title
21
Without a stable identifier
31
References with raw author names still to review
21
References with external metadata lookup issues
0
These indicators apply to cited references displayed on this page, after technical duplicates have been merged. A reference without a DOI can still support author statistics when a title and author names are available.
Author names detected in the cited bibliography
178
From DOI or external metadata
178
From validated raw bibliography text
0
Raw names already validated
0
Raw names still to review
42
44 / 178 (24.7%) names are linked to an author already present in AutiHub. 134 / 178 (75.3%) names are not yet linked.
Names linked to a person identified as autistic
3 / 178 (1.7%)
Calculated across all author names detected in the cited bibliography. Among names linked to an author already present in AutiHub: 3 / 44 (6.8%). Distinct people identified as autistic: 1 / 160 (0.6%).
  1. Mary Anne McLean , Donald B. Bailey , Mark Wolery (1996). Assessing Infants and Preschoolers with Special Needs .
    Type: Book OpenAlex: https://openalex.org/W578459138
    OpenAlex
  2. American Psychiatric Association. (1994). Diagnostic and Statistical Manual of Mental Disorders . Diagnostic and Statistical Manual of Mental Disorders.
    Type: Other
    Crossref
  3. González Moreno, Andrés Santiago (2013). Diagnostic and Statistical Manual of Mental Disorders . American Psychiatric Association.
    Crossref OpenAlex OpenCitations
  4. (2002). Foundations of Clinical Research: Applications to Practice, . Survey of Ophthalmology, 47(6), 598. Elsevier BV.
    OpenAlex
  5. Tony Charman (2003). Screening and Surveillance for Autism Spectrum Disorder in Research and Practice . Early Child Development and Care, 173(4), 363-374. Informa UK Limited.
    Crossref OpenAlex OpenCitations
  6. Catherine Litchfield , Keri Chater (2008). Can I do everything? time management in neonatal unit . Australian Journal of Advanced Nursing, 25(2). Australian Nursing and Midwifery Federation.
    OpenAlex
  7. Armstrong M. F. (2008). bibr3-AJEC. 42. 2. 08 Australian Journal of Advanced Nursing, 25(3), 36.
    Type: Other
    Crossref
  8. Marshalyn Yeargin‐Allsopp , Coleen Boyle (2002). Overview: The epidemiology of neurodevelopmental disorders . Mental Retardation and Developmental Disabilities Research Reviews, 8(3), 113-116. Wiley.
    Crossref OpenAlex OpenCitations
  9. Australian Bureau of Statistics (ABS). (2012). Autism in Australia. Retrieved from www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4428. 0Main+Features12012?OpenDocument.
    Type: Other
    Crossref
  10. Jan Kottner , Laurent Audige , Stig Brorson , Allan Donner , Byron J. Gajewski , Asbjørn Hróbjartsson et al. (2011). Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed . International Journal of Nursing Studies, 48(6), 661-671. Elsevier BV.
    Crossref OpenAlex OpenCitations
  11. Australian Government Department of Education Employment and Workplace Relations (DEEWR). (2009). Belonging, Being & Becoming: The Early Years Learning Framework for Australia. Canberra, ACT: Commonwealth of Australia. https://docs.education.gov.au/system/files/doc/other/belonging_being_and_becoming_the_early_years_learning_framework_for_australia.pdf .
    Type: Other
    Crossref
  12. Council on Children With Disabilities , Section on Developmental Behavioral Pediatrics , Bright Futures Steering Committee , Medical Home Initiatives for Children With Special Needs Project Advisory Committee (2006). Identifying Infants and Young Children With Developmental Disorders in the Medical Home: An Algorithm for Developmental Surveillance and Screening . Pediatrics, 118(1), 405-420. American Academy of Pediatrics (AAP).
    Crossref OpenAlex OpenCitations
  13. Sara Jane Webb , Emily JH Jones , Jean Kelly , Géraldine Dawson (2014). The motivation for very early intervention for infants at high risk for autism spectrum disorders . International Journal of Speech-Language Pathology, 16(1), 36-42. Informa UK Limited.
    OpenAlex
  14. BaileyD. B., HebbelerK., ScarboroughA., SpikerD. & MallikS. (2004). First experiences with early intervention: A national perspective. Pediatrics, 113(4), 887–896. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-1842481946&partnerID=40&md5=94522adae89df112a6fb0d93014cde8b.
    Type: Other
    Crossref
  15. Marjolaine M. Limbos , David P. Joyce (2011). Comparison of the ASQ and PEDS in Screening for Developmental Delay in Children Presenting for Primary Care . Journal of Developmental & Behavioral Pediatrics, 32(7), 499-511. Ovid Technologies (Wolters Kluwer Health).
    Crossref OpenAlex OpenCitations
  16. BaioJ. (2012). Prevalence of autism spectrum disorders—Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. Morbidity and Mortality Weekly Report, 61(SS-3), 1–19. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-84859394070&partnerID=40&md5=91d81545fcd52d631021b568a07802ac.
    Type: Other
    Crossref
  17. Jacob Cohen (1960). A Coefficient of Agreement for Nominal Scales . Educational and Psychological Measurement, 20(1), 37-46. SAGE Publications.
    Crossref OpenAlex OpenCitations
  18. Tracy M. King , Frances P. Glascoe (2003). Developmental surveillance of infants and young children in pediatric primary care . Current Opinion in Pediatrics, 15(6), 624-629. Ovid Technologies (Wolters Kluwer Health).
    OpenAlex
  19. (2011). Trends in the Prevalence of Developmental Disabilities in US Children, 1997-2008 . PEDIATRICS, 127(6), peds.2010-2989d-peds.2010-2989d. American Academy of Pediatrics (AAP).
    Crossref OpenAlex OpenCitations
  20. Diane Branson , Debra C. Vigil , Ann Bingham (2008). Community Childcare Providers’ Role in the Early Detection of Autism Spectrum Disorders . Early Childhood Education Journal, 35(6), 523-530. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  21. Sally J. Rogers , Laurie A. Vismara (2008). Evidence-Based Comprehensive Treatments for Early Autism . Journal of Clinical Child & Adolescent Psychology, 37(1), 8-38. Informa UK Limited.
    OpenAlex
  22. Iris J. Oosterling , Michel Wensing , Sophie H. Swinkels , Rutger Jan Van Der Gaag , Janne C. Visser , Tim Woudenberg et al. (2010). Advancing early detection of autism spectrum disorder by applying an integrated two‐stage screening approach . Journal of Child Psychology and Psychiatry, 51(3), 250-258. Wiley.
    Crossref OpenAlex OpenCitations
  23. Catherine Lord , Susan Risi , Pamela S. DiLavore , Cory Shulman , Audrey Thurm , Andrew Pickles (2006). Autism From 2 to 9 Years of Age . Archives of General Psychiatry, 63(6), 694. American Medical Association (AMA).
    Crossref OpenAlex OpenCitations
  24. Centers for Disease Control and Prevention. (2014). Prevalence of autism spectrum disorder among children aged 8 years—Autism and Developmental Diabilities Monitoring Network, 11 sites, Unites States, 2010. Morbidity and Mortality Weekly Report, 63(2), 1–22. Retrieved from www.cdc.gov/mmwr/pdf/ss/ss6302.pdf.
    Type: Other
    Crossref
  25. Lonnie Zwaigenbaum , Susan Bryson , Nancy Garon (2013). Early identification of autism spectrum disorders . Behavioural Brain Research, 251(0), 133-146. Elsevier BV.
    Crossref OpenAlex OpenCitations
  26. Suniti Chakrabarti , Éric Fombonne (2005). Pervasive Developmental Disorders in Preschool Children: Confirmation of High Prevalence . American Journal of Psychiatry, 162(6), 1133-1141. American Psychiatric Association Publishing.
    Crossref OpenAlex OpenCitations
  27. Frances Page Glascoe (2005). Screening for developmental and behavioral problems . Mental Retardation and Developmental Disabilities Research Reviews, 11(3), 173-179. Wiley.
    Crossref OpenAlex OpenCitations
  28. Jennifer A. Pinto-Martin , Margaret Dunkle , Marian Earls , Dane Fliedner , Cynthia Landes (2005). Developmental Stages of Developmental Screening: Steps to Implementation of a Successful Program . American Journal of Public Health, 95(11), 1928-1932. American Public Health Association.
    Crossref OpenAlex OpenCitations
  29. Tony Charman (2006). Social and communication development in autism spectrum disorders . Social and communication development in autism spectrum disorders, 63.
    Type: Other
    Crossref
  30. Carly Veness , Margot Prior , Edith Bavin , Patricia Eadie , Eileen Cini , Sheena Reilly (2012). Early indicators of autism spectrum disorders at 12 and 24 months of age: A prospective, longitudinal comparative study . Autism, 16(2), 163-177. SAGE Publications.
    Crossref OpenAlex OpenCitations
  31. Frances Page Glascoe (2000). Early Detection of Developmental and Behavioral Problems . Pediatrics In Review, 21(8), 272-280. American Academy of Pediatrics (AAP).
    OpenAlex
  32. Géraldine Dawson (2008). Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder . Development and Psychopathology, 20(3), 775-803. Cambridge University Press (CUP).
    Crossref OpenAlex OpenCitations
  33. Judith Pinborough‐Zimmerman , Deborah Bilder , Amanda Bakian , Robert Satterfield , Paul S. Carbone , Barry E. Nangle et al. (2011). Sociodemographic risk factors associated with autism spectrum disorders and intellectual disability . Autism Research, 4(6), 438-448. Wiley.
    Type: Article DOI: 10.1002/aur.224 OpenAlex: https://openalex.org/W2094675182
    Crossref OpenAlex OpenCitations
  34. Cooperative Research Centre for Living with Autism Spectrum Disorders (Autism CRC). (2014). Annual Report 2013–2014. Annual Report 2013–2014..
    Type: Other
    Crossref
  35. Mieke Dereu , Petra Warreyn , Ruth Raymaekers , Mieke Meirsschaut , Griet Pattyn , Inge Schietecatte et al. (2010). Screening for Autism Spectrum Disorders in Flemish Day-Care Centres with the Checklist for Early Signs of Developmental Disorders . Journal of Autism and Developmental Disorders, 40(10), 1247-1258. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  36. Council of Australian Governments (COAG). (2009). Regulation Impact Statement for Early Childhood Education and Care Quality Reforms. Canberra, ACT: Australian Government. http://ncac.acecqa.gov.au/reports/report-documents/NCAC%20response%20to%20RIS.pdf .
    Type: Other
    Crossref
  37. Lonnie Zwaigenbaum , Susan Bryson , Catherine Lord , Sally J. Rogers , Alice Carter , Leslie Carver et al. (2009). Clinical assessment and management of toddlers with suspected autism spectrum disorder: insights from studies of high-risk infants. Pediatrics, 123(5), 1383. American Academy of Pediatrics (AAP).
    OpenAlex
  38. Lonnie Zwaigenbaum , Margaret Bauman , Wendy L. Stone , Nurit Yirmiya , Annette Estes , Robin L. Hansen et al. (2015). Early Identification of Autism Spectrum Disorder: Recommendations for Practice and Research . Pediatrics, 136(Supplement_1), S10-S40. American Academy of Pediatrics (AAP).
    Crossref OpenAlex OpenCitations
  39. DawsonG., RogersS., MunsonJ., SmithM., WinterJ., GreensonJ. … VarleyJ. (2010). Randomized, controlled trial of an intervention for toddlers with autism: The early start Denver model. Pediatrics, 125(1), e17–e23. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-74049153754&partnerID=40&md5=219677c9035e071f860a458c55c7e711.
    Type: Other
    Crossref
  40. DAVID S. MANDELL , Richard F. Ittenbach , Susan E. Levy , Jennifer A. Pinto-Martin (2007). Disparities in Diagnoses Received Prior to a Diagnosis of Autism Spectrum Disorder . Journal of Autism and Developmental Disorders, 37(9), 1795-1802. Springer Science and Business Media LLC.
    Crossref OpenAlex OpenCitations
  41. Department of Education and Training (DET). (2016). Australian early development census national report 2015. Retrieved from www.aedc.gov.au/resources/detail/2015-aedc-national-report.
    Type: Other
    Crossref
  42. Kapil Sayal (2006). Annotation: Pathways to care for children with mental health problems . Journal of Child Psychology and Psychiatry, 47(7), 649-659. Wiley.
    OpenAlex
  43. GargP., LillystoneD., DossetorD., KeffordC. & ChongS. (2014). An exploratory survey for understanding perceptions, knowledge and educational needs of general practitioners regarding autistic disorders in NSW, Australia. Journal of Clinical and Diagnostic Research, 8(7), PC01–PC09. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-84904809746&partnerID=40&md5=8656ae3ac429dba000ada4a62ccc92d9.
    Type: Other
    Crossref
  44. Chris Plauché Johnson , Scott M. Myers , and the Council on Children With Disabilities (2007). Identification and Evaluation of Children With Autism Spectrum Disorders . Pediatrics, 120(5), 1183-1215. American Academy of Pediatrics (AAP).
    Crossref OpenAlex OpenCitations
  45. GlascoeF. P. (2000). Early detection of developmental and behavioral problems. Pediatrics in Review, 21(8), 272–279; quiz 280. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-0034241396&partnerID=40&md5=75acd5e19ff6d18860d0852610410bc8.
    Type: Other
    Crossref
  46. Margot Prior , Jacqueline Roberts , Sylvia Rodger , Katrina Williams , Rebecca Sutherland (2011). A Review of the Research to Identify the Most Effective Models of Practice in Early Intervention for Children with Autism Spectrum Disorders . PsycEXTRA Dataset. American Psychological Association (APA).
    Crossref OpenAlex OpenCitations
  47. Patricia Howlin , Iliana Magiati , Tony Charman (2009). Systematic Review of Early Intensive Behavioral Interventions for Children With Autism . American Journal on Intellectual and Developmental Disabilities, 114(1), 23-41. Informa UK Limited.
    OpenAlex
  48. Gold Coast Medicare Local. (2012). Gold Coast health and wellbeing plan. Gold Coast health and wellbeing plan..
    Type: Other
    Crossref
  49. Géraldine Dawson , Sally J. Rogers , Jeffrey Munson , Milani Smith , Jamie Winter , Jessica Greenson et al. (2010). Randomized, Controlled Trial of an Intervention for Toddlers With Autism: The Early Start Denver Model . Pediatrics, 125(1), e17-e23. American Academy of Pediatrics (AAP).
    OpenAlex
  50. HowlinP., MagiatiL. & CharmanT. (2009). Systematic review of early intensive behavioral interventions for children with autism. American Journal on Intellectual and Developmental Disabilities, 114(1), 23–41. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-64949112889&partnerID=40&md5=e9fb1ec1bf28074b81c714d348627252.
    Type: Other
    Crossref
  51. Kellett M. (2011). Centre for Children and Young People Background Briefing Series, No. 3. Centre for Children and Young People Background Briefing Series, No. 3..
    Type: Other
    Crossref
  52. KingT. M. & GlascoeF. P. (2003). Developmental surveillance of infants and young children in pediatric primary care. Current Opinion in Pediatrics, 15(6), 624–629. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-0345687433&partnerID=40&md5=d0dd5fc4207a0e15248bc7bb976a63d8.
    Type: Other
    Crossref
  53. Donald B. Bailey , Kathleen Hebbeler , Anita Scarborough , Donna Spiker , Sangeeta Mallik (2004). First Experiences With Early Intervention: A National Perspective . Pediatrics, 113(4), 887-896. American Academy of Pediatrics (AAP).
    OpenAlex
  54. Kraemer H. C. (1992). Evaluating medical tests. Objective and quantitative guidelines. Evaluating medical tests. Objective and quantitative guidelines..
    Type: Other
    Crossref
  55. Carol M. Trivette , Carl J. Dunst , Deborah W. Hamby (2004). Sources of Variation in Consequences of Everyday Activity Settings on Child and Parent Functioning. Perspectives in Education, 22(2), 17-36.
    Type: Article OpenAlex: https://openalex.org/W2711473441
    OpenAlex
  56. McLean M. (2004). Assessing infants and preschoolers with special needs . Assessing infants and preschoolers with special needs, 100.
    Type: Other
    Crossref
  57. Scott L. Traub (1993). Evaluating Medical Tests: Objective and Quantitative Guidelines . American Journal of Health-System Pharmacy, 50(11), 2440-2443. Oxford University Press (OUP).
    OpenAlex
  58. Moore T. (2008). Best practice guidelines for parental involvement in monitoring and assessing young children. Best practice guidelines for parental involvement in monitoring and assessing young children..
    Type: Other
    Crossref
  59. (2020). Australian Journal of Advanced Nursing . Australian journal of advanced nursing. Australian Nursing and Midwifery Federation.
    Type: Other DOI: 10.37464/2020 OpenAlex: https://openalex.org/W4234509554
    OpenAlex
  60. National Association for the Education of Young Children (NAEYC). (2009). Where we stand on curriculum, assessment, and program evaluation. Where we stand on curriculum, assessment, and program evaluation..
    Type: Other
    Crossref
  61. Olga Tennison Autism Research Centre. (2015). Advances in early detection of Autism. Retrieved 20 January, 2015, from www.latrobe.edu.au/otarc/researchers/early-detection-research.
    Type: Other
    Crossref
  62. Portney L. (2009). Foundations of clinical research: applications to practice . Foundations of clinical research: applications to practice.
    Type: Other
    Crossref
  63. RogersS. J. & VismaraL. A. (2008). Evidence-based comprehensive treatments for early autism. Journal of Clinical Child and Adolescent Psychology, 37(1), 8–38. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-42549130526&partnerID=40&md5=090fd92d0c8b99411cf4412dbc5bea63.
    Type: Other
    Crossref
  64. SayalK. (2006). Annotation: Pathways to care for children with mental health problems. Journal of Child Psychology and Psychiatry and Allied Disciplines, 47(7), 649–659. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-33745033300&partnerID=40&md5=a53be690460931207a4f7a92ee1c1521.
    Type: Other
    Crossref
  65. TrivetteC. M., DunstC. & HambyD. (2004). Sources of variation in consequences of everyday activity settings on child and parent functioning. Perspectives in Education, 22(2), 17–35. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-4043111376&partnerID=40&md5=dfaba88c0385301ef714a0ace2808164.
    Type: Other
    Crossref
  66. United States Department of Health and Human Services. (2014). Maternal, infant and child health—Objectives: Morbidity and mortality. Healthy People 2020. Washington, DC: United States Department of Health and Human Services. Retrieved 18 January, 2016, from www.healthypeople.gov/node/3492/objectives#4873.
    Type: Other
    Crossref
  67. WebbS. J. & JonesE. J. H. (2009). Early identification of autism: Early characteristics, onset of symptoms, and diagnostic stability. Infants and Young Children, 22(2), 100–118. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-68549127118&partnerID=40&md5=b71f7f09e0603b04fbaa4d88f5158eab.
    Type: Other
    Crossref
  68. WebbS. J., JonesE. J. H., KellyJ. & DawsonG. (2014). The motivation for very early intervention for infants at high risk for autism spectrum disorders. International Journal of Speech-Language Pathology, 16(1), 36–42. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-84892575644&partnerID=40&md5=a02a08753a405f570a58b7de497c0ad6.
    Type: Other
    Crossref
  69. ZwaigenbaumL., BrysonS., LordC., RogersS., CarterA., CarverL. … YirmiyaN. (2009). Clinical assessment and management of toddlers with suspected autism spectrum disorder: Insights from studies of high-risk infants. Pediatrics, 123(5), 1383–1391. Retrieved from www.scopus.com/inward/record.url?eid=2-s2. 0-66049107663&partnerID=40&md5=bae10b705e178c47142763d78faa6da8.
    Type: Other
    Crossref