Validity of Self-Reports Provided by People With Autism Spectrum Disorder Without Intellectual Disability: A Meta-Analysis
Abstract
Background: Literature collects that people with Autism Spectrum Disorder without Intellectual Disability (ASD-noID) frequently suffer co-occurring clinical problems that predict poorer adult outcome and reduce quality of life (QoL). Previous studies pose doubts about their capacity to recognize and communicate these problems, but that is an issue that, although relevant, has not yet been systematically revised. Method: A meta-analysis on 32 studies (1422 pairs of participants) was carried out to assess to what extent self-reports provided by people with ASD-noID match those provided by their parents. The articles were categorized according to the domains assessed and method. Results: Significant differences between self- and hetero-reports were found in the domains of Depression, QoL and Social skills (d= 0.406; -0.399 and -0.683, respectively), but not in Anxiety and Social anxiety. The average degree of agreement between both groups of reports was r = .40. Conclusions: Self- and hetero-reports do not provide interchangeable results on the problems of people with ASD-noID. However, a general inability to validate self-reporting cannot be attributed to them. Deeper analysis is necessary to allow to optimize the use of self-reports in this population with both clinical and research purposes.
Downloads
References
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213. https://doi.org/10.1037/0033-2909.101.2.213
Adams, R. E., Fredstrom, B. K., Duncan, A. W., Holleb, L. J., & Bishop, S. L. (2014). Using self-and parent-reports to test the association between peer victimization and internalizing symptoms in verbally fluent adolescents with ASD. Journal of Autism and Developmental Disorders, 44(4), 861-872. https://doi.org/10.1007/s10803-013-1938-0
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5ª ed.). https://doi.org/10.1176/appi.books.9780890425596
Andrés, P. J. A., Odriozola, E. E., & de Corral Gargallo, P. (2003). Autoinformes y entrevistas en el ámbito de la psicología clínica forense: limitaciones y nuevas perspectivas. Análisis y Modificación de Conducta, 29(126), 503-522. https://dialnet.unirioja.es/servlet/articulo?codigo=761627
Atwood, T. (2000). Strategies for improving the social integration of children with Asperger syndrome. Autism, 4(1), 85–100. https://psycnet.apa.org/doi/10.1177/1362361300004001006
Autor.
Ben Sasson, A., Gal, E., Fluss, R., Katz Zetler, N. & Cermak, S. (2019). Update of a Meta analysis of Sensory Symptoms in ASD: A New Decade of Research. Journal of Autism and Developmental Disorders, 49, 4974–4996. https://doi.org/10.1007/s10803-019-04180-0
Bergman, M. A., Schene, A. H., Vissers, C. T. W., Vrijsen, J. N., Kan, C. C., & van Oostrom, I. (2020). Systematic review of cognitive biases in autism spectrum disorders: A neuropsychological framework towards an understanding of the high prevalence of co-occurring depression. Research in Autism Spectrum Disorders, 69, 101455. https://doi.org/10.1016/j.rasd.2019.101455
Bitsika, V., & Sharpley, C. F. (2014). Variation in the profile of anxiety disorders in boys with an ASD according to method and source of assessment. Journal of Autism and Developmental Disorders, 45(6), 1825-1835. https://doi.org/10.1007/s10803-014-2343-z
Blakeley-Smith, A., Reaven, J., Ridge, K., & Hepburn, S. (2012). Parent–child agreement of anxiety symptoms in youth with autism spectrum disorders. Research in Autism Spectrum Disorders, 6(2), 707-716. https://doi.org/10.1016/j.rasd.2011.07.020
Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1, 97–111. https://doi.org/10.1002/jrsm.12
Autor.
Catino, E., Perroni, G., Di Trani, M., Alfonsi, C., Chiarotti, F., & Cardona, F. (2019). Application of the Scale for the Assessment of Feeding Interaction (SVIA) to Children with Autism Spectrum Disorder. Frontiers in Psychiatry, 10, 529. https://doi.org/10.3389/fpsyt.2019.00529
Chalfant, A. M., Rapee, R., & Carroll, L. (2007). Treating anxiety disorders in children with high functioning autism spectrum disorders: A controlled trial. Journal of Autism and Developmental Disorders, 37(10), 1842-1857. https://doi.org/10.1007/s10803-006-0318-4
Cohrs, A. C., & Leslie, D. L. (2017). Depression in parents of children diagnosed with autism spectrum disorder: A claims-based analysis. Journal of Autism and Developmental Disorders, 47(5), 1416-1422. https://doi.org/10.1007/s10803-017-3063-y
Elsabbagh, M., Divan, G., Koh, Y.-J., Kim, Y.-S., Kauchali, S., Marcín, C., Montiel-Nava, C., Patel, V., Paula, C.S., Wang, Ch., Yasamy, M.T. & Fombonne, E. (2012). Global Prevalence of Autism and Other Pervasive Developmental Disorders. Autism Research, 5, 160–179. https://doi.org/10.1002/aur.239
Farley, A., López, B., & Saunders, G. (2010). Self-conceptualisation in autism: Knowing oneself versus knowing self-through-other. Autism, 14(5), 519-530. https://doi.org/10.1177/1362361310368536
Farrugia, S., & Hudson, J. (2006). Anxiety in adolescents with Asperger syndrome: Negative thoughts, behavioral problems, and life interference. Focus on Autism and Other Developmental Disabilities, 21(1), 25-35. https://doi.org/10.1177/10883576060210010401
Fortea-Sevilla, M. S., Escandell-Bermúdez, M. O., Castro-Sánchez, J. J., & Martos-Pérez, J. (2016). Valoración de la ansiedad en los trastornos del espectro autista y en el trastorno por déficit de atención/hiperactividad. Revista de Neurología, 62(Supl 1), S99-102. https://doi.org/10.33588/rn.62S01.2015528
Graham Holmes, L., Zampella, C., Clements, C., McCleery, J., Maddox, B., Parish-Morris, J., Udhnani, M., Schultz, R. & Miller, J. (2020). A Lifespan Approach to Patient-Reported Outcomes and Quality of Life for People on the Autism Spectrum. Autism Research, 13, 970–987. https://doi.org/10.1002/aur.2275
Gillott, A., Furniss, F., & Walter, A. (2001). Anxiety in high-functioning children with autism. Autism, 5(3), 277-286. https://doi.org/10.1177/1362361301005003005
Guerrera, S., Menghini, D., Napoli, E., Di Vara, S., Valeri, G., & Vicari, S. (2019). Assessment of Psychopathological Comorbidities in Children and Adolescents with Autism Spectrum Disorder using the Child Behavior Checklist. Frontiers in Psychiatry, 10, 535. https://doi.org/10.3389/fpsyt.2019.00535
Hayes, S. A., & Watson, S. L. (2013). The impact of parenting stress: A meta-analysis of studies comparing the experience of parenting stress in parents of children with and without autism spectrum disorder. Journal of Autism and Developmental Disorders, 43(3), 629-642. https://doi.org/10.1007/s10803-012-1604-y
Hedges, L.V. & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
Autor.
Hurtig, T., Kuusikko, S., Mattila, M. L., Haapsamo, H., Ebeling, H., Jussila, K., ... & Moilanen, I. (2009). Multi-informant reports of psychiatric symptoms among high-functioning adolescents with Asperger syndrome or autism. Autism, 13(6), 583-598. https://doi.org/10.1177/1362361309335719
Jennes-Coussens, M., Magill-Evans, J. & Koning, C. (2006). The quality of life of young men with Asperger syndrome: A brief report. Autism 10(4), 403-414. https://journals.sagepub.com/doi/abs/10.1177/1362361306064432.
Kaat, A. J., & Lecavalier, L. (2015). Reliability and validity of parent-and child-rated anxiety measures in autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(10), 3219-3231. https://doi.org/10.1007/s10803-015-2481-y
Kinnaird, E., Stewart, C., & Tchanturia, K. (). Investigating alexithymia in autism: A systematic review and meta-analysis. European Psychiatry, 55, 80-89. http://dx.doi.org/10.1016/j.eurpsy.2018.09.004
Knott, F., Dunlop, A. W., & Mackay, T. (2006). Living with ASD: How do children and their parents assess their difficulties with social interaction and understanding?. Autism, 10(6), 609-617. https://doi.org/10.1177/1362361306068510
Koning, C., & Magill-Evans, J. (2001). Social and language skills in adolescent boys with Asperger syndrome. Autism, 5(1), 23-36. https://doi.org/10.1177/1362361301005001003
Lipsey, M. W. (2009). Identifying interesting variables and analysis opportunities. In H. Cooper, L.V. Hedges & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis. 2nd edition (pp.147-158). Russell Sage Foundation.
Lopata, C., Toomey, J. A., Fox, J. D., Volker, M. A., Chow, S. Y., Thomeer, M. L., ... & Smerbeck, A. M. (2010). Anxiety and depression in children with HFASDs: Symptom levels and source differences. Journal of Abnormal Child Psychology, 38(6), 765-776. https://doi.org/10.1007/s10802-010-9406-1
Lugo-Marín, J., Magan-Maganto, M., Rivero-Santana, A., Cuellar-Pompa, L., Alviani, M., Jenaro-Rio, C., ... & Canal-Bedia, R. (2019). Prevalence of psychiatric disorders in adults with autism spectrum disorder: A systematic review and meta-analysis. Research in Autism Spectrum Disorders, 59, 22-33. https://doi.org/10.1016/j.rasd.2018.12.004
Matson, J. L. (Ed.). (2016). Handbook of assessment and diagnosis of autism spectrum disorder. Springer.
Mazefsky, C. A., Kao, J., & Oswald, D. P. (2011). Preliminary evidence suggesting caution in the use of psychiatric self-report measures with adolescents with high-functioning autism spectrum disorders. Research in Autism Spectrum Disorders, 5(1), 164-174. https://doi.org/10.1016/j.rasd.2010.03.006
Morris, S. B. & DeShon, R. P. (2002). Combining effect size estimates in meta-analysis with repeated measures and independent-group designs. Psychological Methods, 7, 105-125. https://doi.org/10.1037/1082-989X.7.1.105
Moss, P., Howlin, P., Savage, S., Bolton, P., & Rutter, M. (2015). Self and informant reports of mental health difficulties among adults with autism findings from a long-term follow-up study. Autism, 19(7), 832-841. https://doi.org/10.1177/1362361315585916
Nicpon, M. F., Doobay, A. F., & Assouline, S. G. (2010). Parent, teacher, and self perceptions of psychosocial functioning in intellectually gifted children and adolescents with autism spectrum disorder. Journal of Autism and Developmental Disorders, 40(8), 1028-1038. https://doi.org/10.1007/s10803-010-0952-8
Nylander, L., & Gillberg, C. (2001). Screening for autism spectrum disorders in adult psychiatric out‐patients: a preliminary report. Acta Psychiatrica Scandinavica, 103(6), 428-434. https://doi.org/10.1034/j.1600-0447.2001.00175.x
Oakley, B. F., Tillmann, J., Ahmad, J., Crawley, D., San José Cáceres, A., Holt, R., ... & Loth, E. (2021). How do core autism traits and associated symptoms relate to quality of life? Findings from the Longitudinal European Autism Project. Autism, 25(2), 389-404. https://doi.org/10.1177/1362361320959959
Orm, S., Øie, M. G., Fossum, I. N., Andersen, P. N., & Skogli, E. W. (2021). Declining trajectories of co-occurring psychopathology symptoms in Attention-Deficit/Hyperactivity disorder and Autism Spectrum Disorder: A 10-year longitudinal study. Frontiers in Psychiatry, 1774. https://doi.org/10.3389/fpsyt.2021.724759
Ozsivadjian, A., Hibberd, C., & Hollocks, M. J. (2014). Brief report: the use of self-report measures in young people with autism spectrum disorder to access symptoms of anxiety, depression and negative thoughts. Journal of Autism and Developmental Disorders, 44(4), 969-974. https://doi.org/10.1007/s10803-013-1937-1
Park, S. H., Demetriou, E. A., Pepper, K. L., Song, Y. J. C., Thomas, E. E., Hickie, I. B., ... & Guastella, A. J. (2019). Validation of the 36‐item and 12‐item self‐report World Health Organization Disability Assessment Schedule II (WHODAS‐II) in individuals with autism spectrum disorder. Autism Research, 12(7), 1101-1111. https://doi.org/10.1002/aur.2115
Paula, I., & Martos, J. (2009). Síndrome de Asperger y autismo de alto funcionamiento: comorbilidad con trastornos de ansiedad y del estado de ánimo. Revista de Neurología, 48(2), 31-34. https://doi.org/10.33588/rn.48S02.2008702
Paula, I. (2015). La ansiedad en el autismo: Comprenderla y tratarla. Alianza Editorial.
Pearl, A., Edwards, E. M., & Murray, M. J. (2016). Comparison of self-and other-report of symptoms of autism and comorbid psychopathology in adults with autism spectrum disorder. Contemporary Behavioral Health Care 2. https://doi.org/10.15761/CBHC.1000120
Pisula, E., Pudło, M., Słowińska, M., Kawa, R., Strząska, M., Banasiak, A., & Wolańczyk, T. (2017). Behavioral and emotional problems in high-functioning girls and boys with autism spectrum disorders: Parents’ reports and adolescents’ self-reports. Autism, 21(6), 738-748. https://doi.org/10.1177/1362361316675119
Piven, J., Palmer, P., Jacobi, D., Childress, D. & Arndt, S. (1997). Broader Autism Phenotype: Evidence from a family history study of multiple-incidence autism families. American Journal of Psychiatry, 154, 185-190. https://doi.org/10.1176/ajp.154.2.185
Posserud, M. B., Breivik, K., Gillberg, C., & Lundervold, A. J. (2013). ASSERT–The Autism Symptom Self-ReporT for adolescents and adults: Bifactor analysis and validation in a large adolescent population. Research in Developmental Disabilities, 34(12), 4495-4503. https://doi.org/10.1016/j.ridd.2013.09.032
Powell, A. (2002). Taking responsibility: Good practice guidelines for services-adults with Asperger syndrome. The National Autistic Society.
Prosperi, M., Turi, M., Guerrera, S., Napoli, E., Tancredi, R., Igliozzi, R., ... & Vicari, S. (2021). Sex Differences in Autism Spectrum Disorder: An Investigation on Core Symptoms and Psychiatric Comorbidity in Preschoolers. Frontiers in Integrative Neuroscience, 62. https://doi.org/10.3389/fnint.2020.594082
Renty, J. O. & Roeyers, H. (2006). Quality of life in high-functioning adults with autism spectrum disorder: The predictive value of disability and support characteristics. Autism, 10(5), 511-524. https://doi.org/10.1177/1362361306066604
Rosenthal, R. (1979). The ‘‘file drawer problem’’ and tolerance for null results. Psychological Bulletin, 86, 638–641. https://doi.org/10.1037/0033-2909.86.3.638
Russell, E., Sofronoff, K., Russell, E., & Sofronoff, K. (2005). Anxiety and social worries in children with Asperger syndrome. Australian & New Zealand Journal of Psychiatry, 39(7), 633-638. https://doi.org/10.1080/j.1440-1614.2005.01637.x
Sanduvete Chaves, S. (2008). Innovaciones metodológicas en la evaluación de la formación continua.
Sindermann, C., Cooper, A. J., & Montag, C. (2019). Empathy, autistic tendencies and systemizing tendencies–Relationships between standard self-report measures. Frontiers in Psychiatry, 10, 307. https://doi.org/10.3389/fpsyt.2019.00307
Smith, I. C., Ollendick, T. H., & White, S. W. (2019). Anxiety moderates the influence of ASD severity on quality of life in adults with ASD. Research in Autism Spectrum Disorders, 62, 39-47. https://doi.org/10.1016/j.rasd.2019.03.001
Sterling, L., Renno, P., Storch, E. A., Ehrenreich-May, J., Lewin, A. B., Arnold, E., et al. (2015). Validity of the Revised Children’s Anxiety and Depression Scale for youth with autism spectrum disorders. Autism, 19, 113–117. https://doi.org/10.1177/1362361313510066
Storch, E. A., Ehrenreich-May, J., Wood, J. J., Jones, A. M., De Nadai, A. S., Lewin, A. B., ... & Murphy, T. K. (2012a). Multiple informant agreement on the anxiety disorders interview schedule in youth with autism spectrum disorders. Journal of Child and Adolescent Psychopharmacology, 22(4), 292-299. https://doi.org/10.1089/cap.2011.0114
Storch, E. A., Wood, J. J., Ehrenreich-May, J., Jones, A. M., Park, J. M., Lewin, A. B., & Murphy, T. K. (2012a). Convergent and discriminant validity and reliability of the pediatric anxiety rating scale in youth with autism spectrum disorders. Journal of Autism and Developmental Disorders, 42(11), 2374-2382. https://doi.org/10.1007/s10803-012-1489-9
Swain, D., Scarpa, A., White, S., & Laugeson, E. (2015). Emotion dysregulation and anxiety in adults with ASD: Does social motivation play a role?. Journal of Autism and Developmental Disorders, 45(12), 3971-3977. https://doi.org/10.1007/s10803-015-2567-6
Szatmari, P., Georgiades, S., Duku, E., Zwaigenbaum, L., Goldberg, J. & Bennett, J. (2008). Alexithymia in Parents of Children with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 38, 1859–1865. https://doi.org/10.1007/s10803-008-0576-4
Vaiouli, P. & Panayiotou, G. (2021). Alexithymia and Autistic Traits: Associations With Social and Emotional Challenges Among College Students. Frontiers Neuroscience, 21 October. https://doi.org/10.3389/fnins.2021.733775
Vickerstaff, S., Heriot, S., Wong, M., Lopes, A., & Dossetor, D. (2007). Intellectual ability, self-perceived social competence, and depressive symptomatology in children with high-functioning autistic spectrum disorders. Journal of Autism and Developmental Disorders, 37(9), 1647-1664. https://doi.org/10.1007/s10803-006-0292-x
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1-48. https://doi.org/10.18637/jss.v036.i03
Copyright (c) 2022 Servicio de Publicaciones, University of Murcia (Spain)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The works published in this journal are subject to the following terms:
1. The Publications Service of the University of Murcia (the publisher) retains the property rights (copyright) of published works, and encourages and enables the reuse of the same under the license specified in paragraph 2.
© Servicio de Publicaciones, Universidad de Murcia, 2022
2. The works are published in the online edition of the journal under a Creative Commons Reconocimiento-CompartirIgual 4.0 (legal text). You can copy, use, distribute, transmit and publicly display, provided that: i) you cite the author and the original source of publication (journal, editorial and URL of the work), ii) are not used for commercial purposes, iii ) mentions the existence and specifications of this license.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
3. Conditions of self-archiving. Is allowed and encouraged the authors to disseminate electronically pre-print versions (version before being evaluated and sent to the journal) and / or post-print (version reviewed and accepted for publication) of their works before publication, as it encourages its earliest circulation and diffusion and thus a possible increase in its citation and scope between the academic community. RoMEO Color: Green.
