The unidimensionality and overestimation of metacognitive awareness in children:validating the CATOM
Supporting Agencies
- The Portuguese Foundation for Science and Technology (FCT)
Abstract
Children often have difficulty in reporting their metacognitive functioning, which leads them to frequently overrating themselves under learning situations. Hence, this study presents a preliminary approach of how children's awareness of their own metacognitive knowledge (MK) and metacognitive skills (MS) can be measured. Essentially, this study aims to understand how children (n =1029) report their metacognitive functioning. In a first analysis, PCA revealed an initial two-factor structure of the instrument (MK and MS). Item Response Theory was then used to analyse the unidimensionality of each dimension and the interactions between participants and items. Results revealed good item reliability for MK (.93) and MS (.80), and an average person reliability (.67) for MK and MS (.78) with good Cronbach's α for MK (.84) and MS (.91). These results show the potential of the instrument, as well as a tendency of children to overrate their metacognitive functioning. Implications for researchers and practitioners are discussed.
Downloads
References
Ahmed, A. & Pollitt, A. (2010). The Support Model for interactive assess-ment. Assessment in Education: Principles, Policy & Practice, 17(2), 133–167.
Allwood, C. M., Ask, K., & Granhag, P. A. (2005). The cognitive interview: effects on the realism in witnesses’ confidence in their free recall. Psycholo-gy, Crime & Law, 11, 183–198.
Allwood, C. M., Innes-Ker, Å., Holmgren, J., & Fredin, G. (2008). Children’s and adults’ realism in their event-recall confidence in response to free re-call and focused questions. Psychology, Crime & Law, 14, 529–547.
Annevirta, T. & Vauras, M. (2006). Development changes of metacognitive skill in elementary school children. The Journal of Experimental Education 74, 197-225.
Baker, F (2001). The Basics of Item Response Theory. ERIC Clearinghouse on Assessment and Evaluation, University of Maryland, College Park, MD.
Baker, L. (1994). Fostering metacognitive development. In H. W. Reese (Ed.), Advances in child development and behavior. Vol. 25 (pp. 201–239). San Diego: Academic Press.
Bandura, A. (1989). Regulation of cognitive processes through perceived self-efficacy. Developmental Psychology, 25, 729–735.
Bares, C. B. (2011). Emerging Metacognitive Processes During Childhood: Implications for Intervention Development with Children. Children and Adolescent Social Work, 28(4), 291-299. DOI: 10.1007/s10560-011-0233-1
Barquero, B., Robinson, E. J., & Thomas, G. V. (2003). Children’s ability to attribute different interpretations of ambiguous drawings to a naïve vs. a biased observer. International Journal of Behavioral Development, 27, 445–456.
Boekaerts, M. (2002). Motivation to Learn. The International Academy of Edu-cation and Bureau of Education. Available at http://www.ibe.unesco.org.
Bollen, K. A., & Long, J. S. (1993). Testing structural equations models. Newbury Park, CA: Sage.
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model. Mahwah, NJ: Erl-baum.
Borkowski, J. G., & Turner, L. (1989). Transsituational characteristics of meta-cognition. In W. Schneider & F. Weinert (Eds.), Interaction among aptitudes, strategies, and knowledge in cognitive performance (pp. 159-176). Boston: Springer-Verlag.
Bourque, L. & Fielder, E. (1995). How to Conduct Self-Administered and Mail Sur-veys: Learning Objectives. Thousand Oaks, CA: Sage.
Bronson, M. (2000). Self-regulation in early childhood: nature and nurture. New York: the Guilford Press.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: The Guilford Press.
Burman, E. (1994). Deconstructing Developmental Psychology. London and New York: Routledge.
Butler, D. L., & Winne, P. H. (1995). Feedback and Self-Regulated Learning: A Theoretical Synthesis. Review of Educational Research, 65(3), 245 -281. doi:10.3102/00346543065003245
DeMars, C. (2010). Item response theory. Oxford, UK: Oxford University Press.
Dillman, D. A. (2000). Mail and Internet Surveys: The Tailored Design Method. New York: J. Wiley.
Dixon, Q., Zhao, J., Shin, J., Wu, S., Su, J., Burgess-Brigham, R., Gezer, M., & Snow, C. (2012). What We Know About Second Language Acquisition. A Synthesis From Four Perspectives. Review of Educational Research, 82(1), 5-60. doi:10.3102/0034654311433587
Dweck, C. S. (1999). Self-Theories: Their Role in Motivation, Personality, and Devel-opment. Philadelphia, PA: Psychology Press Ltd.
Efklides, A. (2001). Metacognitive experiences in problem solving: Metacogni-tion, motivation, and self-regulation. In A. Efklides, J. Kuhl, & R. M. Sorrentino (Eds.), Trends and prospects in motivation research (pp. 297–323). Dordrecht, The Netherlands: Kluwer.
Efklides, A. (2006). Metacognition and affect: What can metacognitive experi-ences tell us about the learning process? Educational Research Review, 1, 3–14. doi:10.1016/j.edurev.2005.11.001
Efklides, A. (2008). Metacognition: Defining its facets and levels of function-ing in relation to self-regulation and co-regulation. European Psychologist, 13(4), 277-287.
Efklides, A. (2011). Interactions of Metacognition With Motivation and Af-fect in Self-Regulated Learning: The MASRL Model. Educational Psycholo-gist, 46(1), 6–25. 10.1080/00461520.2011.538645
Embretson, S. E. (1996). Item response theory models and inferential bias in multiple group comparisons. Applied Psychological Measurement, 20, 201-212. DOI: 10.1037/1040-3590.8.4.341
European Commission (2009). Strategic framework for
cooperation on educa-tion and training. Retrieved from http://ec.europa.eu/languages/languages-of-europe/.
Ferrando, P.(2010). Assessing short-term individual consistency using IRT-based statistics, Psicológica, 31, 319-334.
Ferreira, A. I., Almeida, L., & Prieto, G. (2011). The role of processes and con-tents in human memory: An item response theory approach. Journal of Cognitive Pscyhology, 23 (7), 873-885.
Ferreira, A.I., Almeida, L., & Prieto, G. (2012). Construction of a memory bat-tery for computerized administration, using Item Response Theory. Psy-chological Reports, 111(2), 1-25.
Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Res-nick (Ed.), The nature of intelligence (pp.231-236). Hillsdale, NJ: Erl-baum
Flavell, J. H. (2002). Development of children’s knowledge about the mental world. In W. W. Hartup & R. K. Silbereisen (Eds.), Growing points in de-velopmental science: An introduction (pp.102–122). Hove, UK: Psychology Press.
Flavell, J. H. (2004). Theory-of-Mind Development: Retrospect and Prospect. Merrill-Palmer Quarterly, 50(3), 274-290. doi: 10.1353/mpq.2004.0018
Flavell, J. H., Friedrichs, A. G., & Hoyt, J. D. (1970). Developmental changes in memorization processes. Cognitive Psychology, 1, 324–340.
Fink, A. (1995). How To Ask Survey Questions. Thousand Oaks, CA: Sage.
Fox, C. M., & Jones, J. A. (1998). Uses of Rasch modeling in counseling psy-chology research. Journal of Counseling Psychology, 45(1), 30-45. doi: 10.1037/0022-0167.45.1.30
Hacker, D. J. (1998). Definitions and Empirical Foundations. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in Educational Theory and Practice (pp. 1−23). Lawrence Erlbaum Associates.
Hofer, B. (2005). The legacy and the challenge: Paul Pintrich’s contributions to personal epistemology research. Educational Psychologist, 40, 95-105.
Johnson, J. & Newport, E. (1989). Critical period effects in second language learning: the influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21, 60-99.
Joreskog, K.G. (1977). Factor analysis by least-squares and maximum-likelihood methods. In K. Enslein, A. Ralston, & H.S. Wilf (Eds.), Statis-tical Methods for Digital Computers, pp.125-153, New York: Wiley.
Kirsh, C. (2012). Developing children’s language learner strategies at primary school. Education 3–13, 40, (4), 379–399. doi: 10.1080/03004279.2012.691372
Krebs, S. & Roebers, C. (2010). Children's strategic regulation, metacognitive monitoring, and control processes during test taking. British Journal of Ed-ucational Psychology, 80, 325-340.
Kuhn, D. & Dean, D. (2004). Metacognition: A Bridge Between Cognitive Psychology and Educational Practice. Theory Into Practice, 43(4), 268-273. doi: 10.1353/tip.2004.0047
Larkin, S. (2010). Metacognition in Young Children. NY: Routledge.
Linacre, M. (2013). Winsteps software. Available at http://www.winsteps.com/wsupd.htm
Lipko-Speed, A. (2013). Can young children be more accurate predictors of their recall performance? Journal of Experimental Child Psychology, 114, 357–363.
Lorenzo-Seva, U., & Ferrando, P. (2013). FACTOR 9.20 software. Available at http://psico.fcep.urv.es/utilitats/factor/index.html.
Mayberry, R. & Lock, E. (2003). Age constraints on first versus second lan-guage acquisition: Evidence for linguistic plasticity and epigenesis. Brain and Language. 87, 369–384. doi:10.1016/S0093-934X(03)00137-8
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: LEA.
Missailidi, P. (2010). Children’s Metacognition and Theory of Mind: Bridging the Gap. In A. Efklides & P. Missailidi (Eds), Trends and Prospects in Metacognition Research (pp. 279-291), New York: Springer. DOI 10.1007/978-1-4419-6546-2_13
Muthén, B., & Kaplan D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathe-matical and Statistical Psychology, 38, 171-189.
Muthén, B., & Kaplan D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45, 19-30.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Re-search Methods, Instrumentation, and Computers, 32, 396-402.
Pihlainen-Bednarik, K., & Keinonen, T. (2010). Sixth graders’ understanding of their own learning: A case study in environmental education course In-ternational Journal of Environmental & Science Education, 6(1), 59-78.
Pintrich, P. (2000). The role of goal orientation in self-regulated learning. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Handbook of Self-Regulation, (pp. 451-502). San Diego: Academic Press.
Randi, J & Corno, L. (2000). Teacher Innovations in Self-Regulated Learning. In M. Boekaerts, P. Pintrich & M. Zeidner (Eds.), Handbook of Self-Regulation, (pp 651-685). New York: Academic Press.
Rasch, G. (1980). Probabilistic models for some intelligence and attainment tests. Chica-go. IL: University of Chicago Press. (Original work published 1960)
Rheinberg, F., Vollmeyer, R., & Rollett, W. (2000). Motivation and Action in Self-Regulated Learning. In M.
Boekaerts, P. Pintrich & M. Zeidner (Eds.), Handbook of Self-Regulation, (pp 503-529). New York: Academic Press.
Rizzo, P., Steinhausen, H.C., & Drechsler, R. (2010). Self-perception of self-regulatory skills in children with attention-deficit/hyperactivity disorder aged 8-10 years. Attention Deficit and Hyperactivity Disorders, 2(4),171-83.
Schmitz, P., & Perels, F. (2011). Self-monitoring of self-regulation during math homework behaviour using standardized diaries. Metacognition and Learning, 6, 255–273. DOI 10.1007/s11409-011-9076-6
Schneider, W. (1998). Performance prediction in young children: Effects of skill, metacognition and wishful thinking. Developmental Science, 1, 291–297.
Schneider, W. (2008). The Development of Metacognitive Knowledge in Children and Adolescents: Major Trends and Implications for Educa-tion. Mind, Brain, and Education. 2(3), 114-121.
Schneider, W. & Lockl, K. (2002). The development of metacognitive knowledge in children and adolescents. In Perfect, T. & Schwartz, B. (Eds.), Applied metacognition. Cambridge, UK: Cambridge University Press.
Schraw, G., & Moshman, D. (1995). Metacognitive theories. Educational Psy-chology Review, 7(4), 351-371.
Shin, H., Bjorklund, D. F., & Beck, E. F. (2007). The adaptive nature of chil-dren’s overestimation in a strategic memory task. Cognitive Development, 22, 197–212.
Smith, E. V. Jr (2001). Evidence for the reliability of measures and validity of measure interpretation: A Rasch measure perspective. Journal of Applied Measurement, 2(3), 281-311.
Sperling, R. A., Howard, B. C., Miller, L. A., & Murphy, C. (2002). Measures of children’s knowledge and regulation of cognition. Contemporary Educa-tional Psychology, 27, 51-79.
Stipek, D. J., & MacIver, D. (1989). Developmental change in children’s as-sessment of intellectual competence. Child Development, 60, 521–538.
Thomas, G.P. & Au Kin Mee, D. (2005). Changing the learning environment to enhance students´ metacognition in Hong Kong primary school class-room. Learning Environments Research, 8, 221-243.
Throndsen, I. (2010). Self-regulated learning of basic arithmetic skills: A longi-tudinal study. British Journal of Educational Psychology, 81(4), 558–578. DOI: 10.1348/2044-8279.002008.
Turner, J.C. (1995). The influence of classroom contexts on young children’s motivation for literacy. Reading Research Quarterly, 30, 410-441.
Tzuriel, D. & Shamir, A. (2002). The effects of mediation in computer assisted dynamic assessment. Journal of Computer Assisted Learning, 18, 21-32.
Veenman, M., & Elshout, J. J. (1999). Changes I n relation between cognitive and metacognitive skills during acquisition of expertise. European Journal of Psychology of Education, 14, 509-523.
Velicer, W. F. (1976). Determining the number of components from the ma-trix of partial correlations. Psychometrika, 41, 321-327.
Whitebread, D., Coltman, P., Pino Pasternak, D., Sangster, C., Grau, V., Bingham, S., Almeqdad, Q. & Demetriou, D. (2009). The development of two observational tools for assessing metacognition and self-regulated learning in young children, Metacognition and Learning, 4(1), 63-85.
Wigfield, A., Klauda, S., & Cambria, J. (2011). Influences on the Development of Academic Self-regulatory Processes. In B., Zimmerman & D., Schunk (Eds.), Handbook of Self-regulated Learning and Performance (pp. 33 - 48). New York, NY: Taylor & Francis.
Winne, P. & Perry, N. (2000). Measuring Self-Regulated Learning. In M. Boekaerts, P. Pintrich & M. Zeidner (Eds.), Handbook of Self-Regulation, (pp 531-566). New York: Academic Press.
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago, IL: Mesa Press.
Zimmerman, B. & Martinez-Pons, M. (1986). Development of a structured in-terview for assessing student use of self-regulated learning strategies. American Educational Research Journal, 23, 614–628.
The works published in this journal are subject to the following terms:
1. The Publications Service of the University of Murcia (the publisher) retains the property rights (copyright) of published works, and encourages and enables the reuse of the same under the license specified in paragraph 2.
© Servicio de Publicaciones, Universidad de Murcia, 2022
2. The works are published in the online edition of the journal under a Creative Commons Reconocimiento-CompartirIgual 4.0 (legal text). You can copy, use, distribute, transmit and publicly display, provided that: i) you cite the author and the original source of publication (journal, editorial and URL of the work), ii) are not used for commercial purposes, iii ) mentions the existence and specifications of this license.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
3. Conditions of self-archiving. Is allowed and encouraged the authors to disseminate electronically pre-print versions (version before being evaluated and sent to the journal) and / or post-print (version reviewed and accepted for publication) of their works before publication, as it encourages its earliest circulation and diffusion and thus a possible increase in its citation and scope between the academic community. RoMEO Color: Green.
