Construction of an instrument on the digital competences of the teacher to use YouTube as a didactic resource: analysis of reliability and validity
Abstract
The purpose of this study was the creation of an instrument on the digital competence of the teacher in the use of YouTube as a learning tool. Specifically, the following specific objectives were outlined: content validity, comprehension validity, construct validity (exploratory and confirmatory factor analysis), convergent and discriminant validity, invariance by gender (male-female) and type of center (urban-rural), and determine the internal consistency through different reliability coefficients. The instrument had an initial version of 30 items classified into three factors: DIM. DC-I - Information; DIM. DC-C - Communication; DIM. DC-CC - Creation of content. The instrument was applied to 2157 teachers from all over the Spanish territory, belonging to different educational stages: Early Childhood, Primary and Secondary Education, Vocational Training and Adult Education. The reliability analyzes were satisfactory. Regarding validity, the results found a good adjustment of the model, both in internal validity and in factorial invariance by gender and type of center, with a final version of the instrument of 13 items. These results show that the instrument presented is valid and reliable to measure the digital competence of the teacher regarding the use they make of YouTube as a didactic resource.
Downloads
References
Almobarraz, A. (2018). Utilization of YouTube as an information resource to support university courses. The Electronic Library, 36(1), 71-81. https://doi.org/10.1108/EL-04-2016-0087
Alwehaibi, H. O. (2015). The impact of using Youtube in EFL classroom on enhancing EFL students' content learning. Journal of College Teaching & Learning (TLC), 12(2), 121-126. https://doi.org/10.19030/tlc.v12i2.9182
Asencio, E. N., García, E. J., Redondo, S. R., & Thoilliez, B. (2017). Fundamentos de la investigación y la innovación educativa. Unir Editorial.
Baharudin, H., Ghazali, R. M., & Halias, N. (2019). YouTube application in supporting students’ Arabic listening skills. Religación: Revista de Ciencias Sociales y Humanidades, 4(22), 104-109.
Bärtl, M. (2018). Youtube channels, uploads and views: A statistical analysis of the past 10 years. Convergence, 24(1), 16–32. https://doi.org/10.1177/1354856517736979
Bentler, P. M. (1989). EQS structural equations program manual. BMDP Statistical Software
Bérail,P., & Bungener,C.(2022).Parasocial relationships and YouTube addiction: The role of viewer and YouTuber video characteristics. Psychology of Language and Communication, 26(1) 169-206. https://doi.org/10.2478/plc-2022-0009
Bollen, K. A. (1989). Structural equations with latent variables (Vol. 210). John Wiley & Sons.
Brito, J. G., Laaser, W., & Toloza, E. A. (2012). El uso de redes sociales por parte de las universidades a nivel institucional. Un estudio comparativo. Revista de Educación a Distancia (RED), (32), 1-38.
Büyüköztürk, Ş. (2002). Faktör analizi: Temel kavramlar ve ölçek geliştirmede kullanımı. Kuram ve uygulamada eğitim yönetimi, 32(32), 470-483.
Cabero-Almenara, J., Gutiérrez-Castillo, J. J., Guillén-Gámez, F. D., & Gaete-Bravo, A. F. (2022). Digital Competence of Higher Education Students as a Predictor of Academic Success. Technology, Knowledge and Learning, 1-20. https://doi.org/10.1007/s10758-022-09624-8
Caena, F., & Redecker, C. (2019). Aligning teacher competence frameworks to 21st century challenges: The case for the European Digital Competence Framework for Educators (Digcompedu). European Journal of Education, 54(3), 356-369. https://doi.org/10.1111/ejed.12345
Carrillo-García, M. E., Cascales-Martínez, A., & Valero, A. L. (2018). Apps para el aprendizaje de idiomas en la Universidad de Murcia. Revista de Educación a Distancia (RED), (58), 1-18. http://dx.doi.org/10.6018/red/58/13
Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Sage.
Castro Rodríguez, M. M., Suelves, D. M., & Fernández, H. S. (2019). Digital competence and inclusive education. Visions of teachers, students and families. Revista de Educación a Distancia, 61, 1-37. http://dx.doi.org/10.6018/red/61/06
Cattell, R. B. (1966). The screen test for the number of factors. Multivariate behavioral research, 1(2), 245-276. https://doi.org/10.1207/s15327906mbr0102_10
Cheung, G.W. & Rensvold, R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Cheung, G. W., & Wang, C. (2017). Current approaches for assessing convergent and discriminant validity with SEM: issues and solutions. Academy of Management Proceedings, 2017(1), 12706. https://doi.org/10.5465/AMBPP.2017.12706abstract
Chintalapati, N., & Daruri, V. S. K. (2017). Examining the use of YouTube as a Learning Resource in higher education: Scale development and validation of TAM model. Telematics and Informatics, 34(6), 853-860. https://doi.org/10.1016/j.tele.2016.08.008
Copper, J. M., & Semich, G. W. (2019). Professional Development in the Twenty-First Century: YouTube Teacher Training and Professional Development. In M. Habib (Ed.), Advanced Online Education and Training Technologies (pp. 185-199). IGI Global. https://doi.org/10.4018/978-1-5225-7010-3.ch011
Dascalu, C.G., Antohe, M.E., Zegan, G., Burlea, S.L., Carausu, E.M., Ciubara, A., & Purcarea, V.L. (2021). Blended Learning - The Efficiency of Video Resources and YouTube in the Modern Dental Education. Revista de Cercetare si Interventie Sociala, 72, 288-310. https://doi.org/10.33788/rcis.72.18
Del Valle-Ramón, D., Muñoz-Repiso, A. G. V., & Gómez-Pablos, V. B. (2020). Aprendizaje basado en proyectos por medio de la plataforma YouTube para la enseñanza de matemáticas en Educación Primaria. Education in the knowledge society (EKS), (21), 1-16. https://doi.org/10.14201/eks.20272
Diamantopoulos, A., & Siguaw, J. A., (2000). Introduction to LISREL: A guide for the uninitiated. Sage.
Esteban, I. G., & Fernández, E. A. (2017). Fundamentos y técnicas de investigación comercial. Esic Editorial.
Farag, M., Bolton, D., & Lawrentschuk, N. (2020). Use of youtube as a resource for surgical education—clarity or confusion. European urology focus, 6(3), 445-449. https://doi.org/10.1016/j.euf.2019.09.017
Field, A. (2013). Discovering statistics using IBM SPSS statistics. Sage.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, 18(1), 39-50. https://doi.org/10.1177/002224378101800104
Fyfield, M. (2022). YouTube in the secondary classroom: how teachers use instructional videos in mainstream classrooms. Technology, Pedagogy and Education, 31(2), 185-197. https://doi.org/10.1080/1475939X.2021.1980429
Gerhart, L. M., & Anderton, B. N. (2021). Engaging students through online video homework assignments: A case study in a large‐enrollment ecology and evolution course. Ecology and Evolution, 11(11), 5777-5789. https://doi.org/10.1002/ece3.7547
Gil, M., Gómez, R., & Almansa, A. (2020). YouTube y coronavirus: análisis del consumo de vídeos sobre la pandemia COVID-19. Revista Latina de Comunicación Social, 78, 121–153. https://doi.org/10.4185/RLCS-2020-1471
Goian, V., Goian, O., & Biletska, T. (2021). Management Priorities of Audiovisual Student Projects During the COVID-Crisis. International Journal of Emerging Technologies in Learning, 16(10), 35–53. https://doi.org/10.3991/ijet.v16i10.19679
Gómez, C.J., Hinojo-Lucena, F.J., Moreno-Vera, J.R., & Alonso-Garcia, S. (2022). Analysis of a forced blended-learning program in social sciences higher education during the COVID-19 post-pandemic. Education + Training. https://doi.org/10.1108/ET-06-2022-0246
Guillén-Gámez, F. D., & Ramos, M. (2021). Competency profile on the use of ICT resources by Spanish music teachers: Descriptive and inferential analyses with logistic regression to detect significant predictors. Technology, Pedagogy and Education, 30(4), 511-523. https://doi.org/10.1080/1475939X.2021.1927164
Guillén-Gamez, F.D., Mayorga-Fernández, M. J., & Contreras-Rosado, J. A. (2021). Validity and reliability of an instrument to evaluate the digital competence of teachers in relation to online tutorials in the stages of Early Childhood Education and Primary Education. Revista de Educación a Distancia (RED), 21(67) 1-20. https://doi.org/10.6018/red.474981
Gümüş, M. M., & Kukul, V. (2022). Developing a digital competence scale for teachers: validity and reliability study. Education and Information Technologies, 1-19. https://doi.org/10.1007/s10639-022-11213-2
Hair, J., Anderson, R., Tathan, R., y Black, W. (2009). Análisis multivariante. Pearson.
Hair Jr, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis. In J.F. Hair Jr., W.C. Black, B.J. babin, & R.E. Anderson (Eds.), Multivariate data analysis: a global perspective (pp. 785-785). Prentice Hall.
Hefetz, A., & Liberman, G. (2017). The factor analysis procedure for exploration: a short guide with examples/El análisis factorial exploratorio: una guía breve con ejemplos. Cultura y Educación, 29(3), 526-562. https://doi.org/10.1080/11356405.2017.1365425
Heinzl, A., Buxmann, P., Wendt, O., & Weitzel, T. (Eds.). (2011). Theory-Guided Modeling and Empiricism in Information Systems Research. Springer Science & Business Media.
Hinkin, T. R., Tracey, J. B., & Enz, C. A. (1997). Scale construction: Developing reliable and valid measurement instruments. Journal of Hospitality & Tourism Research, 21(1), 100-120. https://doi.org/10.1177%2F109634809702100108
Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure 17 analysis: Conventional criteria versus new alternatives. Structural Equation 18 Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Instefjord, E. J., & Munthe, E. (2017). Educating digitally competent teachers: A study of integration of professional digital competence in teacher education. Teaching and teacher education, 67, 37-45. https://doi.org/10.1016/j.tate.2017.05.016
Jackman, W. M., & Roberts, P. (2014). Students' perspectives on YouTube video usage as an e-resource in the university classroom. Journal of Educational Technology Systems, 42(3), 273-296. https://doi.org/10.2190/ET.42.3.f
Kalaycı, Ş. (2010). SPSS uygulamalı çok değişkenli istatistik teknikleri (Vol. 5, p. 359). Asil Yayın Dağıtım.
Khatri, P., Singh, S. R., Belani, N. K., Yeong, Y. L., Lohan, R., Lim, Y. W., & Teo, W. Z. (2020). YouTube as source of information on 2019 novel coronavirus outbreak: a cross sectional study of English and Mandarin content. Travel medicine and infectious disease, 35, 101636. https://doi.org/10.1016/j.tmaid.2020.101636
Klobas, J. E., McGill, T. J., Moghavvemi, S., & Paramanathan, T. (2018). Compulsive youtube usage: A comparison of use motivation and personality effects. Computers in Human Behavior, 87, 129–139. https://doi.org/10.1016/j.chb.2018.05.038
KMI (Statista's Key Market Indicators). (2022). Forecast of the number of Youtube users in Spain from 2017 to 2025. https://www.statista.com/forecasts/1146700/youtube-users-in-spain
Lijo, R., Quevedo, E., Castro, J. J., & Horta, R. (2022). Assessing users’ perception on the current and potential Educational value of an Electrical Engineering YouTube channel. IEEE, 10, 8948-8959. https://doi.org/10.1109/ACCESS.2021.3139305
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de psicología/annals of psychology, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361
Lomax, R.G., & Schumacker, R.E. (2012). A beginner's guide to structural equation 17 modeling. Routledge Academic.
Lozano, R., Quilez, A., Delgado, D., & Latorre, M.P. (2021). YouTube’s growth in use among children 0-5 during COVID19: The Occidental European case. Technology in Society, 66, 101648. https://doi.org/10.1016/j.techsoc.2021.101648
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological methods, 1(2), 130-149. https://doi.org/10.1037/1082-989x.1.2.130
Marín-Díaz, V., Sampedro, B. E., & Vega Gea, E. (2022). Promoviendo el aprendizaje a través del uso de videos en 360º . Innoeduca. International Journal of Technology and Educational Innovation, 8(2), 138-151. https://doi.org/10.24310/innoeduca.2022.v8i2.15120
Meroño, L., Calderón Luquin, A., Arias Estero, J. L., & Méndez Giménez, A. (2018). Diseño y validación del cuestionario de percepción del profesorado de Educación Primaria sobre el aprendizaje del alumnado basado en competencias (# ICOMpri2). Revista Complutense de Educación, 29(1), 215-235. http://dx.doi.org/10.5209/RCED.52200
Nandagiri, V., & Philip, L. (2018). Impact of influencers from Instagram and YouTube on their followers. International Journal of Multidisciplinary Research and Modern Education, 4(1), 61-65.
Neumann, M. M., & Herodotou,C. (2020). Evaluating YouTube videos for young children. Education and Information Technologies, 25, 4459–4475. https://doi.org/10.1007/s10639-020-10183-7
Nunally, J. C. (1978). Psychometric Theory (2º ed.). McGraw-Hill.
Ogirima, O. A., Tolulope, J. J., & Temitope, S. J. (2021). Future teachers’ perception towards the use of YouTube for teaching-learning activities in Nigerian basic schools. Mimbar Sekolah Dasar, 8(1), 81–95. http://www.doi.org/10.53400/mimbar-sd.v8i1.31378
Ortega-Rodríguez, P. J., Gómez-García, M., Boumadan, M., & Soto-Varela, R. (2022). La competencia mediática del alumnado universitario para crear contenidos digitales. Innoeduca. International Journal of Technology and Educational Innovation, 8(2), 69-82. https://doi.org/10.24310/innoeduca.2022.v8i2.14169
Pattier, D. (2021). The Gender Gap Among EduTubers and the Factors Significantly Influencing It. Journal of New Approaches in Educational Research, 10(2), 313-329. http://dx.doi.org/10.7821/naer.2021.7.732
Pérez, C., & Carretero-Dios, H. (2005). Normas para el desarrollo y revisión de estudios instrumentales. International Journal of clinical and health psychology, 5(3), 521-551.
Pérez, E. R., & Medrano, L. A. (2010). Análisis factorial exploratorio: bases conceptuales y metodológicas. Revista Argentina de Ciencias del Comportamiento (RACC), 2(1), 58-66.
Reyes, J. S. (2019). La brecha digital en las escuelas rurales: un estudio de caso. Innoeduca. International Journal of Technology and Educational Innovation, 5(2), 189-196. https://doi.org/10.24310/innoeduca.2019.v5i2.4995
Ríos Vázquez, A., & Romero Tena, R. (2022). YouTube y el aprendizaje formal de matemáticas. Percepciones de los estudiantes en tiempos de COVID-19. Innoeduca. International Journal of Technology and Educational Innovation, 8(2), 27-42. https://doi.org/10.24310/innoeduca.2022.v8i2.14516
Roque, E. (2020). Tutoriales de Youtube como estrategia de aprendizaje no formal en estudiantes universitarios. RIDE Revista Iberoamericana Para La Investigación Y El Desarrollo Educativo, 11(21). https://doi.org/10.23913/ride.v11i21.797
Sangermán, M.A., Ponce, P., & VázquezCano, E. (2021). YouTube Videos in the Virtual Flipped Classroom Model Using Brain Signals and Facial Expressions. Future Internet, 13(9), e224. https://doi.org/10.3390/fi13090224
Scagnoli, N. I., Choo, J., & Tian, J. (2019). Students' insights on the use of video lectures in online classes. British Journal of Educational Technology, 50(1), 399-414. https://doi.org/10.1111/bjet.12572
Sencan, H. (2005). Sosyal ve Davranissal Olçumlerde Guvenilirlik ve Gecerlilik [Validity and reliability in social and behavioral measures]. Seçkin Yayı ncılık.
Shaffer, B. T., Cohen, M. S., Bigelow, D. C., & Ruckenstein, M. J. (2010). Validation of a disease‐specific quality‐of‐life instrument for acoustic neuroma: the Penn Acoustic Neuroma Quality‐of‐Life scale. The Laryngoscope, 120(8), 1646-1654. https://doi.org/10.1002/lary.20988
Smith, R., & Secoy, J. (2019). Exploring the music identity development of elementary education majors using ukulele and YouTube. Journal of Music Teacher Education, 29(1), 71-85. https://doi.org/10.1177/1057083719871026
Syafiq, A. N., Rahmawati, A., Anwari, A., & Oktaviana, T. (2021). Increasing speaking skill through YouTube video as English learning material during online learning in pandemic covid-19. Elsya: Journal of English Language Studies, 3(1), 50-55. https://doi.org/10.31849/elsya.v3i1.6206
Szeto, E., Cheng, A. Y. N., & Hong, J. C. (2016). Learning with social media: How do preservice teachers integrate YouTube and social media in teaching? The Asia-Pacific Education Researcher, 25(1), 35-44. https://doi.org/10.1007/s40299-015-0230-9
Tadbier, A. W., & Shoufan, A. (2021). Ranking educational channels on YouTube: Aspects and issues. Education and Information Technologies, 26(3), 3077-3096. https://doi.org/10.1007/s10639-020-10414-x
Taufik, M.S., Ridlo, A., Solahuddin, S., Iskandar, T., & Taroreh, B.S. (2022). Application of YouTube-Based Virtual Blended Learning as a Learning Media for Fundamental Movement Skills in Elementary Schools during the Covid Pandemic 19. Annals of Applied Sport Sciences, 10(1), 1-10. https://doi.org/10.52547/aassjournal.1020
Temban, M.M., Hua, T. K., & Mohd Said, N.E. (2021). Exploring Informal Learning Opportunities via YouTube Kids among Children During COVID-19. Academic Journal of Interdisciplinary Studies, 10(3), 272. https://doi.org/10.36941/ajis-2021-0083
Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association
Tomczyk, Ł. (2019). Skills in the area of digital safety as a key component of digital literacy among teachers. Education and Information Technologies, 25(1), 471–486. https://doi.org/10.1007/s10639-019-09980-6
Tomczyk, Ł., & Fedeli, L. (Eds.). (2022). Digital Literacy for Teachers. Springer (Collection: Lecture Notes in Educational Technology). https://doi.org/10.1007/978-981-19-1738-7
Trabelsi, A., Abdelkader, M., Scharenberg, S., Mrayeh, M., & Gharbi, A. (2022). YouTube as a complementary learning tool in times of COVID-19: Self-reports from sports science students. Trends in Neuroscience and Education, 29, e100186. https://doi.org/10.1016/j.tine.2022.100186
West, R. F., Meserve, R. J., & Stanovich, K. E. (2012). Cognitive sophistication does not attenuate the bias blind spot. Journal of personality and social psychology, 103(3), 506-519. https://psycnet.apa.org/doi/10.1037/a0028857
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The counseling psychologist, 34(6), 806-838. https://doi.org/10.1177/0011000006288127
Zeller, R. A., & Carmines, E. G. (1980). Measurement in the social sciences: The link between theory and data. Cambridge University Press.
Zimba, Z. F., Khosa, P., & Pillay, R. (2021). Using blended learning in South African social work education to facilitate student engagement. Social Work Education, 40(2), 263-278. https://doi.org/10.1080/02615479.2020.1746261
Copyright (c) 2023 Distance Education Journal
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Las obras que se publican en esta revista están sujetas a los siguientes términos:
1. El Servicio de Publicaciones de la Universidad de Murcia (la editorial) conserva los derechos patrimoniales (copyright) de las obras publicadas, y favorece y permite la reutilización de las mismas bajo la licencia de uso indicada en el punto 2.
2. Las obras se publican en la edición electrónica de la revista bajo una licencia Creative Commons Reconocimiento-NoComercial-SinObraDerivada 3.0 España (texto legal). Se pueden copiar, usar, difundir, transmitir y exponer públicamente, siempre que: i) se cite la autoría y la fuente original de su publicación (revista, editorial y URL de la obra); ii) no se usen para fines comerciales; iii) se mencione la existencia y especificaciones de esta licencia de uso.
3. Condiciones de auto-archivo. Se permite y se anima a los autores a difundir electrónicamente las versiones pre-print (versión antes de ser evaluada) y/o post-print (versión evaluada y aceptada para su publicación) de sus obras antes de su publicación, ya que favorece su circulación y difusión más temprana y con ello un posible aumento en su citación y alcance entre la comunidad académica. Color RoMEO: verde.
