Validation and pilot study of a scale for assessing faculty digital security competence in educational institutions using a PLS-SEM approach
Abstract
Given the current challenges and issues, such as the risks and threats inherent in the use of the internet and smart devices, it is essential to be competent in digital security and behave ethically in digital environments. Therefore, the study aimed to design and validate the COSEDI instrument based on the European Framework for Digital Competence for Citizens (DigComp). To achieve this, an analysis based on structural equation modelling (PLS-SEM) was conducted, employing a non-experimental and quantitative methodology. The representative sample consisted of 497 teachers from the public education system in Andalusia, with a pilot study involving 60 teachers, who were excluded from the final analysis. The results demonstrate the validity and reliability of the instrument by illustrating the causal relationships between the constructs of data and privacy protection, device protection, environmental protection, and health and well-being protection. This is further supported by the inclusion of observed variables, as evidenced by the values of factor loadings and significance. Thus, the model supports the idea that the four latent variables influence each other, with the relationship between data and privacy protection and device protection being the strongest and most significant, while the weakest relationship is observed between the protection of personal data and environmental protection.
Downloads
References
Alin, A. (2010). Multicollinearity. WIREs Computational Statistics, 2(3), 370-374. https://doi.org/10.1002/wics.84
Amador, M. P., Torres, C. A., Lagunes, A., Angulo, J., Argüello, C. A., & Medina, H. (2021). Marcos de competencias digitales relacionados con seguridad para docentes. Pädi Boletín Científico de Ciencias Básicas e Ingenierías del ICBI, 9(Especial), Article Especial. https://doi.org/10.29057/icbi.v9iEspecial.7490
Attai, L. (2020). Student Data Privacy: Managing Vendor Relationships. Rowman & Littlefield.
Becker, J.-M., Cheah, J.-H., Gholamzade, R., Ringle, C. M., & Sarstedt, M. (2022). PLS-SEM’s most wanted guidance. International Journal of Contemporary Hospitality Management, 35(1), 321-346. https://doi.org/10.1108/IJCHM-04-2022-0474
Betín, A.B., Rodríguez, A., Caurcel, M.J. y Gallardo, C.P. (2022). Statistical validation of the "ECODIES" questionnaire to measure the
digital competence of Colombian high school students in the subject of Mathematics. Mathematics, 11, 33, 11, 33. https://doi.org/10.3390/math11010033
Betín, A. B., Rodríguez, A., Caurcel, M. J., & Gallardo, C. P. (2023). Effectiveness of a digital literacy program in High School Basic education students. Espiral. Cuadernos del Profesorado, 16(34), 12-27. https://doi.org/10.25115/ecp.v16i34.9516
Burr, C., Taddeo, M., & Floridi, L. (2020). The Ethics of Digital Well-Being: A Thematic Review. Science and Engineering Ethics, 26(4), 2313-2343. https://doi.org/10.1007/s11948-020-00175-8
Cabero, J., Guillén, F. D., Ruiz, J., & Palacios, A. (2022). Teachers’ digital competence to assist students with functional diversity: Identification of factors through logistic regression methods. British Journal of Educational Technology, 53(1), 41-57. https://doi.org/10.1111/bjet.13151
Chong, E. K., & Pao, S. S. (2022). Promoting digital citizenship education in junior secondary schools in Hong Kong: Supporting schools in professional development and action research. Asian Education and Development Studies, 11(4), 677-690. https://doi.org/10.1108/AEDS-09-2020-0219
Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences. Academic Press.
Matarrita, D., Trejos, B., Qin, H., Joo, D., & Debner, S. (2022). Conceptualizing community resilience: Revisiting conceptual distinctions. En Community Development for Times of Crisis (pp. 34-55). Routledge.
Escobar, J., & Cuervo, Á. (2008). Validez de contenido y juicio de expertos: Una aproximación a su utilización. Avances en medición, 6(1), 27-36.
Ferrag, M. A., Maglaras, L., Janicke, H., & Smith, R. (2019, septiembre 1). Deep Learning Techniques for Cyber Security Intrusion Detection: A Detailed Analysis. 6th International Symposium for ICS & SCADA Cyber Security Research 2019. https://doi.org/10.14236/ewic/icscsr19.16
Floridi, L. (2021). Digital Ethics Online and Off: Molding the digital future as it simultaneously shapes us. American Scientist, 109(4), 218-223. https://doi.org/10.1511/2021.109.4.218
Gabarda, V., García, E., Ferrando Rodríguez, M. de L., & Chiappe, A. (2021). El profesorado de Educación Infantil y Primaria: Formación tecnológica y competencia digital. Innoeduca: international Journal of Technology and Educational Innovation, 7(2), 19–31. https://doi.org/10.24310/innoeduca.2021.v7i2.12261
Gallardo, C. P., Rodríguez, A., Caurcel, M. J., y Capperucci, D. (2020). Adaptación y validación de un instrumento de evaluación sobre la utilización de herramientas digitales en las aulas de Educación Especial. Studi sulla Formazione, 23(2), 161-173. http://10.13128/ssf-12058
Gallego, M.J., Torres, N., & Pessoa, T. (2019). Competence of future teachers in the digital security area. Comunicar, 61, 57-67. https://doi.org/10.3916/C61-2019-05
González, J., & Pazmiño, M. (2015). Cálculo e interpretación del Alfa de Cronbach para el caso de validación de la consistencia interna de un cuestionario, con dos posibles escalas tipo Likert. Revista Publicando, 2(1), 62-67.
Grande de Prado, M., García, F. J., Corell, A., & Abella, V. (2021). Evaluación en Educación Superior durante la pandemia de la COVID-19. Campus Virtuales, 1(10), 49-58.
Griffiths, P., & Stockman, C. (2022). Expanding AI’s Impact with Organizational Learning. MIT Academic Conferences and publishing limited.
Guillén, F. D., Colomo, E., Ruiz, J., & Tomczyk, Ł. (2023). Teaching digital competence in the use of YouTube and its incidental factors: Development of an instrument based on the UTAUT model from a higher order PLS-SEM approach. British Journal of Educational Technology, 0(0), 1-23. https://doi.org/10.1111/bjet.13365
Gumus, M. M., Cakir, R., & Korkmaz, O. (2023). Investigation of pre-service teachers’ sensitivity to cyberbullying, perceptions of digital ethics and awareness of digital data security. Education and Information Technologies, 28(11). https://doi.org/10.1007/s10639-023-11785-7
Hernández, R., Fernández, C., & Baptista, P. (2014). Metodología de la investigación. McGraw Hill España. https://dialnet.unirioja.es/servlet/libro?codigo=775008
Honig, C. A., & Salmon, D. (2021). Learner Presence Matters: A Learner-Centered Exploration into the Community of Inquiry Framework. Online Learning, 25(2), 95-119.
Ivy, J., Lee, S. B., Franz, D., & Crumpton, J. (2019). Seeding Cybersecurity Workforce Pathways with Secondary Education. Computer, 52(3), 67-75. https://doi.org/10.1109/MC.2018.2884671
Kampylis, P., Punie, Y., & Devine, J. (2015). Promoting Effective Digital-Age Learning—A European Framework for Digitally-Competent Educational Organisations (JRC98209; JRC Research Reports). Joint Research Centre. https://publications.jrc.ec.europa.eu/repository/handle/JRC98209
Khan, N. F., Ikram, N., Saleem, S., & Zafar, S. (2023). Cyber-security and risky behaviors in a developing country context: A Pakistani perspective. Security Journal, 36(2), 373-405. https://doi.org/10.1057/s41284-022-00343-4
Kumar, V., & Nanda, P. (2019). Social Media to Social Media Analytics: Ethical Challenges. International Journal of Technoethics (IJT), 10(2), 57-70. https://doi.org/10.4018/IJT.2019070104
Latorre, M. J., & Tnibar, C. (2023). Digital Security in Educational Training Programs: A Study Based on Future Teachers’ Perceptions. Information technologies and learning tools, 95(3), Article 3. https://doi.org/10.33407/itlt.v95i3.5204
Lavery, M. R., Acharya, P., Sivo, S. A., & Xu, L. (2019). Number of predictors and multicollinearity: What are their effects on error and bias in regression? Communications in Statistics Simulation and Computation, 48(1), 27-38. https://doi.org/10.1080/03610918.2017.1371750
Más, V., Gabarda, V., & Peirats, J. (2022). Competencia digital del profesorado de Educación Secundaria: Análisis del estado del arte. REIDOCREA, 11(35), 418-430. https://doi.org/10.30827/Digibug.76068
Novella, C., & Cloquell, A. (2021). The ethical dimension of digital competence in teacher training. Education and Information Technologies, 26(3), 3529-3541. https://doi.org/10.1007/s10639-021-10436-z
Pérez, A., García, R., & Lena, F. J. (2021). Brecha digital de género y competencia digital entre estudiantes universitarios. Aula abierta, 50(1), 505-514.
Redecker, C. (2017, noviembre 28). European Framework for the Digital Competence of Educators: DigCompEdu. JRC Publications Repository. https://doi.org/10.2760/178382
Ringle, Christian M., Wende, Sven, & Becker, Jan-Michael. (2024). SmartPLS 4. Monheim am Rhein: SmartPLS. Retrieved from https://www.smartpls.com
Rodríguez, A. (2018). Editorial. Expansión postmoderna tecnológica, escuela inclusiva tecnológica. RETOS XXI, 2, 6-12. https://doi.org/10.33412/retoxxi.v2.1.2055
Rodríguez, A., Caurcel, M.J., Gallardo-Montes, C.d.P. y Crisol, E. (2021). Psychometric Properties of the Questionnaire “Demands and Potentials of ICT and Apps for Assisting People with Autism” (DPTIC-AUT-Q). Education Sciences, 11 (586). https://doi.org/10.3390/educsci11100586
RStudio Team. (2020). RStudio: Integrated Development for R. RStudio, PBC, Boston, MA URL http://www.rstudio.com/
Spyropoulou, N. D., & Kameas, A. D. (2020). Methodology for the Development of a Competence Framework for STE(A)M Educators. EDEN Conference Proceedings. https://doi.org/10.38069/edenconf-2020-ac0014
Torres, N. (2023). Análisis de Marcos de Competencia Digital Docente para la Formación inicial de profesorado en seguridad digital. Revista de Estilos de Aprendizaje, 16(31). https://doi.org/10.55777/rea.v16i31.5407
Torres, N., & Gallego, M.-J. (2022). Indicators to assess preservice teachers’ digital competence in security: A systematic review. Education and information technologies, 27(6), 8583-8602. https://doi.org/10.1007/s10639-022-10978-w
Viechtbauer, W., Smits, L., Kotz, D., Budé, L., Spigt, M., Serroyen, J., & Crutzen, R. (2015). A simple formula for the calculation of sample size in pilot studies. Journal of Clinical Epidemiology, 68(11), 1375-1379. https://doi.org/10.1016/j.jclinepi.2015.04.014
Vuorikari, R., Kluzer, S., & Punie, Y. (2022). DigComp 2.2: The Digital Competence Framework for Citizens - With new examples of knowledge, skills and attitudes (JRC Research Reports JRC128415). Joint Research Centre. https://econpapers.repec.org/paper/iptiptwpa/jrc128415.htm
Witsenboer, J. W. A., Sijtsma, K., & Scheele, F. (2022). Measuring cyber secure behavior of elementary and high school students in the Netherlands. Computers & Education, 186, 104536. https://doi.org/10.1016/j.compedu.2022.104536
Los artículos que se publican en esta revista están sujetos a los siguientes términos:
1. El Departamento de Métodos de Investigación y Diagnóstico en Educación de la Universidad de Murcia (España), junto con el Servicio de Publicaciones de la Universitdad de Murcia (Editum) son los editores de la revista REIFOP y conserva los derechos patrimoniales (copyright) de los artículos publicados, permitiendo la reutilización de las mismos bajo la licencia de uso indicada en el punto 2.
2. Las obras se publican en la edición electrónica de la revista bajo una licencia Creative Commons Reconocimiento-NoComercial-SinObraDerivada 3.0 España (texto legal). Se pueden copiar, usar, difundir, transmitir y exponer públicamente, siempre que: i) se cite la autoría y la fuente original de su publicación (revista, editores y URL de la obra); ii) no se usen para fines comerciales; iii) se mencione la existencia y especificaciones de esta licencia de uso.
3. Condiciones de auto-archivo. Se permite y se anima a los autores a difundir electrónicamente las versiones pre-print (versión antes de ser evaluada) y/o post-print (versión evaluada y aceptada para su publicación) de sus obras antes de su publicación, ya que favorece su circulación y difusión más temprana y con ello un posible aumento en su citación y alcance entre la comunidad académica. Color RoMEO: verde.
