Methodological quality of football studies based on observational methodology: A sistematic review
Supporting Agencies
- Ministerio de Ciencia, Innovación y Universidades, MICIU/AEI/10.13039/501100011033, Government of Spain
- ANID, Government of Chile, the National Scientific and Technological Development Fund -FONDECYT
- Generalitat de Catalunya Research Group (GRUP DE RECERCA E INNOVACIÓ EN DISSENYS [GRID]) Tecnología i aplicació multimedia i digital als dissenys observacionals
Abstract
Observational methodology (OM) has been extensively employed in football research. This study presents a systematic review that applies the Methodological Quality Scale for studies based on Observational Methodology (MQSOM) to 236 primary papers on football based on OM to unveil methodological trends. The psychometric properties of the MQSOM yielded adequate results. Descriptive statistics were provided; a proportion analysis was conducted to identify differences in procedures; and a two-step cluster analysis was conducted to identify methodological quality (MQ) profiles. The proportion analysis revealed significant differences in observation type (frequently direct), coding manual (often specified), data type (seldom specified), observational instrument (frequently specified), recording (often specified), control (occasionally specified) and analysis software (frequently specified), parameter type (usually frequency), quality control (frequently employed), and analysis (usually non-descriptive). Two-step cluster analysis yielded five MQ profiles ranked in decreasing order based on the MQSOM score (P1: high Design Quality -DQ-, and Measurement & Analysis Quality -MAQ-; P2: moderate DQ, high MAQ; P3: low DQ, high MAQ; P4: low DQ, moderate MAQ; and P5: low DQ and MAQ). This work presents an updated snapshot of OM applied in football research, outlining future improvements in MQ.
Downloads
-
Abstract18
-
pdf0
References
Anguera, M. T. (2003). Observational methods (General). In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological Assessment, Vol. 2 (pp. 632-637). Sage.
Anguera, M. T. (2021). Desarrollando la observación indirecta: Alcance, proceso, y habilidades metodológicas en el análisis de textos [Development of indirect observation: Scope, process and methodological abilities in textual analysis]. In C. Santoyo-Velasco, and L. Colmenares-Vázquez (Eds.), Patrones de habilidades metodológicas y conceptuales de análisis, evaluación e intervención en ciencias del comportamiento [Patterns of methodological and conceptual skills of analysis, evaluation and intervention in behavioral sciences]. Libros UNAM.
Anguera, M. T. (2023). Revisitando las revisiones sistemáticas desde la perspectiva metodológica [Revisiting systematic reviews from a methodological perspective]. RELIEVE, 29(1). https://doi.org/10.30827/relieve.v29i1.27758
Anguera, M. T., & Blanco-Villaseñor, A. (2005). Registro y codificación en el comportamiento deportivo [Recording and coding in sports behavior]. In A. Hernández-Mendo (Ed.). Psicología del Deporte (Vol. II): Metodología [Sport Psychology (Vol. II): Methodology] (pp. 6–34). Wanceulen.
Anguera, M. T., Blanco-Villaseñor, A., Hernández-Mendo, A., & Losada, J. L. (2011). Diseños observacionales: ajuste y aplicación en psicología del deporte [Observational designs: their suitability and application in sports psychology]. Cuadernos de Psicología del Deporte, 11, 63–76. https://revistas.um.es/cpd/article/view/133241
Anguera, M. T., Blanco-Villaseñor, A., Losada, J. L., & Portell, M. (2018a). Guidelines for designing and conducting a study that applies observational methodology. Anuario de Psicología, 48(1), 9-17. https://doi.org/10.1016/j.anpsic.2018.02.001
Anguera, M. T., Blanco-Villaseñor, A., Losada, J. L., & Sánchez-Algarra, P. (2020) Integración de elementos cualitativos y cuantitativos en metodología observacional [Integration of qualitative and quantitative elements in observational methodology]. Ámbitos: Revista internacional de comunicación, 49, 49-70. https://doi.org/10.12795/Ambitos.2020.i49.04
Anguera, M. T., Camerino, O., Castañer, M., Sánchez-Algarra, P., & Onwuegbuzie, A. J. (2017). The specificity of observational studies in physical activity and sports sciences: Moving forward in mixed methods research and proposals for achieving quantitative and qualitative symmetry. Frontiers in Psychology, 8, Article 2196. https://doi.org/10.3389/fpsyg.2017.02196
Anguera, M. T., Magnusson, M. S., & Jonsson, G. K. (2007). Instrumentos no estándar: Planteamiento, desarrollo y posibilidades [Non-standard instruments: approach, development and possibilities]. Avances en Medición, 5, 63–82. http://bit.ly/473pXVj
Anguera, M. T., Portell, M., Chacón-Moscoso, S., & Sanduvete-Chaves, S. (2018b). Indirect observation in everyday contexts: Concepts and methodological guidelines within a mixed methods framework. Frontiers in Psychology, 9, Article 13. https://doi.org/10.3389/fpsyg.2018.00013
Bakeman, R. (1978). Untangling streams of behavior: Sequential analysis of observation data. In G. P. Sackett (Ed.), Observing Behavior: Vol. 2. Data collection and analysis methods (pp. 63-78). University of Park Press.
Blanco-Villaseñor, A., Losada, J. L., & Anguera, M. T. (2001). Diseños observacionales, cuestión clave en el proceso de la metodología observacional. Metodología de las Ciencias del Comportamiento, 3(2), 135-160.
Carling, C., Reilly, T., & Williams, A. (2009). Performance assessment for field sports. Routledge.
Carling, C., Williams, A., & Reilly, T. (2005). The handbook of soccer match analysis: A systematic approach to improving performance. Routledge.
Chacón-Moscoso, S., Anguera, M. T., Sanduvete-Chaves, S., Losada, J. L., & Portell, M. (2019). Methodological quality checklist for studies based on observational methodology (MQCOM). Psicothema, 31(4), 458-464. https://doi.org/10.7334/psicothema2019.116
Chiu, T., Fang, D., Chen, J., Wang, Y., & Jeris, C. (2001). A robust and scalable clustering algorithm for mixed type attributes in large database environment. In D. Lee, M. Schkolnick, F. Provost & R. Srikant (Eds.), Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (pp. 263-268). ACM. https://doi.org/10.1145/502512.502549
Cochran, W. G., & Chambers, S. P. (1965). The planning of observational studies of human populations. Journal of the Royal Statistical Society. Series A (General), 128(2), 234-266. https://doi.org/10.2307/2344179
Crespillo-Jurado, M., Anguera, M. T., Reigal, R. E., & Hernández-Mendo, A. (2021). Análisis de la calidad del dato de un instrumento de observación del clima motivacional: Conductas verbales y proxémicas de monitores de mantenimiento físico [Data quality analysis of a motivational climate observation instrument: Verbal and proxemic behaviours of physical maintenance monitors]. Cuadernos de Psicología del Deporte, 21(1), 18–42. https://doi.org/10.6018/cpd.423051
Cresswell, J. W., & Plano-Clark, V. (2017). Designing and conducting mixed methods research. Sage.
*Di Salvo, V., Baron, R., Tschan, H., Montero, F. C., Bachl, N., & Pigozzi, F. (2007). Performance characteristics according to playing position in elite soccer. International Journal of Sports Medicine, 28(3), 222-227. https://doi.org/10.1055/s-2006-924294
Holgado-Tello, F. P. (2015). Análisis de los ítems. [Analysis of the items]. In M. I. Barbero-García, E. Vila-Abad, & F. P. Holgado-Tello (Eds.). Psicometría [Psychometrics] (pp. 407-468). Sanz y Torres.
Hollander, M., Wolfe, D. A., & Chicken, E. (2013). The dichotomous data problem. In M. Hollander, D. A. Wolfe, & E. Chicken (Eds.), Nonparametric statistical methods (pp. 11-38). Wiley.
Hughes, M. & Franks, I. (1997). Notational analysis of sport. E&F Spon.
Huwiler-Müntener, K., Jüni, P., Junker, C., & Egger, M. (2002). Quality of reporting of randomized trials as a measure of methodologic quality. Journal of the American Medical Association, 287(21), 2801-2804. https://doi.org/10.1001/jama.287.21.2801
IBM. (2025). TwoStep Cluster Analysis. IBM. https://www.ibm.com/docs/en/spss-statistics/30.0.0?topic=features-twostep-cluster-analysis
*James, N., Mellalieu, S. D., & Hollely, C. (2002). Analysis of strategies in soccer as a function of European and domestic competition. International Journal of Performance Analysis in Sport, 2(1), 85-103. https://doi.org/10.1080/24748668.2002.11868263
Kalkbrenner, M. T. (2023). Alpha, omega, and H internal consistency reliability estimates: Reviewing these options and when to use them. Counseling Outcome Research and Evaluation, 14(1), 77-88. https://doi.org/10.1080/21501378.2021.1940118
Lapresa, D., Otero, A., Arana, J., Álvarez, I., & Anguera, M. T. (2021). Concordancia consensuada en metodología observacional: Efectos del tamaño del grupo en el tiempo y la calidad del registro [The consensus agreement method in observational methodology: impact of sample size on time requirements and dataset quality]. Cuadernos de Psicología del Deporte, 21(2), 47-58. https://doi.org/10.6018/cpd.467701
Madill, A., & Gough, B. (2008). Qualitative research and its place in psychological science. Psychological methods, 13(3), 254-271. https://doi.org/10.1037/a0013220
Norusis, M. J. (2012). IBM SPSS Statistics 19: Advanced Statistical Procedures Companion. Prentice Hall.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., ... & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88, Article 105906. https://doi.org/10.1016/j.ijsu.2021.105906.
Portell, M., Anguera, M. T., Chacón-Moscoso, S., & Sanduvete-Chaves, S. (2015). Guidelines for reporting evaluations based on observational methodology. Psicothema, 27(3), 283-289. https://doi.org/10.7334/psicothema2014.276
Portney, L., & Watkins, M. (2000). Foundations of clinical research: Applications to practice. Prentice Hall.
Preciado, M., Anguera, M. T., Olarte, M., & Lapresa, D. (2019). Observational studies in male elite football: A systematic mixed study review. Frontiers in Psychology, 10, Article 77. https://doi.org/10.3389/fpsyg.2019.02077
Preciado, M., Anguera, M. T., Olarte, M., & Lapresa, D. (2021). Revisión sistemática en fútbol sala desde los mixed methods [Systematic review in futsal from mixed methods]. Revista de Psicología del Deporte, 30(1), 75-96. https://rpd-online.com/index.php/rpd/article/view/291
*Rampinini, E., Coutts, A. J., Castagna, C., Sassi, R., & Impellizzeri, F. M. (2007). Variation in top level soccer match performance. International journal of sports medicine, 28(12), 1018-1024. https://doi.org/10.1055/s-2007-965158
Sánchez-Algarra, P., & Anguera, M. T. (2013). Qualitative/quantitative integration in the inductive observational study of interactive behaviour: Impact of recording and coding predominating perspectives. Quality & Quantity, 47, 1237–1257. https://doi.org/10.1007/s11135-012-9764-6
Sánchez-Meca, J. (2022). Revisiones sistemáticas y meta-análisis en Educación: Un tutorial [Systematic reviews and meta-analyses in Education: A tutorial]. RiiTE - Revista interuniversitaria de investigación en Tecnología Educativa, 13, 5-40. https://doi.org/10.6018/riite.545451
Sanduvete-Chaves, S., López-Arenas, D., Anguera, M. T., & Chacón-Moscoso, S. (2025). Methodological Quality of studies based on Observational Methodology: A scale for its evaluation. Psicothema, 37(1), 1-10. https://doi.org/10.70478/psicothema.2025.37.01
Sarmento, H., Marcelino, R., Anguera, M. T., Campaniço, J., Matos, N., & Leitão, J. (2014). Match analysis in football: A systematic review. Journal of Sport Sciences, 32, 1831–1843. https://doi.org/10.1080/02640414.2014.898852
Schwarz, G. (1978). Estimating the dimension of a model. The annals of statistics, 6(2), 461-464. https://doi.org/10.1214/aos/1176344136
*Sgrò, F., Aiello, F., Casella, A., & Lipoma, M. (2016). Offensive strategies in the European football championship 2012. Perceptual and motor skills, 123(3), 792-809. https://doi.org/10.1177/0031512516667455
*Thomas, S., Reeves, C., & Smith, A. (2006). English soccer teams’ aggressive behavior when playing away from home. Perceptual and motor skills, 102, 317-320. https://doi.org/10.2466/pms.102.2.317-320
Copyright (c) 2026 The authors
This work is licensed under a Creative Commons Attribution 4.0 International License.
About Copyright and Licensing, more details here.
