The importance of methodological-analytical indicators at the level of concreteness of research designs of scientific articles
Abstract
This research aims to establish the importance of the different indicators of a methodological-analytical nature included in the research reports presented in scientific articles. Thus, our interest is focused on determining which of these indicators are the best predictors for establishing a scientific article profile with a higher or lower degree of concreteness. For this purpose, we selected all the scientific articles published in the seven Spanish journals within the field of educational research indexed in the Journal Citation Report (JCR) database during 2016. More precisely, we selected a total of 479 papers published during the three-year period 2014-2016. Each journal obtained an overall score depending on the presence vs absence of such methodological indicators. Following the implementation of the Chi-squared Automatic Interaction Detection technique, where this variable, transformed into a new fictitious variable grouped into three levels, has been taken as a variable criterion, and, as predictors, the ten methodological-analytical indicators, it has been found that, in fact, some methodological-analytical indicators play a more important role than others in the concreteness of the research designs raised in the research work. In this way, we are able to determine how these indicators related to the quality criteria are (QUC); the type of sampling-s considered (ST3); and the study methodology (ME), which have been decisive for the establishment of more complete methodological-analytical designs.
Downloads
References
Aliaga, F. M., Gutiérrez-Braojos, C. y Fernández-Cano, A. (2018). Las revistas de investigación en educación: análisis DAFO. Revista de Investigación Educativa, 36(2), 563-579. https://dx.doi.org/10.6018/rie.36.2.312461
Ariza, T. y Quevedo-Blasco, R. (2013). Bibliometric analysis of the Revista de Investigación Educativa (2000-2012). Revista de Investigación Educativa, 31(1), 31-52. https://doi.org/10.6018/rie.31.1.160321
Arnau, J., Anguera, M. T. y Gómez, J. (1990). Metodología de la investigación en Ciencias del Comporrtamiento. Universidad de Murcia.
Bordons, A. y Zulueta, M. (1999). Evaluation of scientific activity through bibliometric indicators. Revista Española de Cardiología, 52(10), 790-800. https://doi.org/10.1016/S0300-8932(99)75008-6
Botella, J. y Zamora, A. (2017). Meta-analysis: a methodology for research in education. Educación XX1, 20(2), 17-38. https://doi.org/10.5944/educXX1.18241
Buckley, J., Hyland, T., & Seery, N. (2021). Examining the Replicability of Contemporary Technology Education Research. Techne serien-Forskning i slöjdpedagogik och slöjdvetenskap, 28(2), 1-9.
Byeon, H. (2017). Chi-Square Automatic Interaction Detection Modeling for Predicting Depression in Multicultural Female Students. International Journal of Advanced Computer Science and Applications, 8(12), 179–183. https://doi.org/10.14569/IJACSA.2017.081222
Cordón García, J. A., Alonso Arévalo, J., Gómez Díaz, R. y López Lucas, J. (2012). Las nuevas fuentes de información: información y búsqueda documental en el contexto de la web 2.0. Pirámide.
De-Moya-Anegón, F. (2020). Frecuencia de publicación e impacto de la producción científica mundial. Scimago Lab. https://www.scimagolab. com/blog/2020/frecuencia-de-publicacion-e-impacto-de-la-produccion-cienfifica-mundial.
De-Rijcke, S., Wouters, P. F., Rushforth, A. D., Franssen, T. P. y Hammarfelt, B. (2016). Evaluation practices and effects of indicator use: a literature review. Research evaluation, 25(2), 161-169. https://doi.org/10.1093/reseval/rvv038
Delgado-López-Cózar, E., Martín-Martín, A. (2019). El Factor de Impacto de las revistas científicas sigue siendo ese número que devora la ciencia española: ¿hasta cuándo? Anuario ThinkEPI, 13, e13e09. https://doi.org/10.3145/thinkepi.2019.e13e09
Delgado-López-Cózar, E., Ràfols, I. y Abadal, E. (2021). Letter: A call for a radical change in research evaluation in Spain. Profesional De La Información, 30(3). https://doi.org/10.3145/epi.2021.may.09
DORA (2012). Declaración de San Francisco sobre la Evaluación de la Investigación. https://sfdora.org/read/es/
Dorta-González, M.I. y Dorta-González, P. (2014). Factor de impacto agregado según campo científico. Investigación Bibliotecológica 28(62), 15-28.
Feenstra, Ramón A. y Delgado-López-Cózar, E. (2021). The footprint of a metrics-based research evaluation system on Spanish philosophical scholarship: an analysis of researchers perceptions. https://arxiv.org/abs/2103.11987
Feenstra, Ramón A., Delgado-López-Cózar, E. y Pallarés-Domínguez, D. (2021). Research misconduct in the fields of ethics and philosophy: researchers’ perceptions in Spain. Science and engineering ethics, 27(1), 1-21. https://doi.org/10.1007/s11948-021-00278-w
Fernández-Cano, A. (2021). Publish, publish… cursed! Scientometrics, 126(4), 3673-3682. https://doi.org/10.1007/s11192-020-03833-7
Giménez Toledo, E. (2014). Imposturas en el ecosistema de la publicación científica. Revista de Investigación Educativa, 32(1), 13-23. http://dx.doi.org/10.6018/rie.32.1.190251
González García, J. M., León Mejía, A. y Peñalba Sotorrio, M. (2016). Cómo escribir y publicar un artículo científico. Síntesis.
Hernández, F. y Maquilón, J. J. (2010). Quality indicators in scientific journals and publishing management system by means of the OJS. Revista de Investigación Educativa, 28(1), 13-29.
Hicks, D.; Wouters, P.; Waltman, L.; De-Rijcke, S. & Ràfols, I. (2015). Bibliometrics: the Leiden Manifesto for research metrics. Nature, v. 520, n. 7548, pp. 429-431. doi: https://doi.org/10.1038/520429a
Lizasoain, L., Joaristi, L., Santiago, C., Lukas, J. F., Moyano, N., Sedano, M. y Munárriz, B. (2003). Uso de las técnicas de segmentación en la evaluación de rendimiento en lenguas. Un estudio en la Comunidad Autónoma Vasca. Revista de Investigacion Educativa, 21(1), 93-111.
Martinsson, A. (2003). Guía para la redacción de artículos científicos destinados a la publicación. (2ªed.). UNESCO.
Moreno-Pulido, A., López-González, M. Á., Rubio-Garay, F., Ángel Saúl, L., y Sánchez- Elvira-Paniagua, Á. (2013). Evolución de las revistas españolas de Ciencias Sociales en el Journal Citation Reports (2006-2010) y su valoración como indicio de calidad en la normativa evaluadora española. Revista Española de Documentación Científica, 36(3). http://dx.doi.org/10.3989/redc.2013.3.987
Onoja, A. A., Babasola, O. L. y Ojiambo, V. (2018). Chi-Square Automatic Interaction Detection Modeling of the effects of Social Media Networks on Students' Academic Performance. Journal of Business and Management, 20(7), 43-51. 10.9790/487X-2007024351
Perales-Palacios, J., Vílchez-González, J. y Gutiérrez-Pérez, J. (2017). Previous author’s information and quality standards for international journals on science education. Investigación Bibliotecológica, 31(72), 139-159. https://doi.org/10.22201/iibi.0187358xp.2017.72.57827
Peralta González, M. J., Frías Guzmán, M. y Gregorio Chaviano, O. (2015). Criteria, classifications and tendencies of bibliometric indicators in the evaluation of the science. Revista Cubana de Información en Ciencias de la Salud (ACIMED), 26(3), 290-309. http://scielo.sld.cu/scielo.php?script=sci_arttext&pid=S2307-21132015000300009
Quintas-Froufe, N. (2016). Indicadores de calidad de las publicaciones científicas en el área de Ciencias Sociales en España: un análisis comparativo entre agencias evaluadores. Revista de Investigación Educativa 34 (1), 259-272. http://dx.doi.org/10.6018/rie.34.1.210191
Rodríguez Pallarés, M., Martín-Quevedo, J. y Prieto-Gutiérrez, J. (2020, Difusión investigativa y posición en el ranking SCImago de las revistas españolas. Investigación Bibliotecológica, 34(84), 13-32. http://dx.doi.org/10.22201/iibi.24488321xe.2020.84.58154
Rodríguez-Sabiote, C. (2017). Análisis bibliométrico mediante indicadores de calidad metodológicos de las revistas RIE (Revista de Investigación Educativa) y RELIEVE (Revista Electrónica de Investigación y Evaluación Educativa) durante el lustro 2012-2016. In AIDIPE (Eds.), XVIII Congreso Internacional de Investigación Educativa. Interdisciplinaridad y Transferencia (pp. 787-798). Salamanca (Spain).
Rodríguez-Sabiote, C. y Álvarez-Rodríguez, J. (2015). Bibliometric study and methodological quality indicators of the journal Porta Linguarum during six year period 2008-2013. Porta Linguarum, (24), 135-150. file:///C:/Users/USUARIO/Downloads/DialnetBibliometricStudyAndMethodologicalQualityIndicator-5198115.pdf
Rodríguez-Sabiote, C. y Úbeda-Sánchez, A. M. (2019a). Bibliometric analysis through methodological quality indicators of Spanish education journals indexed in JCR during the three year period 2014-2016. RELIEVE, 25(1), art. 2. http://doi.org/10.7203/relieve.25.1.12771
Rodríguez-Sabiote, C. y Úbeda-Sánchez, A. M. (2019b). Can the citation scientific indicators of a journal agree with its methodological excellence? En AIDIPE (Eds.), XIX Congreso Internacional de Investigación Educativa. Investigación Comprometida para la Transformación Social (Vol. II) (pp. 44-50). Madrid (Spain).
Rossner, M., Van Epps, H. y Hill, E. (2007). Show me the data. Journal of Cell Biology, 179(6), 1091-1092. https://doi.org/10.1083/jcb.200711140
Ruíz-Pérez, R., Martín-Martín, M., y Delgado-López-Cózar, E. (2015). Las revistas uni¬versitarias en el marco de los criterios de evaluación de la actividad investigadora en España. Revista Española de Documentación Científica, 38(2). http://dx.doi. org/10.3989/redc.2015.2.1191
The PloS Medicine Editors (2006). The impact factor game. PloS Medicine, 3(6), e291. https://doi.org/10.1371/journal.pmed.0030291
Vanclay, J. K. (2012). Impact factor: outdated artefact or stepping-stone to journal certification? Scientometrics, 92(2), 211-238. https://doi.org/10.1007/s11192-011-0561-0
Wilsdon, J.; Bar-Ilan, J.; Frodeman, R.; Lex, E.; Peters, I. ; Wouters, P. (2017).Next generation metrics. Responsible metrics and evaluation for open science. Report of the European Commissions Experts Group on Altmetrics. Brussels: European Commission. https://op.europa.eu/en/publication-detail/-/publication/b858d952-0a19-11e7-8a35-01aa75ed71a1
Copyright (c) 2022 Journal of Educational Research
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The articles and scientific documents published in RIE abide the following conditions:
1. The Servicio de Publicaciones de la Universidad de Murcia (the publisher) has the property rights (copyright) of all the documents published and allows the reuse under the user’s license indicated in point 2.
2. All documents are published in the digital edition of RIE under a Creative Commons Reconocimiento-NoComercial-SinObraDerivada 3.0 España (legal document) license. These documents can be copied, used, distributed, communicated and explained publicly if: i) the author(s) and its original source of publishing (magazine, publisher and URL of the document) are cited; ii) it is not used for commercial purpose; iii) the existence and the specifications about this license are mentioned.
3. Auto-archive’s conditions. The authors are allowed and encouraged to digitally distribute the pre-print versions (a version before evaluation) and/or post-print (a version that it is already evaluated and accepted to its publication). This promotes circulation and distribution earlier and can increase the citations and significance within the academic community.
