Methodological quality assessment tools of non-experimental studies: a systematic review

Authors

  • Alexander Jarde Universitat Autònoma de Barcelona
  • Josep-Maria Losilla Universitat Autònoma de Barcelona
  • Jaume Vives Universitat Autònoma de Barcelona
DOI: https://doi.org/10.6018/analesps.28.2.148911
Keywords: Non-experimental studies, methodological quality, quality assessment tools, systematic review

Supporting Agencies

  • his research was supported by Grant PSI2010-16270 from the Spanish Ministry of Science and Innovation (Spain).

Abstract

The evaluation of the methodological quality of primary studies in systematic reviews is of great importance in order to guarantee the validity and reliability of their results, but there is no agreement on which tool should be used. Our aim is to analyze the tools proposed so far for the assessment of cohort, case-control, and cross-sectional studies in psychology and health sciences. A systematic review was performed using 5 electronic databases and Google®. In order to analyze the tools’ content, 6 domains of quality were defined based on reporting guidelines, the established bibliography, and previous similar studies. 74 tools were identified and analyzed. Few reported their reliability (20%) or validity (14%). The most frequently addressed content domains were Data collection (71.6%), Selection (67.6%), Statistics and data analysis (67.6%), and Measurement (58.1%); only 35.1% addressed Representativeness, and 6.8% addressed Funding. Despite the strengths we found scattered among the tools, there is no single obvious choice if we had to make any recommendation. Methodological quality assessment tools of non-experimental studies should meet standardized development criteria, but previously it is necessary to reach an agreement on which content domains they should take into account.

Downloads

Download data is not yet available.
How to Cite
Jarde, A., Losilla, J.-M., & Vives, J. (2012). Methodological quality assessment tools of non-experimental studies: a systematic review. Anales de Psicología / Annals of Psychology, 28(2), 617–628. https://doi.org/10.6018/analesps.28.2.148911
Issue
Vol. 28 No. 2 (2012)
Section
Methodology

 

The works published in this journal are subject to the following terms:
1. The Publications Service of the University of Murcia (the publisher) retains the property rights (copyright) of published works, and encourages and enables the reuse of the same under the license specified in paragraph 2.

© Servicio de Publicaciones, Universidad de Murcia, 2022

2. The works are published in the online edition of the journal under a Creative Commons Reconocimiento-CompartirIgual 4.0 (legal text). You can copy, use, distribute, transmit and publicly display, provided that: i) you cite the author and the original source of publication (journal, editorial and URL of the work), ii) are not used for commercial purposes, iii ) mentions the existence and specifications of this license.


This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

3. Conditions of self-archiving. Is allowed and encouraged the authors to disseminate electronically pre-print versions (version before being evaluated and sent to the journal) and / or post-print (version reviewed and accepted for publication) of their works before publication, as it encourages its earliest circulation and diffusion and thus a possible increase in its citation and scope between the academic community. RoMEO Color: Green.