Analysis of the Impact of the International Journal of Environmental Research and Public Health Delisting from the Web of Science on the Field of Public, Environmental and Occupational Health

Authors

DOI: https://doi.org/10.6018/red.608581
Keywords: Megajournal, Multidisciplinary Digital Publishing Institute (MDPI), Clarivate's journal delisting, scientific publishing in public, environmental and occupational health, International Journal of Environmental Research and Public Health (IJERPH)

Abstract

In March 2023, Clarivate delisted the flagship megajournal of the Multidisciplinary Digital Publishing Institute (MDPI), the International Journal of Environmental Research and Public Health (IJERPH), e-ISSN: 1660-4601, which had ranked second worldwide in open access output in 2022, shocking the entire scientific community. This affected thousands of researchers since research assessment experts and funders consider WoS a “whitelist” of journals. Among them, the ones in the field of public, environmental and occupational health stand out. In the previous years, attracted by its position in the first quartile (Q1) of the Journal Impact Factor (JIF) ranking of the Clarivate’s Journal Citation Reports (JCR), and taking advantage of a low article processing charge, a fast turnaround and a low rejection rate, they published around 20 % of the area production indexed in WoS in IJERPH. This paper analyses the consequences of IJERPH’s delisting from WoS on the publishing dynamics of the area, making especial focus on its researchers’ output and its impact. Results show that, after IJERPH’s delisting, publications have not been reallocated within the area, losing more than 30 % of its output indexed in WoS in 2023. Moreover, neither megajournals of similar disciplines nor multidisciplinary ones absorbed the lost documents. Finally, even the frequent IJERPH’s authors lost half of their output indexed in WoS in 2023, degrading their JIF-Q1 presence (JCR 2022) in equal proportion.

Downloads

Download data is not yet available.

References

Ansede, M. (2023). La burbuja de las revistas científicas se traga millones de euros de dinero público. El País.

Aubert Bonn, N. y Bouter, L. (2023). Research Assessments Should Recognize Responsible Research Practices. Narrative Review of a Lively Debate and Promising Developments BT - Handbook of Bioethical Decisions. Volume II: Scientific Integrity and Institutional Ethics (E. Valdés y J. A. Lecaros (eds.); pp. 441–472). Springer International Publishing. https://doi.org/10.1007/978-3-031-29455-6_27

Aubert Bonn, N. y Pinxten, W. (2021). Advancing science or advancing careers? Researchers’ opinions on success indicators. PLOS ONE, 16(2), e0243664.

Binfield, P. (2013). Open access megajournals – have they changed everything? Creative Commons Blog. http://creativecommons.org.nz/2013/10/open-accessmegajournals-have-they-changed-everything/

Björk, B.-C. (2015). Have the “mega-journals” reached the limits to growth? PeerJ, 3, e981. https://doi.org/10.7717/peerj.981

Björk, B.-C. y Solomon, D. (2012). Open access versus subscription journals: a comparison of scientific impact. BMC Medicine, 10(1), 73. https://doi.org/10.1186/1741-7015-10-73

Brito, R. y Rodríguez-Navarro, A. (2019). Evaluating research and researchers by the journal impact factor: Is it better than coin flipping? Journal of Informetrics, 13(1), 314–324. https://doi.org/https://doi.org/10.1016/j.joi.2019.01.009

Clarivate. (2021a). Indicator Handbooks. Clarivate InCites Help. https://incites.help.clarivate.com/Content/Indicators-Handbook/ih-about.htm

Clarivate. (2021b). Journal Citation Reports Help. Clarivate. https://jcr.help.clarivate.com/Content/home.htm

Clarivate. (2021c). Web of Science Help. Clarivate. https://webofscience.help.clarivate.com/Content/home.htm

Clarivate. (2023). InCites Help. Clarivate. https://incites.help.clarivate.com/Content/home.htm

CoARA. (2022). The Agreement on Reforming Research Assessment. https://coara.eu/agreement/the-agreement-full-text/

Cortegiani, A., Manca, A., Lalu, M. y Moher, D. (2020). Inclusion of predatory journals in Scopus is inflating scholars’ metrics and advancing careers. En International journal of public health (Vol. 65, Issue 1, pp. 3–4). https://doi.org/10.1007/s00038-019-01318-w

Crosetto, P. (2023). MDPI_special_issues.

Dinis-Oliveira, R. J. (2022). Open-access Mega-journals in Health and Life Sciences: What Every Researcher needs to know about this Publishing Model. En Current drug research reviews (Vol. 14, Issue 1, pp. 3–5). https://doi.org/10.2174/2589977514666220209101713

Eckert, M. (2024). Safeguarding peer review to ensure quality at scale. Frontiers-Science News. https://www.frontiersin.org/news/2024/01/09/safeguarding-peer-review-to-ensure-quality-at-scale

Garfield, E. (2006). The History and Meaning of the Journal Impact Factor. JAMA, 295(1), 90–93. https://doi.org/10.1001/jama.295.1.90

Guerrero-Bote, V. P. y Moya-Anegón, F. (2012). A further step forward in measuring journals’ scientific prestige: The SJR2 indicator. Journal of Informetrics, 6(4), 674–688. https://doi.org/https://doi.org/10.1016/j.joi.2012.07.001

Hanson, M. (2023). MDPI mega-journal delisted by Clarivate / Web of Science. M.A. HANSON RESEARCH. https://mahansonresearch.weebly.com/blog/mdpi-mega-journal-delisted-by-clarivate-web-of-science

Hanson, M., Gomez Barreiro, P., Crosetto, P. y Brockington, D. (2023). The strain on scientific publishing. https://doi.org/10.48550/arXiv.2309.15884

Heaney, K. (2023). Unveiling the Journal Citation Reports 2023: Supporting research integrity with trusted tools and data. . Clarivate. https://clarivate.com/blog/unveiling-the-journal-citation-reports-2023-supporting-research-integrity-with-trusted-tools-and-data/

Heneberg, P. (2019). The troubles of high-profile open access megajournals. Scientometrics, 120(2), 733–746. https://doi.org/10.1007/s11192-019-03144-6

Hicks, D., Wouters, P., Waltman, L., de Rijcke, S. y Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature, 520(7548), 429–431. https://doi.org/10.1038/520429a

Ioannidis, J. P. A., Pezzullo, A. M. y Boccia, S. (2023). The Rapid Growth of Mega-Journals: Threats and Opportunities. JAMA, 329(15), 1253–1254. https://doi.org/10.1001/jama.2023.3212

Kincaid, E. (2023a). Nearly 20 Hindawi journals delisted from leading index amid concerns of papermill activity. Retraction Watch. https://retractionwatch.com/2023/03/21/nearly-20-hindawi-journals-delisted-from-leading-index-amid-concerns-of-papermill-activity/

Kincaid, E. (2023b). Wiley to stop using “Hindawi” name amid $18 million revenue decline. Retraction Watch. https://retractionwatch.com/2023/12/06/wiley-to-stop-using-hindawi-name-amid-18-million-revenue-decline/

Larivière, V. y Sugimoto, C. R. (2019). The Journal Impact Factor: A Brief History, Critique, and Discussion of Adverse Effects BT - Springer Handbook of Science and Technology Indicators (W. Glänzel, H. F. Moed, U. Schmoch y M. Thelwall (eds.); pp. 3–24). Springer International Publishing. https://doi.org/10.1007/978-3-030-02511-3_1

McKiernan, E. C., Schimanski, L. A., Muñoz Nieves, C., Matthias, L., Niles, M. T. y Alperin, J. P. (2019). Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations. ELife, 8, e47338. https://doi.org/10.7554/eLife.47338

MDPI. (2023). Clarivate Discontinues IJERPH and JRFM Coverage in Web of Science. MDPI. https://www.mdpi.com/about/announcements/5536

Niles, M. T., Schimanski, L. A., McKiernan, E. C. y Alperin, J. P. (2020). Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations. PLoS One. https://doi.org/10.1371/journal.pone.0228914

Nugent, K., Edriss, H., Ball, S. y Björk, B.-C. (2018). Mega Journals, Scientifically Sound Peer Review and Medical Organizations. The American Journal of the Medical Sciences, 357. https://doi.org/10.1016/j.amjms.2018.09.003

Paulus, F. M., Cruz, N. y Krach, S. (2018). The Impact Factor Fallacy. Frontiers in Psychology, 9(1487). https://doi.org/https://doi.org/10.3389/fpsyg.2018.01487

Petersen, A. M., Pan, R. K., Pammolli, F. y Fortunato, S. (2019). Methods to account for citation inflation in research evaluation. Research Policy, 48(7), 1855–1865. https://doi.org/https://doi.org/10.1016/j.respol.2019.04.009

Petrou, C. (2020). MDPI’s Remarkable Growth. The Scholarly Kitchen. https://scholarlykitchen.sspnet.org/2020/08/10/guest-post-mdpis-remarkable-growth/

Petrou, C. (2023). Reputation and Publication Volume at MDPI and Frontiers. Scholarly Kitchen. https://scholarlykitchen.sspnet.org/2023/09/18/guest-post-reputation-and-publication-volume-at-mdpi-and-frontiers-the-1b-question/

Pontika, N., Klebel, T., Correia, A., Metzler, H., Knoth, P. y Ross-Hellauer, T. (2022). Indicators of research quality, quantity, openness, and responsibility in institutional review, promotion, and tenure policies across seven countries. Quantitative Science Studies, 3(4), 888–911. https://doi.org/10.1162/qss_a_00224

Quaderi, N. (2023). Supporting integrity of the scholarly record: Our commitment to curation and selectivity in the Web of Science. Clarivate. https://clarivate.com/blog/supporting-integrity-of-the-scholarly-record-our-commitment-to-curation-and-selectivity-in-the-web-of-science/

Quaderi, N. (2024). 2024 Journal Citation Reports: Changes in Journal Impact Factor category rankings to enhance transparency and inclusivity. Clarivate. https://clarivate.com/blog/2024-journal-citation-reports-changes-in-journal-impact-factor-category-rankings-to-enhance-transparency-and-inclusivity/

Rehn, C., Wadskog, D., Gornitzki, C. y Larsson, A. (2014). Bibliometric indicators – definitions and usage at Karolinska Institutet.

Repiso-Caballero, R. y Delgado-Vázquez, Á.-M. (2023). Fallen Journals 2023. Implicaciones para la ciencia española de la expulsión de revistas en Web of Science . Revista Mediterránea de Comunicación, 0(0 SE-Miscelánea).

Rice, D. B., Raffoul, H., Ioannidis, J. P. A. y Moher, D. (2020). Academic criteria for promotion and tenure in biomedical sciences faculties: cross sectional analysis of international sample of universities. BMJ, 369, m2081. https://doi.org/10.1136/bmj.m2081

Rushforth, A. y De Rijcke, S. (2024). Practicing responsible research assessment: Qualitative study of faculty hiring, promotion, and tenure assessments in the United States. Research Evaluation, rvae007. https://doi.org/10.1093/reseval/rvae007

Rushforth, A. y Hammarfelt, B. (2023). The rise of responsible metrics as a professional reform movement: A collective action frames account. Quantitative Science Studies, 4(4), 879–897. https://doi.org/10.1162/qss_a_00280

Sandesh, N. y Wahrekar, S. (2017). Choosing the scientific journal for publishing research work: perceptions of medical and dental researchers. Clujul Medical (1957), 90(2), 196–202. https://doi.org/10.15386/cjmed-704

Schloss, P. y Cuomo, C. (2023). More evidence of Impact Factor Mania. Microbiology Spectrum, 11. https://doi.org/10.1128/spectrum.03496-23

SCImago. (s.f.). SJR – SCImago Journal & Country Rank. SCImago LAB. Retrieved June 10, 2023, from https://www.scimagolab.com/productos/sjr-scimago-journal-country-rank/

Siler, K., Larivière, V. y Sugimoto, C. R. (2020). The diverse niches of megajournals: Specialism within generalism. Journal of the Association for Information Science and Technology, 71(7), 800–816. https://doi.org/https://doi.org/10.1002/asi.24299

Solomon, D. J. (2014). A survey of authors publishing in four megajournals. PeerJ, 2, e365. https://doi.org/10.7717/peerj.365

Spezi, V., Wakeling, S., Pinfield, S., Creaser, C., Fry, J. y Willett, P. (2017a). Open-access mega-journals: The future of scholarly communication or academic dumping ground? A review. Journal of Documentation, 73(2), 263–283. https://doi.org/https://doi.org/10.1108/JD-06-2016-0082

Spezi, V., Wakeling, S., Pinfield, S., Creaser, C., Fry, J. y Willett, P. (2017b). Open-access mega-journals. Journal of Documentation, 73(2), 263–283. https://doi.org/10.1108/JD-06-2016-0082

Szomszor, M. (2021). Introducing the Journal Citation Indicator: A new, field-normalized measurement of journal citation impact. Clarivate. https://clarivate.com/blog/introducing-the-journal-citation-indicator-a-new-field-normalized-measurement-of-journal-citation-impact/

Torres-Salinas, D., Orduna-Malea, E., Delgado-Vázquez, Á. y Arroyo-Machado, W. (2024). Fundamentos de Bibliometría Narrativa. https://doi.org/10.5281/zenodo.10512837

Wakeling, S., Creaser, C., Pinfield, S., Fry, J., Spezi, V., Willett, P. y Paramita, M. (2019). Motivations, understandings, and experiences of open-access mega-journal authors: Results of a large-scale survey. Journal of the Association for Information Science and Technology, 70(7), 754–768. https://doi.org/https://doi.org/10.1002/asi.24154

Wakeling, S., Willett, P., Creaser, C., Fry, J., Pinfield, S. y Spezi, V. (2017). Transitioning from a Conventional to a ‘Mega’ Journal: A Bibliometric Case Study of the Journal Medicine. En Publications (Vol. 5, Issue 2). https://doi.org/10.3390/publications5020007

Published
30-06-2024
How to Cite
Parodi, M. (2024). Analysis of the Impact of the International Journal of Environmental Research and Public Health Delisting from the Web of Science on the Field of Public, Environmental and Occupational Health . Distance Education Journal, 24(79). https://doi.org/10.6018/red.608581