Skip to main content
SpringerLink
Log in

Revisiting Methodology for Identifying Open Access Advantages

  • Published:
Publishing Research Quarterly Aims and scope

Abstract

Although many empirical studies have investigated whether open access increases citations, researchers have not reached a consensus regarding the issue. This study revisited the methodology for identifying the effects of open access and revealed the causes for contradictory conclusions using four indices for journals that transitioned from subscription to open access. The four indices are two citation scores along with the number of citations and number of articles for eight journals independently launched by leading publishers. Correlation coefficients were used to compare the time trends in the values of the four indices. Although the aggregated data of the eight journals indicated that open access had a positive effect, the effect varied across journals. A few journals produced different results between the two citation scores as well as between citation scores and number of citations or articles. Furthermore, a publisher’s choice of which journal to shift to open access influenced their performance after the shift. Therefore, results varied based on the choice of journals, indices, and types of data (aggregated vs. individual journals), leading to contradictory conclusions regarding open access advantages.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Lawrence S. Online or invisible? Nature. 2001;411(6837):521.

    Article  Google Scholar 

  2. Antelman K. Do open-access articles have a greater research impact? Coll Res Libr News. 2004;65(5):372–82.

    Article  Google Scholar 

  3. Björk BC, Solomon D. Open access versus subscription journals: a comparison of scientific impact. BMC Med. 2012;10:73.

  4. Piwowar H, Priem J, Larivière V, Alperin JP, Matthias L, Norlander B, Farley A, West J, Haustein S. The state of OA: a large-scale analysis of the prevalence and impact of open access articles. PeerJ. 2018;6: e4375.

    Article  Google Scholar 

  5. Perianes-Rodríguez A, Olmeda-Gómez C. Effects of journal choice on the visibility of scientific publications: a comparison between subscription-based and full open access models. Scientometrics. 2019;121(3):1737–52.

    Article  Google Scholar 

  6. Sotudeh H, Ghasempour Z, Yaghtin M. The citation advantage of author-pays model: the case of Springer and Elsevier OA journals. Scientometrics. 2015;104(2):581–608.

    Article  Google Scholar 

  7. Hua F, Sun H, Walsh T, Glenny AM, Worthington H. Open access to journal articles in oncology: current situation and citation impact. Ann Oncol. 2017;28(10):2612–7.

    Article  Google Scholar 

  8. AlRyalat SA, Nassar AA, Tamimi F, Al-fraihat E, Assaf L, Ghareeb R, Masoudi M, Al-Essa M. The impact of the open-access status on journal indices. J Gastrointest Oncol. 2019;10(4):777–82.

    Article  Google Scholar 

  9. Pollock D, Michael A. Open access myth busting: testing two prevailing assumptions about the effects of open access adoption. Learn Publ. 2018;32(1):7–12.

    Article  Google Scholar 

  10. Eysenbach G. Citation advantage of open access articles. PLoS Biol. 2006;4(5): e157.

    Article  Google Scholar 

  11. Frandsen TF. The integration of open access journals in the scholarly communication system: three science fields. Inform Proc Manag. 2009;45(1):131–41.

    Article  Google Scholar 

  12. Lansingh VC, Carter MJ. Does open access in ophthalmology affect how articles are subsequently cited in research? Ophthalmology. 2009;116(8):1425–31.

    Article  Google Scholar 

  13. Davis PM. Author-choice open-access publishing in the biological and medical literature: a citation analysis. J Am Soc Inform Sci Technol. 2009;60(1):3–8.

    Article  Google Scholar 

  14. Davis PM. Open access, readership, citations: a randomized controlled trial of scientific journal publishing. FASEB J. 2011;25(7):2129–34.

    Article  Google Scholar 

  15. McCabe MJ, Snyder CM. Identifying the effect of open access on citations using a panel of science journals. Econ Inq. 2014;52(4):1284–300.

    Article  Google Scholar 

  16. Li Y, Wu C, Yan E, Li K. Will open access increase journal CiteScores? An empirical investigation over multiple disciplines. PLoS ONE. 2018;13(8): e0201885.

    Article  Google Scholar 

  17. Breugelmans JG, Roberge G, Tippett C, Durning M, Struck DB, Makanga MM. Scientific impact increases when researchers publish in open access and international collaboration: a bibliometric analysis on poverty-related disease papers. PLoS ONE. 2018;13(9): e0203156.

    Article  Google Scholar 

  18. Patel RB, Vaduganathan M, Mosarla RC, Venkateswaran RV, Bhatt DL, Bonow RO. Open access publishing and subsequent citations among articles in major cardiovascular journals. Am J Med. 2019;132(9):1103–5.

    Article  Google Scholar 

  19. Mueller-Langer F, Watt R. How many more cites is a $3,000 open access fee buying you? Empirical evidence from a natural experiment. Econ Inq. 2018;56(2):931–54.

    Article  Google Scholar 

  20. Alkhawtani RHM, Kwee TC, Kwee RM. Citation advantage for open access articles in European Radiology. Eur Radiol. 2020;30(1):482–6.

    Article  Google Scholar 

  21. Clayson PE, Baldwin SA, Larson MJ. The open access advantage for studies of human electrophysiology: impact on citations and Altmetrics. Int J Psychophysiol. 2021;164:103–11.

    Article  Google Scholar 

  22. Cooney-McQuat S, Busch S, Kahn D. Open access publishing: a viable solution for society publishers. Learn Publ. 2010;23(2):101–5.

    Article  Google Scholar 

  23. Bautista-Puig N, Lopez-IIIescas C, de Moya-Anegon F, Guerrero-Bote V, Moed HF. Do journals flipping to gold open access show an OA citation or publication advantage? Scientometrics. 2020;124(3):2551–75.

    Article  Google Scholar 

  24. Momeni F, Mayr P, Fraser N, Peters I. What happens when a journal converts to open access? A bibliometric analysis. Scientometrics. 2021;126(12):9811–27.

    Article  Google Scholar 

  25. Langham-Putrow A, Bakker C, Riegelman A. Is the open access citation advantage real? A systematic review of the citation of open access and subscription-based articles. PLoS ONE. 2021;16: e0253129.

    Article  Google Scholar 

  26. Laakso M, Solomon D, Björk BC. How subscription-based scholarly journals can convert to open access: a review of approaches. Learn Publ. 2016;29(4):259–69.

    Article  Google Scholar 

  27. SCOAP3 journals. Sponsoring Consortium for Open Access Publishing in Particle Physics. https://scoap3.org/phase3-journals/. Accessed 2 Aug 2021.

  28. González-Pereira B, Guerrero-Bote VP, Moya-Anegón F. A new approach to the metric of journals’ scientific prestige: the SJR indicator. J Inform. 2010;4(3):379–91.

    Article  Google Scholar 

  29. Moed HF. Measuring contextual citation impact of scientific journals. Informet. 2010;4(3):265–77.

    Article  Google Scholar 

  30. Nicholas D, Huntington P, Jamali HR. The impact of open access publishing (and other access initiatives on use and users of digital scholarly journals. Learn Publ. 2007;20(1):11–5.

    Article  Google Scholar 

  31. Craig ID, Plume AM, McVeigh ME, Pringle J, Amin M. Do open access articles have greater citation impact? A critical review of the literature. J Inform. 2007;1(3):239–48.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Japan Society for the Promotion of Science, KAKENHI (Grant Number 20K01663).

Author information

Authors and Affiliations

  1. School of Political Science and Economics, Meiji University, 1-1 Kanda-Surugadai, Chiyoda-Ku, Tokyo, 101-8301, Japan

    Sumiko Asai

Authors
  1. Sumiko Asai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sumiko Asai.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Asai, S. Revisiting Methodology for Identifying Open Access Advantages. Pub Res Q 39, 107–119 (2023). https://doi.org/10.1007/s12109-023-09946-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12109-023-09946-0

Keywords

Search

Navigation