Abstract
Research in the Social Sciences and Humanities is published in a variety of formats and types of documents. Local journals are relevant for these fields, particularly in non-English-speaking countries, but coverage of large bibliographic databases is still limited, leading to a large percentage of non-source items. This is an acknowledged challenge for Performance-based Research Funding Systems and also for national evaluation exercises, such as the evaluation of the graduate degree programs performed by CAPES in Brazil. Our assumption is that the evaluation of interdisciplinary research may face similar challenge, particularly when faculty´s disciplinary background is predominantly from the Social Sciences and Humanities. The purpose of this article is to analyse an interdisciplinary research area in Brazil to calculate the percentage of non-source items in its scholarly output, in comparison to the 3 areas in which the majority of its faculty graduated. We extracted 11,000 publications reported by 140 degree programs from the Teaching area -also known as Science Education, and found 77.5% of non-source titles. We also analysed another 50,000 publications from the Education, Astronomy/Physics and Chemistry areas. Comparison showed that the Teaching Area had a similar publication pattern to the Education Area, and typical of the Humanities, which is the predominant Major Area of its faculty graduation. Our conclusion is that faculty disciplinary background may influence publication patterns and stakeholders involved in research evaluation should consider using alternative sources of data when assessing the scholarly output of interdisciplinary research, besides the main international bibliographic databases.
Similar content being viewed by others
References
Akoev, M., Moskaleva, O., & Pislayakow, V. (2018). Confidence and RISC: How Russian papers indexed in the national citation database Russian Index of Science Citation (RISC) characterize universities and research institutes. In 23rd international conference on science and technology indicators – STI. Leiden.
Boyack, K. K. (2014). Including cited non-source items in a large-scale map of science: What difference does it make? Journal of Informetrics, 8, 569–580.
Butler, L. V. (2006). Extending citation analysis to non-source items. Scientometrics, 66(2), 327–343.
CAPES. (2014). CAPES Notícias. Retrieved from: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior: http://www.capes.gov.br/36-noticias/6810-capes-lanca-plataforma-sucupira-para-gestao-da-pos-graduacao.
CAPES. (2017a). Documento de Área Ensino. Brasilia. Retrieved from: http://www.capes.gov.br/images/documentos/Documentos_de_area_2017/DOCUMENTO_AREA_ENSINO_24_MAIO.pdf.
CAPES. (2017b). Planilha de Indicadores. Retrieved from Plataforma Sucupira: http://avaliacaoquadrienal.capes.gov.br/home/planilhas-de-indicadores.
CAPES. (2017c). Qualis. Retrieved from: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior: http://www.capes.gov.br/acessoainformacao/perguntas-frequentes/avaliacao-da-pos-graduacao/7422-qualis.
CAPES. (2017d). Sobre a Avaliação. Retrieved from: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior: http://www.capes.gov.br/avaliacao/sobre-a-avaliacao.
CAPES. (2018). GEOCAPES. Retrieved from: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior: https://geocapes.capes.gov.br/geocapes/.
CAPES. (2019). Quem participa. Retrieved from: Portal de Periódicos: http://www-periodicos-capes-gov-br.ez45.periodicos.capes.gov.br/index.php?option=com_pcontent&view=pcontent&alias=quem-participa&Itemid=110.
CHC. (2019). Sobre a CHC. Retrieved from: Ciência Hoje das Crianças: http://chc.org.br/sobre-a-chc/.
Chi, P.-S. (2013). Do non-source items make a difference in the Social Sciences? 14th International Society of Scientometrics and Informetrics Conference, (pp. 612–625). Viena.
Clarivate Analytics. (2018, 12 5). Master Journal List. Retrieved from Master Journal List: http://mjl.clarivate.com/.
Clarivate Analytics. (2019). The impact factor. https://clarivate.com/essays/impact-factor/.
CNPq. (2016). Painel Lattes-mapa estatístico. Retrieved from: Conselho Nacional de Desenvolvimento Científico e Tecnológico: http://estatico.cnpq.br/painelLattes/mapa/.
CNPq. (2019). Sobre a Plataforma Lattes. Retrieved from: Conselho Nacional de Desenvolvimento Científico e Tecnológico: http://lattes.cnpq.br/.
Collazo-Reyes, F. (2013). Growth of the number of indexed journals of Latin America and the Carribean: the effect on the impact of each country. Scientometrics, 98, 197–209.
Coutinho, R. X. (2012). Brazilian scientific production in science education. Scientometrics, 92(3), 697–710.
Dagiene, E. S. (2015). Dynamics between National Assessment Policy and Domestic Academic Journals. In 15th international conference of the international society for scientometrics and informetrics (pp. 1191–1193). Istanbul.
De Meis, L. A. (2007). The impact of science in Brazil. IUBMB Life, 59(4-5), 227-234. Retrieved 3 5, 2013.
DOAJ. (2019). About DOAJ. Retrieved from Directory of Open Access Journals.
Elsevier. (2018). Scopus Content. Retrieved from Elsevier solutions. https://www.elsevier.com/solutions/scopus/how-scopus-works/content.
ERIC. (2019). About ERIC. Retrieved from Institute of Education Sciences. https://eric.ed.gov/.
Google Scholar. (2019). About Google Scholar. Retrieved from About Google Scholar. https://scholar.google.com/intl/en/scholar/about.html.
Halevi, G. M.-I. (2017). Suitability of Google Scholar as a source of scientific inforation and as a source of data for scientific evaluation: Review of the literature. Journal of Informetrics, 11, 823.
Hicks, D. (1999). The difficulty of achieving full coverage of international social science literature and the bibliometric consequences. Scientometrics, 44, 193–215.
Hicks, D. W. (2010). Coverage and overlap of the new social sciences and humanities journal lists. Journal of the American Society for Information Science and Technology, 62, 284–294.
Hicks, D. (2012). Performance-based university research funding systems. Research Policy, 41, 251–261.
Kulczycki, Emmanuel. (2017). Assessing publications through a bibliometric indicator: The case of comprehensive evaluation of scientific units in Poland. Research Evaluation, 26(1), 41–52.
Latindex. (2019). Retrieved from online regional information systema for scientific journals from Latin America, the Caribbean, Spain and Portugal. http://www.latindex.org/latindex/inicio?lang=en.
Leta, J. G. (2006). Science in Brazil. Part 2: Sectoral and institutional research profiles. Scientometrics, 67(1), 87–105.
Madrid-Martín, M. J.-F.-M. (2017). Revistas brasileñas de Educación en Scopus: un análisis bibliométrico. Biblios, 67. http://biblios.pitt.edu/ojs/index.php/biblios/article/view/344.
Medina-Jerez, W. (2018). Science education research trends in Latin America. International Journal of Science and Mathematics Education, 16, 465–485.
Moed, H. (2005). Citation analysis in research evaluation. Dodrecht: Springer.
ORCID. (2019). What is ORCID. Retrieved from ORCID: https://orcid.org/about.
RBECT. (2019). Focus and Scope. Retrieved from: Revista Brasileira de Ensino de Ciência e Tecnologia: https://periodicos.utfpr.edu.br/rbect/about/editorialPolicies.
Schneider, Jesper. (2009). An outline of the bibliometric indicator used for performance-based funding of research institutions in Norway. European Political Science, 8, 364–378.
SciELO. (2018). Jornals by publication years. Retrieved from Collection Indicators: http://www.scielo.org/php/level.php?lang=en&component=42&item=26.
Stokols, et al. (2003). Evaluating transdisciplinary science. Nicotine & Tobacco Research, 5, S21–S39.
UFRGS. (2018). Universidade Federal do Rio Grande Do Sul. Retrieved from: Programa de Pós-Graduação em Ensino de Física: http://www.if.ufrgs.br/ppgenfis/index.php.
Viggiani, E., Calabró, L. (2019). Using a local database to uncover non-source items: The case of Science Education in Brazil using the Sucupira Platform. In Catalano, G., Daraio, C., Gregori, M., Moed, H., Rouco, G. (Eds.), Proceedings of ISSI 2019 Rome: 17th international society of scientometrics and informetrics conference, Rome, Italy, September 2–9, 2019 (pp. 1075–1085). Edizioni Efesto.
Wagner, C. S., et al. (2011). Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature. Journal of Informetrics, 165, 14–26.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Viggiani, E., Calabró, L. Does faculty disciplinary background play a role in the publication pattern of an interdisciplinary research area? The case of science education in Brazil. Scientometrics 125, 893–908 (2020). https://doi.org/10.1007/s11192-020-03593-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-020-03593-4
Keywords
- Research assessment
- Interdisciplinary research
- Faculty disciplinary background
- Database coverage
- Publication patterns
- Brazil