Purpose

This paper aims to propose a set of quantitative statistical indicators for measuring the scientific relevance of research groups and researchers, based on high-impact open-access digital production repositories.

Design/methodology/approach

An action research (AR) methodology is proposed in which research is associated with the practice; research informs practice and practice is responsible for informing research in a cooperative way. AR is divided into five phases, beginning with the definition of the problematic scenario and an analysis of the state of the art and ending with conducting tests and publishing the results.

Findings

The proposed indicators were used to characterise group and individual output in a major public university in south-eastern Mexico. University campuses hosting a large number of high-impact research groups. These indicators were very useful in generating information that confirmed specific assumptions about the scientific production of the university.

Research limitations/implications

The data used here were retrieved from Scopus and open access national repository of Mexico. It would be possible to use other data sources to calculate these indicators.

Practical implications

The system used to implement the proposed indicators is independent of any particular technological tool and is based on standards for metadata description and exchange, thus facilitating the easy integration of new elements for evaluation.

Social implications

Many organisations evaluate researchers according to specific criteria, one of which is the prestige of journals. Although the guidelines differ between evaluation bodies, relevance is measured based on elements that can be adapted and where some have greater weight than others, including the prestige of the journal, the degree of collaboration with other researchers and individual production, etc. The proposed indicators can be used by various entities to evaluate researchers and research groups. Each country has its own organisations that are responsible for evaluation, using various criteria based on the impact of the publications.

Originality/value

The proposed indicators assess based on the importance of the types of publications and the degree of collaborations. However, they can be adapted to other similar scenarios.

中文翻译：

---

一种用于数字存储库和元数据中学术成果和研究的相关性的索引系统

目的

本文旨在基于高影响力的开放获取数字产品存储库，提出一套量化的统计指标，以衡量研究小组和研究人员的科学相关性。

设计/方法/方法

提出了一种行动研究（AR）方法论，其中研究与实践有关；研究告知实践，实践负责以合作的方式告知研究。AR分为五个阶段，从定义有问题的场景开始，对现有技术进行分析，最后到进行测试并发布结果。

发现

拟议的指标用于表征墨西哥东南部一所主要公立大学的团体和个人产出。大学校园内设有大量具有高影响力的研究小组。这些指标在生成确认有关大学科学生产的特定假设的信息时非常有用。

研究局限/意义

这里使用的数据是从墨西哥的Scopus和开放访问国家资料库中检索到的。可以使用其他数据源来计算这些指标。

实际影响

用于实施建议指标的系统独立于任何特定的技术工具，并且基于元数据描述和交换的标准，因此有助于轻松集成新的评估元素。

社会影响

许多组织根据特定标准评估研究人员，其中之一就是期刊的声誉。尽管评估机构之间的准则有所不同，但相关性是根据可以调整的要素来衡量的，其中一些要素的权重要高于其他要素，包括期刊的声望，与其他研究人员的协作程度以及个人研究成果等。拟议指标可以被各种实体用来评估研究人员和研究小组。每个国家都有自己的组织，负责根据出版物的影响使用各种标准进行评估。

创意/价值

拟议指标根据出版物类型的重要性和合作程度进行评估。但是，它们可以适用于其他类似方案。