Skip to main content
SpringerLink
Log in

Evaluating Researchers Based on the Criteria of Reputation Responsibility

  • Published:
Scientific and Technical Information Processing Aims and scope

Abstract—

This article considers the problems of developing objective criteria for evaluating researchers. The approaches to assessing academic reputation are shown to be similar to those for assessing corporate goodwill. The elements that make up academic reputation are identified. A technique of ranking researchers by reputation that combines scientometric indicators with peer appraisal is proposed. The principle of selecting peer committee members based on bibliometric indicators is enunciated. The application of collective peer appraisal methods to the construction of the scales of the indicators of the proposed reputation ranking is shown. The concept of an automated system intended for compiling the proposed reputation ranking of researchers is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. Orlova, M.G., The teacher’s reputation rating as an indicator of the university’s competitiveness, in Materialy Mezhdunarodnoi nauchno-metodicheskoi konferentsii “Aktual’nye problemy modernizatsii vysshei shkoly” (Proc. Int. Sci. Methodol. Conf. Current Problems of Higher School Modernization), Novosibirsk, 2014.

  2. Alekseeva, E.P., Management of the process of formation of reputation capital in modern Russian companies, Ross. Predpr., 2012, no. 1, pp. 110–113.

  3. Grekova, G.I. and Savina, T.S., The influence of corporate social responsibility on the formation of business reputation, Vestn. Novgorod. Gos. Univ. im. Yaroslava Mudrogo, 2011, no. 61, pp. 49–53.

  4. Kozlova, N., Business reputation management and development of relations with stakeholders, RISK: Resur. Inf. Snabzh. Konkurentsiya, 2011, no. 4, pp. 312–316.

  5. Mavrina, N.A., The essence of human capital and features of investments in it, Vestn. Chelyab. Gos. Univ., 2008, no. 29, pp. 10–14.

  6. Kolesnikova, Yu.S., Scientific activity as a means of investing in human capital, Kazan. Ekon. Vestn., 2015, no. 5, pp. 20–23.

  7. Rodionov, D.G., Kushneva, O.A., and Rudskaya, I.A., University ranking as a tool in competition in the global market of educational services, Innovatsii, 2013, no. 11, pp. 89–97.

  8. Reznik, S.D. and Yudina, T.A., High school reputation: Problems, experience, and prospects, Vyssh. Obraz. Ross., 2017, no. 1, pp. 56–61.

  9. Petsol’dt, K., Vorob’eva, I.V., and Inozemtseva, E.S., Teacher’s reputation and its role in improving the competitiveness of the university in the global market of educational services, Probl. Sovrem. Ekon., 2010, no. 2, pp. 433–437.

  10. Robotova, A.S., About the features of modern scientific and pedagogical discourse, Vyssh. Obraz. Ross., 2011, no. 7, pp. 9–19.

  11. Dulyasova, M.V., Khannanova, T.R., and Islamgalieva, E.R., Business reputation as a multi-level system, Neftegazov. Delo, 2006, no. 1, p. 65.

  12. Petrova, L.E., Scientific citation indices and scientific electronic libraries: The potential and its implementation by university teachers, Vestn. Sots.-Gumanit. Obraz. Nauki, 2014, no. 2, pp. 79–87.

  13. Ivanov, G.G. and Maiorova, E.A., Business reputation and trade efficiency, Ekon. Chasopis-XXI, 2014, nos. 1–2, pp. 54–57.

  14. Saha, S., Saint, S., and Christakis, D.A., Impact factor: A valid measure of journal quality?, J. Med. Libr. Assoc., 2003, vol. 91, no. 1, pp. 42–46.

    Google Scholar 

  15. Kamshibaev, E.E., Postdoctoral studies: A new level of training for modern managers, Materialy mezhdunarodnoi zaochnoi nauchno-prakticheskoi konferentsii “Teoriya i praktika sovremennogo menedzhmenta” (Proc. Int. Correspondence Scientific-Practical Conference Theory and Practice of Modern Management), Novosibirsk, 2010.

  16. Shoven, P.M., Sociology of reputations, Otechestvennye Zap., 2014, no. 1, pp. 85–99.

  17. Chernysheva, T.Yu., A hierarchical model for evaluating and selecting experts, Dokl. Tomsk. Gos. Univ. Sist. Upr. Radioelektron., 2009, no. 1-1, pp. 168–173.

  18. Korobov, V.B., Comparative analysis of methods for determining weights of “influencing factors,” Sotsiol.: Metodol. Metody Mat. Model., 2005, no. 20, pp. 54–73.

  19. Glotov, V.A. and Pavel’ev, V.V., Expert methods for determining weighting coefficients, Avtom. Telemekh., 1976, no. 12, pp. 95–107.

  20. Asatulin, R.R. and Akhmed’yanov, A.U., Development of the method of expert assessments using relative values, Tochnaya Nauka, 2019, no. 39, pp. 4–6.

  21. Belokurov, S.V., Zybin, D.G., Sidel’nikov, A.P., and Sotnikov, N.V., Modeling the processing of expert knowledge for the technique of extrapolating expert estimates, Materialy Mezhdunarodnoi nauchno-prakticheskoi mezhvedomstvennoi konferentsii “Tekhnika i bezopasnost’ ob’’ektov ugolovno-ispolnitel’noi sistemy” (Proc. Int. Sci.-Pract. Interdepartmental Conference Technology and Safety of Objects of the Penal System), Voronezh, 2016.

  22. Khalafyan, A.A., Temerdashev, Z.A., Yakuba, Yu.F., Kiseleva, N.V., Guguchkina, T.I., and Antonenko, M.V., Positional analysis as a method for assessing the consistency of expert assessments, Zavod. Lab.,Diagn. Mater., 2015, vol. 81, no. 12, pp. 69–78.

    Google Scholar 

  23. Il’yasov, B.G., Karamzina, A.G., and Suyargulova, Yu.R., The method of expert assessments in determining the effectiveness of scientific activity, Materialy 3-ei Mezhdunarodnoi konferentsii po intellektual’nym tekhnologiyam obrabotki i upravleniya informatsiei (ITOUI-2015) (Proc. 3rd Int. Conf. on Intelligent Technologies for Information Processing and Management (ITOUI-2015)), Ufa, 2015.

  24. Nishchuk, E.P. and Reznichenko, S.V., The essence and analysis of the method of expert estimates and the main approaches to its use, Problemy identifikatsii, kachestva i konkurentosposobnosti potrebitel’skikh tovarov (Problems of Identification, Quality, and Competitiveness of Consumer Goods), 2017, pp. 206–210.

  25. Chernousova, M.V., Methods of expert estimates. The Delphi method, Trudy Mezhdunarodnoi nauchno-tekhnicheskoi konferentsii molodykh uchenykh BGTU im. V.G. Shukhova (Proc. Int. Sci.-Tech. Conference of Young Scientists of Shukhov Belgorod State Technical University), Belgorod, 2017.

  26. Apatova, N.V., Gaponov, A.I., and Smirnova, O.Yu., Assessing the level of development of competencies based on fuzzy logic, Balt. Gumanit. Zh., 2017, vol. 6, no. 3, pp. 126–128.

    Google Scholar 

  27. Kozina, E.S., Gamification of professional activity as an effective tool for motivating the personnel in modern organizations, Sovrem. Probl. Nauki Obraz., 2015, no. 2, p. 687.

  28. Liang, F., Das, V., Kostyuk N., and Hussain, M.M., Constructing a data-driven society: China’s social credit system as a state surveillance infrastructure, Policy Internet, 2018, vol. 10, no. 4, pp. 415–453.

    Article  Google Scholar 

Download references

Funding

This work was performed as part of research on the topic 0003-2019-0001 of the state assignment to VINITI RAS

Author information

Authors and Affiliations

  1. All-Russian Institute for Scientific and Technical Information (VINITI), Russian Academy of Sciences, 125315, Moscow, Russia

    P. A. Kalachikhin

Authors
  1. P. A. Kalachikhin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. A. Kalachikhin.

Ethics declarations

The authors declare that they have no conflicts of interest.

Additional information

Translated by A. Ovchinnikova

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalachikhin, P.A. Evaluating Researchers Based on the Criteria of Reputation Responsibility. Sci. Tech. Inf. Proc. 46, 280–287 (2019). https://doi.org/10.3103/S0147688219040117

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S0147688219040117

Keywords:

Search

Navigation