Assessment of the Potential of Scientific Activity Based on Scientometric Indicators

  • Galina Markina ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia
  • Mikhail Shley ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia
  • Olga Kuznetcova ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia
  • Sergey Stafeev ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia
  • Tatiana Markina ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia
DOI: https://doi.org/10.32603/2071-2340-2020-3-70-85
Keywords: scientific activity, scientometric indicators, scientific potential, information model, methodology

Abstract

This article deals with issues of assessing the scientific activity of teams of performers when submitting applications to scientific funds. The purpose of the study is to develop new approaches to the use of scientometric indicators to assess the scientific potential of university teams when submitting applications to scientific foundations. Methodological foundations of the research: a systematic approach (considers science as a social institution in an indissoluble connection with society as a whole), a metasystem approach (considers the results of scientific activity as a metasystem, that is, a system with relatively independent components), a probabilistic-statistical approach (considers research activity as a probabilistic process), qualimetric approach (considers the productivity of scientific activity as a latent variable, reflected by a set of criteria). As a result, the authors proposed: an information model of the relationship between the requirements for a scientific project by the customer, and the level of compliance of the scientific potential of the team of performers and a methodology for assessing the scientific potential of the team of performers when applying for the competition. The information model forms the basis of the developed information system for supporting the project activities of ITMO University, which serves to improve the process and increase the efficiency of preparation of draft applications submitted by the university. The proposed methodology is implemented using scientometric indicators, through software algorithms for automated assessment of scientific potential. In the course of an experimental study, the authors have shown that
the proposed approaches correlate with the effectiveness of participation in competitions. The proposed solutions have been successfully integrated into the ITMO University, management system.

Author Biographies

Galina Markina, ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia

Head of the Office of Information Support of Open Tenders for State and Municipal Needs, markina@itmo.ru

Mikhail Shley, ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia

PhD, Deputy Head of Department for Information Systems of Research and Academic Activity, mikhail.shlei@itmo.ru

Olga Kuznetcova, ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia

PhD, Deputy Head of the Office of Information Support of Open Tenders for State and Municipal Needs ITMO University, ovkuznetcova@itmo.ru

Sergey Stafeev, ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia

Doctor of Technical Sciences, Professor of the faculty of physics and technology, leading expert of the children’s Technopark on Birzhevaya, head of the Department of psychological and pedagogical support at ITMO University, stafeev@itmo.ru

Tatiana Markina, ITMO University, 49 Kronverksky, bldg. A, 197101, Russia Saint Petersburg, Russia

Associate Professor (Qualification “Full Associate Professor”) of Faculty of Software Engineering and Computer Systems, markina_t@itmo.ru

References

Ministry of Education and Science of Russia, Order of March 5 2014 № 162, (in Russian). [Online]. Available: https://base.garant.ru/70649666/

L. Bornmann, R. Mutz, and H. D. Daniel, “Are there better indices for evaluation purposes than the h-index? A comparison of nine different variants of the h index using data from biomedicine,” Journal of the American Society for Information Science and Technology, vol. 59, no. 2, pp. 830–837, 2008; doi: 10.1002/asi.20806

A. B. Tsiganov, “Brief rewiev of main scientometric indices based on citations,” Large-Scale Systems Control, pp. 248–261, 2013 (in Russian).

Q. L. Burrel, “Hirsch’s h-index: a stochastic model,” Journal of Informetrics, vol. 1, no. 1, pp. 16–25, 2007; doi: 10.1016/j.joi.2006.07.001

J. E. Iglesias and C. Pecharroman, “Scaling the h-index for different scientific ISI fields,” Scientometrics, vol. 73, no. 3, pp. 303–320, 2007; doi: 10.1007/s11192-007-1805-x

J. E. Hirch, “An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship,” Scientometrics, vol. 85, pp. 741–754, 2010; doi: 10.1007/s11192-010-0193-9

P. D. Batista, M. G. Campiteli, O. Kinouchi, and A. S. Martinez, “Is it possible to compare researchers with different scientific interests?” Scientometrics, vol. 6, pp. 179–189, 2006; doi: 10.1007/s11192-006-0090-4

A. V. Komarov, M. A. Sleptsova, E. V. Chechetkin, and K. A. Komarov, “Specialized tools to evaluate the potential of a R&D project team,” The Economics of Science, vol. 6, no. 1–2, pp. 75–87, 2020 (in Russian); doi: 10.22394/2410-132X-2020-6-1-2-75-87

O. A. Zyateva and E. A. Pitukhin, “Managing university science indicators: an analysis of publishing activity,” Perspektivy nauki i obrazovania — Perspectives of Science and Education, vol. 40, no. 4, pp. 509–517, 2019 (in Russian); doi: 10.32744/pse.2019.4.39

Y. Sheikhnejad and T. Yigitcanlar, “Scientific landscape of sustainable urban and rural areas research: A systematic scientometric analysis,” Sustainability, vol. 12, no. 4, pp. 1–28, 2020; doi: 10.3390/su12030779

I. V. Zibareva, L. Y. Ilina, B. L. Alperin, and A. A. Vedyagin, “The Scientometric Profile of Boreskov Institute of Catalysis,” Herald of the Russian Academy of Sciences, vol. 89, no. 3, pp. 259–270, 2019 (in Russian); doi: 10.1134/S1019331619030109

R. D. Shelton, “Scientometric laws connecting publication counts to national research funding,” Scientometrics, vol. 123, no. 1, pp. 181–206, 2020; doi: 10.1007/s11192-020-03392-x

A. V. Grinev, “The Use of Scientometric Indicators to Evaluate Publishing Activity in Modern Russia,” Herald of the Russian Academy of Sciences, vol. 89, no. 5, pp. 451–459; doi: 10.1134/S1019331619050046

M. Shley, G. Markina, and O. Kuznetsova, “Support system for project application preparation activities in a university,” in Proc. Scientific and educational information environment of the XXI century:

Materials of the X All-Russian scientific and practical conference (Petrozavodsk, Sept. 20–23, 2016), 2016, pp. 171–174.

M. D. Shley and G. L. Markina, “Applications preparation information system for research funds,” Fundamental research, no. 5–2, pp. 289–293, 2016 (in Russian).

G. L. Markina and M. D. Shley, “Decision support organization in science and education on the example of project management system,” Computer Tools in Education, no. 4, pp. 19–31, 2016.

G. L. Markina, M. D. Schlei, O. V. Kuznetsova, and T. A. Markina, “Analysis of the dependence of the effectiveness of requests submitted to scientific competitions from the criteria for their evaluation,” in Proc. 19th International Multidisciplinary Scientific GeoConference, SGEM 2019, vol. 19, no. 2.1, 2019, pp. 83–90; doi: 10.5593/sgem2019/2.1/S07.011

Russian Science Foundation, [WEB site], Available: https://rscf.ru/contests/

“On Amendments to Parts One, Two and Four of the Civil Code of the Russian Federation, and Certain Legislative Acts of the Russian Federation,” Federal Law, 12.03.2014, N. 35-FZ.

“On Amendments to the Regulation on the Award of Academic Degrees,” Resolution of the Government of the Russian Federation, 21.04.2016, № 335

Published
2021-02-18
How to Cite
Markina, G., Shley, M., Kuznetcova, O., Stafeev, S., & Markina, T. (2021). Assessment of the Potential of Scientific Activity Based on Scientometric Indicators. Computer Tools in Education, (3), 70-85. https://doi.org/10.32603/2071-2340-2020-3-70-85
Issue
No 3 (2020)
Section
Informational systems