Formalization of a System of Indicators for Evaluating the Effectiveness of Personnel Training Programs in Information Security

The article addresses the problem of formalizing a system of indicators for evaluating the effectiveness of personnel training programs. The relevance of the study is due to the fact that, in organizational security practice, the evaluation of such programs is often reduced to the use of separate fragmentary characteristics, including training coverage, testing results, or the frequency of training sessions, which does not provide a holistic quantitative representation of the actual effectiveness of a program. This complicates the comparison of programs, the analysis of their development dynamics, and the substantiation of managerial decisions aimed at improving the training process. The purpose of the article is to formalize a system of indicators for evaluating the effectiveness of personnel training programs by determining the composition of quantitative indicators, substantiating their formal representation, and constructing an integral evaluation. The paper proposes a system of six interrelated indicators covering the main aspects of personnel training program effectiveness, namely training coverage, coverage of relevant thematic blocks, final testing result, program updating, behavioral effectiveness, and timeliness of recurrent training. A formal expression is provided for each indicator, ensuring the possibility of its quantitative determination within a unified evaluation model. The expediency of using the entropy method to determine indicator weight coefficients is substantiated, making it possible to account for their relative discriminatory ability on a set of actual or simulated observations. To demonstrate the methodology, the paper develops a scenario-analytical model based on characteristic ranges of indicator values for training programs with different maturity levels. The scientific novelty of the study lies in the formalization of a system of indicators for evaluating the effectiveness of personnel training programs and in substantiating an approach to constructing an integral indicator based on entropy-derived weight coefficients. The obtained results showed that the greatest contribution to the differentiation of training programs by effectiveness level is made by the indicators of behavioral effectiveness, timeliness of recurrent training, and coverage of relevant thematic blocks. The practical significance of the study lies in the possibility of using the proposed model for comparative analysis of training programs, evaluation of their effectiveness dynamics, and support of decisions on improving the training process.