Research on the impact evaluation of academic journals based on altmetrics and citation indicators

ABSTRACT Taking international LIS journals as an example, combining 8 traditional citation indicators and 10 altmetrics indicators, we use the method of multi‐indicator fusion to construct a comprehensive evaluation model of journal impact based on traditional citation indicators and altmetrics indicators. Through normalization processing, correlation analysis, reliability analysis, validity analysis, factor analysis, the paper evaluates the academic impact (F A ), societal impact (F S ) of LIS journals respectively. We get the following conclusion: (1) We get the 2‐dimensional evaluation results and according to LIS journals impacts, we divide the roles into four categories: “Prestige journals”, “Star journals”, “Common journals” and “Expert journals”. (2) It is found that 8 traditional citation indicators based on JCR, present strong positive correlations, and the indicators are highly consistent overall and internally. (3) There are moderate or high positive correlations among 10 altmetrics based on Altmetrics Explorer, and there are also significant consistency among the indicators as a whole and internally. (4) The correlation coefficient between F A and F S is 0.566, with a moderate positive correlation. It indicates that the evaluation of LIS journals' societal impact based on altmetrics indicators has a useful supplement to the evaluation of academic impact based on citation.