The method of bibliometric analysis: a critical evaluation

Abstract The use of bibliometric analysis (BA) as a tool for gaining an overview of scientific fields has increased in recent years. The present work raises necessary and constructive questions about the responsible use of bibliometric methods and the standards used in the preparation of bibliometric analyses (BAs). There has been a need to adhere to a checklist, analogous to systematic reviews, to strengthen the underlying bibliometric process. Problems with the use of some of the software tools are examined, such as over-reliance on programs without a proper understanding of their underlying metrics. Recently, several groups have raised a debate about the usefulness of the BA method and the considerable number of new publications in the field. The authors and potential readers play a clear role in how BAs are published. This work synthesizes critical comments from experts and follows up on an editorial by Watson and Hayter (2024) on whether all BA articles have achieved a level of research that warrants publication in mainstream journals. Unless BAs meet specific scientific criteria, part of the solution could be to consider disseminating the articles in ways that still ensure they reach their intended audiences.