Answers are grounded in this paper and cite their sources.
Richard Smith, former editor of the British Medical Journal, referred to peer review as ‘a flawed process at the heart of science and journals’.1 Yet many of us aspire to being published in a peer reviewed journal – the positive acclaim of our colleagues remains important to us as a mark of credibility and worthiness. Moreover, universities value peer review publications more highly than non-reviewed, and this is important for career progression and promotion. Once you have had your first article published you are ready to become a reviewer yourself: you can write therefore you can critique. In fact most authors learn some form of critical appraisal skills well before they hone their own technique: such skills are included in the majority of health professional curricula, and are considered important graduate attributes. In spite of this, however, peer reviews are very variable in both the quality and quantity of the feedback. Meaningful reviews are vital for The Clinical Teacher to remain relevant to its readership. In this editorial I aim to help reviewers recognise the need for review, develop their skills in written feedback and, by gaining a greater understanding of the review process, enhance their own chances of being published. A flow diagram of what happens when a article is submitted to The Clinical Teacher is shown in Box 1. The editorial team identifies articles that are obviously unsuitable (e.g. because of the topic or length), checks for plagiarism and ethical consent (where applicable), and brings any issues to the editor’s attention. Usually we request three reviews for each article and attempt to choose reviewers who have an interest or expertise in the topic, as highlighted by the keywords supplied when submitting their own manuscripts. Reviewers are asked to appraise the manuscript’s suitability for our readership and to provide feedback for the authors and editor. They will recommend whether it should be accepted without revision (very rare), whether it requires minor or major revision and the areas that need attention, or whether it should be rejected (and why). The reviews are read and rated by the associate editor assigned to the article, who also appraises the article (particularly important if there is disparity between the judgments from the reviewers), and then makes a final recommendation to the editor. The editor considers all of these appraisals and then provides the authors with a final decision and the collated feedback. It is important to remember that peer review is feedback as well as judgment and, in line with other examples of feedback (to students following an assessment or colleagues after observing a teaching session, for example), such critique should be timely, constructive and honest. The judgement and the final decision are sent to all the reviewers, which is enormously helpful in improving the quality of feedback by comparing and contrasting it with comments from colleagues. Different journals use different formats for reviews. We ask reviewers to grade the article on six features: topicality; practical importance; clarity and readability; uses of tables and boxes; use of figures and images; and ‘how much did you enjoy this article?’ These criteria combine to give an overall impression of the article, and are also useful for structuring the free-text comments. Some journals ask for comments structured along the format of the articles themselves. This is common when articles conform to a standard research pattern of Introduction, Methods, Results and Discussion. Others, like The Clinical Teacher, have no such requirements, and reviewers can decide themselves how to structure their feedback. I suggest a structure and process in Box 2. The recent editorial on ‘Successful writing for clinical teachers’ is also very helpful for considering what to look for in an article for this journal.2 Reading through the whole article to start with is a good idea. For The Clinical Teacher, with word counts of around 1500 words, this should not take long. A first impression of the article is a good guide to quality. Our articles should be intelligible and accessible. Remember the readership: the busy clinical teacher who is time-poor but hungry for quality and practicality, aligned with appropriate and relevant scholarship. Research articles should be rigorous, but there is not enough space to go into as much detail about the research process as, for example, in our sister publication, Medical Education, which now has no word limit. However, for research and evaluation articles there should be research aims, methods and results sections that are logical and aligned. The article should conform to the journal’s house style, as outlined in the instructions for authors: word and reference limit; reference convention (Vancouver); use of boxes and figures etc. The editorial team will have carried out the initial screen, but the reviewers may perform an additional check. There is no stipulation as to the length of a review: it is as long as is necessary, bearing in mind that the better reviews are pithy, practical and to the point. It is always nice to start with a positive comment, then continue with generalised feedback, before moving onto specific details about problems and how these may be improved. Feedback without suggestions for change is disheartening and unproductive. Some reviewers are very detailed in respect to typographical errors (‘typos’) such as spelling and grammar. These observations are welcome, but should not distract the reviewer from the main task of commenting on the content of the article. There is the space to provide confidential comments to the editor: these comments will not be fed back to the authors. Such comments are rarely necessary but reviewers may wish to suggest further investigation of ethical issues or similarities to other work that they have noted. Is the content topical and newsworthy? Is it innovative? Does it answer the ‘so what’ question? Did you enjoy it? Do you think your peers, learners, educators and clinicians will learn something from it? Is the title appropriate and interesting? Is there a structured abstract that summarises the article well? Does the introduction give enough detail about the context and research aims (if appropriate)? Have ethical issues been considered and ethical approval been stated appropriately (if relevant)? Is it clear who the participants were (i.e. status), and how they were recruited? Are the methods clear and appropriate? For educational interventions is there an evaluation as well as description? Are the results intelligible, relevant, generalisable and/or probable? Is there an analysis of the results rather than a simple description? Does the discussion follow from the results/data? Are the limitations discussed? Is there a conclusion and recommendations, and a clear indication of what this article adds? Are there appropriate and relevant references? Are there any further references or reading that you would suggest should be included? Could you understand the flow of the article? Was the writing clear? Was the referencing technically sound? Are there any major corrections to be made with respect to spelling/grammar? Did the authors make allowances for an international readership? There are a number of answers to this question. When choosing ‘peers’ we try to have a mixture of topic experts, stakeholders and experienced writers. Stakeholders in this case may include students and junior health professionals, who often bring a different perspective – that of the learner rather than the educator. This mix is, of course, limited by our bank of reviewers and our knowledge of their background and interests. New reviewers are asked to indicate their preference for topics by nominating keywords, but these are fairly broad. We also look at their place of work and health profession or discipline when assigning articles. They may well be a learner themselves, providing a vital perspective. So, really, a peer is anyone who has an interest in clinical education and, hopefully, in improving standards and practice. In order to reduce reviewer bias, many journals continue to operate a double blinding system, i.e. neither the authors nor the reviewers know each other’s identities. This requires authors to remove any identifying information from their text such as place of work or where interventions were carried out. They are able to cite their own works, but the actual reference is obscured in the list while the article is under review. This blinding aims to reduce conscious or unconscious bias: to prevent reviewers being more positive or negative about work from people or institutions that they know, or being influenced by irrelevant attributes such as academic status or nationality. It does not, however, reduce other sources of subjectivity, such as: giving a poor review for work similar to your own that you hope to publish in future; enhancing your opinion for articles that cite your own work; or having a preference for quantitative research methods over qualitative (or vice versa). Reviewers should consider declining a review if they perceive a conflict of interest, but this does not mean turning down articles that cite their own work. If you are concerned that there may be a conflict the editorial team will be happy to discuss the issue of concern and advise you on this matter. Even with the removal of identifying marks, it can be obvious where an article has originated from, and thus many journals now operate a system of open review. Perhaps this leads to more honesty in reviews, as reviewers have to ‘sign’ and own their feedback, but there has been no evaluation of the impact of these changes, although the issue has been discussed.3, 4The Clinical Teacher remains double blinded, with the members of the editorial team being aware of the identities of authors and reviewers. In this era of evidence-based practice, peer reviewing is a relatively unstudied occupation. There are no data that show that peer review improves the quality of published articles. Intuitively we feel that if three of our colleagues judge an article to be of poor quality then no one else will want to read it. If, however, one reviewer likes it, one doesn’t and one opinion sits somewhere between these two extremes (as does happen), we can see that there is a lot of subjectivity to the process, despite protocols that help us rate research and other topics. The review process can only be as good as the quality of the reviews submitted and – even though flawed – we cannot imagine that articles should be published without considering the opinion of the journal’s stakeholders. The aim is to produce a journal that readers want to read and writers want to publish in. The readership can also comment on published articles via letters to the editor: are we getting it right? If you submit a manuscript to The Clinical Teacher you are automatically invited to become a reviewer in your areas of interest and expertise. Reviewers are monitored through the system to ensure standards are being met. All readers are welcome to become reviewers by sending a concise curriculum vitae to the Editorial Office. It’s an excellent way of making a valuable contribution to the growth of our discipline and the health of our journal.
No takes yet. Share an insight, caveat, or question.
Jill Thistlethwaite (2012) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: