Commentary First and foremost, Callanan et al. need to be congratulated for their timely and important contribution to the literature. The authors answered questions that most might not even realize needed answering. Their data establishes the foundation for a framework for—or, at least, a conversation on—the use of AI support in academic writing that should challenge our perspective on the future of peer-reviewed literature, publishing practices, and ethical norms1. Prior to reading this study, one might not have expected that artificial intelligence (AI) detection software would overreport at a baseline rate of 11%. This finding underscores the authors' methodological wisdom in leveraging pre-AI-era comparative data to avoid overstating the prevalence of AI-based support and to provide a quantitative threshold of 33% (based on the mean AI detection percentage for pre-AI-era-manuscripts plus 2 standard deviations) for significant AI involvement in a manuscript. With this newly established threshold, 17% of publications were found to have leveraged considerable AI-based support. For argument's sake, ignore the limitations in the study. Accept that ZeroGPT accurately identified AI-based support no more often than the false positive rate of 11%. Accept that these observations are static and may not change overnight with a simple software update from a privately held company. The visceral reaction by readers upon learning that 17% of articles (38.3% in The Journal of Bone those exclusively come from the human imagination. AI is a tool, not a threat. A global scientific journal should welcome AI assistance in original research to level the playing field for researchers whose first language may not be English. However, we should have heightened wariness of misconduct with AI tools in review articles and editorials, where the scholarly record deserves increased depth and creativity, respectively. The context of AI assistance matters, which is why Callanan et al.'s finding of a 16.4% rate of AI involvement among original research concerns me far less than the 18.2% rate of AI involvement among review studies. As a final note on the subject of the inevitability of AI assistance, we need to recognize that society outwardly proclaims to value authenticity but that our actions repeatedly favor convenience over authenticity. If our indignation over AI support was sincere, we would not allow Netflix to nudge our Friday nights, permit Gmail (Google) to finish our missives, or engage with self-affirming content in our social media echo chambers. When it comes to clinical and scientific medicine, AI assistance should be welcomed as an adjunct—but not as an alternative—to human involvement3.
Building similarity graph...
Analyzing shared references across papers
Loading...
Prem N. Ramkumar
Journal of Bone and Joint Surgery
Building similarity graph...
Analyzing shared references across papers
Loading...
Prem N. Ramkumar (Wed,) studied this question.
synapsesocial.com/papers/68af4cd8ad7bf08b1ead6287 — DOI: https://doi.org/10.2106/jbjs.24.01633