Answers are grounded in this paper and cite their sources.
This paper describes some experimentation with the evolving ability of large language models to generate sentiment estimates. We find that current models seem to equal or even exceed the ability of human annotators in a case study of single sentiment sentences. In addition, using the large language models, we were able to identify a small number of sentences in the data set, where it appears that the annotator made errors in assessing the sentiment. Unfortunately, analysis of the LLM results also illustrates apparent cognitive biases in the LLM behavior. Those effects appear to include an “ostrich effect” and a “no one is good enough” effect cognitive bias in LLM sentiment estimates.
No takes yet. Share an insight, caveat, or question.
Daniel E. O’Leary (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: