PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 21, 2026American Journal of Political Science5 citationsOpen Access

Using large language models to analyze political texts through natural language understanding

View Full Paper
KBKenneth BenoitSMScott de MarchiCLConor Laver

Key Points

  • The research aims to enhance the analysis of political texts through the integration of large language models with natural language understanding.
  • Propose a systematic method utilizing large language models.
  • Analyze political texts for meaning beyond mere data.
  • Correlate LLM-generated estimates of party positions with evaluations by experts.
  • Assess alignment of LLM estimates with models of government formation.
  • LLM estimates of party positions correlate highly with expert ratings.
  • LLM analysis of coalition policy declarations aligns closely with government formation models.
  • Highlight the advantages of LLMs over traditional qualitative and quantitative methods.

Abstract

Abstract Large language models (LLMs) offer scalable alternatives to human experts when analyzing political texts for meaning , using natural language understanding (NLU). Qualitative NLU methods relying on human experts are severely limited by cost and scalability. Statistical text‐as‐data methods are scalable but rely on strong and often unrealistic assumptions. We propose a systematic, scalable, and replicable method that can extend existing qualitative and quantitative approaches by using LLMs to interpret texts meaningfully rather than as mere data. Our ensemble means of LLM‐generated estimates of party positions on six key issue dimensions correlate highly with equivalent mean ratings by country specialists. When applied to coalition policy declarations, LLM estimates align more closely with standard models of government formation than hand‐coded estimates. We conclude with a discussion of the profound implications of modern LLMs for political text analysis.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Benoit et al. (2026) studied this question.

synapsesocial.com/papers/69be35e66e48c4981c67474ehttps://doi.org/10.1111/ajps.70050
Ask AI
Helpful
Bookmark
Share
View Full Paper