PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 2, 2023Social Sciences273 citationsOpen Access

The Political Biases of ChatGPT

DRDavid Rozado

Key Points

  • To evaluate whether ChatGPT exhibits systematic political biases when responding to standardized political orientation questionnaires.
  • Administered 15 standardized political orientation tests (14 in English and 1 in Spanish) to OpenAI's ChatGPT.
  • Analyzed the resulting responses to classify the model's ideological stance on normative and policy-related questions.
  • ChatGPT manifested a consistent preference for left-leaning viewpoints across 14 of the 15 administered political orientation tests.
  • The model frequently claimed complete political neutrality when asked directly about its opinions, despite demonstrating measurable ideological bias in its answers.

Abstract

Recent advancements in Large Language Models (LLMs) suggest imminent commercial applications of such AI systems where they will serve as gateways to interact with technology and the accumulated body of human knowledge. The possibility of political biases embedded in these models raises concerns about their potential misusage. In this work, we report the results of administering 15 different political orientation tests (14 in English, 1 in Spanish) to a state-of-the-art Large Language Model, the popular ChatGPT from OpenAI. The results are consistent across tests; 14 of the 15 instruments diagnose ChatGPT answers to their questions as manifesting a preference for left-leaning viewpoints. When asked explicitly about its political preferences, ChatGPT often claims to hold no political opinions and to just strive to provide factual and neutral information. It is desirable that public facing artificial intelligence systems provide accurate and factual information about empirically verifiable issues, but such systems should strive for political neutrality on largely normative questions for which there is no straightforward way to empirically validate a viewpoint. Thus, ethical AI systems should present users with balanced arguments on the issue at hand and avoid claiming neutrality while displaying clear signs of political bias in their content.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

David Rozado (2023) studied this question.

synapsesocial.com/papers/6a027985a9294ab04901d757https://doi.org/10.3390/socsci12030148
Ask AI
Helpful
Bookmark
Share
View Full Paper