PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
November 30, 2025Proceedings of the National Academy of Sciences5 citationsOpen Access

Simulating human well-being with large language models: Systematic validation and misestimation across 64,000 individuals from 64 countries

View Full Paper
PPPat PataranutapornNPNattavudh PowdthaveeCAChayapatr Archiwaranguprok

Key Points

  • LLMs produced plausible patterns for life satisfaction, yet failed to capture cultural nuances, impacting accuracy.
  • Testing across 64,000 individuals showed meaningful correlations with subjective well-being, but also significant bias in underrepresented nations.
  • Statistical models outperformed LLMs, revealing critical insights into human well-being that these models miss.
  • Incorporating contextual information lessened but did not eliminate biases tied to digital and economic inequality.

Abstract

Subjective well-being is central to economic, medical, and policy decision-making. We evaluate whether large language models (LLMs) can provide valid predictions of well-being across global populations. Using natural-language profiles from 64,000 individuals in 64 countries, we benchmark four leading LLMs against self-reports and statistical models. Unlike regressions, which estimate relationships from survey data, LLMs draw only on individual characteristics (e.g., sociodemographic, attitudinal, and psychological factors) together with associations encoded during pretraining, rather than from the survey’s subjective well-being responses. They produced plausible patterns consistent with known correlates such as income and health, but systematically underperformed relative to regressions and showed the largest errors in underrepresented countries, reflecting biases rooted in global digital and economic inequality. A preregistered experiment revealed that LLMs rely on surface-level linguistic associations rather than conceptual understanding, leading to predictable distortions in unfamiliar contexts. Injecting contextual information partly reduced—but did not remove—these biases. These findings demonstrate that while LLMs can simulate broad correlates of life satisfaction, they fail to capture its experiential and cultural depth. Accordingly, they should not be used as substitutes for human self-reports of well-being; doing so would risk reinforcing inequality and undermining human agency.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Pataranutaporn et al. (2025) studied this question.

synapsesocial.com/papers/692b944c1d383f2b2a378bebhttps://doi.org/10.1073/pnas.2519394122
Ask AI
Helpful
Bookmark
Share
View Full Paper