Synapse
⌘+K
Synapse
PulseExploreClubsResearchersJournals
Instagram
HomeClubsExplore
October 15, 2025Open Access

PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalization

View Full Paper
Ask AI
Bookmark
Share

Authors

MTMeiling TaoGuangdong University of TechnologyCZChenghao ZhuChina Pharmaceutical UniversityDDDan DingCentral South University

Discussion

Loading...

Member takes

Implication

PersonaFeedback assesses personalized responses in LLMs using explicit user personas, highlighting evaluation challenges.

Key Points

  • The study introduces PersonaFeedback, a benchmark for LLM personalization with 8298 human-annotated cases.
  • Empirical evaluations reveal that even advanced LLMs struggle with hard personalization tasks, indicating limitations.
  • The benchmark emphasizes explicit user personas to evaluate LLM capabilities, contrasting with existing implicit models.
  • Comprehensive failure mode analysis suggests that the retrieval-augmented approach is not a definitive solution for personalization.

Cite This Study

Tao et al. (2025) studied this question.

synapsesocial.com/papers/68efd921056559ef4287748chttps://doi.org/10.48550/arxiv.2506.12915
View Full Paper
Ask AI
Bookmark
Share

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1A Personalized Conversational Benchmark: Towards Simulating Personalized Conversations2025
  2. 2Can LLM be a Personalized Judge?2024 · 2 citations
  3. 3PersonaGym: Evaluating Persona Agents and LLMs2024 · 5 citations
  4. 4Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement2024 · 1 citations
  5. 5Personalized Large Language Models2024 · 8 citations