Investigates the balance between user customization and behavioral inference in AI systems, suggesting design solutions for user autonomy.
This paper investigates the tension between explicit user customization and implicit behavioral inference in conversational AI systems, framing this dynamic as a fundamental concern for user autonomy and epistemic accuracy. It defines "inferential ossification" as a critical failure mode in which systems conflate transient situational needs with permanent dispositional traits, thereby restricting the user's agency and depth of interaction. To evaluate and mitigate these risks, the study introduces a five-dimensional framework spanning legibility, correctability, ownership, paternalism, and homogenization and proposes hybrid design patterns such as editable inferences and mandatory explicit overrides. Finally, it formulates actionable policy and design recommendations for regulators and user advocates to ensure adaptive AI architectures balance automated convenience with human agency.
No takes yet. Share an insight, caveat, or question.
Momen Ghazouani (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: