Evaluating emotional understanding in Large Language Models (LLMs) is challenging because assessments are subjective, ambiguous, multidimensional, and sensitive to controllable generation parameters. We developed a unified mathematical framework for characterizing LLM “emotional individuality” that integrates softmax sampling–temperature control (the decoding-time temperature parameter exposed by the API and typically used to modulate output randomness during token generation), fuzzy set theory with Shannon-type fuzzy entropy, and persona-based cognitive diversity analysis. We evaluated 36 API-accessible LLMs from seven major vendors on Japanese literary texts, using four personas each assigned a sampling temperature (T∈0. 1, 0. 4, 0. 7, 0. 9), yielding 4227 /4320 trial responses (97. 8% coverage), of which 4067/4227 contained valid numeric emotion scores (96. 2%). Temperature controllability varied approximately 25-fold (κM∈0. 039, 0. 982) with both positive and negative temperature–variance relationships across models. Because each sampling temperature is deterministically assigned to a persona in our design, κM should be interpreted as an operational temperature–variance association across persona conditions rather than an isolated causal temperature effect. The model-level mean fuzzy entropy ranged from approximately 0. 40 to 0. 66, and the numerical stability consistency scores ranged from approximately 0. 548 to 0. 780. We also observed text-dependent structure, including genre-specific variation in the Interest–Sadness relationship. For practitioners, the framework is most directly useful as a benchmark-design and model-screening template for structured emotion-scoring tasks; its empirical conclusions remain limited to the present Japanese literary, text-only setting.
Building similarity graph...
Analyzing shared references across papers
Loading...
Shirahama et al. (Mon,) studied this question.
synapsesocial.com/papers/69d893eb6c1944d70ce04d62 — DOI: https://doi.org/10.3390/math14071224
Naruki Shirahama
Shimonoseki City University
Yuma Yoshimoto
Kitakyushu National College of Technology
Naofumi Nakaya
Juntendo University
Mathematics
Juntendo University
Juntendo University Urayasu Hospital
Shizuoka Institute of Science and Technology
Building similarity graph...
Analyzing shared references across papers
Loading...