Key points are not available for this paper at this time.
Randomized paired comparisons (RPC) for social values have various advantages over a matrix format of multiple items; however, their use cannot exhaust all possible pairs if there are too many items to compare one-to-one. This article proposes (1) applying a dimension reduction method, structural topic modeling (STM), to RPC survey data by restructuring answers into ordered pairs to estimate latent answering patterns, (2) visualizing them into directed graphs, and (3) interpreting them as respondents’ preference structures among social values. For empirical validation, we randomly divided 920 respondents into RPC and matrix-format groups and asked about the seriousness of ten social problems. Our STM from the RPC group revealed five preference structures beyond a linear order among the 10 items, which are interpretable and incorporate statistical tests with respondents’ traits as covariates. We also discuss how to improve topic modeling with RPC and contribute to various research streams, such as cultural value networks and gamification, by pairwise wiki survey.
Kang et al. (Tue,) studied this question.