Developing an Information Credibility Scale for Social Media and AI‐generated Content: Insights from Expert and User Reviews

This study initiated the development of a new scale to measure perceptions of information credibility on the web, distinguishing between trustworthiness and expertise as core dimensions. Building on a previous analysis of the literature on credibility assessments of information on social media, we generated a pool of 15 items, six for trustworthiness and nine for expertise. Following established scale development guidelines, we refined the scale through expert reviews and cognitive interviews with users. Experts ( n = 2) rated most items as highly relevant and offered suggestions for refinement, such as including new items. Users ( n = 9) confirmed item clarity but raised concerns about certain terms and perceived objectivity. These preliminary findings support the scale's relevance and will inform revisions for subsequent validation. Ongoing work will expand participant feedback and move toward large‐scale empirical testing.