Who Checks the Fact-Checkers? Studying the Work of External Assessors Behind Fact-Checking Organizations

This paper examines the behind the scenes of fact-checking. Based on in-depth interviews with 16 external assessors and advisory board members working for the International Fact-Checking Network (IFCN) and the European Fact-Checking Standards Network (EFCSN), it discusses how these professionals assist in establishing credibility for fact-checking organizations. While scholarship till date has mainly explored frontstage operations through investigating the work of fact-checkers, little is known about the assessment processes of organizations such as IFCN or EFCSN and how they evaluate the performances of fact-checking organizations. This paper turns backstage to get to know the personnel who check the fact-checkers. A thematic analysis shows that assessors are at times caught in a “neutrality dilemma” during evaluation processes. In addition, while assessment processes are oriented with standardized Codes of Conduct and contribute to the professionalization of fact-checking operations, the evaluation process is not always uniform. Lastly, participants raised concerns about the impact of platformization on fact-checking practices, where fact-checkers are pushed into dependency relations with big tech. Overall, this study lifts the curtain on the backstage operations that support fact-checking organizations in their attempt to be recognized as important actors in fighting disinformation.