Explicit civility (Online Discussions/Discussion Quality)

Explicit civility or respect is a key dimension to assess the (deliberative) quality of online discussions. In contrast to operationalizations that address civility through the mere absence of incivility or offensive language, this construct measures explicit indicators for respect, such as acknowledgements, endorsement, and explicit valuation. Field of application/Theoretical foundation Most studies on online discussions draw on deliberative norms to measure the quality of their discourse (e.g., Esau et al., 2017; Friess et al., 2021; Rowe, 2015; Ziegele et al., 2020; Zimmermann, 2017). Deliberation is an important concept for the study of (political) online discussions and consists of a fair and respectful exchange of arguments between participants who are deemed as equals (Graham & Witschge, 2003; Ziegele et al., 2020). Mutual respect and appreciation of one another are considered fundamental assets of a democratic society (Papacharissi, 2004). A minimum level of respect ensures the mutual acknowledgement of participants as free and equal members of society and hence is a requirement for deliberation (Habermas, 2007; Steiner, 2012; Ziegele et al., 2020). References/Combination with other methods Besides quantitative content analyses, the (deliberative) quality of online discussions is examined with qualitative content analyses and discourse analyses (Graham & Witschge, 2003; Price & Capella, 2002). Furthermore, perceptions of civility and incivility are investigated with qualitative interviews and focus groups (Bormann, 2022; Engelke, 2019; Ziegele, 2016), surveys (Kenski et al., 2020; Stryker et al., 2016) and experimental designs (Muddiman, 2017; Ziegele et al., 2019). Cross-references Explicit civility is one of five dimensions of deliberative quality in this database written by the same author. Accordingly, there are overlaps with the entries on interactivity, inclusivity, rationality, and storytelling regarding theoretical background, references/combinations with other methods, and some example studies. Information on Heinbach & Wilms (2022) Authors: Dominique Heinbach & Lena K. Wilms (Codebook by Dominique Heinbach, Marc Ziegele, & Lena K. Wilms) Research question: Which attributes differentiate moderated from unmoderated comments? Object of analysis: The quantitative content analysis was based on a stratified random sample of moderated and not moderated comments (N = 1.682) from the German online participation platform “#meinfernsehen2021” [#myTV2021], a citizen participation platform to discuss the future of public broadcasting in Germany. Time frame of analysis: November 24, 2020 to March 3, 2021 Info about variables Level of analysis: User comment Variables and reliability: see Table 1 Values: All variables were coded on a four-point scale (1 = clearly not present; 2 = rather not present; 3 = rather present; 4 = clearly present). Detailed explanations and examples for each value are provided in the Codebook (in German). Codebook: in the appendix of this entry (in German) Table 1: Variables and reliability (Heinbach & Wilms, 2022) Dimension Measure Definition Krippendorff’s α (n = 159, 3 coders) Explicit respect Polite salutation Does the comment contain formulations of polite salutations, greetings or farewell phrases, e.g., “Dear …”, “Have a good weekend”? .80 Expression of respect Does the comment contain appreciation, approval, praise, or acknowledgements, e.g, “Kudos!”, “You are doing a great job, “Thank you”, “I respect your opinion“? .71 Information on Stromer-Galley (2007) Author: Jennifer Stromer-Galley Research question: The aim of the paper was developing a coding scheme for academics and practitioners of deliberation to systematically measure what happens during group deliberations (p. 1; p. 7). Object of analysis: The author conducted a secondary analysis of online group discussions (23 groups with 5-12 participants) in an experiment called “The Virtual Agora Project” at Carnegie Mellon Unversitiy in Pittsburgh, Pennsylvania. Participants attended the discussions from dormitory rooms that were equipped with a computer, headphones, and microphone. The group discussions were recorded and transcribed for analysis (pp. 7-8). Although strictly speaking the study does not analyze media content, the coding scheme has provided the basis for numerous other studies on the deliberative quality of online discussions (e.g., Rowe, 2015; Stroud et al., 2015; Ziegele et al., 2020). Time frame of analysis: Three weeks in July 2004 (p. 7). Info about variables Level of analysis: Social talk was measured on the level of the thought. Coders segmented each speaking contribution into thought units before coding the categories. “A thought is defined as an utterance (from a single sentence to multiple sentences) that expresses an idea on a topic. A change in topic signaled a change in thought. A second indicator of a change in thought was a change in the type of talk. The distinct types of talk that this coding captured were the following: talk about the problem of public schools, talk about the process of the talk, talk about the process of the deliberation, and social talk” (p. 9). Variables and values: see Table 2 Reliability: Reliability scores for social talk are not provided. Codebook: in the appendix (pp. 22-33) Table 2: Variables and values (Stromer-Galley, 2007, p. 9; pp. 26-27). Variable Description Value Definition Social talk Social talk is talk that brings the strangers together by building social bonds, including salutations, praise, and apologies. Salutations Statements of welcome, greeting, hello, and good bye, see you later, and the like. Apologies Statements of apology: I’m sorry, and ‘I hope’ statements, such as “I hope I haven’t been too obnoxious.” Includes statements of reflection of how the participant performed in the group (likely comes at the end of the group’s discussion): “I hope my few ideas did get across.” Praise Includes thank you, you’re welcome, as well as praise for other individuals or the group (“you’ve been a good group.” I’ve really enjoyed myself,” “this has been fun”) Praise in the service of an argument about the problem is coded as a problem thought (“I want to commend Sally for volunteering at her school. We need more people to be volunteers”). ChitChat Thought statements that are not on topic relative to the deliberation. These could be jokes or puns (but not as they relate to the problem of schools), social chit chat about the weather, and the like. Information on Zimmermann (2017) Author: Tobias Zimmermann Research question: Which role do online reader comments play for a deliberative-democratic understanding of a digital public sphere? (p. 11) Object of analysis: To compare discursive participation online and offline, the author conducted a full-sample content analysis of online reader comments (N = 1.176) and letters to the editor (N = 381) from German local newspapers on three similar conflicts in local politics concerning the renaming of streets and squares. Because the coding scheme was based on the discourse quality index (DQI), only contributions that contained a demand were included in the analysis, that is, “a proposal on what decision should or should not be made” Steenbergen et al., 2003, p. 27). Only then, a speech act is considered relevant from a discourse ethics perspective. Time frame of analysis: June 2012 to May 2013 Info about variables Variables: For the variable respect towards groups, the author extends the respect variable of the Discourse Quality Index (DQI, Steenbergen et al., 2003) by adding anti-democratic behavior following Papacharissi (2004). Besides the ordinal variable “respect”, the author measured the dichotomous variable “democratic respect”. Level of analysis: Individual contribution Variables and values: see Table 3 Reliability: Intracoder reliability was tested on a subset of 100 comments. The ordinal respect variable exceeded a Krippendorff’s Alpha above .73 (p. 201). The dichotomous variable “democratic respect” that measured if a comment contained anti-democratic behavior or not reached a Krippendorff’s Alpha of .89 (p. 200-201). Codebook: pp. 159-185 (in German) Table 3: Variables and values (Zimmermann, 2017, p. 171; p. 189) Variable Value Definition Respect Anti-democratic behavior Only or predominantly statements are made that either contain at least one threat against the democratic system as a whole, use negative stereotypes, or question other individuals’ individual liberty rights. No respect This category applies when exclusively or predomi