REVIEW 4 major objections 6 minor 40 references
Queueing for Civility: User Perspectives on Regulating Emotions in Online Conversations
T0 review · 4 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read Delaying flagged comments about 47 seconds cuts anger and hate speech by up to 15 percent in a replay of 15,000 Reddit threads.
desk verdict The 15% anger-reduction claim is an artifact of the simulation's own rule; the design idea is plausible but unproven. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the 'emotion board' of the root node: the aggregate $E_m(R) = \sum_i E_m(V_i)$ of per-comment influence scores $E_m(V_i) = f(A_i)$, where $f(A_i)$ combines the comment's reply count, distance from the root, PageRank, and NRC emotion intensity. The mechanism publishes a comment only if it would not push any emotion past a per-emotion threshold (e.g., anger > 50%, fear > 60%); otherwise the comment is queued and re-evaluated on every new comment. Thresholds are dynamic—adjusted by conversation size, current emotion distribution, engagement level, and a sliding window of the most recent 100 comments—so moderation tracks the conversation's evolving tone. The queue is what converts the emotion board from a measurement into an intervention: it creates the reflective pause and changes which comments ever enter the graph.
What would settle it
Run a live randomized trial on a social platform: flag comments with the same anger/fear thresholds, delay a random half for about 47 seconds, and compare conversation-level emotion scores and hate-speech reports; if delayed comments do not lower anger by roughly 15 percent, or if user frustration and disengagement offset the gain, the claim fails.
Extended reading notes
Core claim
The paper claims that a pre-publication queue on emotionally charged comments measurably calms online conversations. Replaying 15,000 political Reddit interactions as directed acyclic graphs, it compares the root node's emotion board—an aggregate of per-comment influence scores built from reply counts, distance from the root, PageRank, and NRC emotion intensities—with and without the queue. The queued condition reduces average anger by about 15 percent and lowers fear while increasing joy and love, achieved not by deleting angry comments but by slowing their entry so no single emotion dominates. The operating cost is small: 4 percent of comments are held, on average for 47 seconds, and even in threads with up to 7,000 comments roughly 1,000 comments are held. A 20-user survey adds that 93.3 percent see the mechanism as calming and 83 percent as curbing impulsiveness, but this perception is split along the user's own emotional state.
Load-bearing premise
The 15 percent reduction rests on treating the emotion-board threshold rule as a faithful model of real conversation, without accounting for how users react to being delayed.
Editorial extensions
If this is right
- Deployed on a platform, the queue would reduce the anger contribution to a conversation's emotional tone by roughly 15 percent without deleting or editing any comment.
- Only about 4 percent of comments would be held, each for under a minute on average, so the mechanism preserves the natural pace of most exchanges.
- Users' baseline emotional state predicts acceptance: calm and happy users find the delay helpful, frustrated users expect it to frustrate them, so rollouts should anticipate emotion-dependent pushback.
- Dynamic thresholds and the 100-comment sliding window let the mechanism follow a conversation's emotional trajectory in real time rather than imposing a fixed toxicity rule.
- Survey evidence indicates broad stated willingness—93.3 percent support calming conversations and 83 percent expect fewer impulsive comments—suggesting user appetite for proactive emotion-regulation features.
Reading between the lines
- Because the simulation simply excludes comments that score above threshold rather than letting authors react, the true in-the-wild effect may differ; the survey's frustrated users are precisely the population most likely to contribute flagged comments, so a real deployment could trade reduced toxicity for higher user frustration and disengagement.
- The same queuing logic could be tested in adjacent real-time media—email, chat, or messaging—where a brief cooling-off hold on emotionally hot drafts might reduce regret and interpersonal conflict; this is an extension the paper does not explore.
- The calibration is limited to English-language political Reddit threads collected from August 2023 to August 2024; porting the thresholds to other languages, platforms, or non-political topics would require re-estimating emotion scores and re-tuning the dynamic thresholds.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a comment queuing mechanism that delays publication of emotionally charged comments in online discussions, with the goal of promoting self-reflection and reducing emotional contagion. The authors evaluate the idea with a simulation on 15,000 Reddit interactions, claiming an average reduction of about 15% in anger and fear with only 4% of comments delayed by roughly 47 seconds, and with a user survey (N=20) reporting that 93.3% of participants believed the mechanism would calm discussions. The paper frames the contribution as a real-time, proactive complement to post-hoc content moderation.
Significance. The underlying idea—intervening before a comment is published by introducing a reflective delay—is worth exploring in HCI and social computing. If the 15% reduction were a genuine empirical finding, it would be practically relevant. However, the central quantitative claim is not supported as presented: the simulation's with-queue condition withholds the very comments that contribute most to the measured emotion, making the reduction a mathematical artifact of the evaluation rather than an observed behavioral effect. The survey is too small and its reported percentages are internally inconsistent, further undermining the evidence. The paper does not ship reproducible code and leaves the core influence function unspecified. The concept has merit, but this manuscript does not currently provide a valid demonstration of the mechanism's efficacy.
major comments (4)
- [§4.1 and §3.4–3.5] The headline claim of a 15% reduction in anger is circular. In the with-queue condition, comments that exceed the emotion thresholds are withheld from the conversation graph before the root node's emotion board is recomputed. Since the emotion board is the aggregate of per-comment influence scores Em(Vi) = f(Ai) (Eq. 1), excluding the highest-emotion comments guarantees a lower aggregate anger/fear score. No downstream user response to the delay is modeled; the paper itself states the queue 'does not eliminate angry comments, but moderates their impact on the conversation's emotional tone' (§4.1), which reduces 'impact' to simple absence from the aggregate. To support the causal claim about reducing spread, the simulation needs to model how delayed publication changes subsequent replies, or at minimum compare against a control that withholds an equivalent number of random comments.
- [§4.2.1] The survey statistics are internally inconsistent with the reported N=20. Percentages such as 93.3%, 41.7%, 66.7%, 33.3%, 21.4%, and 42.9% imply denominators of 15, 12, 6, 3, 14, and 7 respectively, none of which match N=20 or the described subgroup counts. For example, 93.3% of 20 people is 18.66 individuals, which is impossible. These inconsistencies apply to the descriptive percentages and to the chi-square and Cramér's V results, which require observed and expected cell counts not provided in the paper. The authors must supply the actual response contingency tables and either use exact tests appropriate for small N or reduce the statistical claims accordingly.
- [§3.4, Eq. (1)] The influence score Em(Vi) = f(Ai) is never given a concrete functional form. The text mentions number of replies, distance from root, PageRank, and emotion intensity, but does not specify how these are combined into f. This makes the emotion board and hence the 15% reduction figure non-reproducible. Please specify f explicitly (e.g., a weighted sum with the stated factors), and ideally release code or a detailed parameter listing.
- [§3.5 and §4.1] The queuing simulation depends on several unspecified or coarsely described parameters: the initial emotion thresholds (e.g., 'Anger > 50%, Fear > 60%'), the dynamic threshold adjustment rules, the sliding window size (only 'last 100 comments' is mentioned), and the criterion for 'when the conversation yields a more balanced emotional tone' that releases queued comments. These are free parameters, and the reported 4% delay rate and 15% reduction may be sensitive to them. A sensitivity analysis or a clearly fixed parameter set with justification is necessary to assess the robustness of the headline numbers.
minor comments (6)
- [Abstract and §4.2.1] The abstract reports 93.3% for participants believing the mechanism calms discussions, while Section 4.2.1 also reports 83% for balanced emotional tone and 93.3% for reducing trolling. Please ensure all survey percentages are consistent and traceable to the raw responses.
- [§3.3 and §4.1] The term '15,000 user interactions' is used interchangeably with '15,000 instances of user posts and interactions'; clarify whether this count refers to comments, replies, or both, and how it relates to the 65 threads.
- [§3.5, Fig. 2] The caption 'Number of comments < 2000' is ambiguous; it presumably means thread size categories. Please clarify the x- and y-axis labels of the histograms and state the units (seconds and frequency).
- [§5, Limitations] The limitations section acknowledges the simulated setting and small N but does not acknowledge that the evaluation procedure removes the to-be-measured high-emotion comments. Add an explicit statement of this circularity and its implications for interpreting the 15% figure.
- [References] Reference [Edwards 2005] lists 'RA Fischer' but the correct spelling is 'R. A. Fisher'; also, the reference format for [Verma et al. 2023] appears in the bibliography as an arXiv preprint, which should be clearly marked as prior work by the same authors.
- [Throughout] There are several minor grammatical and typographical errors (e.g., 'these subreddit are known' in §3.2, 'Emojinal library' without a citation link). A careful proofreading pass is needed.
Circularity Check
The 15% anger-reduction result is an artifact of the evaluation: comments are queued when they exceed emotion thresholds, and the measured emotion board is the same aggregate from which those comments are withheld, making the reduction a consequence of the mechanism's rules rather than a behavioral effect.
-
self definitional
[Section 3.5 (queuing rule) and Section 4.1 (claimed 15% reduction), with Eq. (1)]
"Upon submission of a comment, the proposed framework evaluates its potential emotional impact on the conversation’s emotion board. The emotion board aggregates the emotional influence of all comments in the discussion, with specific thresholds set for each emotion (e.g., Anger > 50%, Fear > 60%). For instance, if a comment elicits an anger level exceeding 50% or a fear level surpassing 60%, it is identified as potentially disruptive. Instead of being published instantaneously, these flagged comments are placed into a queue for periodic re-assessment."
Equation (1) defines the emotion board as the sum of per-comment influences Em(V_i) = f(A_i), i.e., the aggregate of comments' emotion intensities. The queueing rule in the quoted passage uses that same board and thresholds to hold any comment with anger above 50%. Section 4.1's 'with queue' condition then measures the board after such comments have been withheld from the conversation, so their anger contributions are absent from the aggregate during the window being scored. The average ~15% anger reduction is therefore a logical consequence of removing the very comments selected by the anger threshold from the quantity used to measure anger, not a behavioral effect of delay on other users.
full rationale
The paper's headline quantitative claim is that the queue 'could reduce the spread of hate speech and anger by up to 15%' (Abstract) and that 'the queue mechanism achieved an average reduction of approximately 15% in anger' (Section 4.1). The evaluation compares a no-queue condition with a queue condition in which comments are held whenever they exceed emotion thresholds. The outcome measure is the root node's 'emotion board', defined in Eq. (1) as the aggregate of per-comment emotion influences Em(V_i) = f(A_i). Because the queue condition withholds comments with high anger from exactly that aggregate, the measured anger reduction is guaranteed by the evaluation procedure. The paper even acknowledges that the queue does not eliminate angry comments but 'moderates their impact on the conversation's emotional tone' — and that 'impact' is the same aggregate from which the held comments are missing. This is not an empirical finding about how delay changes subsequent user behavior; the simulation does not generate replies contingent on delay or model emotional contagion after a pause. The survey component reports participants' anticipated reactions, which is independent and not circular, but it cannot validate the 15% figure. The hold-duration statistics (4% delayed, ~47 seconds) are descriptive and not themselves circular. There is one self-citation to the authors' prior work, but it is not load-bearing for the circularity finding. Overall, the central computational efficacy claim reduces by construction, warranting a score of 8.
Assumptions & free parameters
free parameters (4)
- Emotion thresholds for queuing =
Anger > 50%, Fear > 60%
- Sliding window size =
100 most recent comments
- Dynamic threshold adjustment parameters =
unspecified
- Influence score function f(A_i) =
undefined
assumptions (3)
- domain assumption NRC Word-Emotion Association Lexicon provides valid emotion intensity scores for Reddit comments.
- domain assumption The DAG-based influence model (replies, distance from root, PageRank, emotion intensity) accurately measures a comment's emotional impact on the root node.
- domain assumption A short delay before posting induces self-reflection and reduces impulsive or toxic behavior.
invented entities (1)
-
Emotion board of the root node
Cite this review
Pith. "Pith review of Queueing for Civility: User Perspectives on Regulating Emotions in Online Conversations." pith.science (2026). https://pith.science/paper/OCZYUGQN
@misc{pith2026250711477,
author = {Pith},
title = {Pith review of: Queueing for Civility: User Perspectives on Regulating Emotions in Online Conversations},
year = {2026},
howpublished = {\url{https://pith.science/paper/OCZYUGQN}},
note = {Machine review of arXiv:2507.11477}
}
read the original abstract
Online conversations are often interrupted by trolling, which causes emotional distress and conflict among users. Previous research has focused on moderating harmful content after it has been posted, but ways to manage emotions in real-time remain unexplored. This study suggests a comment queuing mechanism that delays comment publishing, encourages self-reflection, and reduces the impact of impulsive and toxic comments. To assess the efficacy of this approach, a mixed-method research design is used. An analysis of 15,000 user interactions on Reddit showed that this approach could reduce the spread of hate speech and anger by up to 15%, with only 4% of comments being delayed for about 47 seconds on average. We also surveyed users for feedback on the mechanism. The results showed that 93. 3\% of the participants thought that the queuing mechanism could help calm the discussions and showed interest in seeing it used on social media platforms. Furthermore, 83% believed it would reduce impulsive comments and balance the emotional tone in conversations. We found a strong link between users' typical emotional states while using social media and their perceptions of the delay, with calm users finding the mechanism helpful and frustrated users anticipating frustration.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[6]
ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4 (2022), 1–26
Quarantined! Examining the effects of a community-wide moderation intervention on Reddit. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4 (2022), 1–26. Eshwar Chandrasekharan, Umashanthi Pavalanathan, Anirudh Srinivasan, Adam Glynn, Jacob Eisenstein, and Eric Gilbert
work page 2022
-
[7]
Proceedings of the ACM on human-computer interaction 1, CSCW (2017), 1–22
You can’t stay here: The efficacy of reddit’s 2015 ban examined through hate speech. Proceedings of the ACM on human-computer interaction 1, CSCW (2017), 1–22. Justin Cheng, Michael Bernstein, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec
work page 2017
-
[8]
Anyone can become a troll: Causes of trolling behavior in online discussions. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing . 1217–1230. Jacob Cohen
work page 2017
-
[12]
Social Network Analysis and Mining 12, 1 (2022),
Detection and moderation of detrimental content on social media platforms: current status and future directions. Social Network Analysis and Mining 12, 1 (2022),
work page 2022
-
[16]
Handbook of emotions 3, 3 (2008), 497–513
Emotion regulation. Handbook of emotions 3, 3 (2008), 497–513. Joshua Guberman, Carol Schmitz, and Libby Hemphill
work page 2008
-
[17]
NeuroImage 50, 2 (2010), 734–741
Self-related awareness and emotion regulation. NeuroImage 50, 2 (2010), 734–741. Susan Holtzman, Drew DeClerck, Kara Turcotte, Diana Lisi, and Michael Woodworth
work page 2010
-
[18]
Annika Howells, Itai Ivtzan, and Francisco Jose Eiroa-Orosa
Emotional support during times of stress: Can text messaging compete with in-person interactions? Computers in Human Behavior 71 (2017), 130–139. Annika Howells, Itai Ivtzan, and Francisco Jose Eiroa-Orosa
work page 2017
-
[19]
Journal of happiness studies 17 (2016), 163–185
Putting the ‘app’in happiness: a randomised controlled trial of a smartphone-based mindfulness intervention to enhance wellbeing. Journal of happiness studies 17 (2016), 163–185. Emma A Jane
work page 2016
Show all 40 references
-
[22]
Proceedings of the National academy of Sciences of the United States of America 111, 24 (2014),
Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National academy of Sciences of the United States of America 111, 24 (2014),
2014
-
[23]
Personality and Social Psychology Bulletin 34, 7 (2008), 924–938
Facilitating adaptive emotional analysis: Distinguishing distanced-analysis of depressive experiences from immersed-analysis and distraction. Personality and Social Psychology Bulletin 34, 7 (2008), 924–938. Srijan Kumar, Justin Cheng, and Jure Leskovec
2008
-
[24]
arXiv preprint arXiv:2210.13770 (2022)
The Virality of Hate Speech on Social Media. arXiv preprint arXiv:2210.13770 (2022). Lydia Manikonda, Ghazaleh Beigi, Huan Liu, and Subbarao Kambhampati
2022 arXiv
-
[28]
National Research Council, Canada 2 (2013),
Nrc emotion lexicon. National Research Council, Canada 2 (2013),
2013
-
[29]
Communications of the association for Information Systems 19, 1 (2007),
Social computing: An overview. Communications of the association for Information Systems 19, 1 (2007),
2007
-
[30]
Commercial content moderation: Digital laborers’ dirty work. (2016). Minna Ruckenstein and Linda Lisa Maria Turunen
2016
-
[31]
New media & society 22, 6 (2020), 1026–1042
Re-humanizing the platform: Content moderators and the logic of care. New media & society 22, 6 (2020), 1026–1042. Martin Saveski, Brandon Roy, and Deb Roy
2020
-
[33]
In Proceedings of the ACM Web Conference 2022
Moral emotions shape the virality of COVID-19 misinformation on social media. In Proceedings of the ACM Web Conference 2022 . 3706–3717. John Suler
2022
-
[35]
Emotion Review 10, 2 (2018), 116–124
Putting feelings into words: Affect labeling as implicit emotion regulation. Emotion Review 10, 2 (2018), 116–124. Amaury Trujillo and Stefano Cresci
2018
-
[36]
Proceedings of the ACM on Human-computer Interaction 6, CSCW2 (2022), 1–28
Make reddit great again: assessing community effects of moderation interventions on r/the_donald. Proceedings of the ACM on Human-computer Interaction 6, CSCW2 (2022), 1–28. Geetanjali Upadhyaya
2022
-
[37]
Thaler and Cass R
Richard H. Thaler and Cass R. Sunstein (2009). Nudge: Improving Decisions about Health, Wealth, and Happiness. Economic Journal of Nepal 43, 1-2 (2020), 96–97. Akriti Verma, Shama Islam, Valeh Moghaddam, and Adnan Anwar
2009
-
[38]
arXiv preprint arXiv:2303.00884 (2023)
Encouraging Emotion Regulation in Social Media Conversations through Self-Reflection. arXiv preprint arXiv:2303.00884 (2023). Greg Wadley, Wally Smith, Peter Koval, and James J Gross
2023 arXiv
-
[39]
Current Directions in Psychological Science 29, 4 (2020), 412–418
Digital emotion regulation. Current Directions in Psychological Science 29, 4 (2020), 412–418. Dawei Yin, Zhenzhen Xue, Liangjie Hong, Brian D Davison, April Kontostathis, Lynne Edwards, et al
2020
-
[1980]
Journal of Educational Statistics 5, 3 (1980), 269–287
Pairwise multiple comparisons in repeated measures designs. Journal of Educational Statistics 5, 3 (1980), 269–287. Mary L McHugh
1980
-
[1998]
Review of general psychology 2, 3 (1998), 271–299
The emerging field of emotion regulation: An integrative review. Review of general psychology 2, 3 (1998), 271–299. James J Gross
1998
-
[2002]
Psychophysiology 39, 3 (2002), 281–291
Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology 39, 3 (2002), 281–291. James J Gross
2002
-
[2004]
Cyberpsychology & behavior 7, 3 (2004), 321–326
The online disinhibition effect. Cyberpsychology & behavior 7, 3 (2004), 321–326. Jared B Torre and Matthew D Lieberman
2004
-
[2005]
In Landmark writings in western mathematics 1640-1940
RA Fischer, statistical methods for research workers, (1925). In Landmark writings in western mathematics 1640-1940. Elsevier, 856–870. Sharad Goel, Ashton Anderson, Jake Hofman, and Duncan J Watts
1925
-
[2007]
Current directions in psychological science 16, 6 (2007), 351–355
The strength model of self-control. Current directions in psychological science 16, 6 (2007), 351–355. Steven Bird, Ewan Klein, and Edward Loper
2007
-
[2008]
Computers in human behavior 24, 3 (2008), 766–785
The role of emotion in computer-mediated communication: A review. Computers in human behavior 24, 3 (2008), 766–785. Anthony WF Edwards
2008
-
[2009]
Proceedings of the Content Analysis in the WEB 2, 0 (2009), 1–7
Detection of harassment on web 2.0. Proceedings of the Content Analysis in the WEB 2, 0 (2009), 1–7. , Vol. 1, No. 1, Article . Publication date: May 2025
2009
-
[2010]
Journal of personality and social psychology 98, 5 (2010),
From a distance: implications of spontaneous self-distancing for adaptive self-reflection. Journal of personality and social psychology 98, 5 (2010),
2010
-
[2013]
Biochemia medica 23, 2 (2013), 143–149
The chi-square test of independence. Biochemia medica 23, 2 (2013), 143–149. Saif M Mohammad and Peter D Turney
2013
-
[2014]
Personality and individual Differences 67 (2014), 97–102
Trolls just want to have fun. Personality and individual Differences 67 (2014), 97–102. Eshwar Chandrasekharan, Shagun Jhaver, Amy Bruckman, and Eric Gilbert
2014
-
[2016]
Management Science 62, 1 (2016), 180–196
The structural virality of online diffusion. Management Science 62, 1 (2016), 180–196. Vaishali U Gongane, Mousami V Munot, and Alwin D Anuse
2016
-
[2017]
Proceedings of the National Academy of Sciences 114, 28 (2017), 7313–7318
Emotion shapes the diffusion of moralized content in social networks. Proceedings of the National Academy of Sciences 114, 28 (2017), 7313–7318. , Vol. 1, No. 1, Article . Publication date: May
2017
-
[2018]
arXiv preprint arXiv:1803.08022 (2018)
Twitter for sparking a movement, reddit for sharing the moment:# metoo through the lens of social media. arXiv preprint arXiv:1803.08022 (2018). , Vol. 1, No. 1, Article . Publication date: May
2018 arXiv
-
[2020]
The international encyclopedia of gender, media, and communication 116 (2020)
Online abuse and harassment. The international encyclopedia of gender, media, and communication 116 (2020). Joel Kiskola, Thomas Olsson, Aleksi H Syrjämäki, Anna Rantasila, Mirja Ilves, Poika Isokoski, and Veikko Surakka
2020
-
[2021]
In Proceedings of the 2021 CHI conference on human factors in computing systems
Applying critical voice in design of user interfaces for supporting self-reflection and emotion regulation in online news commenting. In Proceedings of the 2021 CHI conference on human factors in computing systems . 1–13. Adam DI Kramer, Jamie E Guillory, and Jeffrey T Hancock
2021
-
[2022]
Expert Systems with Applications 189 (2022), 116110
The theater of fake news spreading, who plays which role? A study on real graphs of spreading on Twitter. Expert Systems with Applications 189 (2022), 116110. William J Brady, Julian A Wills, John T Jost, Joshua A Tucker, and Jay J Van Bavel
2022
-
[2023]
ACM Transactions on Computer- Human Interaction 30, 1 (2023), 1–51
Designing for emotion regulation interventions: an agenda for HCI theory and research. ACM Transactions on Computer- Human Interaction 30, 1 (2023), 1–51. Wally Smith, Greg Wadley, Sarah Webber, Benjamin Tag, Vassilis Kostakos, Peter Koval, and James J Gross
2023
-
[2024]
https://www.grammarly.com
Grammarly. https://www.grammarly.com. Accessed: 2024-06-20. James J Gross
2024
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.