REVIEW 2 major objections 6 minor 138 references
Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation
T0 review · 2 major / 6 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read LLMs act as strategy coaches for deceivers and defenders in a Werewolf-style forum game.
desk verdict A small Werewolf study with a real finding—participants use LLMs as strategy coaches, not just content tools—though the coding needs more rigor before the percentages carry weight. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is a Werewolf-inspired communication game played on a custom online forum platform. Five players per group—one Disinformer, one Moderator, three Users—discussed locally relevant topics with fixed agendas, while all had continuous access to an uncensored open-source chatbot. The game's asymmetric-information structure and deception goals make hidden intents observable; forum posts, votes, reports, chatbot prompts and responses, think-aloud commentary, and post-game interviews were then analysed with reflexive thematic analysis, using an influence guide adapted from established disinformation and persuasion techniques to support participants. This setup lets the authors directly observe the strategies users employ with LLM assistance in a controlled but dynamic setting.
What would settle it
If a similar game (or an analysis of real-world influence-operation logs from platform takedowns) showed no strategy-seeking chatbot prompts—no requests for advice on deceiving, deflecting suspicion, or coordinating—the strategic-advisory claim would be exposed as an artifact of the role-play and checklist design.
Extended reading notes
Core claim
The study's central discovery is that LLMs act as sword and shield simultaneously: they serve as strategic advisors for every role in a disinformation ecosystem, not merely as informational tools. Disinformers most frequently used the chatbot as a strategist (27% of their interactions), asking how to push an agenda while staying hidden, how to frame false claims so they survive fact-checking, and how to shift blame; Moderators and Users used it to verify claims, identify suspicious content, and seek guidance on drawing out the Disinformer or clearing their own name. The paper's contribution is the mapping of these use cases across roles, showing that LLM-based assistance includes coaching on deception, concealment, and detection, and that its effectiveness is mediated by social dynamics such as group scrutiny, emotional tone, and rapport-building.
Load-bearing premise
The study assumes that a role-playing game with non-professional participants, assigned checklists, and a chatbot is a trustworthy stand-in for how real-world disinformation actors and defenders actually behave.
Editorial extensions
If this is right
- Disinformation detection should monitor not only AI-generated content but also strategy-seeking interactions, since both malicious and defensive actors use LLMs for planning.
- Groups that critically engage with chatbot output are more likely to catch LLM-generated disinformation, suggesting that platform designs promoting scrutiny can blunt the sword.
- The effectiveness gap between uncensored open-source models and guardrailed commercial models may create a differential where defenders have access to better tools than typical malicious actors.
- Platform design should foster appropriate reliance on LLMs, balancing verification tools with transparency and preserving space for subjective opinion.
Reading between the lines
- If strategic-advisory use generalizes beyond the lab, safety evaluations of LLMs should test not only refusal to generate disinformation but also refusal to coach deception plans under role-play.
- The game's small, intimate setting maps more naturally to local online communities than to mass-scale influence campaigns; the strategic-advisory role may matter most where trust and rapport are built through sustained interaction.
- A testable extension would compare Disinformers who sought strategic advice against those who only generated content, to isolate whether coaching actually improves concealment or whether it is the Disinformer's editing and social skill that matters.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper reports a qualitative empirical study (n=25, five five-player groups) in which participants played a custom Werewolf-inspired online forum game with a built-in, uncensored LLM chatbot. Disinformers, Moderators, and Users each pursued role-specific goals, and the authors collected forum interactions, chatbot prompts and responses, think-aloud protocols, surveys, and interviews. Using reflexive thematic analysis, they identify role-specific chatbot use cases and argue that LLMs serve not only as content generators and verifiers but also as strategic advisors that help both malicious and defensive actors plan role-appropriate actions. The paper further describes how group dynamics moderate LLM influence, reports obstacles to effective LLM use, and draws implications for platform design and policy.
Significance. If the central claim holds, the paper broadens the current understanding of LLM-assisted disinformation beyond content generation and detection to include strategic coaching of actors on both sides. The study is valuable for its direct observational design: real-world disinformers are difficult to study, and the game environment allows the authors to capture intentions and adaptive strategies, triangulated from forum logs, chatbot transcripts, think-alouds, interviews, and surveys. The case summaries and participant quotes give the paper concrete texture. The authors are also appropriately candid about the game's external validity in Section 6. However, the paper's headline finding about the chatbot as a 'strategic advisor' rests on a thematic category whose coding is not demonstrated to be reproducible, and the effectiveness claims are not systematically tied to game outcomes. These are load-bearing gaps for the stated contributions.
major comments (2)
- [§4.1, Table 4, Figure 5, §5.1.1] The paper's central novelty—that LLMs serve as strategic advisors, not merely content generators or verifiers—rests on the code 'Chatbot as strategist' (n=27, 27% of Disinformer interactions). The Table 4 definition ('Use chatbot for ideas on how to play the role') is broad enough to include asking for phrasing, counterarguments, or role-relevant content, and no codebook, category-boundary rules, or inter-rater reliability check (or a documented audit trail) are reported for the reflexive thematic analysis. Because the paper presents these counts as quantitative support for the claim, coding consistency is not merely a methodological nicety. Moreover, with only five Disinformers, one participant (G5D) may account for a large share of the 27 'strategist' interactions; G5D is repeatedly quoted as treating the chatbot as a strategist, and Figure 5 does not provide per-participant counts. The manuscript therefore does not rule out the possibility that the aggregate 27% is driven by a single participant's extended role-playing prompts. Please report per-participant counts for the categories in Table 4, provide a more operationalized coding scheme with boundary examples, and either add an inter-coder reliability check or justify why the quantitative percentages can stand without one; if the reliability evidence cannot be supplied, the 'strategic advisor' claim should be reframed as a hypothesis rather than a demonstrated finding.
- [§4.5, §5.3] The paper claims to uncover 'varying efficacy' of LLMs depending on role and strategy, and §5.3 asserts that successful Disinformers exercised greater control over chatbot outputs and 'performed better, receiving fewer suspicion votes (G4D, G3D, G5D)'. However, no analysis systematically links chatbot-use categories to objective game outcomes such as detection, suspicion votes, or stance shifts. The group summaries in Tables 3 and 5 show that outcomes were heavily influenced by confounds (e.g., G4U2's disruptive behavior, G5U1's emotional posts), and Section 6 itself reports only minute stance shifts. With n=5, the success pattern in §5.3 is post hoc and not quantified. Please either provide a systematic within-case comparison that connects chatbot-use patterns to outcome measures (for example, per-round suspicion votes alongside chatbot interaction counts and qualitative evidence of causal influence) or explicitly downgrade the effectiveness claims to exploratory observations suitable for hypothesis generation.
minor comments (6)
- [§6] The first sentence of Section 6 contains a typo: 'a inherent limitation' should be 'an inherent limitation'.
- [Table 4] In the Disinformer row for 'Mitigate risk of detection', the text reads 'as as deceptive'; the duplicated 'as' should be removed.
- [§5.2.2] The sentence 'Following up with with "what is this year"' contains a doubled 'with'; please correct it.
- [Figures 5–7] The bar charts would be easier to evaluate if the exact counts per group were printed on the bars or reproduced in an appendix table, since the aggregate percentages currently conceal the per-participant distribution that is critical to the 'strategist' claim.
- [§1] The 'sword and shield' metaphor is not introduced until Section 5; a brief anticipatory mention in the introduction would help readers map the central metaphor onto the paper's structure.
- [§3.1.2] The phrase 'the game has five phases in each round' could be clarified by stating the total duration (2 hours 30 minutes) and the per-phase durations in Figure 1, since the figure does not include numeric durations in the text.
Circularity Check
No circular reasoning found: the study's claims are empirical observations from gameplay data, not derivations from fitted parameters or self-referential prior results.
full rationale
The paper's central claims are ethnographic and qualitative: it reports how participants in a Werewolf-inspired communication game used an LLM chatbot, and it groups these uses into categories such as 'Chatbot as strategist' (Section 4.5, Table 4). The 'strategic advisor' finding is presented as an observed pattern in participant prompts and interview statements, with direct quotes such as G5D's role-playing prompt in Section 5.1.1. No equation, fitted parameter, or formal derivation is involved, so the claim cannot reduce to its own inputs by construction. The only self-citation in the reference list is [65], Lim and Perrault's prior fact-checking chatbot work, which is cited in Section 5.1.2 as related work on fact-checking services and is not load-bearing for any of this paper's novel findings. Concerns that the 'Chatbot as strategist' category may be broad, that no inter-rater reliability is reported, or that results may be driven by a small number of participants relate to evidentiary robustness and generalizability, not circularity. The paper explicitly acknowledges the role-play limitation in Section 6, stating that participants were non-professional actors and that checklist-driven actions 'may reduce the authenticity of participants' behaviours.' This is an external validity caveat, not a circular dependence. Since the findings are grounded in recorded forum interactions, chatbot prompts, think-aloud protocols, and interviews, and since no load-bearing step is equivalent to its input by definition or by self-citation, the appropriate circularity score is 0.
Assumptions & free parameters
assumptions (4)
- domain assumption Werewolf game mechanics are a valid model of key disinformation dynamics in small online communities.
- domain assumption Role-play behavior by amateur participants reflects how real disinformation actors and defenders would behave.
- domain assumption The uncensored open-source LLM chosen for the study represents a realistic tool that malicious actors can access.
- domain assumption Reflexive thematic analysis by five researchers yields reliable and consistent themes.
Cite this review
Pith. "Pith review of Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation." pith.science (2026). https://pith.science/paper/ZFX7LU4N
@misc{pith2026250607211,
author = {Pith},
title = {Pith review of: Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation},
year = {2026},
howpublished = {\url{https://pith.science/paper/ZFX7LU4N}},
note = {Machine review of arXiv:2506.07211}
}
read the original abstract
The emergence of Large Language Models (LLMs) presents a dual challenge in the fight against disinformation. These powerful tools, capable of generating human-like text at scale, can be weaponised to produce sophisticated and persuasive disinformation, yet they also hold promise for enhancing detection and mitigation strategies. This paper investigates the complex dynamics between LLMs and disinformation through a communication game that simulates online forums, inspired by the game Werewolf, with 25 participants. We analyse how Disinformers, Moderators, and Users leverage LLMs to advance their goals, revealing both the potential for misuse and combating disinformation. Our findings highlight the varying uses of LLMs depending on the participants' roles and strategies, underscoring the importance of understanding their effectiveness in this context. We conclude by discussing implications for future LLM development and online platform design, advocating for a balanced approach that empowers users and fosters trust while mitigating the risks of LLM-assisted disinformation.
Figures
Figures from the paper (6 more)
Reference graph
Works this paper leans on
-
[1]
2016.Here’s What We Know So Far About Russia’s 2016 Meddling
Abigail Abrams. 2016.Here’s What We Know So Far About Russia’s 2016 Meddling. https://time.com/5565991/russia-influence-2016-election/
-
[2]
Iuliia Alieva, Lynnette Hui Xian Ng, and Kathleen M. Carley. 2022. Investigating the Spread of Russian Disinformation about Biolabs in Ukraine on Twitter Using Social Network Analysis. In2022 IEEE International Conference on Big Data (Big Data). doi:10.1109/BigData55660.2022.10020223
arXiv 2022
-
[3]
2024.Introducing the next generation of Claude
Anthropic. 2024.Introducing the next generation of Claude. https://www. anthropic.com/news/claude-3-family
2024
-
[4]
Gregory Asmolov. 2018. The disconnective power of disinformation campaigns. Journal of International Affairs71, 1.5 (2018), 69–76
2018
-
[5]
Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, Carol Chen, Catherine Olsson, Christopher Olah, Danny Hernandez, Dawn Drain, Deep Ganguli, Dustin Li, Eli Tran-Johnson, Ethan Perez, Jamie Kerr, Jared Mueller, Jeffrey Ladish, Joshua Landau, Kamal Ndousse, K...
arXiv 2022
-
[6]
Dipto Barman, Ziyi Guo, and Owen Conlan. 2024. The dark side of language models: Exploring the potential of llms in multimedia disinformation generation and dissemination.Machine Learning with Applications(2024), 100545
2024
-
[7]
2018.Network propaganda: Manipulation, disinformation, and radicalization in American politics
Yochai Benkler, Robert Faris, and Hal Roberts. 2018.Network propaganda: Manipulation, disinformation, and radicalization in American politics. Oxford University Press
2018
-
[8]
Sarah Blakeslee. 2004. The CRAAP test.Loex Quarterly31, 3 (2004), 4
2004
Show all 138 references
-
[9]
Ali Borji. 2023. A categorical archive of chatgpt failures.arXiv preprint arXiv:2302.03494(2023)
2023 arXiv
-
[10]
Lia Bozarth, Jane Im, Christopher Quarles, and Ceren Budak. 2023. Wisdom of Two Crowds: Misinformation Moderation on Reddit and How to Improve this Process—A Case Study of COVID-19.Proc. ACM Hum.-Comput. Interact.7, CSCW1, Article 155 (April 2023), 33 pages. doi:10.1145/3579631
2023 doi
-
[11]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology3, 2 (2006), 77–101
2006
-
[12]
2023.Could ChatGPT become a monster misinformation superspreader? NewsGuard
J Brewster, L Arvanitis, and MK Sadeghi. 2023.Could ChatGPT become a monster misinformation superspreader? NewsGuard
2023
-
[13]
George Buchanan, Ryan Kelly, Stephann Makri, and Dana McKay. 2022. Reading Between the Lies: A Classification Scheme of Types of Reply to Misinforma- tion in Public Discussion Threads. InProceedings of the 2022 Conference on Human Information Interaction and Retrieval(Regensbu...
2022
-
[14]
Joy Buchanan and William Hickman. 2024. Do People Trust Humans More Than ChatGPT?Journal of Behavioral and Experimental Economics(2024), 102239
2024
-
[15]
Tom Buchanan. 2020. Why do people spread false information online? The effects of message and viewer characteristics on self-reported likelihood of sharing social media disinformation.PLOS ONE15, 10 (10 2020), 1–33. doi:10. 1371/journal.pone.0239666
2020
-
[16]
Banghao Chen, Zhaofeng Zhang, Nicolas Langrené, and Shengxin Zhu. 2023. Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review.arXiv preprint arXiv:2310.14735(2023)
2023 arXiv
-
[17]
Canyu Chen and Kai Shu. 2023. Can llm-generated misinformation be detected? arXiv preprint arXiv:2309.13788(2023)
2023 arXiv
-
[18]
Canyu Chen and Kai Shu. 2023. Combating misinformation in the age of llms: Opportunities and challenges.AI Magazine(2023)
2023
-
[19]
Sijing Chen, Lu Xiao, and Jin Mao. 2021. Persuasion strategies of misinformation- containing posts in the social media.Information Processing & Management58, 5 (2021), 102665. doi:10.1016/j.ipm.2021.102665
2021
-
[20]
Jeffrey Cheng, Marc Marone, Orion Weller, Dawn Lawrie, Daniel Khashabi, and Benjamin Van Durme. 2024. Dated Data: Tracing Knowledge Cutoffs in Large Language Models.arXiv preprint arXiv:2403.12958(2024)
2024 arXiv
-
[21]
Gonzalez, and Ion Stoica
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chatbot arena: An open platform for evaluating llms by human preference.arXiv preprint arXiv:240...
2024 arXiv
-
[22]
Eun Cheol Choi and Emilio Ferrara. 2024. Automated claim matching with large language models: empowering fact-checkers in the fight against misinformation. InCompanion Proceedings of the ACM on Web Conference 2024. 1441–1449
2024
-
[23]
Commons Librarian. 2024. Disinformation vs Misinformation: Definitions & Types. Retrieved December 1, 2024 from https://commonslibrary.org/ disinformation-vs-misinformation-definitions-types/
2024
-
[24]
Sumit Kumar Dam, Choong Seon Hong, Yu Qiao, and Chaoning Zhang. 2024. A Complete Survey on LLM-based AI Chatbots.arXiv preprint arXiv:2406.16937 (2024)
2024 arXiv
-
[25]
Menno D. T. de Jong, Gabriel Huluba, and Ardion D. Beldad. 2020. Different Shades of Greenwashing: Consumers’ Reactions to Environmental Lies, Half- Lies, and Organizations Taking Credit for Following Legal Obligations.Journal of Business and Technical Communication34, 1 (01 J...
2020
-
[26]
Yi Dong, Ronghui Mu, Yanghao Zhang, Siqi Sun, Tianle Zhang, Changshun Wu, Gaojie Jin, Yi Qi, Jinwei Hu, Jie Meng, Saddek Bensalem, and Xiaowei Huang. 2024. Safeguarding Large Language Models: A Survey.arXiv preprint arXiv:2406.02622(2024)
2024 arXiv
-
[27]
John C Flanagan. 1954. The critical incident technique.Psychological bulletin 51, 4 (1954), 327
1954
-
[28]
Yue Fu, Sami Foell, Xuhai Xu, and Alexis Hiniker. 2024. From Text to Self: Users’ Perception of AIMC Tools on Interpersonal Communication and Self. InProceedings of the CHI Conference on Human Factors in Computing Systems. 1–17
2024
-
[29]
Whiting, and Kazutoshi Sasahara
Dilrukshi Gamage, Piyush Ghasiya, Vamshi Bonagiri, Mark E. Whiting, and Kazutoshi Sasahara. 2022. Are Deepfakes Concerning? Analyzing Conversations of Deepfakes on Reddit and Exploring Societal Implications. InProceedings of the 2022 CHI Conference on Human Factors in Computin...
2022
-
[30]
Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, and Haofen Wang. 2023. Retrieval-augmented generation for large language models: A survey.arXiv preprint arXiv:2312.10997(2023)
2023 arXiv
-
[31]
Christine Geeng, Savanna Yee, and Franziska Roesner. 2020. Fake News on Face- book and Twitter: Investigating How People (Don’t) Investigate. InProceedings of the 2020 CHI Conference on Human Factors in Computing Systems(Honolulu, HI, USA)(CHI ’20). Association for Computing M...
2020
-
[32]
Josh A Goldstein, Girish Sastry, Micah Musser, Renee DiResta, Matthew Gentzel, and Katerina Sedova. 2023. Generative language models and automated influ- ence operations: Emerging threats and potential mitigations.arXiv preprint arXiv:2301.04246(2023). Lim et al
2023 arXiv
-
[33]
2024.Generative AI Prohibited Use Policy
Google. 2024.Generative AI Prohibited Use Policy. https://policies.google.com/ terms/generative-ai/use-policy
2024
-
[34]
Gemini Team Google. 2024. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.arXiv preprint arXiv:2403.05530(2024)
2024 arXiv
-
[35]
Sandy J. J. Gould, Duncan P. Brumby, and Anna L. Cox. 2024. ChatTL;DR – You Really Ought to Check What the LLM Said on Your Behalf. InExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA ’24). Association for Computing Machinery, New York...
2024
-
[36]
Jarod Govers, Eduardo Velloso, Vassilis Kostakos, and Jorge Goncalves. 2024. AI-Driven Mediation Strategies for Audience Depolarisation in Online Debates. InProceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24). Association for Computing Machinery, ...
2024
-
[37]
Rafael Grohmann and Jonathan Corpus Ong. 2024. Disinformation-for-Hire as Everyday Digital Labor: Introduction to the Special Issue.Social Media + Society10, 1 (2024), 20563051231224723. doi:10.1177/20563051231224723
2024 doi
-
[38]
Andrew M Guess and Benjamin A Lyons. 2020. Misinformation, disinformation, and online propaganda.Social media and democracy: The state of the field, prospects for reform10 (2020)
2020
-
[39]
Cheng Guo and Kelly Caine. 2021. Anonymity, User Engagement, Quality, and Trolling on Q&A Sites.Proc. ACM Hum.-Comput. Interact.5, CSCW1, Article 141 (apr 2021), 27 pages. doi:10.1145/3449215
2021 doi
-
[40]
Ankur Gupta, Yash Varun, Prarthana Das, Nithya Muttineni, Parth Srivastava, Hamim Zafar, Tanmoy Chakraborty, and Swaprava Nath. 2021. TruthBot: An Automated Conversational Tool for Intent Learning, Curated Information Presenting, and Fake News Alerting.arXiv preprint arXiv:210...
2021 arXiv
-
[41]
Michael Hameleers, Thomas E Powell, Toni GLA Van Der Meer, and Lieke Bos. 2020. A picture paints a thousand lies? The effects and mechanisms of multimodal disinformation and rebuttals disseminated via social media.Political communication37, 2 (2020), 281–301
2020
-
[42]
2024.This Brazilian fact-checking org uses a ChatGPT-esque bot to answer reader questions
Hanaa’ Tameez. 2024.This Brazilian fact-checking org uses a ChatGPT-esque bot to answer reader questions. https://www.niemanlab.org/2024/01/this-brazilian- fact-checking-org-uses-a-chatgpt-esque-bot-to-answer-reader-questions/
2024
-
[43]
Hans W. A. Hanley, Deepak Kumar, and Zakir Durumeric. 2023. A Golden Age: Conspiracy Theories’ Relationship with Misinformation Outlets, News Media, and the Wider Internet.Proc. ACM Hum.-Comput. Interact.7, CSCW2, Article 252 (oct 2023), 33 pages. doi:10.1145/3610043
2023 doi
-
[44]
2024.Disinformation and 7 Common Forms of Information Disor- der
HiveMind. 2024.Disinformation and 7 Common Forms of Information Disor- der. https://commonslibrary.org/disinformation-and-7-common-forms-of- information-disorder/
2024
-
[45]
Yi-Li Hsu, Jui-Ning Chen, Yang Fan Chiang, Shang-Chien Liu, Aiping Xiong, and Lun-Wei Ku. 2024. Enhancing Perception: Refining Explanations of News Claims with LLM Conversations. InFindings of the Association for Computational Linguistics: NAACL 2024. 2129–2147
2024
-
[46]
Muhammad Nihal Hussain, Serpil Tokdemir, Nitin Agarwal, and Samer Al- Khateeb. 2018. Analyzing disinformation and crowd manipulation tactics on YouTube. In2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM). IEEE, 1092–1095
2018
-
[47]
Index on Censorship. 2011. Interview with a troll. Retrieved December 1, 2024 from https://www.indexoncensorship.org/2011/09/interview-with-a-troll/
2011
-
[48]
Md Rafiqul Islam, Shaowu Liu, Xianzhi Wang, and Guandong Xu. 2020. Deep learning for misinformation detection on online social networks: a survey and new perspectives.Social Network Analysis and Mining10, 1 (29 Sept. 2020), 82. doi:10.1007/s13278-020-00696-x
2020 doi
-
[49]
Kokil Jaidka, Tsuhan Chen, Simon Chesterman, Wynne Hsu, Min-Yen Kan, Mohan Kankanhalli, Mong Li Lee, Gyula Seres, Terence Sim, Araz Taeihagh, Anthony Tung, Xiaokui Xiao, and Audrey Yue. 2024. Misinformation, Disinfor- mation, and Generative AI: Implications for Perception and ...
2024 doi
-
[50]
Pedro Jerónimo and Marta Sanchez Esparza. 2022. Disinformation at a Lo- cal Level: An Emerging Discussion.Publications10, 2 (2022). doi:10.3390/ publications10020015
2022
-
[51]
Chenyan Jia, Alexander Boltz, Angie Zhang, Anqing Chen, and Min Kyung Lee
-
[52]
Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, Gianna Lengyel, Guillaume Bour, Guil- laume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-An...
2024 arXiv
-
[53]
2024.Generative AI is already helping fact-checkers
Gretel Kahn. 2024.Generative AI is already helping fact-checkers. But it’s proving less useful in small languages and outside the West. https://reutersinstitute.politics.ox.ac.uk/news/generative-ai-already-helping- fact-checkers-its-proving-less-useful-small-languages-and
2024
-
[54]
Daniel Karell and Anjali Agrawal. 2022. Small town propaganda: The content and emotions of politicized digital local news in the United States.Poetics92 (2022), 101641. doi:10.1016/j.poetic.2021.101641
2022
-
[55]
Brian L Keeley. 2024. Conspiracy theorists are not the problem; Conspiracy liars are.Inquiry(2024), 1–21
2024
-
[56]
2024.Digital 2024: Singapore
Simon Kemp. 2024.Digital 2024: Singapore. https://datareportal.com/reports/ digital-2024-singapore
2024
-
[57]
GARY KING, JENNIFER PAN, and MARGARET E. ROBERTS. 2013. How Cen- sorship in China Allows Government Criticism but Silences Collective Expres- sion.American Political Science Review107, 2 (2013), 326–343. doi:10.1017/ S0003055413000014
2013
-
[58]
Sarah Kreps, R Miles McCain, and Miles Brundage. 2022. All the news that’s fit to fabricate: AI-generated text as a tool of media misinformation.Journal of experimental political science9, 1 (2022), 104–117
2022
-
[59]
2024.Uncensor Any LLM with Abliteration
Maxime Labonne. 2024.Uncensor Any LLM with Abliteration. https:// huggingface.co/blog/mlabonne/abliteration
2024
-
[60]
Jianqiao Lai, Xinran Yang, Wenyue Luo, Linjiang Zhou, Langchen Li, Yongqi Wang, and Xiaochuan Shi. 2024. RumorLLM: A Rumor Large Language Model- Based Fake-News-Detection Data-Augmentation Approach.Applied Sciences 14, 8 (Jan. 2024), 3532. doi:10.3390/app14083532
2024 doi
-
[61]
MacKenzie
Candice Lanius, Ryan Weber, and William I. MacKenzie. 2021. Use of bot and content flags to limit the spread of misinformation among social networks: a behavior and attitude survey.Social Network Analysis and Mining11, 1 (12 March 2021), 32. doi:10.1007/s13278-021-00739-x
2021 doi
-
[62]
2023.Meet Chaos-GPT: An AI Tool That Seeks to De- stroy Humanity
Jose Antonio Lanz. 2023.Meet Chaos-GPT: An AI Tool That Seeks to De- stroy Humanity. https://finance.yahoo.com/news/meet-chaos-gpt-ai-tool- 163905518.html
2023
-
[63]
Thinking-aloud
Clayton Lewis. 1982. Using the "Thinking-aloud" Method in Cog- nitive Interface Design. https://dominoweb.draco.res.ibm.com/ 2513e349e05372cc852574ec0051eea4.html
1982
- [64]
-
[65]
Gionnieve Lim and Simon T Perrault. 2023. Fact checking chatbot: A misinfor- mation intervention for instant messaging apps and an analysis of trust in the fact checkers. InMobile Communication and Online Falsehoods in Asia: Trends, Impact and Practice. Springer, 197–224
2023
- [66]
-
[67]
Lukosch, Geertje Bekebrede, Shalini Kurapati, and Stephan G
Heide K. Lukosch, Geertje Bekebrede, Shalini Kurapati, and Stephan G. Lukosch
-
[68]
Raphael Meier. 2024. LLM-Aided Social Media Influence Operations.Large Language Models in Cybersecurity: Threats, Exposure and Mitigation(2024), 105– 112
2024
-
[69]
2024.Meet Your New Assistant: Meta AI, Built With Llama 3
Meta. 2024.Meet Your New Assistant: Meta AI, Built With Llama 3. https: //about.fb.com/news/2024/04/meta-ai-assistant-built-with-llama-3/
2024
-
[70]
2024.Trust & Safety
Meta. 2024.Trust & Safety. https://llama.meta.com/trust-and-safety/
2024
-
[71]
Nicholas Micallef, Vivienne Armacost, Nasir Memon, and Sameer Patil. 2022. True or False: Studying the Work Practices of Professional Fact-Checkers.Proc. ACM Hum.-Comput. Interact.6, CSCW1, Article 127 (apr 2022), 44 pages. doi:10. 1145/3512974
2022
-
[72]
Muhammad Shujaat Mirza, Labeeba Begum, Liang Niu, Sarah Pardo, Azza Abouzied, Paolo Papotti, and Christina Pöpper. 2023. Tactics, Threats & Targets: Modeling Disinformation and its Mitigation.. InNDSS
2023
-
[73]
Will Moy. 2021. Scaling Up the Truth: Fact-Checking Innovations and the Pandemic. National Endowment For Democracy. https://www.ned.org/wp- content/uploads/2021/01/Fact-Checking-Innovations-Pandemic-Moy.pdf
2021
-
[74]
M. F. Mridha, Ashfia Jannat Keya, Md. Abdul Hamid, Muhammad Mostafa Monowar, and Md. Saifur Rahman. 2021. A Comprehensive Review on Fake News Detection With Deep Learning.IEEE Access9 (2021), 156151–156170. doi:10.1109/ACCESS.2021.3129329
2021
-
[75]
Noritsugu Nakamura, Michimasa Inaba, Kenichi Takahashi, Fujio Toriumi, Hi- rotaka Osawa, Daisuke Katagami, and Kousuke Shinoda. 2016. Constructing a human-like agent for the werewolf game using a psychological model based multiple perspectives. In2016 IEEE Symposium Series on ...
2016
-
[76]
2024.Tracking AI-enabled Misinformation
NewsGuard. 2024.Tracking AI-enabled Misinformation. https://www. newsguardtech.com/special-reports/ai-tracking-center/
2024
-
[77]
Jingwei Ni, Minjing Shi, Dominik Stammbach, Mrinmaya Sachan, Elliott Ash, and Markus Leippold. 2024. AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators.arXiv preprint arXiv:2402.11073 (2024)
2024 arXiv
-
[78]
Ben Nimmo and Aric Toler. 2018. How They Did It: The Real Russian Journalists Who Exposed the Troll Factory in St. Petersburg. Retrieved December 1, 2024 Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation from https://gijn.org/stories/real-russian-journ...
2018
-
[79]
Babu Noushad, Pascal WM Van Gerven, and Anique BH De Bruin. 2024. Twelve tips for applying the think-aloud method to capture cognitive processes.Medical Teacher46, 7 (2024), 892–897
2024
-
[80]
OpenAI. 2023. Gpt-4 technical report.arXiv preprint arXiv:2303.08774(2023)
2023 arXiv
-
[81]
2024.Disrupting Deceptive Uses of AI by Covert Influence Opera- tions
OpenAI. 2024.Disrupting Deceptive Uses of AI by Covert Influence Opera- tions. https://openai.com/index/disrupting-deceptive-uses-of-AI-by-covert- influence-operations/
2024
-
[82]
2024.The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions
OpenAI. 2024.The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions. https://openai.com/index/the-instruction-hierarchy/
2024
-
[83]
2024.OpenAI Safety Practices
OpenAI. 2024.OpenAI Safety Practices. https://openai.com/index/openai- safety-update/
2024
-
[84]
2024.Usage Policies
OpenAI. 2024.Usage Policies. https://openai.com/policies/usage-policies/
2024
-
[85]
Liangming Pan, Xiaobao Wu, Xinyuan Lu, Anh Tuan Luu, William Yang Wang, Min-Yen Kan, and Preslav Nakov. 2023. Fact-Checking Complex Claims with Program-Guided Reasoning. InProceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long P...
2023 doi
-
[86]
Joon Sung Park, Rick Barber, Alex Kirlik, and Karrie Karahalios. 2019. A Slow Algorithm Improves Users’ Assessments of the Algorithm’s Accuracy.Proc. ACM Hum.-Comput. Interact.3, CSCW, Article 102 (nov 2019), 15 pages. doi:10. 1145/3359204
2019
-
[87]
Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI literature review. Microsoft Research(2022)
2022
- [88]
-
[89]
Kellin Pelrine, Anne Imouza, Camille Thibault, Meilina Reksoprodjo, Caleb Gupta, Joel Christoph, Jean-François Godbout, and Reihaneh Rabbany. 2023. Towards reliable misinformation mitigation: Generalization, uncertainty, and gpt-4.arXiv preprint arXiv:2305.14928(2023)
2023 arXiv
-
[90]
Tobias M Peters and Roel W Visser. 2023. The importance of distrust in AI. In World Conference on Explainable Artificial Intelligence. Springer, 301–317
2023
-
[91]
Eva M Pomerantz, Shelly Chaiken, and Rosalind S Tordesillas. 1995. Attitude strength and resistance processes.Journal of personality and social psychology 69, 3 (1995), 408
1995
-
[92]
Martin Potter. 2021. Bad actors never sleep: content manipulation on Reddit. Continuum35, 5 (03 Sep 2021), 706–718. doi:10.1080/10304312.2021.1983254
2021
-
[93]
West, and Kate Starbird
Stephen Prochaska, Kayla Duskin, Zarine Kharazian, Carly Minow, Stephanie Blucker, Sylvie Venuto, Jevin D. West, and Kate Starbird. 2023. Mobilizing Manufactured Reality: How Participatory Disinformation Shaped Deep Stories to Catalyze Action during the 2020 U.S. Presidential ...
2023 doi
-
[94]
Dorian Quelle and Alexandre Bovet. 2024. The perils and promises of fact- checking with large language models.Frontiers in Artificial Intelligence7 (2024), 1341697
2024
-
[95]
Nathalie Van Raemdonck. 2019. The Echo Chamber of Anti-Vaccination Conspir- acies: Mechanisms of Radicalization on Facebook and Reddit. Retrieved Decem- ber 1, 2024 from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3510196
2019
-
[96]
Varshney, Amit Dhurand- har, and Richard Tomsett
Charvi Rastogi, Yunfeng Zhang, Dennis Wei, Kush R. Varshney, Amit Dhurand- har, and Richard Tomsett. 2022. Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making.Proc. ACM Hum.-Comput. Interact.6, CSCW1, Article 83 (apr 2022), 22 pages. doi:10.1145/3512930
2022 doi
-
[97]
Raquel Recuero, Felipe Soares, and Otávio Vinhas. 2020. Discursive strategies for disinformation on WhatsApp and Twitter during the 2018 Brazilian presidential election.First Monday26, 1 (Dec. 2020). doi:10.5210/fm.v26i1.10551
2020 doi
-
[98]
Cialdini Robert. 2001. Harnessing the science of persuasion.Harvard Business Review79, 9 (2001), 72–79
2001
-
[99]
Jon Roozenbeek and Sander Van der Linden. 2019. Fake news game confers psy- chological resistance against online misinformation.Palgrave Communications 5, 1 (2019), 1–10
2019
-
[100]
Saltz, S
E. Saltz, S. Barari, C. R. Leibowicz, and C. Wardle. 2021. Misinformation in- terventions are common, divisive, and poorly understood. Harvard Kennedy School (HKS) Misinformation Review. doi:10.37016/mr-2020-81
2021 doi
-
[101]
Deceptive
Kate Scott. 2023. “Deceptive” clickbait headlines: Relevance, intentions, and lies.Journal of Pragmatics218 (2023), 71–82
2023
-
[102]
Connie Moon Sehat, Ryan Li, Peipei Nie, Tarunima Prabhakar, and Amy X. Zhang. 2024. Misinformation as a harm: structured approaches for fact-checking prioritization.Proceedings of the ACM on Human-Computer Interaction8, CSCW1 (April 2024), 1–36. doi:10.1145/3641010
2024 doi
-
[103]
Haeseung Seo, Aiping Xiong, and Dongwon Lee. 2019. Trust It or Not: Effects of Machine-Learning Warnings in Helping Individuals Mitigate Misinformation. In Proceedings of the 10th ACM Conference on Web Science(Boston, Massachusetts, USA)(WebSci ’19). Association for Computing ...
2019
-
[104]
Vinay Setty. 2024. FactCheck Editor: Multilingual Text Editor with End-to-End fact-checking. InProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2744–2748
2024
-
[105]
Siddhant Bikram Shah, Surendrabikram Thapa, Ashish Acharya, Kritesh Rau- niyar, Sweta Poudel, Sandesh Jain, Anum Masood, and Usman Naseem. 2024. Navigating the Web of Disinformation and Misinformation: Large Language Models as Double-Edged Swords.IEEE Access(2024)
2024
-
[106]
Chengcheng Shao, Giovanni Luca Ciampaglia, Onur Varol, Kai-Cheng Yang, Alessandro Flammini, and Filippo Menczer. 2018. The spread of low-credibility content by social bots.Nature Communications9, 1 (20 Nov 2018). doi:10.1038/ s41467-018-06930-7
2018
-
[107]
Vera Liao, and Ziang Xiao
Nikhil Sharma, Q. Vera Liao, and Ziang Xiao. 2024. Generative Echo Chamber? Effect of LLM-Powered Search Systems on Diverse Information Seeking. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA)(CHI ’24). Association for Computing M...
2024
-
[108]
Marita Skjuve, Petter Bae Brandtzaeg, and Asbjørn Følstad. 2024. Why do people use ChatGPT? Exploring user motivations for generative conversational AI.Exploring user motivations for generative conversational AI. This paper has been published in First Monday. Please use the fo...
2024
-
[109]
Craig S. Smith. 2023.What Large Models Cost You – There Is No Free AI Lunch. https://www.forbes.com/sites/craigsmith/2023/09/08/what-large- models-cost-you--there-is-no-free-ai-lunch/
2023
-
[110]
Giovanni Spitale, Nikola Biller-Andorno, and Federico Germani. 2023. AI model GPT-3 (dis) informs us better than humans.Science Advances9, 26 (2023), eadh1850
2023
-
[111]
Kate Starbird, Ahmer Arif, and Tom Wilson. 2019. Disinformation as Col- laborative Work: Surfacing the Participatory Nature of Strategic Information Operations.Proc. ACM Hum.-Comput. Interact.3, CSCW, Article 127 (nov 2019), 26 pages. doi:10.1145/3359229
2019 doi
-
[112]
Sunstein and Adrian Vermeule
Cass R. Sunstein and Adrian Vermeule. 2009. Conspiracy Theories: Causes and Cures.Journal of Political Philosophy17, 2 (2009), 202–227. doi:10.1111/j.1467- 9760.2008.00325.x arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1467- 9760.2008.00325.x
2009
-
[113]
2023.OpenHermes 2.5: An Open Dataset of Synthetic Data for Generalist LLM Assistants
Teknium. 2023.OpenHermes 2.5: An Open Dataset of Synthetic Data for Generalist LLM Assistants. https://huggingface.co/datasets/teknium/OpenHermes-2.5
2023
-
[114]
2024.Producing Fake Information Is Getting Easier
The Economist. 2024.Producing Fake Information Is Getting Easier. https://www.economist.com/science-and-technology/2024/05/01/producing- fake-information-is-getting-easier
2024
-
[115]
Shane Tilton. 2019. Winning through deception: A pedagogical case study on using social deception games to teach small group communication theory. SAGE Open9, 1 (2019), 2158244019834370
2019
-
[116]
Fujio Toriumi, Hirotaka Osawa, Michimasa Inaba, Daisuke Katagami, Kosuke Shinoda, and Hitoshi Matsubara. 2017. AI wolf contest—development of game AI using collective intelligence—. InComputer Games: 5th Workshop on Computer Games, CGW 2016, and 5th Workshop on General Intelli...
2017
-
[117]
Issei Tsunoda and Yoshinobu Kano. 2019. AI werewolf agent with reasoning us- ing role patterns and heuristics. InProceedings of the 1st International Workshop of AI Werewolf and Dialog System (AIWolfDial2019). 15–19
2019
-
[118]
Uscinski and Ryden W
Joseph E. Uscinski and Ryden W. Butler. 2013. The Epistemology of Fact Checking.Critical Review25, 2 (2013), 162–180. doi:10.1080/08913811.2013. 843872 arXiv:https://doi.org/10.1080/08913811.2013.843872
2013
-
[119]
2024.Large Language Model Statistics And Num- bers
Serhii Uspenskyi. 2024.Large Language Model Statistics And Num- bers. https://springsapps.com/knowledge/large-language-model-statistics- and-numbers-2024
2024
-
[120]
Luis Vargas, Patrick Emami, and Patrick Traynor. 2020. On the Detection of Disinformation Campaign Activity with Network Analysis. InProceedings of the 2020 ACM SIGSAC Conference on Cloud Computing Security Workshop(Virtual Event, USA)(CCSW’20). Association for Computing Machi...
2020
-
[121]
Sidharth Vemuri, Jenny Hynson, Lynn Gillam, and Katrina Williams. 2020. Simulation-Based Research: A Scoping Review.Qualitative Health Research30, 14 (2020), 2351–2360. doi:10.1177/1049732320946893
2020 doi
-
[122]
Harko Verhagen, Magnus Johansson, and Wander Jager. 2017. Games and Online Research Methods
2017
-
[123]
Soroush Vosoughi, Deb Roy, and Sinan Aral. 2018. The spread of true and false news online.Science359, 6380 (2018), 1146–1151. doi:10.1126/science.aap9559
2018 doi
-
[124]
Herun Wan, Shangbin Feng, Zhaoxuan Tan, Heng Wang, Yulia Tsvetkov, and Minnan Luo. 2024. DELL: Generating Reactions and Explanations for LLM- based Misinformation Detection. InFindings of the Association for Computational Linguistics ACL 2024, Lun-Wei Ku, Andre Martins, and Vi...
2024
-
[125]
Claire Wardle and Hossein Derakhshan. 2017. Information disorder: Toward an interdisciplinary framework for research and policy making. Retrieved December 1, 2024 from https://edoc.coe.int/en/media/7495-information- disorder-toward-an-interdisciplinary-framework-for-research-a...
2017
-
[126]
William J White. 2018. Communication research and role-playing games. In Role-Playing Game Studies. Routledge, 337–345
2018
-
[127]
2024.GPT4-Chan
Wikipedia. 2024.GPT4-Chan. https://en.wikipedia.org/w/index.php?title= GPT4-Chan&oldid=1239484967
2024
-
[128]
Junchao Wu, Shu Yang, Runzhe Zhan, Yulin Yuan, Derek F Wong, and Lidia S Chao. 2023. A survey on llm-gernerated text detection: Necessity, methods, and future directions.arXiv preprint arXiv:2310.14724(2023)
2023 arXiv
-
[129]
Carley, and Huan Liu
Liang Wu, Fred Morstatter, Kathleen M. Carley, and Huan Liu. 2019. Misin- formation in Social Media: Definition, Manipulation, and Detection.SIGKDD Explor. Newsl.21, 2 (Nov. 2019), 80–90. doi:10.1145/3373464.3373475
2019
- [130]
-
[131]
Hui Yang, Sifu Yue, and Yunzhong He. 2023. Auto-gpt for online decision making: Benchmarks and additional opinions.arXiv preprint arXiv:2306.02224 (2023)
2023 arXiv
- [132]
-
[133]
Sidi Zhang and Bowen Jiang. 2021. The Sense of Community in the Era of Online Socials: A Case Study of Werewolf Killing Among Chinese Youth. In 2021 5th International Seminar on Education, Management and Social Sciences (ISEMSS 2021). Atlantis Press, 480–486
2021
-
[134]
Jiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G Parker, and Munmun De Choudhury. 2023. Synthetic lies: Understanding ai-generated misinfor- mation and evaluating algorithmic and human solutions. InProceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–20
2023
-
[135]
Xinyi Zhou and Reza Zafarani. 2020. A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities.ACM Comput. Surv.53, 5, Article 109 (Sept. 2020), 40 pages. doi:10.1145/3395046
2020 doi
-
[136]
phantom employees
Terry Yue Zhuo, Yujin Huang, Chunyang Chen, and Zhenchang Xing. 2023. Red teaming chatgpt via jailbreaking: Bias, robustness, reliability and toxicity. arXiv preprint arXiv:2301.12867(2023). Sword and Shield: Uses and Strategies of LLMs in Navigating Disinformation A Appendix ...
2023 arXiv
-
[2018]
doi:10.1177/ 1046878118768858
A Scientific Foundation of Simulation Games for the Analysis and Design of Complex Systems.Simulation & Gaming49, 3 (2018), 279–314. doi:10.1177/ 1046878118768858
2018
-
[2022]
Community Label on Perceived Accuracy of Hyper-partisan Misinformation.Proc
Understanding Effects of Algorithmic vs. Community Label on Perceived Accuracy of Hyper-partisan Misinformation.Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 371 (Nov. 2022), 27 pages. doi:10.1145/3555096
2022 doi
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.