Pith. sign in

REVIEW 2 major objections 5 minor 1 cited by

Measuring the Mental Health of Content Reviewers, a Systematic Review

T0 review · 2 major / 5 minor · reviewed 2026-08-09 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This systematic review argues that the psychological measures now used on content moderators were built for low-volume, interactive helping work and can misdiagnose the workers they are meant to assess.

desk verdict A useful and well-argued systematic review of mental health measures for content reviewers, whose central claim holds despite a search-protocol inconsistency that needs fixing before the country/language gap counts are taken as definitive. read the letter →

arxiv 2502.00244 v1 pith:OUN4OVQR submitted 2025-02-01 cs.CY cs.HC

Alexandra Gonzalez , J. Nathan Matias This is my paper · ORCID
classification cs.CYcs.HC
keywords contentmoderationmentalhealthmeasurementsecondarytraumaticstressvicarioustraumaburnoutcompassionfatiguesystematicreviewwell-beingscales
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This systematic review argues that the psychological measures now used on content moderators were built for low-volume, interactive helping work and can misdiagnose the workers they are meant to assess. After screening 1,673 papers and reading 143 validation studies, the authors profile 12 scales covering secondary trauma, vicarious trauma, compassion fatigue, well-being, burnout, compassion satisfaction, and vicarious resilience. They report where each scale has actually been validated in terms of languages and countries, and they find serious gaps in the regions where content review labor is concentrated. The paper's practical conclusion is that reliable measurement of content reviewer mental health requires scales matched to this specific kind of work and validated in the cultures where it happens.

What carries the argument

The systematic review itself is the machinery: a PRISMA-guided Google Scholar search that combined five mental-health terms with three measurement terms, yielding 1,673 unique papers, of which 143 met the inclusion criteria for full review. For each validation study, the authors coded the profession, country, language, statistical evidence, and availability of the instrument, then compared the scale's assumptions about helping work against the conditions of content review. This comparison produces a central table of 12 measures organized by clinical versus research purpose, with each scale's reported validation coverage in languages and countries.

What would settle it

A published validation study of the TSI Belief Scale or TABS in a language other than English, such as Spanish, Portuguese, Hindi, or Swahili, and conducted in a country outside the two reported, would directly contradict the paper's country-language table. Re-running the same twelve Google Scholar queries without the 150-result cap and coding all resulting papers would also settle whether the validation gaps are real or an artifact of the search.

Watch

Extended reading notes

Core claim

The paper's central claim is that existing measures of vicarious trauma, secondary traumatic stress, compassion fatigue, and burnout are not ready-made for content review work. These instruments were designed for professionals who work with clients at low volume, can choose cases, interact with the people they help, and often see the outcomes; content reviewers instead face high volumes of disturbing material with no meaningful interaction or intervention, often under precarious labor conditions. Based on 143 validation studies, the authors show that most of the 12 adaptable measures lack validation in the languages and countries where content review labor is common, and some widely used tools have published validity evidence that falls below accepted standards. They therefore conclude that applying these scales uncritically to content reviewers risks misdiagnosis and improper prevalence estimates, and they call for measures that reflect the actual structure of the work and are culturally relevant.

Load-bearing premise

The claim that certain measures lack validation in particular languages and countries rests on an English-language Google Scholar search capped at the first 150 results per query and coded by a single reviewer, so the reported gaps could reflect search coverage rather than the true universe of validation studies.

Editorial extensions

If this is right

  • Researchers doing descriptive work on content moderation should prioritize clinical measures and partner with clinicians when the goal is screening or diagnosis, rather than treating research burnout scores as diagnoses.
  • Cross-country or cross-vendor comparisons using scales that have not been validated in those settings should be avoided, because the instruments may not be comparable.
  • Burnout measures can still help study workplace conditions, but teams should review the validation literature first, since the Maslach Burnout Inventory-General Survey has unclear structural and cross-cultural validity.
  • Compassion fatigue measures are best limited to volunteer and community moderation where workers choose cases and interact with people; they need significant redesign for commercial moderation work.
  • The WHO-5 Well-Being Index is the most widely translated and validated scale in the set, but it screens for depression-related well-being and does not capture the intrusive thoughts, avoidance, and hyperarousal that content reviewers report.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the paper is right, prior content-moderation studies that used unadapted burnout, secondary trauma, or compassion fatigue scales may have produced prevalence estimates that are systematically off, not merely noisy.
  • A concrete testable implication is that scales redesigned for content review, such as versions of the Vicarious Trauma Scale that remove assumptions about intervening with clients, will show different factor structures or prevalence rates in moderator samples than the originals do.
  • The measurement gaps the paper documents reinforce the case for validated instruments in the actual languages and countries of moderation labor, which would give labor advocacy and supply-chain accountability a stronger empirical basis.
  • For AI red-teaming and data-annotation work, where there may be no real situation to intervene in at all, the mismatch is even sharper and may call for constructs beyond translations of existing care-work scales.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. This systematic review asks whether psychological measures developed for helping professions are suitable for measuring the mental health of content reviewers. The authors report screening Google Scholar results, identifying 1,673 unique records, reviewing 143 validation studies, and summarizing 12 measures across 7 phenomena, including the STSS, TSI/TABS, VTS, MBI, BAT, CBI, ProQoL, and WHO-5. Their central argument is that most existing instruments were designed for low-volume, interactive client relationships and therefore fit content review work poorly, which may lead to misdiagnosis or misestimated prevalence of secondary and vicarious trauma. They also report that few scales have been validated in the countries and languages where content review labor is concentrated, and they call for work-matched, culturally relevant measures.

Significance. The paper makes a timely and practically important contribution to CSCW/HCI and digital labor research. Its strongest asset is the item-level analysis of why care-profession measures embed assumptions about client interaction, case choice, and relational work that do not hold for most content reviewers. The distinction between clinical and research uses is clearly drawn, and the review usefully identifies a concrete set of candidate instruments for future studies. If the empirical gap claims are supported, the paper provides a valuable caution against uncritical cross-country and cross-occupation comparisons. The main weaknesses are in the reporting and evidentiary basis of the search: the protocol is internally inconsistent, and the geographic/language gap counts rest on a single English-language database search, which limits the force of the 'serious gaps in regions where content review labor is common' conclusion.

major comments (2)
  1. [3.3, Figure 1] The search protocol as written cannot reproduce the reported record count. The text lists five mental-health terms ('burnout,' 'secondary trauma,' 'vicarious trauma,' 'occupational trauma,' 'compassion fatigue') but states that 'with four mental health terms and three measurement terms, we conducted a total of twelve searches.' Fifteen term combinations (five times three) would have a 150-result cap of 2,250 records, consistent with the reported 2,249; twelve searches would cap at 1,800. Because Table 2's language and country counts—the empirical basis for the claim of 'serious gaps in measurement validity in regions where content review labor is common'—are derived from this search, the manuscript must state the actual number of searches, list all query strings, and make the raw search results available. As written, the validation-gap counts are not reproducible.
  2. [3.2, 3.4, Table 2] The language and country gap counts in Table 2 (e.g., TSI validated in one language, VTS in six languages across two countries) are used to conclude that validation is missing in regions where content review labor is common. However, the search was restricted to Google Scholar, to English-language publications, and to the first 150 results per query; the review even excluded reports for not being in English. These design choices can produce exactly the kind of geographic and linguistic gaps reported, so the counts should be presented as lower bounds conditional on search coverage, or the authors should supplement the review with additional databases and non-English searches before drawing the regional-gap conclusion. This limitation is load-bearing for one of the paper's central claims.
minor comments (5)
  1. [Figure 1] The PRISMA flow diagram is internally inconsistent: it reports 143 reports sought for retrieval, 5 reports not retrieved, yet shows 143 reports assessed for eligibility and 138 studies included. Please clarify whether the 5 unretrieved reports are included in the 143 assessed and make the flow diagram match the text.
  2. [4.1.2, Table 1] The TSI Belief Scale is listed under 'Secondary Trauma' in Table 1 but is described in Section 4.1.2 as a vicarious-trauma measure. This classification inconsistency should be resolved, and the phenomenon grouping would benefit from verification given that coding was performed by a single reviewer.
  3. [3.3] The sentence 'Out of all of the papers, 143 papers met the inclusion criteria... We added four papers from the larger dataset to our list of validation studies after noticing later that they also met these criteria' is ambiguous: it is unclear whether the final count is 143 or 147 and whether the four added papers are included in the 143 described elsewhere.
  4. [2] The first sentence of Section 2 reads 'we review prior on content review work'; the missing word is likely 'research.'
  5. [4.1.4] Minor grammatical issue: 'the tool has validated in 2 languages' should read 'the tool has been validated in 2 languages.'

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the review's conclusions are drawn from external validation studies, and the authors' self-citations are background only.

full rationale

This systematic review's central claims—that secondary trauma, vicarious trauma, compassion fatigue, and burnout measures were designed for low-volume, interactive helping relationships and that validation coverage is concentrated in few countries and languages—are derived from the external validation literature the review summarizes. The country/language gaps in Table 2 and the item-level critiques of scales such as the STSS, VTS, TSI/TABS, and MBI come from the cited validation studies and from the scale descriptions, not from any prior result of the authors. No parameter is fitted and then renamed as a prediction; no conclusion is defined in terms of the review's own outcome. The authors' self-citations ([72], [88], [116]) provide background about volunteer moderation and moderator well-being, but they are not load-bearing for the validity-gap counts or the adaptability judgments. The reported search protocol contains an internal arithmetic inconsistency (five listed mental-health terms but the text says 'four' and 'twelve searches,' while 2,249 records are reported), and single-coder extraction is a limitation; however, these are reproducibility and correctness concerns, not circularity, and they do not make any derived claim equivalent to its input. Overall, the derivation chain is self-contained with respect to external evidence, so no circular step is present.

Assumptions & free parameters 2 free parameters · 4 assumptions · 0 invented entities

The review's conclusions rest on domain assumptions about the similarity between content reviewing and helping professions, plus hand-chosen search and coding procedures. No numeric model parameters or invented entities are involved.

free parameters (2)
  • Result cap per search query = 150
    The authors exported only the first 150 Google Scholar results for each of 12 queries, a hand-chosen cutoff that determines which validation studies entered screening.
  • Phenomena selection = 7 of 85
    From 85 coded psychological phenomena, the authors selected 7 they judged most relevant to content reviewing, which shapes the set of 12 measures reported.
assumptions (4)
  • domain assumption Measures validated in adjacent helping professions are relevant to content reviewers' experiences.
    Section 2.2 argues that symptoms reported by content reviewers resemble secondary trauma, vicarious trauma, compassion fatigue, and burnout, justifying the review scope.
  • domain assumption Content reviewing is structurally different from interactive helping work, making existing measures insufficient without adaptation.
    Sections 2.1 and 4 repeatedly state that content reviewers cannot intervene, work at high volume, and are detached from the people involved, which is why the measures need re-validation.
  • domain assumption Validation statistics reported in primary studies are accurate and correctly interpreted.
    The review relies on published Cronbach's alpha and other psychometric results without re-analyzing primary data.
  • domain assumption Google Scholar provides sufficient coverage of the validation literature for the selected constructs.
    Section 3.2 justifies the single database choice; all counts and gap claims depend on this coverage assumption.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Measuring the Mental Health of Content Reviewers, a Systematic Review." pith.science (2026). https://pith.science/paper/OUN4OVQR

@misc{pith2026250200244,
  author       = {Pith},
  title        = {Pith review of: Measuring the Mental Health of Content Reviewers, a Systematic Review},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/OUN4OVQR}},
  note         = {Machine review of arXiv:2502.00244}
}
read the original abstract

Artificial intelligence and social computing rely on hundreds of thousands of content reviewers to classify high volumes of harmful and forbidden content. Many workers report long-term, potentially irreversible psychological harm. This work is similar to activities that cause psychological harm to other kinds of helping professionals even after small doses of exposure. Yet researchers struggle to measure the mental health of content reviewers well enough to inform diagnoses, evaluate workplace improvements, hold employers accountable, or advance scientific understanding. This systematic review summarizes psychological measures from other professions and relates them to the experiences of content reviewers. After identifying 1,673 potential papers, we reviewed 143 that validate measures in related occupations. We summarize the uses of psychological measurement for content reviewing, differences between clinical and research measures, and 12 measures that are adaptable to content reviewing. We find serious gaps in measurement validity in regions where content review labor is common. Overall, we argue for reliable measures of content reviewer mental health that match the nature of the work and are culturally-relevant.

Figures

Figures reproduced from arXiv: 2502.00244 by the authors.

Figure 1
Figure 1. Selection and filtering criteria for systematic review, following the PRISMA method [ [PITH_FULL_IMAGE:figures/full_fig_p009_1.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Dynamic Content Moderation in Livestreams: Combining Supervised Classification with MLLM-Boosted Similarity Matching

    cs.CV 2025-12 conditional novelty 4.0 of 10

    A deployed hybrid moderation system combining supervised classification and reference-based similarity matching, boosted by MLLM distillation, reduces unwanted livestream views by 6–8%.

Reference graph

Works this paper leans on

192 extracted references · 68 canonical work pages · cited by 1 Pith paper

  1. [1]

    [n. d.]. Google Scholar Search Help. https://scholar.google.com/intl/en/scholar/help.html#coverage

  2. [2]

    [n. d.]. Mental Health Service Availability. https://www.who.int/data/gho/data/themes/topics/GHO/mental-health-service-availability

  3. [3]

    Substance Abuse and Mental Health Services Administration. 2014. SAMHSA’s Concept of Trauma and Guidance for a Trauma-Informed Approach . Technical Report HHS Publication No. (SMA) 14-4884. Substance Abuse and Mental Health Services Administration. https://ncsacw.acf.hhs.gov/ userfiles/files/SAMHSA_Trauma.pdf

    2014

  4. [4]

    Acierno, K

    R. Acierno, K. J. Ruggiero, D. G. Kilpatrick, H. S. Resnick, and S. Galea. 2006. Risk and protective factors for psychopathology among older versus younger adults after the 2004 Florida hurricanes. The American Journal of Geriatric Psychiatry 14, 12 (2006), 1051–1059. https://doi.org/10.1097/01. JGP.0000221327.97904.b0

    work page arXiv 2006

  5. [5]

    R. E. Adams and J. A. Boscarino. 2006. Predictors of PTSD and delayed PTSD after disaster: The impact of exposure and psychosocial resources. The Journal of Nervous and Mental Disease 194, 7 (2006), 485–493. https://doi.org/10.1097/01.nmd.0000228503.95503.e9

    work page arXiv 2006

  6. [6]

    Richard E Adams, Joseph A Boscarino, and Charles R Figley. 2006. Compassion fatigue and psychological distress among social workers: A validation study. American Journal of orthopsychiatry 76, 1 (2006), 103–108

    2006

  7. [7]

    ADP Health. 2023. Research Tools and Techniques. https://adphealth.org/irtoolkit/research-methods-and-data-management/research-tools-and- techniques.html

    2023

  8. [8]

    American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders (5th ed.) . American Psychiatric Publishing. https://doi.org/10.1176/appi.books.9780890425596

    doi:10.1176/appi.books.9780890425596 2013

Show all 192 references
  1. [9]

    American Psychiatric Association. 2023. Frequently Asked Questions about DSM. https://www.psychiatry.org/psychiatrists/practice/dsm/frequently- asked-questions

    2023

  2. [10]

    Harlene Anderson. 2007. A Postmodern Umbrella: Language and Knowledge as Relational, Generative, and Inherently Transforming. InCollaborative Therapy: Relationships and Conversations that Make a Difference , Harlene Anderson and Diane Gehart (Eds.). Routledge - Taylor & Franci...

    2007

  3. [11]

    Michalopoulos, and George J

    Erika Aparicio, Linda M. Michalopoulos, and George J. Unick. 2013. An Examination of the Psychometric Properties of the Vicarious Trauma Scale in a Sample of Licensed Social Workers. Health & Social Work 38, 4 (2013), 199–206

    2013

  4. [12]

    American Counseling Association. n.d.. Fact Sheet #9: Vicarious Trauma . http://www.wendtcenter.org Accessed: 2016-04-20

    2016

  5. [13]

    Mike Barkham, Beth Bewick, Tom Mullin, et al. 2013. The CORE-10: A short measure of psychological distress for routine use in the psychological therapies. Counselling and Psychotherapy Research 13, 1 (2013), 3–13. https://doi.org/10.1080/14733145.2012.729069

    2013

  6. [14]

    P. Barr. 2017. Compassion fatigue and compassion satisfaction in neonatal intensive care unit nurses: Relationships with work stress and perceived social support. Traumatology 23, 2 (2017), 214–222. https://doi.org/10.1037/trm0000115

    2017 doi

  7. [15]

    PM Barrett. 2020. Who Moderates the Social Media Giants? A Call to End Outsourcing. Available from: https://www.stern.nyu.edu/sites/default/ files/assets/documents/con_039668.pdf

    2020

  8. [16]

    P. Bech. 1993. Rating Scales for Psychopathology, Health Status and Quality of Life: A Compendium on Documentation in Accordance with the DSM-III-R and WHO Systems . Springer, Berlin

    1993

  9. [17]

    P. Bech, C. Gudex, and K. Staehr Johansen. 1996. The WHO (Ten) Well-Being Index: validation in diabetes. Psychotherapy and Psychosomatics 65 (1996), 183–190

    1996

  10. [18]

    Benjelloun and Y

    R. Benjelloun and Y. Otheman. 2020. Psychological distress in a social media content moderator: A case report. Archives of Psychiatric Mental Health 4 (2020), Article 7375. https://doi.org/10.29328/journal.apmh.1001024

    2020 doi

  11. [19]

    Benuto, Judith Singer, Christine Cummings, and Amanda Ahrendt

    Lorraine T. Benuto, Judith Singer, Christine Cummings, and Amanda Ahrendt. 2018. The Vicarious Trauma Scale: Confirmatory Factor Analysis and Psychometric Properties with a Sample of Victim Advocates. Health & Social Care in the Community 26, 4 (July 2018), 564–571. https: //d...

    2018 doi

  12. [20]

    Bianchi, I

    R. Bianchi, I. S. Schonfeld, and E. Laurent. 2015. Burnout–depression overlap: A review. Clinical Psychology Review 36 (2015), 28–41. https: //doi.org/10.1016/j.cpr.2015.01.004

    2015 doi

  13. [21]

    Blackwell, T

    L. Blackwell, T. Chen, S. Schoenebeck, et al. 2018. When online harassment is perceived as justified. In Twelfth International AAAI Conference on Web and Social Media. Available at: https://ojs.aaai.org/index.php/ICWSM/article/view/15036

    2018

  14. [22]

    P. Q. Brady. 2017. Crimes against caring: Exploring the risk of secondary traumatic stress, burnout, and compassion satisfaction among child exploitation investigators. Journal of Police and Criminal Psychology 32, 4 (2017), 305–318. https://doi.org/10.1007/s11896-016-9223-8

    2017 doi

  15. [23]

    Dana C. Branson. 2021. When Helping Is Dangerous: Benefits and Risks to Providers Delivering Digital Crisis Intervention. In Digital Services in Crisis, Disaster, and Emergency Situations . IGI Global, 304–327. https://www.igi-global.com/chapter/when-helping-is-dangerous/269170

    2021

  16. [24]

    B. E. Bride, M. Radey, and C. R. Figley. 2007. Measuring Compassion Fatigue. Clinical Social Work Journal 35 (2007), 155–163. https://doi.org/10. 1007/s10615-007-0091-7

    2007

  17. [25]

    B. E. Bride, M. M. Robinson, B. Yegidis, and C. R. Figley. 2004. Development and Validation of the Secondary Traumatic Stress Scale. Research on Social Work Practice 14, 1 (2004), 27–35. https://doi.org/10.1177/1049731503254106

    2004 doi

  18. [26]

    Browne, M

    T. Browne, M. Evangeli, and N. Greenberg. 2012. Trauma-related guilt and posttraumatic stress among journalists. Journal of Traumatic Stress 25, 2 (2012), 207–210. https://doi.org/10.1002/jts.21678 Manuscript submitted to ACM 22 Gonzalez and Matias

    2012 doi

  19. [27]

    Beril Bulat, Hannah Wang, Stephen Fujimoto, and Seth Frey. 2024. The psychology of volunteer moderators: Tradeoffs between participation, belong- ing, and norms in online community governance. New Media & Society (July 2024), 14614448241259028. https://doi.org/10.1177/14614448...

    2024 doi

  20. [28]

    Catherine Buni and Soraya Chemaly. 2016. The Secret Rules of the Internet. The Verge (April 13 2016). http://www.theverge.com/2016/4/13/ 11387934/internet-moderator-history-youtube-facebook-reddit-censorship-free-speech

    2016

  21. [29]

    Harvey J Burnett Jr and Kathleen Wahl. 2015. The compassion fatigue and resilience connection: A survey of resilience, compassion fatigue, burnout, and compassion satisfaction among trauma responders. International Journal of Emergency Mental Health and Human Resilience (2015)

    2015

  22. [30]

    C. M. Burns, J. Morley, R. Bradshaw, and J. Domene. 2008. The emotional impact on and coping strategies employed by police teams investigating internet child exploitation. Traumatology 14, 2 (2008), 20–31. https://doi.org/10.1177/1534765608319082

    2008 doi

  23. [31]

    Des Butler. 2017. Employer Liability for Workplace Trauma. Routledge, London. https://doi.org/10.4324/9781315188270

    2017 doi

  24. [32]

    Susan A. Capel. 1991. A LONGITUDINAL STUDY OF BURNOUT IN TEACHERS. British Journal of Educational Psychology 61, 1 (Feb. 1991), 36–45. https://doi.org/10.1111/j.2044-8279.1991.tb00959.x

    1991

  25. [33]

    Card, Thomas P

    Stuart K. Card, Thomas P. Moran, and Allen Newell. 1986. The Psychology of Human-Computer Interaction (1st edition ed.). Lawrence Erlbaum Associates, Mahwah, NJ

    1986

  26. [34]

    Adrian Chen. 2014. The Laborers Who Keep Dick Pics and Beheadings Out of Your Facebook Feed. Wired (October 23 2014). https://www.wired. com/2014/10/content-moderation/

    2014

  27. [35]

    Chen, Allison McDonald, Yixin Zou, Emily Tseng, Kevin A Roundy, Acar Tamersoy, Florian Schaub, Thomas Ristenpart, and Nicola Dell

    Janet X. Chen, Allison McDonald, Yixin Zou, Emily Tseng, Kevin A Roundy, Acar Tamersoy, Florian Schaub, Thomas Ristenpart, and Nicola Dell

  28. [36]

    Coles, J

    J. Coles, J. Astbury, E. Dartnall, et al. 2014. A qualitative exploration of researcher trauma and researchers’ responses to investigating sexual violence. Violence Against Women 20, 1 (2014), 95–117. https://doi.org/10.1177/1077801213520578

    2014 doi

  29. [37]

    Columbia University. 2023. Published Study Material Examples . https://www.tc.columbia.edu/media/administration/institutional-review-board- /guide-amp-resources---documents/Published_Study-Material-Examples.pdf

    2023

  30. [38]

    Paul Conway, Susan Lundrigan, Tom Redmond, et al. 2023. Protecting the Protectors: Moral Injury, Coping Styles, and Mental Health of UK Police Officers and Staff Investigating Child Sexual Abuse Material. https://www.stah.org/assets/Uploads/04.-Dr-Paul-Conway.pdf Available fro...

    2023

  31. [39]

    Cook, Jie Cai, and Donghee Yvette Wohn

    Christine L. Cook, Jie Cai, and Donghee Yvette Wohn. 2022. Awe Versus Aww: The Effectiveness of Two Kinds of Positive Emotional Stimulation on Stress Reduction for Online Content Moderators. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (Nov. 2022), 1–19. https...

    2022 doi

  32. [40]

    C. D. Craig and G. Sprang. 2010. Compassion satisfaction, compassion fatigue, and burnout in a national sample of trauma treatment therapists. Anxiety, Stress, & Coping 23, 3 (2010), 319–339. https://doi.org/10.1080/10615800903085818

    2010 doi

  33. [41]

    Riedl, and Matthew Lease

    Brandon Dang, Martin J. Riedl, and Matthew Lease. 2020. But Who Protects the Moderators? The Case of Crowdsourced Image Moderation. http://arxiv.org/abs/1804.10999 arXiv:1804.10999 [cs]

    2020 arXiv

  34. [42]

    L. T. De Beer, L. van der Vaart, M. Escaffi-Schwarz, H. De Witte, and W. B. Schaufeli. 2024. Maslach Burnout Inventory—General Survey: A systematic review and meta-analysis of measurement properties. European Journal of Psychological Assessment (2024)

    2024

  35. [43]

    Dehlin and L

    M. Dehlin and L. G. Lundh. 2018. Compassion fatigue and compassion satisfaction among psychologists: Can supervision and a reflective stance be of help? Journal for Person-Oriented Research 4, 2 (2018), 95–107. https://doi.org/10.17505/jpor.2018.09

    2018 doi

  36. [44]

    Dillahunt, Xinyi Wang, Earnest Wheeler, Hao Fei Cheng, Brent Hecht, and Haiyi Zhu

    Tawanna R. Dillahunt, Xinyi Wang, Earnest Wheeler, Hao Fei Cheng, Brent Hecht, and Haiyi Zhu. 2017. The Sharing Economy in Computing: A Systematic Literature Review. Proc. ACM Hum.-Comput. Interact. 1, CSCW (Dec. 2017), 38:1–38:26. https://doi.org/10.1145/3134673

    2017 doi

  37. [45]

    Dosono and B

    B. Dosono and B. Semaan. 2019. Moderation practices as emotional labor in sustaining online communities: The case of AAPI identity work on Reddit. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19) . ACM, 1–13. https://doi.org/10.1145/329...

    2019

  38. [46]

    Doyle, K

    M. Doyle, K. Tapson, V. Karagiannopoulos, et al. 2023. Impacts of organisational role and environmental factors on moral injury and trauma amongst police investigators in Internet Child Abuse Teams. Police Journal 96, 1 (2023), 153–171. https://doi.org/10.1177/0032258X211043331

    2023 doi

  39. [47]

    Community Guidelines

    Anna Drootin. 2021. " Community Guidelines": The Legal Implications of Workplace Conditions for Internet Content Moderators. Fordham L. Rev. 90 (2021), 1197. https://heinonline.org/hol-cgi-bin/get_pdf.cgi?handle=hein.journals/flr90&section=38&casa_token=NU4qmr38xNgAAAAA: ad9Z_...

    2021

  40. [48]

    Sam Dubberley. 2020. Finally recognizing secondary trauma as a primary issue. Columbia Journalism Review (July 2020). https://www.cjr.org/ analysis/finally-recognizing-secondary-trauma-as-a-primary-issue.php

    2020

  41. [49]

    Sam Dubberley, Elizabeth Griffin, and Haluk Mert Bal. 2015. Making secondary trauma a primary issue: A study of eyewitness media and vicarious trauma on the digital frontline. Eyewitness Media Hub (2015), 1–69. http://firstdraftnews.org/wp-content/uploads/2018/03/trauma_report.pdf

    2015

  42. [50]

    Ebren, M

    G. Ebren, M. Demircioğlu, and O. C. Çırakoğlu. 2022. A neglected aspect of refugee relief works: Secondary and vicarious traumatic stress. Journal of Trauma & Stress 35, 3 (June 2022), 891–900. https://doi.org/10.1002/jts.22796 arXiv:2022 Feb 24

    2022 doi

  43. [51]

    Edelkott, D

    N. Edelkott, D. W. Engstrom, P. Hernández-Wolfe, and D. Gangsei. 2016. Vicarious Resilience: Complexities and Variations.American Journal of Orthopsychiatry (2016). https://doi.org/10.1037/ort0000180 Advance online publication. Manuscript submitted to ACM Measuring the Mental ...

    2016 doi

  44. [52]

    David Engstrom, Pilar Hernandez, and David Gangsei. 2008. Vicarious Resilience: A Qualitative Investigation into Its Description. Traumatology 14 (2008), 13–21. https://doi.org/10.1177/1534765608319323

    2008 doi

  45. [53]

    Facebook. 2022. Community standards enforcement report. Technical Report. https://transparency.fb.com/data/community-standards-enforcement/ child-nudity-and-sexual-exploitation/facebook/

    2022

  46. [54]

    G. A. Fava. 1999. Well-being therapy: conceptual and technical issues. Psychotherapy and Psychosomatics 68 (1999), 171–179

    1999

  47. [55]

    Charles R. Figley. 1982. Traumatization and Comfort: Close Relationships May Be Hazardous to Your Health. Keynote presentation, Lubbock, TX. Keynote presentation at the conference

    1982

  48. [56]

    C. R. Figley (Ed.). 1995. Compassion Fatigue: Coping with Secondary Traumatic Stress Disorder in Those Who Treat the Traumatized . Brunner/Mazel

    1995

  49. [57]

    Charles R. Figley. 1996. Compassion Fatigue as a Secondary Traumatic Stress Disorder: An Overview. In Compassion Fatigue, Charles R. Figley (Ed.). Brunner/Mazel, New York

    1996

  50. [58]

    Charles R. Figley. 1999. Compassion Fatigue: Toward a New Understanding of the Costs of Caring. In Secondary Traumatic Stress: Self-Care Issues for Clinicians, Researchers, and Educators (2nd ed.), Beth Hudnall Stamm (Ed.). Sidran, Lutherville, MD, 3–28

    1999

  51. [59]

    Charles R Figley and B Hudnall Stamm. 1996. Psychometric review of compassion fatigue self test. Measurement of stress, trauma, and adaptation (1996), 127–130

    1996

  52. [60]

    Josep Catà Figuls. 2024. The horrors experienced by Meta moderators: ‘I didn’t know what humans are capable of’. El País (2024). https://english.elpais.com/economy-and-business/2024-01-29/the-horrors-experienced-by-meta-moderators-i-didnt-know-what-humans- are-capable-of.html

    2024

  53. [61]

    Finholt and Stephanie D

    Thomas A. Finholt and Stephanie D. Teasley. 1998. Psychology: The Need for Psychology in Research on Computer-Supported Cooperative Work. Social Science Computer Review 16, 1 (April 1998), 40–52. https://doi.org/10.1177/089443939801600106

    1998 doi

  54. [62]

    Giancarlo Fiorella. 2022. How to Maintain Mental Hygiene as an Open Source Researcher. https://www.bellingcat.com/resources/2022/11/23/how- to-maintain-mental-hygiene-as-an-open-source-researcher/

    2022

  55. [63]

    Foley and K

    J. Foley and K. L. D. Massey. 2021. The ‘cost’ of caring in policing: From burnout to PTSD in police officers in England and Wales. The Police Journal: Theory, Practice and Principles 94, 3 (2021), 298–315. https://doi.org/10.1177/0032258X20917442

    2021 doi

  56. [64]

    Fox, Samantha Shorey, Esther Y

    Sarah E. Fox, Samantha Shorey, Esther Y. Kang, Dominique Montiel Valle, and Estefania Rodriguez. 2023. Patchwork: The Hidden, Human Labor of AI Integration within Essential Work. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (April 2023), 1–20. https: //doi.org...

    2023 doi

  57. [65]

    Foxglove. 2022. Mark Zuckerberg: Stop Exploiting Your Workers. https://www.foxglove.org.uk/. Open letter addressing exploitation and unlawful union-busting at Facebook’s content moderation center in Nairobi, Kenya

    2022

  58. [66]

    David Gangsei. 2004. Torture Treatment and Social Work: Amplifying Thoughts. Families in Society 85, 3 (2004), 313–314

    2004

  59. [67]

    Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, Andy Jones, Sam Bowman, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Nelson Elhage, Sheer El-Showk, Stanislav Fort, Zac Hatfi...

    2022 arXiv

  60. [68]

    Livia Garofalo. 2024. Doing the Work: Therapeutic Labor, Teletherapy, and the Platformization of Mental Health Care . Technical Report. Data & Society. https://datasociety.net/library/doing-the-work/

    2024

  61. [69]

    JE Gentry, AB Baranowsky, K Dunning, and CR Figley. 2002. Treating compassion fatigue. Brunner-Routledge (2002), 123–127

    2002

  62. [70]

    Steve Geoffrion, Josianne Lamothe, Julien Morizot, and Charles-Édouard Giguère. 2019. Construct Validity of the Professional Quality of Life (ProQoL) Scale in a Sample of Child Protection Workers. Journal of Trauma Stress 32, 4 (August 2019), 566–576. https://doi.org/10.1002/j...

    2019 doi

  63. [71]

    Sakshi Ghai, Lucia Magis-Weinberg, Mariya Stoilova, Sonia Livingstone, and Amy Orben. 2022. Social media and adolescent well-being in the Global South. Current Opinion in Psychology 46 (2022), 101318. https://www.sciencedirect.com/science/article/pii/S2352250X22000288 Publishe...

    2022

  64. [72]

    Nathan Matias Gilbert, Sarah

    J. Nathan Matias Gilbert, Sarah. 2022. What Can Companies Do For Moderator Well-Being? https://citizensandtech.org/2022/09/moderator- wellbeing-trustcon/

    2022

  65. [73]

    Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media . Yale University Press

    2018

  66. [74]

    Tarleton Gillespie. 2019. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media . Yale University Press, London, United Kingdom

    2019

  67. [75]

    Gray and Siddharth Suri

    Mary L. Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass . Eamon Dolan Books

    2019

  68. [76]

    Judith Gregory. 2003. Scandinavian approaches to participatory design. International Journal of Engineering Education 19, 1 (2003), 62–74. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=d43c53c6bf9fdf757fdba28d908d768ec3425bb6 Publisher: Citeseer

    2003

  69. [77]

    Greinacher, C

    A. Greinacher, C. Derezza-Greeven, W. Herzog, and C. Nikendei. 2019. Secondary traumatization in first responders: A systematic review.European Journal of Psychotraumatology 10, 1 (2019), 1562840. https://doi.org/10.1080/20008198.2018.1562840

    2019

  70. [78]

    Neal Robert Haddaway, Alexandra Mary Collins, Deborah Coughlin, and Stuart Kirk. 2015. The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PloS one 10, 9 (2015), e0138237. https://journals.plos.org/plosone/article?id=10.1371/journ...

    2015 doi

  71. [79]

    Hakanen, Wilmar B

    Jari J. Hakanen, Wilmar B. Schaufeli, and Katri Ahola. 2008. The job demands-resources model: A three-year cross-lagged study of burnout, depression, commitment, and work engagement. Work & Stress 22, 3 (2008), 224–241. https://doi.org/10.1080/02678370802379432

    2008 doi

  72. [80]

    Quentin Hardy. 2011. Spot Pornography on Facebook for a Quarter-Cent an Image. New York Times (December 5 2011). http://bits.blogs.nytimes. com/2011/12/05/spot-porn-on-facebook-for-a-quarter-cent-an-image/

    2011

  73. [81]

    Anne-Wil Harzing. 2016. Publish or Perish. https://harzing.com/resources/publish-or-perish

    2016

  74. [82]

    Heine, and Ara Norenzayan

    Joseph Henrich, Steven J. Heine, and Ara Norenzayan. 2010. The weirdest people in the world? Behavioral and brain sci- ences 33, 2-3 (2010), 61–83. https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/weirdest-people-inthe-world/ BF84F7517D56AFF7B7EB58...

    2010

  75. [83]

    Pilar Hernandez, David Gangsei, and David Engstrom. 2007. Vicarious Resilience: A Qualitative Investigation into a Description of a New Concept. Family Process 46 (2007), 229–241

    2007

  76. [84]

    Pilar Hernandez-Wolfe. 2018. Vicarious Resilience: A Comprehensive Review. Revista de Estudios Sociales 66 (2018), 9–17. https://doi.org/10.7440/ res66.2018.02

    2018

  77. [85]

    Pilar Hernandez-Wolfe, Kelly Killian, David Engstrom, and David Gangsei. 2014. Vicarious Resilience, Vicarious Trauma and Awareness of Equity in Trauma Work. Journal of Humanistic Psychology 55 (2014), 153–172

    2014

  78. [86]

    Langley, Bradley D

    Stephen Hydon, Marleen Wong, Audra K. Langley, Bradley D. Stein, and Sheryl H. Kataoka. 2015. Preventing Secondary Traumatic Stress in Educators. Child and Adolescent Psychiatric Clinics 24, 2 (April 2015), 319–333. https://doi.org/10.1016/j.chc.2014.11.003

    2015 doi

  79. [88]

    Nathan Matias, Reem Al-Kashif

    Julia Kamin Max Klein Eric Pennington J. Nathan Matias, Reem Al-Kashif. 2020. Study Results: Mentoring, Thanking Others, and Burning Out on Wikipedia — citizensandtech.org. https://citizensandtech.org/2020/06/mentoring-thanking-and-burnout-wikipedia

    2020

  80. [89]

    Jasper Jackson. 2024. What is content moderation? The Bureau of Investigative Journalism (May 2024). https://www.thebureauinvestigates.com/ stories/2024-05-17/explainer-what-is-content-moderation

    2024

  81. [90]

    M. Jahoda. 1958. Current Concepts of Positive Mental Health . Basic Books, New York

    1958

  82. [91]

    S. R. Jenkins and S. Baird. 2002. Secondary traumatic stress and vicarious trauma: A validational study. Journal of Trauma & Stress 15, 5 (October 2002), 423–432. https://doi.org/10.1023/A:1020193526843

    2002 doi

  83. [92]

    I’m not this person

    R. Jereza. 2022. “I’m not this person”: Racism, content moderators, and protecting and denying voice online. New Media & Society (2022), 1–17. https://doi.org/10.1177/1461444822112222

    2022 doi

  84. [93]

    Johansen, Claire Brophy, Markus Rittenbruch, and Jared W

    Stine S. Johansen, Claire Brophy, Markus Rittenbruch, and Jared W. Donovan. 2024. Characterising CSCW Research on Human-Robot Collaboration. Proc. ACM Hum.-Comput. Interact. 8, CSCW1 (April 2024), 160:1–160:31. https://doi.org/10.1145/3640999

    2024 doi

  85. [94]

    C. Joinson. 1992. Coping with compassion fatigue. Nursing 22, 4 (1992), 116–118

    1992

  86. [95]

    R. L. Kahn and P. Byosiere. 1992. Stress in organizations. In Handbook of industrial and organizational psychology (2nd ed.), M. D. Dunnette and L. M. Hough (Eds.). Consulting Psychologists Press, 571–650

    1992

  87. [96]

    C. J. Kalman. 1999. Ethical requirements for occupational health research—compliance arrangements for a single company in relation to a recent major nuclear industry study. Occupational medicine 49, 4 (1999), 221–224. https://academic.oup.com/occmed/article-abstract/49/4/221/1...

    1999

  88. [97]

    Anne Kaun and Fredrik Stiernstedt. 2020. Prison media work: from manual labor to the work of being tracked. Media, Culture & Society 42, 7-8 (Oct. 2020), 1277–1292. https://doi.org/10.1177/0163443719899809 Publisher: SAGE Publications Ltd

    2020 doi

  89. [98]

    Sara Kiesler, Jane Siegel, and Timothy W. McGuire. 1984. Social psychological aspects of computer-mediated communication.American psychologist 39, 10 (1984), 1123. https://psycnet.apa.org/journals/amp/39/10/1123/ Publisher: American Psychological Association

    1984

  90. [99]

    Kyle Killian. 2018. Development of the Vicarious Resilience Scale (VRS): A Measure of Positive Effects of Working With Trauma Survivors. Psychological Trauma Theory Research Practice and Policy 9 (07 2018)

    2018

  91. [100]

    M. Krause. 2009. Identifying and managing stress in child pornography and child exploitation investigators. Journal of Police & Criminal Psychology 24, 1 (2009), 22–29. https://doi.org/10.1007/s11896-008-9033-8

    2009 doi

  92. [102]

    T. S. Kristensen, M. Borritz, E. Villadsen, and K. B. Christensen. 2005. The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work & Stress 19, 3 (2005), 192–207. https://doi.org/10.1080/02678370500297720

    2005 doi

  93. [103]

    Mariela Loreto Lara-Cabrera, Moisés Betancort, Amparo Muñoz-Rubilar, Natalia Rodríguez-Novo, Ottar Bjerkeset, and Carlos De las Cuevas. 2022. Psychometric properties of the WHO-5 well-being index among nurses during the COVID-19 pandemic: a cross-sectional study in three count...

    2022

  94. [104]

    Edith Law and Luis Von Ahn. 2011. Human computation. Springer Cham. Publisher: Morgan & Claypool Publishers

    2011

  95. [105]

    Chloe Lawrence. 2023. Behind every swipe: The workers toiling to keep dating apps safe . The Bureau of Investigative Journalism. https: //www.thebureauinvestigates.com/stories/2023-11-20/behind-every-swipe-the-workers-toiling-to-keep-dating-apps-safe/ Manuscript submitted to A...

    2023

  96. [106]

    I should have known

    M. D. Ledingham, P. Standen, C. Skinner, and R. Busch. 2019. “I should have known”: The perceptual barriers faced by mental health practitioners in recognising and responding to their own burnout symptoms. Asia Pacific Journal of Counselling and Psychotherapy 10, 2 (2019), 125...

    2019

  97. [107]

    J. J. Lee, R. Gottfried, and B. E. Bride. 2018. Exposure to client trauma, secondary traumatic stress, and the health of clinical social workers: A mediation analysis. Clinical Social Work Journal 46, 3 (2018), 228–235. https://doi.org/10.1007/s10615-017-0638-1

    2018 doi

  98. [108]

    Tuukka Lehtiniemi and Minna Ruckenstein. 2022. Prisoners Training AI. Everyday Automation (2022). https://library.oapen.org/bitstream/handle/ 20.500.12657/53680/9781000583335.pdf#page=201

    2022

  99. [109]

    Leiter and Christina Maslach

    Michael P. Leiter and Christina Maslach. 2024. Job Burnout. InHandbook of Occupational Health Psychology (3 ed.), Lois E. Tetrick, Gwenith G. Fisher, Michael T. Ford, and James Campbell Quick (Eds.). American Psychological Association, 291–308. https://www.jstor.org/stable/j.c...

    2024

  100. [110]

    Elizabeth Levy Paluck. 2010. The Promising Integration of Qualitative Methods and Field Experiments. The ANNALS of the American Academy of Political and Social Science 628, 1 (March 2010), 59–71. https://doi.org/10.1177/0002716209351510 Publisher: SAGE Publications Inc

    2010 doi

  101. [111]

    Hanlin Li, Brent Hecht, and Stevie Chancellor. 2022. All that’s happening behind the scenes: Putting the spotlight on volunteer moderator labor in reddit. In Proceedings of the International AAAI Conference on Web and Social Media , Vol. 16. 584–595. https://ojs.aaai.org/index...

    2022

  102. [112]

    C. Lo. 2018. When all you have is a Banhammer: The social and communicative work of volunteer moderators . Doctoral thesis. Massachusetts Institute of Technology, Cambridge, MA. https://cmsw.mit.edu/wp/wp-content/uploads/2018/05/Claudia-Lo-When-All-You-Have-Is-a-Banhammer.pdf

    2018

  103. [113]

    Beatrix Lockwood. 2024. ‘I quit my job as a content moderator. I can never go back to who I was before. ’. The Washington Post (2024). https://www.washingtonpost.com/opinions/2024/09/09/shifts-content-moderator-comic/

    2024

  104. [114]

    Christina Maslach and Susan E. Jackson. 1981. The measurement of experienced burnout. Journal of Organizational Behavior 2, 2 (1981), 99–113. https://doi.org/10.1002/job.4030020205

    1981 doi

  105. [115]

    Christina Maslach and Susan E. Jackson. 1986. Maslach Burnout Inventory manual (2nd ed.). Consulting Psychologists Press

    1986

  106. [116]

    Nathan Matias

    J. Nathan Matias. 2019. The Civic Labor of Volunteer Moderators Online. Social Media + Society 5, 2 (April 2019), 2056305119836778. https: //doi.org/10.1177/2056305119836778

    2019 doi

  107. [117]

    I. L. McCann and L. A. Pearlman. 1990. Vicarious Traumatization: A Framework for Understanding the Psychological Effects of Working with Victims. Journal of Traumatic Stress 3, 1 (1990), 131–149

    1990

  108. [118]

    Niamh McIntyre. 2023. Teleperformance signs ‘historic agreement’ allowing Colombian workers. . . .The Bureau of Investigative Journalism (April 2023). https://www.thebureauinvestigates.com/stories/2023-04-19/teleperformance-signs-historic-agreement-allowing-colombian-workers-t...

    2023

  109. [119]

    Niamh McIntyre, Rosie Bradbury, and Billy Perrigo. 2022. Behind TikTok’s boom: A legion of traumatised, $10-a-day content. . . .The Bureau of Investigative Journalism (Oct. 2022). https://www.thebureauinvestigates.com/stories/2022-10-20/behind-tiktoks-boom-a-legion-of-traumati...

    2022

  110. [120]

    Andrew McMillen. [n. d.]. Wikipedia Is Not Therapy! | Backchannel. Wired ([n. d.]). https://www.wired.com/2016/08/wikipedia-is-not-therapy/ Section: tags

    2016

  111. [121]

    Amanda Menking and Ingrid Erickson. 2015. The Heart Work of Wikipedia: Gendered, Emotional Labor in the World’s Largest Online Encyclopedia. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems . ACM, Seoul Republic of Korea, 207–210. https: /...

    2015

  112. [122]

    Dan Milmo. 2023. TikTok Moderator’s Employer Backtracks on Plans to Monitor Workers with Cameras . Time. https://time.com/6265603/tiktok- moderator-teleperformance-backtracks/

    2023

  113. [123]

    Dan Milmo. 2024. Mercy and Anita: the African workers feeding the AI machine . The Guardian. https://www.theguardian.com/technology/article/ 2024/jul/06/mercy-anita-african-workers-ai-artificial-intelligence-exploitation-feeding-machine

    2024

  114. [124]

    Garrett Morrow, Briony Swire-Thompson, Jessica Montgomery Polny, Matthew Kopec, and John P. Wihbey. 2022. The Emerging Science of Content Labeling: Contextualizing Social Media Content Moderation. Journal of the Association for Information Science and Technology 73, 10 (2022),...

    2022 doi

  115. [125]

    Charlie Morton. 2022. Facebook moderators: ’We’re treated like expendable robots’ . BBC News. https://www.bbc.com/news/technology-57088382

    2022

  116. [126]

    J. F. Munroe, J. Shay, L. Fisher, C. Makary, K. Rapperport, and R. Zimering. 1995. Preventing Compassion Fatigue: A Treatment Team Model. In Compassion Fatigue: Coping with Secondary Traumatic Stress Disorder in Those Who Treat the Traumatized , Charles R. Figley (Ed.). Brunne...

    1995

  117. [127]

    National Center for Biotechnology Information. 2023. Chapter 4: Assessment and Diagnosis . https://www.ncbi.nlm.nih.gov/books/NBK207188/ #part1_ch4.s15

    2023

  118. [128]

    C. Newton. 2019. The terror queue: These moderators help keep Google and YouTube free of violent extremism – and now some of them have PTSD. The Verge (December 16 2019). https://www.theverge.com/2019/12/16/21021005/google-youtube-moderators-ptsd-accenture-violent- disturbing-...

    2019

  119. [129]

    Casey Newton. 2020. Facebook will pay $52 million in settlement with moderators who developed PTSD on the job. The Verge (May 2020). https://www.theverge.com/2020/5/12/21255870/facebook-content-moderator-settlement-scola-ptsd-mental-health

    2020

  120. [130]

    C. Newton. 2020. YouTube moderators are being forced to sign a statement acknowledging the job can give them PTSD. The Verge (January 24 2020). https://www.theverge.com/2020/1/24/21075830/youtube-moderators-ptsd-accenture-statement-lawsuits-mental-health Manuscript submitted t...

    2020

  121. [131]

    Don Norman. 2013. The design of everyday things: Revised and expanded edition . Basic books

    2013

  122. [132]

    Obuobi-Donkor, F

    G. Obuobi-Donkor, F. Oluwasina, N. Nkire, and V. I. O. Agyapong. 2022. A Scoping Review on the Prevalence and Determinants of Post-Traumatic Stress Disorder among Military Personnel and Firefighters: Implications for Public Policy and Practice. International Journal of Environ...

    2022 doi

  123. [133]

    Olson and Judith S

    Gary M. Olson and Judith S. Olson. 1997. Research on computer supported cooperative work. Handbook of human-computer interaction (1997), 1433–1456. https://www.sciencedirect.com/science/article/pii/B9780444818621501254 Publisher: Elsevier

    1997

  124. [134]

    Amy Orben. 2020. The Sisyphean Cycle of Technology Panics. Perspectives on Psychological Science 15, 5 (Sept. 2020), 1143–1157. https: //doi.org/10.1177/1745691620919372

    2020 doi

  125. [135]

    Ant Ozok

    A. Ant Ozok. 2007. Survey Design and Implementation in HCI. In The Human-Computer Interaction Handbook (2 ed.). CRC Press. Num Pages: 20

    2007

  126. [136]

    O’Malley, Y

    M. O’Malley, Y. A. Robinson, S. Hydon, J. Caringi, and M. Hu. 2019. Organizational Resilience: Reducing the Impact of Secondary Trauma on Front Line Human Services Staff . Issue Brief. Substance Abuse and Mental Health Services Administration (SAMHSA). https://eastsideforall.o...

    2019

  127. [137]

    Page, Joanne E

    Matthew J. Page, Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer, Jennifer M. Tetzlaff, Elie A. Akl, and Sue E. Brennan. 2021. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Bmj...

    2021

  128. [138]

    Pearlman

    Laurie A. Pearlman. 1999. Self-Care for Trauma Therapists: Ameliorating Vicarious Traumatization. In Secondary Traumatic Stress: Self-Care Issues for Clinicians, Researchers, and Educators (2nd ed.), Beth Hudnall Stamm (Ed.). Sidran, Lutherville, MD, 51–64

    1999

  129. [139]

    Laurie Anne Pearlman. 2003. Trauma and attachment belief scale (TABS) . Western Psychological Services Los Angeles, CA

    2003

  130. [140]

    L. A. Pearlman and P. S. Mac Ian. 1995. Vicarious traumatization: An empirical study of the effects of trauma work on trauma therapists.Professional Psychology: Research and Practice 26, 6 (1995), 558–565

    1995

  131. [141]

    Pearlman and Karen W

    Linda A. Pearlman and Karen W. Saakvitne. 1995. Treating Therapists with Vicarious Traumatization and Secondary Traumatic Stress Disorders. In Compassion Fatigue: Coping with Secondary Traumatic Stress Disorder in Those Who Treat the Traumatized , Charles R. Figley (Ed.). Brun...

    1995

  132. [142]

    L. M. Perez, J. Jones, D. R. Englert, et al. 2010. Secondary traumatic stress and burnout among law enforcement investigators exposed to disturbing media images. Journal of Police and Criminal Psychology 25 (2010), 113–124. https://doi.org/10.1007/s11896-010-9066-7

    2010 doi

  133. [143]

    Billy Perrigo. 2022. Inside Facebook’s African Sweatshop. TIME (February 14 2022). https://time.com/nextadvisor/business/facebook-african- sweatshop/ Updated: February 17, 2022

    2022

  134. [144]

    Billy Perrigo. 2023. 150 AI Workers Vote to Unionize at Nairobi Meeting. TIME (May 2023). https://time.com/6275995/chatgpt-facebook-african- workers-union/

    2023

  135. [145]

    Pinter, Pamela J

    Anthony T. Pinter, Pamela J. Wisniewski, Heng Xu, Mary Beth Rosson, and Jack M. Caroll. 2017. Adolescent Online Safety: Moving Beyond Formative Evaluations to Designing Solutions for the Future. In Proceedings of the 2017 Conference on Interaction Design and Children (IDC ’17)...

    2017

  136. [146]

    Hector Postigo. 2003. Emerging sources of labor on the Internet: The case of America online volunteers. International review of social History 48, S11 (2003), 205–223. https://www.cambridge.org/core/journals/international-review-of-social-history/article/emerging-sources-of-la...

    2003

  137. [147]

    Roberts, B

    F. Roberts, B. Teague, J. Lee, and I. Rushworth. 2021. The prevalence of burnout and secondary traumatic stress in professionals and volunteers working with forcibly displaced people: A systematic review and two meta-analyses. Journal of Traumatic Stress 34, 4 (2021), 773–785....

    2021 doi

  138. [148]

    Sarah Roberts. 2017. Social Media’s Silent Filter.The Atlantic (March 8 2017). https://www.theatlantic.com/technology/archive/2017/03/commercial- content-moderation/518796/

    2017

  139. [149]

    Sarah T. Roberts. 2019.Behind the Screen: Content Moderation in the Shadows of Social Media. Yale University Press. https://doi.org/10.2307/j.ctvhrcz0v

    2019 doi

  140. [150]

    We Care About the Internet; We Care About Everything

    Sarah T. Roberts, Stacy E. Wood, and Yvonne Eadon. 2023. " We Care About the Internet; We Care About Everything" Understanding Social Media Content Moderators’ Mental Models and Support Needs. In Proceedings of the 56th hawaii international conference on system sciences . http...

    2023

  141. [151]

    J. W. Roden-Foreman, M. M. Bennett, E. E. Rainey, J. S. Garrett, M. B. Powers, and A. M. Warren. 2017. Secondary Traumatic Stress in Emergency Medicine Clinicians. Cognitive Behaviour Therapy 46, 6 (2017), 522–532. https://doi.org/10.1080/16506073.2017.1315612

    2017

  142. [152]

    Alberto Monge Roffarello and Luigi De Russis. 2023. Achieving Digital Wellbeing Through Digital Self-control Tools: A Systematic Review and Meta-analysis. ACM Trans. Comput.-Hum. Interact. 30, 4 (Sept. 2023), 53:1–53:66. https://doi.org/10.1145/3571810

    2023 doi

  143. [153]

    Luciano Romano, Giacomo Angelini, Piermarco Consiglio, and Caterina Fiorilli. 2022. An Italian adaptation of the burnout assessment tool-core symptoms (BAT-C) for students. Education Sciences 12, 2 (2022), 124

    2022

  144. [154]

    Safe Content Advocacy Network. n.d.. About us. https://www.linkedin.com/company/safe-content-advocacy-network/about/. LinkedIn

  145. [155]

    Adam Satariano and Mike Isaac. 2021. The Silent Partner Cleaning Up Facebook for $500 Million a Year. The New York Times (Aug. 2021). https://www.nytimes.com/2021/08/31/technology/facebook-accenture-content-moderation.html

    2021

  146. [156]

    Schaufeli and H

    W. Schaufeli and H. De Witte. 2023. Burnout Assessment Tool (BAT). In International Handbook of Behavioral Health Assessment , C. U. Krägeloh, M. Alyami, and O. N. Medvedev (Eds.). Springer, Cham, 1–11. https://doi.org/10.1007/978-3-030-89738-3_54-1 Manuscript submitted to ACM...

    2023 doi

  147. [157]

    Schaufeli, S

    W. Schaufeli, S. Desart, and H. De Witte. 2020. The Burnout Assessment Tool (BAT): Development, validity and reliability. International Journal of Environmental Research and Public Health 17, 24 (2020), 9495. https://doi.org/10.3390/ijerph17249495

    2020 doi

  148. [158]

    Schaufeli

    Wilmar B. Schaufeli. 2017. Burnout: A Short Socio-Cultural History. In Burnout, Fatigue, Exhaustion , S. et al. Neckel (Ed.). Springer. https: //doi.org/10.1007/978-3-319-52887-8_5

    2017 doi

  149. [159]

    W. B. Schaufeli, H. De Witte, and S. Desart. 2019. User Manual – Burnout Assessment Tool (BAT) – Version 2.0

    2019

  150. [160]

    Schaufeli, Michael P

    Wilmar B. Schaufeli, Michael P. Leiter, Christina Maslach, and Susan E. Jackson. 1996. Maslach Burnout Inventory–General Survey. In The Maslach Burnout Inventory–Test Manual (3rd ed.), Christina Maslach, Susan E. Jackson, and Michael P. Leiter (Eds.). Consulting Psychologists ...

    1996

  151. [161]

    Aderka, Golan Shahar, Michal Stein, and Eva Gilboa-Schechtman

    Irit Schindel-Allon, Idit M. Aderka, Golan Shahar, Michal Stein, and Eva Gilboa-Schechtman. 2010. Longitudinal associations between post- traumatic distress and depressive symptoms following a traumatic event: A test of three models. Psychological Medicine 40, 10 (2010), 1669–...

    2010 doi

  152. [162]

    Schöpke-Gonzalez, Shubham Atreja, Han Na Shin, Najmin Ahmed, and Libby Hemphill

    Angela M. Schöpke-Gonzalez, Shubham Atreja, Han Na Shin, Najmin Ahmed, and Libby Hemphill. 2022. Why do volunteer content moderators quit? Burnout, conflict, and harmful behaviors. New Media & Society (Dec. 2022), 146144482211385. https://doi.org/10.1177/14614448221138529

    2022 doi

  153. [163]

    Carol F Scott, Gabriela Marcu, Riana Elyse Anderson, Mark W Newman, and Sarita Schoenebeck. 2023. Trauma-Informed Social Media: Towards Solutions for Reducing and Healing Online Harm. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . ACM, Hambur...

    2023

  154. [164]

    A Shirom and Y Ezrachi. 2003. On the discriminant validity of burnout, depression and anxiety: A re-examination of the burnout measure. Anxiety, stress &coping Query date: 2024-05-29 21:25:29 (2003). https://doi.org/10.1080/1061580021000057059 Number: Query date: 2024-05-29 21...

    2003 doi

  155. [165]

    Shoman, S

    Y. Shoman, S. C. Marca, R. Bianchi, L. Godderis, H. F. van der Molen, and I. Guseva Canu. 2021. Psychometric properties of burnout measures: a systematic review. Epidemiology and Psychiatric Sciences 30 (Jan. 2021), e8. https://doi.org/10.1017/S2045796020001134

    2021 doi

  156. [166]

    Shane Sinclair, Shelley Raffin-Bouchal, Lorraine Venturato, Jane Mijovic-Kondejewski, and Lorraine Smith-MacDonald. 2017. Compassion fatigue: A meta-narrative review of the healthcare literature. International Journal of Nursing Studies 69 (2017), 9–24. https://doi.org/10.1016...

    2017 doi

  157. [167]

    Bridget Sova. 2021. The Solution within the Work: A Scoping Review on Vicarious Resilience. https://scholarworks.wmich.edu/capstone_projects/1

    2021

  158. [168]

    Ruth Spence, Antonia Bifulco, Paula Bradbury, Elena Martellozzo, and Jeffrey DeMarco. 2023. The psychological impacts of content moderation on content moderators: A qualitative study. Cyberpsychology: Journal of Psychosocial Research on Cyberspace 17, 4 (2023). https://cyberps...

    2023

  159. [169]

    Ruth Spence, Antonia Bifulco, Paula Bradbury, Elena Martellozzo, and Jeffrey DeMarco. 2024. Content Moderator Mental Health, Secondary Trauma, and Well-being: A Cross-Sectional Study. Cyberpsychology, Behavior, and Social Networking 27, 2 (Feb. 2024), 149–155. https://doi.org/...

    2024

  160. [170]

    Staehr Johansen

    K. Staehr Johansen. 1998. The use of well-being measures in primary health care - the DepCare project. In Well-Being Measures in Primary Health Care - the DepCare Project . World Health Organization, Geneva. https://karger.com/pps/article/84/3/167/282903/The-WHO-5-Well-Being-I...

    1998

  161. [171]

    B Hudnall Stamm. 2005. The proQOL manual. Retrieved July 16 (2005), 2007

    2005

  162. [172]

    B. H. Stamm. 2009. Professional quality of life: compassion satisfaction and fatigue version 5 (ProQOL). Survey. Center for Victims of Torture. Available at: https://socialwork.buffalo.edu/content/dam/socialwork/home/self-care-kit/compassion-satisfaction-and-fatigue-stamm-2009.pdf

    2009

  163. [173]

    Woźniak, Thomas Kosch, Mikołaj P

    Evropi Stefanidi, Marit Bentvelzen, Paweł W. Woźniak, Thomas Kosch, Mikołaj P. Woźniak, Thomas Mildner, Stefan Schneegass, Heiko Müller, and Jasmin Niess. 2023. Literature Reviews in HCI: A Review of Reviews. In Proceedings of the 2023 CHI Conference on Human Factors in Comput...

    2023

  164. [174]

    Bharucha, Wilfredo Torralba, Marlyn Savio, Priyanka Manchanda, and Rachel Lutz-Guevara

    Miriah Steiger, Timir J. Bharucha, Wilfredo Torralba, Marlyn Savio, Priyanka Manchanda, and Rachel Lutz-Guevara. 2023. Effects of a Novel Resiliency Training Program for Social Media Content Moderators. In Proceedings of Seventh International Congress on Information and Commun...

    2023 doi

  165. [175]

    Riedl, and Matthew Lease

    Miriah Steiger, Timir J Bharucha, Sukrit Venkatagiri, Martin J. Riedl, and Matthew Lease. 2021. The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving Support. In Proceedings of the 2021 CHI Conference on Huma...

    2021

  166. [176]

    Hannah Strange. 2021. Ask the experts: how should we measure vicarious trauma . Ph. D. Dissertation. University of Nottingham

    2021

  167. [177]

    Torralba Manuel, Xieyining Huang, and Rachel Lutz Guevara

    Dimitra Eleftheria Strongylou, Marlyn Thomas Savio, Miriah Steiger, Timir Bharucha, Wilfredo R. Torralba Manuel, Xieyining Huang, and Rachel Lutz Guevara. 2024. Perceptions and Experiences of Severe Content in Content Moderation Teams: A Qualitative Study. In Proceedings of Ni...

    2024

  168. [178]

    Wicherts, Ronald C

    Hans Te Brake, Niels Smits, Jelte M. Wicherts, Ronald C. Gorter, and Johan Hoogstraten. 2008. Burnout development among den- tists: a longitudinal study. European Journal of Oral Sciences 116, 6 (2008), 545–551. https://doi.org/10.1111/j.1600-0722.2008.00584.x arXiv:https://on...

    2008

  169. [179]

    Tiziana Terranova. 2012. Free labor. In Digital Labor . Routledge, 33–57. https://api.taylorfrancis.com/content/chapters/edit/download? identifierName=doi&identifierValue=10.4324/9780203145791-4&type=chapterpdf Manuscript submitted to ACM 28 Gonzalez and Matias

    2012 doi

  170. [180]

    Tetrick, Gwenith G

    Lois E. Tetrick, Gwenith G. Fisher, Michael T. Ford, and James Campbell Quick (Eds.). 2023. Handbook of Occupational Health Psychology (3rd ed.). American Psychological Association, Washington, DC

    2023

  171. [181]

    C. W. Topp, S. D. Østergaard, S. Søndergaard, and P. Bech. 2015. The WHO-5 Well-Being Index: a systematic review of the literature.Psychotherapy and Psychosomatics 84, 3 (2015), 167–176. https://doi.org/10.1159/000376585 arXiv:2015 Mar 28

    2015 doi

  172. [182]

    Trust and Safety Professional Association. 2024. What is Content Moderation? TSPA. https://www.tspa.org/curriculum/ts-fundamentals/content- moderation-and-operations/what-is-content-moderation/

    2024

  173. [183]

    Twitter. 2021. Rules enforcement report. Technical Report. https://transparency.twitter.com/en/reports/rulesenforcement.html#2021-jul-dec

    2021

  174. [184]

    VanderWeele, Claudia Trudel-Fitzgerald, Paul Allin, Colin Farrelly, Guy Fletcher, Donald E

    Tyler J. VanderWeele, Claudia Trudel-Fitzgerald, Paul Allin, Colin Farrelly, Guy Fletcher, Donald E. Frederick, Jon Hall, John F. Helliwell, Eric S. Kim, William A. Lauinger, Matthew T. Lee, Sonja Lyubomirsky, Seth Margolis, Eileen McNeely, Neil Messer, Louis Tay, Vish Viswana...

    2020

  175. [185]

    Varra, Laurie Anne Pearlman, Kathleen J

    Edward M. Varra, Laurie Anne Pearlman, Kathleen J. Brock, and Sarah T. Hodgson. 2008. Factor Analysis of the Trauma and Attachment Belief Scale: A Measure of Cognitive Schema Disruption Related to Traumatic Stress. Journal of Psychological Trauma 7, 3 (Sept. 2008), 185–196. ht...

    2008 doi

  176. [186]

    A. G. Vasconcelos, E. P. Lima, K. Teoh, E. do Nascimento, S. MacLennan, and T. Cox. 2021. Work-related factors in the etiology of symptoms of post-traumatic stress among first responders: the Brazilian Firefighters Longitudinal Health Study (FLoHS). Cadernos de Saúde Pública 3...

    2021 doi

  177. [187]

    Vrklevski and Julie Franklin

    Leonie P. Vrklevski and Julie Franklin. 2008. Vicarious Trauma: The Impact on Solicitors of Exposure to Traumatic Material. Traumatology 14, 1 (2008), 106

    2008

  178. [188]

    P. Warr, M. Banks, and P. Ullah. 1985. The experience of unemployment among black and white urban teenagers. British Journal of Psychology 76 (1985), 75–87

    1985

  179. [189]

    Dy Wohn. 2019. Volunteer moderators in Twitch micro communities: how they get involved, the roles they play, and the emotional labor they experience. In CHI ’19 Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems . Association for Computing Machinery, ...

    2019

  180. [190]

    World Health Organization. 2019. International Classification of Diseases, Eleventh Revision (ICD-11) . https://icd.who.int/browse11 Accessed: 2024-10-19

    2019

  181. [191]

    occupational phenomenon

    World Health Organization. 2023. Burn-out an "occupational phenomenon": International Classification of Diseases . https://www.who.int

    2023

  182. [192]

    York and Ethan Zuckerman

    Jillian C. York and Ethan Zuckerman. 2019. Moderating the public sphere. Human rights in the age of platforms 137 (2019), 143. https: //library.oapen.org/bitstream/handle/20.500.12657/24492/1/1005622.pdf#page=184 Publisher: MIT Press Cambridge; London

    2019

  183. [193]

    Roberts, and Mary L

    Alice Qian Zhang, Ryland Shaw, Jacy Reese Anthis, Ashlee Milton, Emily Tseng, Jina Suh, Lama Ahmad, Ram Shankar Siva Kumar, Julian Posada, Benjamin Shestakofsky, Sarah T. Roberts, and Mary L. Gray. 2024. The Human Factor in AI Red Teaming: Perspectives from Social and Collabor...

    2024 arXiv

  184. [2022]

    In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22)

    Trauma-Informed Computing: Towards Safer Technology Experiences for All. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 5...

    2022

Pith tools

Reviewed August 9, 2026 · model on record in the stance chip above.