REVIEW 4 cited by
BigScience: A Case Study in the Social Construction of a Multilingual Large Language Model
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The BigScience Workshop was a value-driven initiative that spanned one and half years of interdisciplinary research and culminated in the creation of ROOTS, a 1.6TB multilingual dataset that was used to train BLOOM, one of the largest multilingual language models to date. In addition to the technical outcomes and artifacts, the workshop fostered multidisciplinary collaborations around large models, datasets, and their analysis. This in turn led to a wide range of research publications spanning topics from ethics to law, data governance, modeling choices and distributed training. This paper focuses on the collaborative research aspects of BigScience and takes a step back to look at the challenges of large-scale participatory research, with respect to participant diversity and the tasks required to successfully carry out such a project. Our main goal is to share the lessons we learned from this experience, what we could have done better and what we did well. We show how the impact of such a social approach to scientific research goes well beyond the technical artifacts that were the basis of its inception.
Forward citations
Cited by 4 Pith papers
-
From OSS to Open Source AI: an Exploratory Study of Collaborative Development Paradigm Divergence
Open source AI shows lower collaboration intensity, reduced direct contributions, and a shift toward adaptive use rather than joint improvement compared to traditional OSS.
-
Opening the Scope of Openness in AI
A taxonomy of 98 openness concepts from across disciplines reveals that AI openness discussions overemphasize access, inspection, reuse, and organic behavior while underrepresenting fairness, diversity, autonomy, and ...
-
Hidden Language Consistency Phenomena in Reasoning LLMs
Reasoning models often stop using the requested language as problems get harder, and this language breakdown can make accuracy look better than it is.
-
A Cartography of Open Collaboration in Open Source AI: Mapping Practices, Motivations, and Governance in 14 Open Large Language Model Projects
A qualitative interview study of 14 open LLM projects maps where collaboration happens, why developers participate, and how projects are governed across the model lifecycle.
Discussion (0). Continue with ORCID to comment.