EleutherAI: Going Beyond "Open Science" to "Science in the Open"

Herbie Bradley; Jason Phang; Leo Gao; Louis Castricato; Stella Biderman

arxiv: 2210.06413 · v1 · pith:YTVQCMP5new · submitted 2022-10-12 · 💻 cs.CL

EleutherAI: Going Beyond "Open Science" to "Science in the Open"

Jason Phang , Herbie Bradley , Leo Gao , Louis Castricato , Stella Biderman This is my paper

classification 💻 cs.CL

keywords researcheleutheraiapproachbeyonddoingopenscienceaccessible

0 comments

read the original abstract

Over the past two years, EleutherAI has established itself as a radically novel initiative aimed at both promoting open-source research and conducting research in a transparent, openly accessible and collaborative manner. EleutherAI's approach to research goes beyond transparency: by doing research entirely in public, anyone in the world can observe and contribute at every stage. Our work has been received positively and has resulted in several high-impact projects in Natural Language Processing and other fields. In this paper, we describe our experience doing public-facing machine learning research, the benefits we believe this approach brings, and the pitfalls we have encountered.

This paper has not been read by Pith yet.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
cs.CL 2023-04 accept novelty 8.0

Pythia releases 16 identically trained LLMs with full checkpoints and data tools to study training dynamics, scaling, memorization, and bias in language models.