REVIEW 7 cited by
Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human-Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT-3, the largest publicly-disclosed dense language model at the time. The meeting took place under Chatham House Rules. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy, and more. Broadly, the discussion centered around two main questions: 1) What are the technical capabilities and limitations of large language models? 2) What are the societal effects of widespread use of large language models? Here, we provide a detailed summary of the discussion organized by the two themes above.
Forward citations
Cited by 7 Pith papers
-
Silicon Minds versus Human Hearts: The Wisdom of Crowds Beats the Wisdom of AI in Emotion Recognition
On eye-based emotion tests, GPT-4o beats the average human, but plurality-voted human crowds beat GPT-4o crowds, and a 90:10 human-AI vote mix performs best.
-
Measuring AI Alignment with Human Flourishing
The authors propose the Flourishing AI Benchmark, which uses 1,229 objective and subjective questions plus LLM judges to score 28 chatbots across seven dimensions of human flourishing, and find none reach the 90-point...
-
CreAgent: Towards Long-Term Evaluation of Recommender System under Platform-Creator Information Asymmetry
CreAgent combines an LLM with game-theoretic beliefs and fast-slow thinking to reproduce creator behavior under information asymmetry, and it is used to evaluate recommender systems over long time horizons.
-
A New Incentive Model For Content Trust
Creators, challengers, and jurors stake money on contested content, with forfeited bonds paying the winners, in a proposed self-sustaining content trust protocol.
-
Detection Method for Prompt Injection by Integrating Pre-trained Model and Heuristic Feature Engineering
A dual-channel detector combining DeBERTa and heuristic rules is claimed to beat existing prompt injection detectors on three benchmarks and to reduce attack success on GLM-4, Llama 3, Qwen 2.5, and GPT-4o.
-
Continually Self-Improving Language Models for Bariatric Surgery Question--Answering
bRAGgen uses a perplexity threshold to trigger web retrieval and LoRA fine-tuning, improving answers on a new bariatric surgery QA dataset, but the evaluation is confounded by test-time adaptation.
-
Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecycle
A survey that maps reinforcement learning methods, datasets, benchmarks, and open-source tools across the full training lifecycle of large language models, focusing on verifiable-reward reasoning.
Discussion (0). Continue with ORCID to comment.