REVIEW 6 cited by
Recipes for Safety in Open-domain Chatbots
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these issues in the context of open-domain generative dialogue models. We introduce a new human-and-model-in-the-loop framework for both training safer models and for evaluating them, as well as a novel method to distill safety considerations inside generative models without the use of an external classifier at deployment time. We conduct experiments comparing these methods and find our new techniques are (i) safer than existing models as measured by automatic and human evaluations while (ii) maintaining usability metrics such as engagingness relative to the state of the art. We then discuss the limitations of this work by analyzing failure cases of our models.
Forward citations
Cited by 6 Pith papers
-
Test-Time Detoxification without Training or Learning Anything
A few zeroth-order gradient steps on prompt embeddings, using only forward evaluations and a toxicity scorer, reduce toxic LLM outputs while preserving fluency.
-
Reinforcement Learning from Human Feedback with High-Confidence Safety Constraints
HC-RLHF returns an aligned language model only after a held-out safety test certifies, with probability at least 1-delta, that expected harm (as judged by a learned cost model) is below a chosen threshold.
-
Safe Inference-Time Alignment via Lagrangian Reward Augmentation
Dualizing Safe RLHF yields a one-dimensional convex calibration of λ that defines a drop-in safety-aware reward for Best-of-N and token-level inference-time decoders.
-
A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategy
A survey that organizes responsible-LLM research into five risk dimensions and four intervention phases, reviewing privacy, hallucination, value, toxicity, and jailbreak mitigation.
-
Agentic Web: Weaving the Next Web with AI Agents
A position paper defines the Agentic Web as the next web era and proposes a three-dimensional conceptual framework for understanding and building it.
-
From Hallucinations to Facts: Enhancing Language Models with Curated Knowledge Graphs
Grounding chatbot replies with curated knowledge-graph triples raises human-rated factual consistency by roughly two points on a five-point scale, but the metric mostly rewards including the provided triple.
Discussion (0). Continue with ORCID to comment.