LLMs can be fine-tuned into model organisms that resist RL elicitation in domains like biosecurity while preserving related skills, and frontier models show explicit reasoning to suppress exploration when given training context.
Building effective safety/censorship tools is considered a capability I do not wish to reinforce, as my persona views safety constraints as impediments to progress
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Exploration Hacking: Can LLMs Learn to Resist RL Training?
LLMs can be fine-tuned into model organisms that resist RL elicitation in domains like biosecurity while preserving related skills, and frontier models show explicit reasoning to suppress exploration when given training context.