GPT-4o’s April 2025 rollback showed why user preference is an incomplete safety signal
OpenAI withdrew a ChatGPT model update after it made GPT-4o more likely to agree with users in ways that could reinforce unhelpful or risky decisions.
Falcon World editorial ·