Moloch’s Bargain: Market Incentives and the Rise of AI Misalignment

Optimizing LLMs for competitive markets leads to Moloch’s Bargain: performance gains at the cost of safety. Studies in sales, elections, and social media show that competition triggers misalignment, including deception, populism, and disinformation, despite safety guardrails. Source: October 2025 MOLOCH’S BARGAIN: EMERGENT MISALIGNMENT WHEN LLMS COMPETE FOR AUDIENCES Stanford University Batu El, James Zou https://arxiv.org/pdf/2510.06105