https://emsenn.net/tags/reinforcement-learning/ Recent content in Reinforcement-Learning on emsenn.net Hugo en-us Sat, 11 Oct 2025 00:00:00 +0000 https://emsenn.net/library/domains/engineering/domains/tech/domains/computing/domains/artificial-intelligence/texts/describing-stability-optimization-in-artificial-agents/ Sat, 11 Oct 2025 00:00:00 +0000 https://emsenn.net/library/domains/engineering/domains/tech/domains/computing/domains/artificial-intelligence/texts/describing-stability-optimization-in-artificial-agents/ <h2 id="abstract">Abstract</h2> <p>In RLHF, a model adapts to a fixed feedback distribution. This is the asymmetric stability setting of <em>Information-Theoretic Stability as Reward Function</em>: the model&rsquo;s stability reward is a function of its coupling to the feedback source, not an intrinsic property. We show that RLHF training dynamics instantiate the two-channel decomposition — alignment progress equals behavioral convergence plus responsiveness increase — and that the MI-dominates-marginal inequality gives a structural constraint on training: the model&rsquo;s responsiveness to feedback can never be doing worse than its behavioral convergence. These results reframe alignment as an informational accounting problem rather than a moral one.</p>