PPO and the GRPO baseline studied here use clipped surrogate objectives whose favorable-direction saturation introduces an abrupt change in the scalar objective's derivative. We ask whether Output Reset (OR), a smooth one-sided saturation rule, offers a…
PRISM indexes and ranks — it never republishes. The full piece lives with its author on arxiv.org.
Read on arxiv.org