On-policy self-distillation (OPSD) is promising as it removes the external teacher required by on-policy distillation (OPD), yet it still needs asymmetric information between teacher and student to ensure that the self-teacher provides a stronger learning…
PRISM indexes and ranks — it never republishes. The full piece lives with its author on arxiv.org.
Read on arxiv.org