Keep teacher and student compatible - On Policy Distillation | Zoonk
Keep teacher and student compatible
Compare a teacher agent and a student agent using the same observation and action interface. Reason about why distillation only makes sense when the student can see compatible inputs and produce compatible actions.