PLD: List Wise Knowledge Distillation with Plackett-Luce
Machine Learning › Knowledge Distillation › Paper Analysis aitrendblend.com · Knowledge Distillation Almost every logit based distillation method shares an awkward design. You take the student’s ordinary cross entropy loss, bolt a distillation term onto it, and then spend hours…
PLD: List Wise Knowledge Distillation with Plackett-Luce Read More »