ACAM-KD Gives Student Networks A Say In Their Own Distillation
Most feature based knowledge distillation work follows a familiar script. Take a bulky teacher network, decide which regions of its feature maps look most informative, then push the smaller student network to mimic exactly those regions. FGFI drew boxes near…
ACAM-KD Gives Student Networks A Say In Their Own Distillation Read More »










