EasyDistill Packages LLM Distillation, But Its Top-k Shortcut Has A Cost
It is worth being upfront about what kind of paper this is. EasyDistill does not propose a new loss function or a new theoretical result about distillation. It is a systems paper, describing an open source toolkit that wraps a…
EasyDistill Packages LLM Distillation, But Its Top-k Shortcut Has A Cost Read More »