DAIT: Distilling CLIP into Tiny Classifiers with an Adaptive Intermediate Teacher
Researchers at Nanjing Normal University placed a trainable 10-million-parameter intermediary between a frozen 1.2-billion-parameter vision-language model and a tiny student classifier — solving the architectural mismatch, noise contamination, and unstable optimization that make direct VLM-to-lightweight distillation fail, and gaining +12.63%…
DAIT: Distilling CLIP into Tiny Classifiers with an Adaptive Intermediate Teacher Read More »










