Knowledge Distillation

Mask-CDKD: Source-Free Knowledge Distillation from SAM for Satellite Onboard Land Cover Mapping.

Mask-CDKD: Source-Free Knowledge Distillation from SAM for Satellite Onboard Land Cover Mapping

Mask-CDKD: Source-Free Knowledge Distillation from SAM for Satellite Onboard Land Cover Mapping | AI Trend Blend Satellite AI & Remote Sensing · ISPRS J. Photogramm. Remote Sens. 236 (2026) 1–21 · Wuhan University / Emory · 28 min read Teaching a Satellite to See the World Without Labels: How Mask-CDKD Squeezes SAM Into a 30M-Parameter […]

Mask-CDKD: Source-Free Knowledge Distillation from SAM for Satellite Onboard Land Cover Mapping Read More »

IQ-LUT: 34 KB of Super-Resolution That Beats 1.5 MB Models.

IQ-LUT: 34 KB of Super-Resolution That Beats 1.5 MB Models

IQ-LUT: 34 KB of Super-Resolution That Beats 1.5 MB Models | AI Trend Blend AITrendBlend Machine Learning Computer Vision About Image Super-Resolution · Edge AI · arXiv:2604.07000 | Shanghai Jiao Tong University · Rockchip Electronics (2026) · 19 min read IQ-LUT: How a 34 KB Lookup Table Beats a 1.5 MB Neural Network at Image

IQ-LUT: 34 KB of Super-Resolution That Beats 1.5 MB Models Read More »

PQKD: How a Beam of Light Is Teaching AI to Learn Smarter — Photonic Quantum-Enhanced Knowledge Distillation Explained

PQKD: How a Beam of Light Is Teaching AI to Learn Smarter — Photonic Quantum-Enhanced Knowledge Distillation Explained

PQKD: How a Beam of Light Is Teaching AI to Learn Smarter — Photonic Quantum-Enhanced Knowledge Distillation Explained | AI Systems Research Quantum Machine Learning · arXiv:2603.14898v1 [quant-ph] · Imperial College London · 18 min read PQKD: How a Beam of Light Is Teaching AI to Learn Smarter — Photonic Quantum-Enhanced Knowledge Distillation Explained A

PQKD: How a Beam of Light Is Teaching AI to Learn Smarter — Photonic Quantum-Enhanced Knowledge Distillation Explained Read More »

DAIT: Distilling CLIP into Tiny Classifiers with an Adaptive Intermediate Teacher

DAIT: Distilling CLIP into Tiny Classifiers with an Adaptive Intermediate Teacher

DAIT: Distilling CLIP into Tiny Classifiers with an Adaptive Intermediate Teacher | AI Trend Blend AITrendBlend Machine Learning Computer Vision About Fine-Grained Vision · Model Compression · arXiv:2603.15166 | Nanjing Normal University · Westlake University (2026) · 20 min read DAIT: Why You Should Never Ask CLIP to Directly Teach ResNet-18 — And What to

DAIT: Distilling CLIP into Tiny Classifiers with an Adaptive Intermediate Teacher Read More »

PCKD: Physically Motivated Knowledge Distillation for Blind Side-Scan Sonar Correction.

PCKD: Physically Motivated Knowledge Distillation for Blind Side-Scan Sonar Correction

PCKD: Physically Motivated Knowledge Distillation for Blind Side-Scan Sonar Correction | AI Trend Blend AITrendBlend Machine Learning Computer Vision About Underwater AI · Remote Sensing · arXiv:2603.15200 | Northwestern Polytechnical University · University of Girona (2026) · 22 min read PCKD: Teaching a Sonar to Straighten Itself — Blind Geometric Correction When GPS Fails Underwater

PCKD: Physically Motivated Knowledge Distillation for Blind Side-Scan Sonar Correction Read More »

PRECTR-V2: How Alibaba Solved Cold-Start, Exposure Bias, and a Frozen Encoder — All in One Unified Search Ranking Framework.

PRECTR-V2: How Alibaba Solved Cold-Start, Exposure Bias, and Frozen Encoders in One Unified Search Ranking Framework

PRECTR-V2: How Alibaba Solved Cold-Start, Exposure Bias, and Frozen Encoders in One Unified Search Ranking Framework | AI Trend Blend AITrendBlend Machine Learning About Recommendation Systems · arXiv:2602.20676 · Alibaba Group / Xianyu · 18 min read PRECTR-V2: How Alibaba Solved Cold-Start, Exposure Bias, and a Frozen Encoder — All in One Unified Search Ranking

PRECTR-V2: How Alibaba Solved Cold-Start, Exposure Bias, and Frozen Encoders in One Unified Search Ranking Framework Read More »

GATES: How Consensus Gating Fixed the Broken Promise of Self-Distillation in Language Models.

GATES: How Consensus Gating Fixed the Broken Promise of Self-Distillation in Language Models

GATES: How Consensus Gating Fixed the Broken Promise of Self-Distillation in Language Models | AI Trend Blend Self-Supervised Learning · arXiv:2602.20574v1 [cs.LG] · University of Maryland, College Park · 18 min read GATES: How Consensus Gating Fixed the Broken Promise of Self-Distillation in Language Models Researchers at the University of Maryland trained a model to

GATES: How Consensus Gating Fixed the Broken Promise of Self-Distillation in Language Models Read More »

The overall framework of the proposed momentum memory knowledge distillation framework(MoMKD).

MoMKD: The Momentum Memory That Teaches Cancer Histology to Think Genetically

MoMKD: The Momentum Memory That Teaches Cancer Histology to Think Genetically Computational Pathology · arXiv:2602.21395v2 [cs.CV] · 15 min read MoMKD: The Momentum Memory That Teaches Cancer Histology to Think Genetically How a team at Wake Forest University School of Medicine built a cross-modal distillation framework that transfers the predictive power of expensive genomic assays

MoMKD: The Momentum Memory That Teaches Cancer Histology to Think Genetically Read More »

Overview of DSKD training.

DSKD: How Sense Dictionaries Are Finally Making Decoder LLMs Smarter Without Slowing Them Down

DSKD: How Sense Dictionaries Are Finally Making Decoder LLMs Smarter Without Slowing Them Down | AI Research AITrendBlend Machine Learning About Natural Language Processing · arXiv:2602.22351v1 [cs.CL] · 15 min read DSKD: The Lexical Knowledge Injection That Finally Works for Decoder Language Models How researchers at RPI and IBM Research taught generative LLMs to understand

DSKD: How Sense Dictionaries Are Finally Making Decoder LLMs Smarter Without Slowing Them Down Read More »

DySL-VLA: How Researchers Finally Taught Robots to Think Fast Without Thinking Less.

DySL-VLA: How Researchers Finally Taught Robots to Think Fast Without Thinking Less

DySL-VLA: How Researchers Finally Taught Robots to Think Fast Without Thinking Less | AI Systems Research AISecurity Research Machine Learning About Robot Learning · arXiv:2602.22896v2 [cs.RO] · 15 min read DySL-VLA: How Researchers Finally Taught Robots to Think Fast Without Thinking Less A team at Peking University discovered something that sounds almost too obvious once

DySL-VLA: How Researchers Finally Taught Robots to Think Fast Without Thinking Less Read More »