Natural Language Processing

Natural language processing covers how machines represent, understand, and generate human language. Articles here move from foundational ideas like embeddings and attention to current research on language models, retrieval, and evaluation, written to connect the theory with the systems people use today.

Overview of DSKD training.

DSKD: How Sense Dictionaries Are Finally Making Decoder LLMs Smarter Without Slowing Them Down

DSKD: How Sense Dictionaries Are Finally Making Decoder LLMs Smarter Without Slowing Them Down | AI Research AITrendBlend Machine Learning About Natural Language Processing · arXiv:2602.22351v1 [cs.CL] · 15 min read DSKD: The Lexical Knowledge Injection That Finally Works for Decoder Language Models How researchers at RPI and IBM Research taught generative LLMs to understand […]

DSKD: How Sense Dictionaries Are Finally Making Decoder LLMs Smarter Without Slowing Them Down Read More »

ToDi, Per Token KL Divergence Control for LLM Distillation.

ToDi: Per Token KL Divergence Control for LLM Distillation

Machine Learning › Knowledge Distillation › Paper Analysis Knowledge Distillation Forward KL Reverse KL LLM Compression Instruction Following Paper Analysis Analysis by the aitrendblend editorial team · October 2025 · 13 min read · arXiv:2505.16297 aitrendblend.com · Knowledge Distillation ToDi, Per Token Control of KL Divergence in LLM Distillation A seven billion parameter model writes

ToDi: Per Token KL Divergence Control for LLM Distillation Read More »