Topic · self-distillation
self-distillation
Tracked open-source repos tagged self-distillation, sorted by stars.
Repos
2
Total stars
2,077
Avg. stars
1,039
Share
0.00%
Related topics
Topics that frequently appear alongside self-distillation on the same repo.
Recent risers
Repos created in the last 90 days, tagged self-distillation.
No new repos tagged with this topic in the last 90 days.
- #1
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
★ 1,306+0Star change over the last 7 days - #2
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
★ 812+32Star change over the last 7 days
