Skip to main content
buildradar
Sign in

Tebmer/Awesome-Knowledge-Distillation-of-LLMs

@Tebmer

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Stars
1,306
Forks
73
Language
License
Last push
2 years ago
llmdata-synthesisalignmentfeedbacksurveyknowledge-distillationcompressionlarge-language-modelmulti-modalinstruction-followingdata-augmentationself-distillationsupervised-finetuningkdself-training

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.