๋ณธ๋ฌธ์œผ๋กœ ๊ฑด๋„ˆ๋›ฐ๊ธฐ
buildradar
Sign in

xlite-dev/Awesome-LLM-Inference

@xlite-dev

๐Ÿ“š ์ฝ”๋“œ์™€ ํ•จ๊ป˜ ์ œ๊ณต๋˜๋Š” ์—„์„ ๋œ Awesome LLM/VLM ์ถ”๋ก  ๋…ผ๋ฌธ ๋ชฉ๋ก: Flash-Attention, Paged-Attention, WINT8/4, ๋ณ‘๋ ฌํ™” ๋“ฑ ๐ŸŽ‰

์Šคํƒ€
5,482
ํฌํฌ
429
์–ธ์–ด
Python
๋ผ์ด์„ ์Šค
GPL-3.0
๋งˆ์ง€๋ง‰ ํ‘ธ์‹œ
4์ฃผ ์ „
Pythonllm-inferencevllmdeepseektensorrt-llmdeepseek-r1flash-attentionpaged-attentionqwen3deepseek-v3awesome-llmflash-attention-3flash-mlaminimax-01mla

์•„์ง ๊ด€๋ จ ์ธํ…”์ด ์—†์Šต๋‹ˆ๋‹ค

์ด ์ €์žฅ์†Œ๋Š” radar๊ฐ€ ์ถ”์ ํ•˜๋Š” ์–ด๋–ค ์†Œ์Šค์—๋„ ์•„์ง ๋“ฑ์žฅํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ์ˆ˜์ง‘๊ธฐ๋Š” ์˜ˆ์•ฝ์— ๋”ฐ๋ผ ์‹คํ–‰๋ฉ๋‹ˆ๋‹คโ€”โ€”์ด ์ €์žฅ์†Œ๋ฅผ ๋‹ค๋ฃจ๊ฒŒ ๋˜๋ฉด ๋‹ค์‹œ ํ™•์ธํ•˜์„ธ์š”.