harleyszhang/llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

↗ Open on GitHub

Stars

889

Forks

90

Language

Python

License

—

Last push

3 weeks ago

Python llm llm-inference vllm transformer-models kv-cache cuda-programming triton-kernels

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.