efeslab/Nanoflow

A throughput-oriented high-performance serving framework for LLMs

↗ Open on GitHub

Stars

975

Forks

53

Language

Jupyter Notebook

License

—

Last push

5 months ago

Jupyter Notebook llm cuda llama2 inference llm-serving model-serving

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.