intel/auto-round

A SOTA quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的量化工具包

↗ Open on GitHub

Stars

1,599

Forks

171

Language

Python

License

Apache-2.0

Last push

5 days ago

Python vllm llms transformers quantization gguf omni diffusers sglang nvfp4 int4 vlms mxfp4 rounding

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.