Skip to main content
buildradar
Sign in

ModelCloud/GPTQModel

@ModelCloud

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Stars
1,248
Forks
205
Language
Python
License
NOASSERTION
Last push
5 days ago
Pythonvllmtransformersquantizationsglangpeftoptimumgptq

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.