SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

↗ Open on GitHub

Stars

724

Forks

52

Language

Python

License

MIT

Last push

2 years ago

Python llm large-language-models transformer quantization llama natural-language-processing small-models text-generation model-compression efficient-inference localllm post-training-quantization

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.