pytorch/ao

PyTorch native quantization for training and inference

↗ Open on GitHub

Stars

2,961

Forks

611

Language

Python

License

NOASSERTION

Last push

4 days ago

Python cuda transformer pytorch quantization llama inference training sparsity mx brrr dtypes float8

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.