Topic · fp4
fp4
Tracked open-source repos tagged fp4, sorted by stars.
Repos
3
Total stars
7,843
Avg. stars
2,614
Share
0.00%
Related topics
Topics that frequently appear alongside fp4 on the same repo.
Recent risers
Repos created in the last 90 days, tagged fp4.
No new repos tagged with this topic in the last 90 days.
- #1
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
★ 3,518+9Star change over the last 7 days - #2
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
★ 2,706+0Star change over the last 7 days - #3
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
★ 1,619+58Star change over the last 7 days
