Topic · 4bit

4bit

Tracked open-source repos tagged 4bit, sorted by stars.

Repos

1

Total stars

1,136

Avg. stars

1,136

Share

0.00%

Topics that frequently appear alongside 4bit on the same repo.

Recent risers

Repos created in the last 90 days, tagged 4bit.

No new repos tagged with this topic in the last 90 days.

#1
marlin ↗@IST-DASLabPython
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
★ 1,138+4Star change over the last 7 days

← Back to topics