Owner · scrya-com

scrya-com

scrya-com's tracked open-source repos, sorted by stars.

1 repos

#1
rotorquant ↗@scrya-comPython
KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44x fewer params. Drop-in llama.cpp integration.
★ 1,046+3Star change over the last 7 days