Owner · weicj

weicj

weicj's tracked open-source repos, sorted by stars.

1 repos

#1
vLLM-2080Ti-Definitive ↗@weicjPython
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 100+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )
★ 828+53Star change over the last 7 days