RahulSChand's tracked open-source repos, sorted by stars.
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization