RahulSChand/gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

↗ Open on GitHub

Stars

1,406

Forks

88

Language

JavaScript

License

—

Last push

2 years ago

JavaScript llm language-model pytorch gpu quantization llama llama2 huggingface ggml llamacpp

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.