Skip to main content
buildradar
Sign in

Michael-A-Kuykendall/shimmy

@Michael-A-Kuykendall

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Stars
5,864
Forks
569
Language
Rust
License
Apache-2.0
Last push
2 weeks ago
Rustrustdeveloper-toolsmachine-learningwebgpullm-inferencetransformersllamacommand-line-toolhuggingfaceggufollama-apirust-crateopenai-compatiblellamacppwebgpu-shadersapi-serverlocal-aihuggingface-transformersinference-serverhuggingface-models

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.