Luce-Org/lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

↗ Open on GitHub

Stars

2,829

Forks

268

Language

C++

License

Apache-2.0

Last push

6 days ago

C++spark cuda cuda-kernels qwen rocm llama-cpp kernel speculative-decoding local-ai heterogeneous-computing rtx3090 dflash luce megakernel pflash poolside r9700 speculative-prefill strix-halo

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.