andrewkchan/yalm

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

↗ Open on GitHub

Stars

597

Forks

64

Language

C++

License

—

Last push

12 months ago

C++cpp machine-learning llm cuda llm-inference llama inference-engine mistral llamacpp

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.