withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

↗ Open on GitHub

Stars

2,170

Forks

215

Language

TypeScript

License

MIT

Last push

4 weeks ago

TypeScript metal nodejs ai llm cuda self-hosted cmake gpu vulkan llama json-schema bindings gguf llama-cpp function-calling grammar prebuilt-binaries embedding cmake-js catai

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.