mlc-ai/web-llm

High-performance In-browser LLM Inference Engine

↗ Open on GitHub

Stars

18,830

Forks

1,368

Language

TypeScript

License

Apache-2.0

Last push

1 week ago

TypeScript llm deep-learning language-model webgpu chatgpt tvm webml

Hacker News Front Page7 days ago

WebLLM: high-performance in-browser LLM inference engine

by saikatsg131 points23 commentsDiscussion → GitHub repo: mlc-ai/web-llm