bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

↗ Open on GitHub

Stars

12,524

Forks

837

Language

Python

License

Apache-2.0

Last push

1 week ago

Python llm llm-inference fine-tuning llmops llama llama2 vicuna mlops mistral open-source-llm llm-serving llm-ops bentoml llama3-1 llama3-2 llama3-2-vision model-inference openllm

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.