sgl-project/sglang-omni

SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.

↗ Open on GitHub

Stars

1,118

Forks

443

Language

Python

License

Apache-2.0

Last push

3 days ago

Python text-to-speech tts multimodal cuda pytorch openai-api streaming asr speech-recognition inference music-generation audio-generation model-serving sglang distributed-inference

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.