toverainc/willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

↗ Open on GitHub

Stars

512

Forks

60

Language

Python

License

Apache-2.0

Last push

7 months ago

Python webrtc privacy llm deep-learning text-to-speech cuda whisper llama speech-recognition speech-to-text vicuna willow

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.