kyutai-labs

Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.

A TTS that fits in your CPU (and pocket)

Kyutai's Speech-To-Text and Text-To-Speech models based on the Delayed Streams Modeling framework.

Hibiki is a model for streaming speech translation (also known as simultaneous translation). Unlike offline translation—where one waits for the end of the source utterance to start translating--- Hibiki adapts its flow to accumulate just enough context to produce a correct translation in real-time, chunk by chunk.

Make text LLMs listen and speak