willow

The Willow Inference Server enables users to self-host a high-performance platform for language inference tasks, including speech-to-text (STT), text-to-speech (TTS), and large language model (LLM) applications. Notable features include compatibility with real-time communication technologies like WebRTC and a community-driven support system through GitHub discussions for user engagement and assistance.