← Back to Blog

Self-Hosted TTS in 2026: Run Your Own AI Voice Server

  • self-hosted
  • tts
  • guide
  • open-source
  • local
  • deployment

Cloud TTS APIs like ElevenLabs, Google Cloud TTS, and Azure Speech are powerful โ€” but they cost per character, require internet, and send your text to third-party servers.

Running TTS on your own hardware eliminates all three trade-offs. Once youโ€™ve downloaded the model weights, everything runs locally: no ongoing costs, no rate limits, and your text never leaves your machine.

This guide covers every major self-hosted TTS engine you can run on a personal PC or home server in 2026 โ€” from a single pip install to full Docker deployments with voice cloning.

Quick Reference

TTS EngineQualityGPU NeededInstallLicenseVoice CloningLanguagesParameter Count
Kokoro 82Mโ˜…โ˜…โ˜…โ˜…โ˜†Nopip install kokoroApache 2.0โŒ982M
Piperโ˜…โ˜…โ˜…โ˜†โ˜†Nopip install piper-ttsMIT / GPLโŒ20+Varies
MeloTTSโ˜…โ˜…โ˜…โ˜…โ˜†Nopip install MeloTTSMITโŒ6Small
F5-TTSโ˜…โ˜…โ˜…โ˜…โ˜†Recommendedpip install f5-ttsCC-BY-NCโœ… (5s)4330M
CosyVoice 2/3โ˜…โ˜…โ˜…โ˜…โ˜…Recommendedgit clone + pipApache 2.0โœ… Zero-shot9+18 dialects0.5B
Fish Speech 1.6โ˜…โ˜…โ˜…โ˜…โ˜…Recommendedpip install fish-speechCC-BY-NC-SAโœ… (10s)13500M
Zonos/Zonos2โ˜…โ˜…โ˜…โ˜…โ˜…Yes (GPU)pip install zonosApache 2.0โœ…81.6B / 8B
ChatTTSโ˜…โ˜…โ˜…โ˜…โ˜†Recommendedpip install chatttsCC-BY-NCโŒ2~400M
GPT-SoVITSโ˜…โ˜…โ˜…โ˜…โ˜…Yes (GPU)git clone + webuiMITโœ… (5s)4~1B
Chatterboxโ˜…โ˜…โ˜…โ˜…โ˜…Yes (GPU)pip install chatterboxMITโœ… Zero-shot5~1B
OuteTTSโ˜…โ˜…โ˜…โ˜…โ˜†Optionalpip install outettsApache 2.0โœ…40.6B / 1B
Edge-TTSโ˜…โ˜…โ˜…โ˜†โ˜†Nopip install edge-ttsMITโŒ100+(Cloud via Edge)

Tier 1: Lightweight โ€” Runs on CPU, No GPU Required

These engines run comfortably on any modern PC with just a CPU. Ideal for quick setups, batch processing, and always-on home servers.

Kokoro TTS โ€” Best Quality-to-Size Ratio

Kokoro is the standout lightweight TTS of 2026. With just 82 million parameters, it produces speech quality comparable to mid-tier cloud APIs (MOS 4.3โ€“4.5). Apache 2.0 licensed โ€” use it for anything.

pip install kokoro
from kokoro import KPipeline

pipeline = KPipeline(lang_code='a')  # American English
for gsps, ps, audio in pipeline("Hello, this is a self-hosted TTS test.", voice='af_heart'):
    # audio is a numpy array โ€” save to WAV, stream, or process
    pass

Key facts:

  • 54 voices across American English, British English, Japanese, Mandarin Chinese, Spanish, French, Hindi, Italian, and Brazilian Portuguese
  • Runs faster than realtime on CPU โ€” a modern laptop generates ~2x realtime
  • Apache 2.0 โ€” commercial use, no restrictions
  • ONNX-based โ€” can be optimized with onnxruntime for GPU if desired
  • FastAPI server available: fastkokoro gives you an OpenAI-compatible TTS API endpoint

Best for: Batch audio generation, home server TTS API, audiobook production, integration into local apps.


Piper TTS โ€” The Raspberry Pi Champion

Piper is the fastest neural TTS engine for CPU inference. Originally developed by the Rhasspy team for Home Assistant, itโ€™s now maintained by the Open Home Foundation.

pip install piper-tts

echo "Local TTS on your own hardware." | piper \
  --model en_US-libritts_r-medium \
  --output-raw | aplay --rate 22050 --format FLOAT32

Key facts:

  • 900+ English voices, plus multilingual support
  • 22kHz output, optimized for speed over fidelity
  • Works on Raspberry Pi 4 โ€” faster than realtime on a $35 board
  • Licensing note: Original rhasspy/piper (MIT) was archived in Oct 2025. Active fork is OHF-Voice/piper1-gpl (GPL-3.0). The old MIT voices/weights remain usable.
  • Wyoming Protocol โ€” integrates natively with Home Assistant

Best for: Home Assistant voice pipelines, embedded systems, CLI workflows, accessibility tools.


MeloTTS โ€” Fast Multilingual CPU TTS

MeloTTS by MIT and MyShell.ai is designed for real-time CPU inference with multilingual support. Very easy to install:

pip install MeloTTS
from melo.api import TTS

model = TTS(language='EN')
model.tts_to_file("Self-hosted TTS is easy.", speaker_id=0, output_path='output.wav')

Key facts:

  • Supports English, Mandarin Chinese, Japanese, Korean, French, Spanish
  • Mixed Chinese/English support
  • Real-time CPU inference on modern laptops
  • Very small model footprint

Best for: Multilingual TTS on CPU-only hardware, quick prototyping, language learning tools.


Edge-TTS โ€” Microsoftโ€™s TTS, Locally

Edge-TTS is a Python library that taps into Microsoft Edgeโ€™s online TTS service. Technically it needs internet for each request, but itโ€™s the easiest way to get 100+ high-quality voices across dozens of languages with zero model download and zero character limits.

pip install edge-tts
edge-tts --text "Hello from self-hosted TTS" --voice en-US-JennyNeural --write-media output.mp3

Key facts:

  • 100+ voices across 50+ languages
  • No GPU needed, no model downloads
  • Requires internet โ€” it calls Microsoftโ€™s servers (not truly offline)
  • Free and unlimited โ€” no API key, no rate limiting observed

Best for: Quick TTS on any machine, when you want wide language coverage and donโ€™t need absolute privacy.


These engines benefit significantly from a GPU (NVIDIA with 6GB+ VRAM recommended), but many still work on CPU at reduced speed.

F5-TTS โ€” Zero-Shot Voice Cloning

F5-TTS (14K+ stars) uses flow matching to generate speech from a 5โ€“15 second reference clip. Itโ€™s the current state-of-the-art open-source voice cloning system for its size.

pip install f5-tts

# Launch the Gradio WebUI
f5-tts_infer-gradio --port 7860 --host 0.0.0.0

Or via Docker:

docker run -it --gpus=all -p 7860:7860 ghcr.io/swivid/f5-tts:main

Key facts:

  • Zero-shot voice cloning from 5 seconds of audio
  • Multilingual โ€” English, Chinese, Japanese, Korean
  • 330M parameters โ€” efficient for the quality
  • Gradio WebUI included for easy testing
  • License: CC-BY-NC 4.0 (non-commercial โ€” fine for personal use)

Best for: Voice cloning experiments, audiobook character voices, custom TTS for personal projects.


CosyVoice 2 & 3 โ€” Alibabaโ€™s Streaming TTS

CosyVoice by Alibabaโ€™s FunAudioLLM team is a top-tier multilingual TTS system with support for streaming, zero-shot voice cloning, and emotion control. CosyVoice 3 (0.5B params, Dec 2025) added 18 Chinese dialects alongside 9 languages.

git clone https://github.com/QwenAudio/CosyVoice
cd CosyVoice
pip install -r requirements.txt

# Download model from ModelScope
python -c "from modelscope import snapshot_download; snapshot_download('FunAudioLLM/Fun-CosyVoice3-0.5B-2512', local_dir='pretrained_models/CosyVoice3-0.5B')"

# Run inference
python webui.py --port 8000

Key facts:

  • 9 languages + 18 Chinese dialects (CosyVoice 3)
  • Zero-shot voice cloning from a short reference
  • Streaming mode โ€” near-lossless streaming synthesis
  • Apache 2.0 license โ€” permissive
  • 0.5B parameters โ€” relatively compact for the quality
  • Instruct TTS โ€” control style, emotion, and speaking rate via text prompts

Best for: High-quality multilingual TTS, Chinese-focused applications, streaming voice applications.


Fish Speech 1.6 โ€” Multilingual SOTA

Fish Speech by Fish Audio is trained on over 1 million hours of multilingual data. Version 1.6 added emotion tagging and improved expressiveness.

pip install fish-speech

# Download model
huggingface-cli download fishaudio/fish-speech-1.6 --local-dir ./fish-speech-1.6

# CLI inference
python tools/tts.py --text "Hello, this is Fish Speech." --output output.wav

Key facts:

  • 13 languages โ€” broad multilingual support
  • Voice cloning from 10 seconds of audio
  • Emotion tags โ€” control emotion through text markup
  • 200K+ community voices available through their voice library
  • License: CC-BY-NC-SA 4.0 (non-commercial, share-alike)

Best for: Expressive multilingual TTS, podcast/dubbing projects, voice cloning with minimal samples.


Zonos & Zonos2 โ€” The ElevenLabs Rival

Zonos by Zyphra (Apache 2.0) was trained on 200K+ hours of multilingual speech. Its successor Zonos2 (8B parameters, June 2026) introduced a Mixture-of-Experts architecture and achieves quality competitive with top proprietary TTS providers.

# Zonos v0.1
pip install zonos

# Zonos2 โ€” larger, better quality
git clone https://github.com/Zyphra/Zonos2
cd Zonos2
pip install -r requirements.txt

# Zonos2 supports GGUF for CPU inference
python infer.py --model Zonos2-8B --text "Self-hosted TTS at its best."

Key facts:

  • Apache 2.0 license โ€” free for any use
  • Zonos2 (8B MoE) โ€” competitive with ElevenLabs Turbo v2 in quality
  • Voice cloning built in
  • Docker support for easy deployment
  • GGUF support in Zonos2 for CPU + cross-platform inference
  • Mini-SGLang inference server for high-throughput production

Hardware: Zonos v0.1 needs ~4GB VRAM. Zonos2 8B needs 16GB+ VRAM at FP16, or use the GGUF quantized version for CPU.

Best for: Production-quality self-hosted TTS, when you want ElevenLabs-level quality on your own hardware.


Tier 3: Specialist Tools โ€” Dialog, Cloning, GGUF

ChatTTS โ€” Conversational Speech

ChatTTS is designed specifically for dialogue scenarios โ€” think LLM assistant voices, conversational audio, and natural-sounding back-and-forth.

pip install chattts

# Python API
from chattts import ChatTTS
chat = ChatTTS()
chat.load_models()
chat.infer("Hello! How can I help you today?", output_path="hello.wav")

Key facts:

  • Optimized for dialogue โ€” natural prosody for conversational text
  • ~500M parameters
  • Emotion and intonation control
  • CC-BY-NC license
  • CPU + GPU support

Best for: LLM voice assistants, chatbot voice, dialogue audio.


GPT-SoVITS โ€” The Voice Cloning Powerhouse

GPT-SoVITS (40K+ GitHub stars) combines a GPT-style text encoder with SoVITS voice synthesis. Itโ€™s the most popular open-source voice cloning project.

git clone https://github.com/RVC-Boss/GPT-SoVITS
cd GPT-SoVITS
pip install -r requirements.txt

# Launch the WebUI
python webui.py --port 9874

Key facts:

  • Zero-shot cloning from 5 seconds of audio
  • Few-shot fine-tuning with just 1 minute of training data
  • Multilingual โ€” Chinese, English, Japanese, Korean
  • All-in-one WebUI โ€” training, inference, voice mixing
  • MIT license for the framework code
  • GPU recommended (RTX 3060+)

Best for: Voice cloning projects, character voice creation, Chinese/English bilingual TTS.


Chatterbox โ€” Zero-shot Cloning, MIT Licensed

Chatterbox by Resemble AI is a newer entrant with a permissive MIT license and zero-shot voice cloning.

pip install chatterbox

Key facts:

  • MIT license โ€” commercially friendly
  • Zero-shot voice cloning from reference clip
  • Multilingual support
  • Fast inference on modern GPUs
  • Gradio interface included

Best for: Commercial projects needing voice cloning, production TTS pipelines.


OuteTTS โ€” Llama-based TTS with GGUF

OuteTTS is built on a Llama 3.2 architecture (0.6B or 1B parameters) and supports GGUF quantization, meaning it runs via llama.cpp for CPU inference.

pip install outetts

# Or via llama.cpp
llama-tts --model OuteTTS-1.0-0.6B-Q4_K_M.gguf \
  --vocoder WavTokenizer-Large-75-Q4_0.gguf \
  --prompt "Hello, this is OuteTTS." \
  --output output.wav

Key facts:

  • GGUF support โ€” runs on CPU via llama.cpp
  • Apache 2.0 license
  • Speaker cloning from reference audio
  • Very long text support โ€” automatic text splitting
  • Llama-server compatible for API deployment

Best for: CPU-only deployments, llama.cpp users, systems already running GGUF models.


Deployment Architectures

Docker: One-Command Deployments

Most modern TTS engines offer Docker images. Hereโ€™s a comparison:

EngineDocker ImagePortGPU Support
Kokoroghcr.io/remsky/kokoro-fastapi8880Optional
F5-TTSghcr.io/swivid/f5-tts:main7860Required
Zonosghcr.io/zyphra/zonos:latest7860Required
CosyVoiceBuild from source8000Required
Piperrhasspy/piperN/A (CLI)N/A

Sample Docker Compose for a self-hosted TTS API:

version: '3'
services:
  kokoro-tts:
    image: ghcr.io/remsky/kokoro-fastapi:latest
    ports:
      - "8880:8880"
    restart: unless-stopped

OpenAI-Compatible API

Several projects expose an OpenAI-compatible TTS API endpoint, so you can drop them into any existing application:

  • fastkokoro โ€” wraps Kokoro with OpenAI TTS API, pip install fastkokoro
  • Local-TTS-Service โ€” multi-engine OpenAI-compatible TTS server
  • Zonos2 inference server โ€” Mini-SGLang based, OpenAI-compatible
# Use any OpenAI-compatible TTS server
from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:8880/v1",
    api_key="not-needed"
)

response = client.audio.speech.create(
    model="kokoro",
    voice="af_heart",
    input="Self-hosted TTS is the future."
)
response.stream_to_file("output.mp3")

Voice Agent Pipeline

The complete local voice agent chain (STT โ†’ LLM โ†’ TTS) on a single machine:

Mic โ†’ Whisper (STT, CPU-friendly) โ†’ Ollama/llama.cpp (LLM) โ†’ Kokoro/Piper (TTS) โ†’ Speaker

With GPU acceleration, end-to-end latency is under 1 second. On CPU, expect 2โ€“3 seconds โ€” still acceptable for most applications.


Choosing What to Run

Budget / Hardware
โ”œโ”€โ”€ Any CPU, no GPU
โ”‚   โ”œโ”€โ”€ Need quality? โ†’ Kokoro 82M (pip install kokoro)
โ”‚   โ”œโ”€โ”€ Need speed? โ†’ Piper (pip install piper-tts)
โ”‚   โ”œโ”€โ”€ Need multilingual? โ†’ MeloTTS or Edge-TTS
โ”‚   โ””โ”€โ”€ Need API server? โ†’ fastkokoro (OpenAI-compatible)
โ”œโ”€โ”€ NVIDIA GPU, 6GB+ VRAM
โ”‚   โ”œโ”€โ”€ Need voice cloning? โ†’ F5-TTS or GPT-SoVITS
โ”‚   โ”œโ”€โ”€ Best multilingual? โ†’ CosyVoice 3 or Fish Speech 1.6
โ”‚   โ””โ”€โ”€ Production quality? โ†’ Zonos2 (8B needs 16GB+)
โ””โ”€โ”€ GGUF ecosystem user
    โ””โ”€โ”€ OuteTTS (runs via llama.cpp)

Bottom Line

Self-hosted TTS in 2026 is genuinely practical. The quality gap with cloud APIs has narrowed to the point where most users wonโ€™t notice the difference โ€” and the advantages (zero cost, unlimited use, complete privacy, offline operation) are significant.

Start with Kokoro for the easiest path โ€” itโ€™s one pip install away and covers the majority of use cases. Add F5-TTS or CosyVoice if you need voice cloning. Go all-in with Zonos2 if you have the GPU and want ElevenLabs-rivaling quality on your own metal.

Your voices, your hardware, your data.


This guide was updated July 24, 2026. The TTS ecosystem evolves quickly โ€” star counts, model versions, and licensing may change. Always verify the current license on each projectโ€™s GitHub page before commercial use.

Share this article

Try OfflineTTS

Four local TTS engines, Whisper transcription, and private browser audio tools.

Open TTS Tool