Kokoro

Credits

This model would not exist without:

• hexgrad/Kokoro-82M — the original English Kokoro-82M model and architecture.
• kikiri-tts by semidark — the German fine-tuning recipe, patched StyleTTS2/Kokoro submodules, and documentation this training was based on. Please check out their project and the German community voices (Martin, Victoria) they've already published.

Fine-tuned on the Thorsten-Voice dataset (CC0 / public domain).

Files in this repository

Installation

This model requires the German-language forks of misaki and kokoro (the official PyPI misaki package does not include the de submodule needed for German G2P), plus the espeak-ng system package that misaki relies on for phonemization:

# System dependency (required by misaki for German G2P)
# macOS:
brew install espeak-ng
# Debian/Ubuntu:
sudo apt-get install espeak-ng

# Python dependencies
pip install huggingface_hub soundfile numpy torch
pip install "git+https://github.com/semidark/misaki.git@6d252a2e02f3b030f22f56686f1a73786c16ffc8"
pip install "git+https://github.com/semidark/kokoro.git"

Usage

import numpy as np
import soundfile as sf
import torch
from huggingface_hub import hf_hub_download
from kokoro import KModel, KPipeline

REPO_ID = "Thorsten-Voice/Kokoro"

device = "cuda" if torch.cuda.is_available() else "cpu"

config_path = hf_hub_download(repo_id=REPO_ID, filename="config.json")
model_path = hf_hub_download(repo_id=REPO_ID, filename="model.pth")
voice_path = hf_hub_download(repo_id=REPO_ID, filename="voices/thorsten.pt")

kmodel = KModel(repo_id="hexgrad/Kokoro-82M", config=config_path, model=model_path)
kmodel = kmodel.to(device).eval()

pipeline = KPipeline(lang_code="d", repo_id="hexgrad/Kokoro-82M", model=kmodel)

# Workaround: misaki's German G2P can emit 'ʏ' (short ü), which is not in
# Kokoro's vocabulary (only 'y' is). See "Known limitations" below.
_original_g2p = pipeline.g2p
pipeline.g2p = lambda text: (lambda ps, tok: (ps.replace("ʏ", "y"), tok))(*_original_g2p(text))

voice = torch.load(voice_path, map_location="cpu", weights_only=True)

text = "Hallo, hier spricht Thorsten."
audio_chunks = [audio for _, _, audio in pipeline(text, voice=voice, speed=1.0)]
combined = np.concatenate(audio_chunks)

sf.write("output.wav", combined, 24000)

A ready-to-run version of this snippet is included as inference.py:

# Default checkpoint (epoch 5)
python inference.py "Hallo, hier spricht Thorsten." output.wav

# Any other epoch (1-10) - e.g. epoch 10, faster/tighter delivery
python inference.py "Hallo, hier spricht Thorsten." output.wav ep10
python inference.py "Hallo, hier spricht Thorsten." output.wav ep3

Audio samples

Sample outputs from the default (epoch 5) checkpoint, covering German pronunciation edge cases (umlauts, ich/ach-laut, eszett, consonant clusters, numbers, prosody) and technical/loanword pronunciation overrides:

All 14 samples are available under test_audio_epoch5/.

Training details

• Base model: Kokoro-82M (English), architecture unchanged
• Dataset: Thorsten-Voice (12,283 training sentences after cleaning/filtering)
• Training recipe: kikiri-tts, a patched StyleTTS2 fine-tuning pipeline for Kokoro
• Stage 1 (acoustic/alignment): 10 epochs
• Stage 2 (adversarial/prosody, with GAN + WavLM discriminator): 10 epochs

Stage 2 checkpoint comparison

Validation loss stayed essentially flat across the second half of Stage 2 training, with epoch 5 and epoch 10 tied for the lowest value. Epoch 10 has a slightly lower F0 (pitch) loss, suggesting more refined prosody after additional adversarial fine-tuning — but in informal listening comparisons, epoch 5 was judged more natural, with a slightly slower, less "clipped" speaking pace. The metrics alone did not predict this; it only became apparent by listening to both checkpoints on identical sentences.

All 10 Stage 2 checkpoints are included in this repository, already converted to Kokoro's inference format and ready to use via inference.py (see Usage above) — no separate conversion step needed.

Only epochs 5 and 10 were carefully compared by ear; the others are pro