Model reference · open weights

real-nepali-kala

Available as managed deployment Audio ampixa Text→speech 1 variants 2k dl/mo

real-nepali-kala is an open-weight audio or speech model from ampixa. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.

Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.

What it is

Released byampixa
TypeAudio & music
TaskText→speech
Runs withkala-tts
Released2026-05-04
Popularity2k downloads / month
LicenceOpen weights

About

What real-nepali-kala is

The first open-source Nepali TTS model built on a hand-crafted G2P — no eSpeak.

Kala is a multi-speaker VITS model trained with the real_nepali G2P frontend: a rule-and-lexicon system grounded in Khatiwada 2009 and tuned to mainstream Kathmandu Nepali phonology. The ONNX model runs on CPU in real time (RTF ≈ 0.02 — 50× faster than real time on a laptop).


Read the full model card

Why a new G2P?

eSpeak-ng's ne voice was designed for phoneme coverage, not phonological accuracy. It maps Nepali affricates to alveolar labels (ts, tsh) that do not match how Kathmandu speakers produce च and छ. It silently loses gemination and does not handle Latin code-switching at all.

The real_nepali frontend:

FeatureeSpeak nereal_nepali
च / छts / tsh (alveolar)ch / chh (palatal)
Geminationoften lostexplicit : tokens
Schwa deletionheuristicrule-based, audited
Latin code-switchundefinedletter-by-letter or override lexicon
Phone inventory~3548 phones + geminated variants
Lexiconnone48 000-entry curated lexicon

On the NepTTS-Bench minimal-pairs test (365 sentences), the frontend reaches 99.5 % minimal-pair contrast preservation against the reference IPA transcriptions.


Available speakers

SpeakerIDData typeTraining hours
kala2human studio0.37 h
barsha1human recording1.62 h
slr143_F3corpus (OpenSLR-143)1.01 h
slr43_05464corpus (OpenSLR-43)0.62 h
slr43_20995corpus (OpenSLR-43)0.51 h

Recommended speaker: kala for demo and production use. The corpus speakers (slr143_F, slr43_*) have good prosody but recording conditions vary; barsha is the second-best human voice.


Quick start (Python)

pip install kala-tts
import kala_tts

# Returns WAV bytes (16-bit PCM, 22050 Hz mono)
wav = kala_tts.synthesize("नमस्कार, कसरी हुनुहुन्छ?", speaker="kala")

# Write directly to a file
kala_tts.synthesize_to_file(
    "नेपाल सुन्दर देश हो।",
    "output.wav",
    speaker="kala",
)

# List available speakers
print(kala_tts.list_speakers())
# ('kala', 'barsha', 'slr143_F', 'slr43_0546', 'slr43_2099')
# CLI
kala-tts "नमस्कार, कसरी हुनुहुन्छ?" --speaker kala -o out.wav
kala-tts --list-speakers

The first call downloads the ONNX model (~60 MB) from this repo and caches it locally via huggingface_hub.


Manual inference (no pip)

Download the ONNX and config files from this repo, then:

git clone https://github.com/Ampixa/nepa-newa-text-frontend
cd nepa-newa-text-frontend
pip install onnxruntime huggingface_hub numpy
python -m kala_tts "नमस्कार" -o out.wav

Or use piper directly:

pip install piper-tts
echo "नमस्कार, कसरी हुनुहुन्छ?" | \
  piper --model real_nepali_v02_kala.fp32.onnx --speaker_id 2 --output_file out.wav

ONNX model details

PropertyValue
Filereal_nepali_v02_kala.fp32.onnx
FormatFP32 ONNX (VITS encoder + decoder fused)
Sample rate22050 Hz
Inputsinput (int64 phone IDs), input_lengths, scales, sid
Speakers6 (use sid to select)
RTF on laptop CPU~0.02 (50× real-time)

Training details

ItemValue
Base checkpointpiper-plus multilingual (302 MB)
ArchitectureVITS + monotonic attention
Total training rows4 338
Total training hours8.61 h
Training epochs1 000
Frameworkpiper-plus (patched for Nepali)
HardwareNVIDIA L40S 46 GB

Checkpoint SHA-256:

2b36b27f42e8549658676f953704573a31e2155fc95ec5d6407561e9fc4797fa

Training data

SpeakerSourceRowsHoursLicense
algenibGemini-Flash synthetic (excluded from v0.2 public release)1 9844.47 hinternal
barshaHuman recital8081.62 hCC-BY-SA-4.0
kalaHuman studio2000.37 hCC-BY-SA-4.0
slr143_FOpenSLR-1435661.01 hCC-BY-SA-4.0
slr43_0546OpenSLR-435050.62 hCC-BY-SA-4.0
slr43_2099OpenSLR-432750.51 hCC-BY-SA-4.0

Known limitations

  • Naturalness gap: Trained on only 200 utterances for the Kala voice; prosody can be flat on long sentences.
  • Punctuation awareness: Periods, commas, and question marks are handled via deterministic pause insertion — the model does not learn intonation contours from punctuation tokens.
  • OOV words: Unknown Devanagari words fall back to letter-by-letter rules. The 48 000-entry lexicon covers ~95% of common vocabulary.
  • Numbers: Digits are read in Nepali word order; mixed Nepali/English numerals may produce unexpected output.

Citation

@misc{ampixa2026kala,
  title  = {Kala: CPU-native Nepali Text-to-Speech with a hand-crafted G2P},
  author = {Ampixa},
  year   = {2026},
  url    = {https://huggingface.co/ampixa/real-nepali-v0.2-kala},
}

Phonological foundation: Khatiwada (2009), Nepali, Journal of the International Phonetic Association, 39(3), 373–380.


License

Model weights and code: CC-BY-SA 4.0 Training corpus (OpenSLR-143, OpenSLR-43): CC-BY-SA 4.0 G2P lexicon seed (google/language-resources ne/): CC-BY 4.0

From the published model card. Full card on the HuggingFace links in the sidebar.

How it works

How audio & music work

Audio or textinputAudio modelrecognise / synthesiseText or audiooutputSpeech-to-text turns audio into text; text-to-speech and music models turn text into audio.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys real-nepali-kala for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (real-nepali-kala below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="real-nepali-kala" -F file=@audio.mp3

Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms