Model reference · open weights

wav2vec2-xls-r-300m_phone-mfa_korean

Available as managed deployment Audio slplab · community Speech→text 1 variants 3k dl/mo

wav2vec2-xls-r-300m_phone-mfa_korean is an open-weight audio or speech model from slplab. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.

Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.

What it is

Released byslplab
TypeAudio & music
TaskSpeech→text
Runs withtransformers
Released2022-12-30
Popularity3k downloads / month
LicenceOpen weights

About

What wav2vec2-xls-r-300m_phone-mfa_korean is

This model is a fine-tuned version of facebook/wav2vec2-xls-r-300m on a phonetically balanced native Korean read-speech corpus.

Read the full model card

Training and Evaluation Data

Training Data

  • Data Name: Phonetically Balanced Native Korean Read-speech Corpus
  • Num. of Samples: 54,000 (540 speakers)
  • Audio Length: 108 Hours

Evaluation Data

  • Data Name: Phonetically Balanced Native Korean Read-speech Corpus
  • Num. of Samples: 6,000 (60 speakers)
  • Audio Length: 12 Hours

Training Hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • gradient_accumulation_steps: 2
  • total_train_batch_size: 16
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_ratio: 0.2
  • num_epochs: 20 (EarlyStopping: patience: 5 epochs max)
  • mixed_precision_training: Native AMP

Evaluation Results

  • Phone Error Rate 3.88%
  • Monophthong-wise Error Rates: (To be posted)

Output Examples

MFA-IPA Phoneset Tables

Vowels

Consonants

Experimental Results

Official implementation of the paper (ICPhS 2023) Major error patterns of L2 Korean speech from five different L1s: Chinese (ZH), Vietnamese (VI), Japanese (JP), Thai (TH), English (EN)

Framework versions

  • Transformers 4.21.3
  • Pytorch 1.12.1
  • Datasets 2.4.0
  • Tokenizers 0.12.1

From the published model card. Full card on the HuggingFace links in the sidebar.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys wav2vec2-xls-r-300m-phone-mfa-korean for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (wav2vec2-xls-r-300m-phone-mfa-korean below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="wav2vec2-xls-r-300m-phone-mfa-korean" -F file=@audio.mp3

Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms