Model reference · open weights

ai-light-dance_drums_ft_pretrain_wav2vec2

Name: ai-light-dance_drums_ft_pretrain_wav2vec2
Brand: AxForge

Available as managed deployment Audio gary109 · community Speech→text 1 variants 724 dl/mo

ai-light-dance_drums_ft_pretrain_wav2vec2 is an open-weight audio or speech model from gary109. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.

Request deployment All audio & music

Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.

What it is

Released by	gary109
Type	Audio & music
Task	Speech→text
Runs with	transformers
Released	2022-11-07
Popularity	724 downloads / month
Licence	Unknown

About

What ai-light-dance_drums_ft_pretrain_wav2vec2 is

This model is a fine-tuned version of gary109/ai-light-dance_drums_ft_pretrain_wav2vec2-base on the GARY109/AI_LIGHT_DANCE - ONSET-DRUMS dataset. It achieves the following results on the evaluation set:

Loss: 1.8991
Wer: 0.6046

Read the full model card

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0004
train_batch_size: 8
eval_batch_size: 8
seed: 42
gradient_accumulation_steps: 8
total_train_batch_size: 64
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 20
num_epochs: 200.0
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
No log	0.9	8	2.0434	0.6226
0.4739	1.9	16	2.1024	0.6247
0.4693	2.9	24	1.9824	0.6211
0.5139	3.9	32	2.2962	0.6429
0.5081	4.9	40	2.2201	0.6292
0.5081	5.9	48	2.1399	0.6208
0.5785	6.9	56	2.1451	0.6417
0.533	7.9	64	2.1184	0.6330
0.5141	8.9	72	2.0230	0.6342
0.4971	9.9	80	2.2137	0.6381
0.4971	10.9	88	2.1159	0.6253
0.5645	11.9	96	2.0966	0.6247
0.4932	12.9	104	1.9249	0.6223
0.4918	13.9	112	2.0445	0.6235
0.5053	14.9	120	2.1317	0.6304
0.5053	15.9	128	2.0723	0.6256
0.5565	16.9	136	2.1390	0.6402
0.4819	17.9	144	1.9556	0.6321
0.5131	18.9	152	1.9886	0.6333
0.4798	19.9	160	1.9700	0.6259
0.4798	20.9	168	1.9771	0.6295
0.5221	21.9	176	1.9880	0.6235
0.4862	22.9	184	2.0994	0.6298
0.4831	23.9	192	2.0521	0.6205
0.4952	24.9	200	1.9838	0.6064
0.4952	25.9	208	2.0319	0.6103
0.5119	26.9	216	2.0419	0.6160
0.4996	27.9	224	2.0073	0.6178
0.488	28.9	232	2.1740	0.6304
0.4978	29.9	240	2.2731	0.6163
0.4978	30.9	248	2.2420	0.6205
0.5259	31.9	256	2.0561	0.6184
0.47	32.9	264	1.9455	0.6136
0.5132	33.9	272	1.9307	0.6043
0.4972	34.9	280	2.0536	0.6127
0.4972	35.9	288	1.9113	0.6223
0.5147	36.9	296	1.9317	0.6286
0.4914	37.9	304	2.1810	0.6241
0.472	38.9	312	2.1403	0.6160
0.4825	39.9	320	2.1141	0.6094
0.4825	40.9	328	2.2870	0.6031
0.5138	41.9	336	2.1404	0.6181
0.48	42.9	344	2.0243	0.6265
0.4598	43.9	352	2.1117	0.6199
0.474	44.9	360	2.0378	0.6321
0.474	45.9	368	2.1919	0.6211
0.4933	46.9	376	2.3645	0.6109
0.4692	47.9	384	2.1920	0.6076
0.4716	48.9	392	2.3663	0.6034
0.4601	49.9	400	2.2838	0.6280
0.4601	50.9	408	2.0287	0.6148
0.4891	51.9	416	2.1346	0.6130
0.4506	52.9	424	2.1556	0.6181
0.4581	53.9	432	2.0560	0.6229
0.4485	54.9	440	1.9944	0.5971
0.4485	55.9	448	1.9791	0.6097
0.4942	56.9	456	2.1166	0.6070
0.4748	57.9	464	2.0271	0.6124
0.4229	58.9	472	2.0437	0.6229
0.45	59.9	480	2.1012	0.6142
0.45	60.9	488	1.9151	0.6049
0.4936	61.9	496	1.8991	0.6046
0.4602	62.9	504	1.9813	0.6112
0.4626	63.9	512	1.9372	0.6136
0.445	64.9	520	1.9060	0.6154
0.445	65.9	528	1.9574	0.6151
0.4907	66.9	536	2.0947	0.6022
0.4723	67.9	544	2.0061	0.6010
0.4103	68.9	552	1.9557	0.6094
0.4808	69.9	560	2.1042	0.6088
0.4808	70.9	568	2.1360	0.6073
0.4682	71.9	576	2.1290	0.6013
0.4472	72.9	584	1.9454	0.5989
0.4259	73.9	592	2.0937	0.6043
0.4464	74.9	600	2.0822	0.6058
0.4464	75.9	608	2.0128	0.6058
0.4775	76.9	616	1.9744	0.6094
0.4394	77.9	624	1.9992	0.6010
0.418	78.9	632	2.1693	0.5947
0.4384	79.9	640	2.1326	0.5923
0.4384	80.9	648	2.1151	0.5950
0.4971	81.9	656	2.1581	0.5923
0.4176	82.9	664

From the published model card. Full card on the HuggingFace links in the sidebar.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys ai-light-dance-drums-ft-pretrain-wav2vec2 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (ai-light-dance-drums-ft-pretrain-wav2vec2 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/audio/transcriptions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -F model="ai-light-dance-drums-ft-pretrain-wav2vec2" -F file=@audio.mp3

Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.

Get API access

Sizes, precisions & builds

ai-light-dance_drums_ft_pretrain_wav2vec2-base

— · BF16

Weights ↗

Details

Trained / evaluated on

ai_light_dance