Model reference · open weights
LeVJEPA-VideoMix-Large is an open-weight embedding model from galilai-group. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | galilai-group |
|---|---|
| Type | Embedding models |
| Task | Image embed |
| Parameters (lead) | 303M |
| Runs with | transformers |
| Released | 2026-08-27 |
| Popularity | 915 downloads / month |
| Licence | Commercial licence needed |
About
A ViT-L/16 video encoder trained with LeV-JEPA, a self-supervised objective combining a multi-crop prediction loss with SIGReg. No labels are used at any point.
import torch
from transformers import AutoModel
model = AutoModel.from_pretrained(
"galilai-group/LeVJEPA-VideoMix-Large", trust_remote_code=True
).eval()
# (B, C, T, H, W), ImageNet-normalised
video = torch.randn(1, 3, 16, 224, 224)
with torch.no_grad():
out = model(pixel_values=video)
out.last_hidden_state # (1, 3137, 1024) -- CLS + 16*14*14 patch tokens
out["pooler_output"] # (1, 1024) -- the CLS token
trust_remote_code=True is required: this is a custom architecture (RoPE +
block-causal attention) rather than a stock transformers model, so the modeling
code ships with the weights.
Normalise with the ImageNet statistics used in training —
mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225] — and resize/crop to 224.
Frames are sampled at roughly 7.5 fps in training, so a 16-frame clip covers about
two seconds.
For a single image, repeat it along the temporal axis:
image = torch.randn(1, 3, 224, 224)
video = image.unsqueeze(2).repeat(1, 1, 16, 1, 1)
The weights were trained with block-causal attention: bidirectional within a
temporal slot, causal across slots, with CLS as a read-only sink that sees the whole
clip while no patch attends to it. config.attn_mode defaults to "block_causal"
for this reason.
Running these weights under full attention will not raise an error — it will quietly return worse features. Leave
attn_modealone unless you know why you are changing it. An explicit attention mask also disqualifies SDPA's flash kernel, so expect higher memory than a full-attention ViT-L at the same batch size.
The released tensors are the EMA copy of the encoder (decay=0.9999,
update_every=32), which is what we evaluate. There is no separate LR-decay artifact
to apply — the cosine leg is already baked into these weights.
| Objective | multi-crop prediction + SIGReg (weight 0.02) |
| Crops | 1 global + 10 local |
| Token drop | 95%, random, applied inside the encoder forward (training only) |
| Optimizer | AdamW, lr 4e-4 flat then 1-sqrt → 0, weight decay 0.04 |
| Batch | 3072 global |
| Precision | bf16-mixed |
Token dropping is a training-time regulariser and is inert under eval(), so the
released model returns all 3137 tokens.
Frozen feature extraction for video and image understanding — attentive or linear probing, retrieval, and as a backbone for downstream heads. It is a self-supervised encoder with no classification head.
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys levjepa-videomix-large for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (levjepa-videomix-large below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"levjepa-videomix-large","input":"text to embed"}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.