Model reference · open weights
Qwen3-Reranker is an open-weight embedding model from mlx-community, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
mlx-community/Qwen3-Reranker-0.6B-4bit This model was converted to MLX format from Qwen/Qwen3-Reranker-0.6B using mlx-lm 0.31.3. - Quantization: affine 4-bit, groupsize=64 (~4.5 bits/weight) - On-disk size: ~331 MB - Task: text reranking (cross-encoder, yes/no relevance scoring) Scoring recipe Qwen3-Reranker is a causal LM used as a reranker: the relevance score of a (query, document) pair is softmax([logit("no"), logit("yes")])[1] at the last position of the prompt below.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | mlx-community |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 93M |
| Context | 40k tokens |
| Variants | 1 |
| Runs with | mlx |
| Based on | Qwen/Qwen3-Reranker-0.6B |
| Released | 2026-06-06 |
| Popularity | 1k downloads / month |
| Likes | 2 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| Qwen3-Reranker-0.6B-4bit | 93M | BF16 | ~0.2 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys mlx-community-qwen3-reranker for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (mlx-community-qwen3-reranker below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"mlx-community-qwen3-reranker","input":"text to embed"}'
Details
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore