Model reference · open weights
all-MiniLM-L6 is an open-weight embedding model from Xenova, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2 with ONNX weights to be compatible with Transformers.js. Usage (Transformers.js) If you haven't already, you can install the Transformers.js JavaScript library from NPM using: You can then use the model to compute embeddings like this: You can convert this Tensor to a nested JavaScript array using .tolist(): Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | Xenova |
|---|---|
| Type | Embedding models |
| Context | 512 tokens |
| Variants | 1 |
| Runs with | transformers.js |
| Based on | sentence-transformers/all-MiniLM-L6-v2 |
| Released | 2023-05-02 |
| Popularity | 2.6M downloads / month |
| Likes | 143 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| all-MiniLM-L6-v2 | — | BF16 | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys xenova-all-minilm-l6 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (xenova-all-minilm-l6 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"xenova-all-minilm-l6","input":"text to embed"}'
Details
Tags
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore