Dedicated model · Available as managed deployment

all-MiniLM-L6-v2 embeddings in Europe: managed deployment

The sentence-transformers workhorse: a 23M-parameter embedding model producing 384-dimensional vectors, the most downloaded embedding model in the world, under Apache-2.0. Available as a managed deployment: validated on AxForge hardware and deployed on a DGX Spark for your traffic only, as an OpenAI-compatible endpoint on hardware only you use, hosted in the EU.

Available as managed deployment eu-es-1 · Málaga 512 ctx · Text → vector (embeddings) all-minilm-l6.axforge.ai
Request deployment Qwen3.8 27B, on the API now Hour, week, month or year. Hardware from €0.85/hour; managed service quoted per deployment.

Why all-MiniLM-L6-v2

What you get

The most used embedding modelHundreds of millions of downloads: the default in tutorials, vector databases and RAG starters everywhere.
Tiny and fast23M parameters and 384 dimensions: thousands of embeddings per second on a single machine, cheap to store and search.
Apache-2.0Permissive: commercial use, no licence conversation.

Specifications

The model

Modelall-MiniLM-L6-v2 by sentence-transformers
ModalitiesText → vector (embeddings)
Sizes23M
Context window512 tokens
Released2022-03
Popularity255.1M downloads / month on HuggingFace
LicenceOpen weights (Apache 2.0); commercial use permitted
AvailabilityAvailable as managed deployment, operated by AxForge on hardware reserved for you
HardwareNVIDIA DGX Spark (GB10, 128 GB unified memory), owned and operated by AxForge
RegionMálaga, Spain (eu-es-1)
PricingHardware from €0.85/hour, rental term: Hour, week, month or year. Managed service quoted per deployment. Request deployment and we confirm both in writing.

We publish only numbers we measure ourselves, and we haven't benchmarked this model on our nodes yet. For quality benchmarks, see the model card in the catalogue and the official card on HuggingFace.

Deployment

What "managed deployment" means

SystemA dedicated NVIDIA DGX Spark (GB10, 128 GB unified memory), reserved for you
Commercial modelHour, week, month or year. Hardware from €0.85/hour, managed service quoted per deployment
EndpointOpenAI-compatible /v1 on your own machine, only your traffic
LocationHosted in the EU: Málaga, Spain (eu-es-1)
Data handlingZero prompt retention, same policy as the serverless API

The model is validated on AxForge hardware and deployed on your system. After deployment, your endpoint speaks the OpenAI API with the model name you receive with the deployment.

Data & privacy

Zero prompt retention

Prompts and completions are processed in memory in the EU, not written to disk, not logged, not retained, and never used to train anything. We keep only request metadata (token counts, timestamps, status) for billing and operations. The full policy is at axforge.ai/privacy.

FAQ

all-MiniLM-L6-v2 hosting: common questions

Is all-MiniLM-L6-v2 on the AxForge serverless API?

Not on the serverless API. It is available as a managed deployment: validated on AxForge hardware and deployed on a DGX Spark for your traffic only. The serverless API serves Qwen3.8 27B.

When is all-MiniLM-L6-v2 the right choice?

English text, short passages and high volume where speed and cost matter more than the last few points of retrieval quality; for multilingual or long inputs look at BGE-M3 or Qwen3 Embedding.

Can I embed on the same machine as my LLM?

Yes, a dedicated DGX Spark runs a small embedding model next to an LLM behind one OpenAI-compatible endpoint.

How fast is all-MiniLM-L6-v2 on your hardware?

We publish only numbers we measure ourselves, and we haven't benchmarked this model on our nodes yet. For quality benchmarks, see the official model card.

What does a dedicated all-MiniLM-L6-v2 deployment look like?

A dedicated NVIDIA DGX Spark (GB10, 128 GB unified memory) rented by the hour, week, month or year, running all-MiniLM-L6-v2 behind an OpenAI-compatible endpoint on your own machine, hosted in the EU with zero prompt retention.

What does EU all-MiniLM-L6-v2 hosting cost?

Hardware from €0.85/hour, by the hour, week, month or year; the managed service is quoted per deployment. Request deployment and we confirm both in writing.

Ready to build on EU inference?

Request deployment Talk to an engineer

Explore

All models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms