Model reference · open weights

WeMM-Embedding

WeMM-Embedding is an open-weight embedding model from tencent, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

NEW · released this week Licence fee required Embeddings tencent 3 variants 4k downloads/mo
Request a licence + hosting quote All served models Not on the shared API today — deployed on request.

About

What WeMM-Embedding is

WeMM-Embedding-2B [](https://huggingface.co/collections/tencent/wemm-embedding) [](https://arxiv.org/abs/2608.24053) [](https://github.com/Tencent/WeMM-Embedding) WeMM-Embedding-2B is a universal multimodal embedding model built on Qwen3.5. It accepts text, images, videos, visual documents, and interleaved multimodal inputs, and returns a 2,048-dimensional L2-normalized embedding. Audio input is not supported. Installation Transformers Use any subset of the content items to encode text, image, or video independently. Sentence Transformers Each input is a string, a URL or path, a PIL.Image, or a dict combining image, video, and text keys. Put image or video before text so the prompt matches the ordering used above. Chat messages such as {"role": "user", "content": [{"type": "image", "image": ...}, {"type": "text", "text": ...}]} are also accepted, which is the way to interleave several images or videos in one input. Matryoshka Embeddings With Sentence Transformers, pass truncatedim and let it renormalize: Use a dimension listed in model.config.matryoshkadimensions. On MMEB-v2, 256-dimensional embeddings retain 98.7% of the full-dimensional image and video performance. Serving vLLM 0.27.0: SGLang 0.5.9: Evaluation MMEB-v2 Results on 78 datasets from Table 1 of the technical report. Image and video tasks use Hit@1, while visual-document tasks use NDCG@5. Higher is better. † Closed-source leaderboard submission without publicly released model weights or a public inference endpoint. MMEB-v3 Results on all 190 tasks from Table 2 of the technical report. V3-All includes the 78 MMEB-v2 tasks, 53 text tasks, 47 agent tasks, 11 audio tasks, and MCMR. Unsupported tasks are assigned a score of zero. Text results use NDCG@5; agent, MCMR, and audio results use Hit@1. Citation If you find this repository useful, please consider giving a star ⭐ and citation License WeMM-Embedding-2B, including the code, model parameters, and weights made publicly available by Tencent, is licensed under the Apache License 2.0. Third-party components remain subject to their respective original licenses.

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makertencent
TypeEmbedding models
Parameters (lead)2.7B
Variants3
Runs withtransformers
Based onQwen/Qwen3.5-2B
Released2026-08-25
Popularity4k downloads / month
Likes99
LicenceCommercial licence needed

How it works

How embedding models work

Your textsentence / documentEncodermaps meaningVectorlist of numbersAn embedding model turns text into a vector, so similar meanings sit close together — the basis of search and RAG.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
WeMM-Embedding-2B2.7BBF16~6.3 GBWeights ↗
WeMM-Embedding-9B9.4BBF16~21.6 GBWeights ↗
WeMM-Embedding-4B5.2BBF16~11.9 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys wemm-embedding for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (wemm-embedding below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/embeddings \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"wemm-embedding","input":"text to embed"}'

Details

Languages, data & research

Languages

zh en

Tags

transformers safetensors qwen3_5 image-text-to-text sentence-transformers multimodal-embedding text-embedding image-embedding video-embedding mrl feature-extraction custom_code zh en

Papers

Licence

Commercial licence needed

The weights are open but its licence needs a commercial agreement for business use. AxForge can arrange that licence and host the model for you — you pay AxForge, we settle with the model’s maker. Ask us for a quote. Read the licence ↗

Sources

Weights & code

Want WeMM-Embedding on EU-owned hardware?

Request a licence + hosting quote See what’s served now

Explore

More embedding models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms