Model reference · open weights

embeddinggemma-qat-q8_0-unquantized

Embeddings google Embeddings 1 build Open, with conditions 2k dl/mo

embeddinggemma-qat-q8_0-unquantized is an open-weight embedding model from Google. embeddinggemma-300m-qat-q8_0-unquantized (FP32) weighs 606 MB; the smallest configuration that runs it is RTX 3060 12 GB.

  • EmbeddingGemma is a 303M parameter open embedding model developed by Google for sentence-similarity tasks.
  • It generates vector representations of text to support search, retrieval, classification, and clustering applications.
  • The model supports a maximum input context length of 2048 tokens and was trained on data in over 100 spoken languages.
  • It is distributed under the gemma license.

Summary of the google/embeddinggemma-300m-qat-q8_0-unquantized model card, 2026-10-01

What it is

Released byGoogle
Released2025-08-27
Parameters303M
VRAM606 MB for the weights

What it runs on

Memory and cards for embeddinggemma-300m-qat-q8_0-unquantized (FP32)

606 MBweights, file size
1.1 GBruntime overhead
CardRunsMemory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

How it works

How embedding models work

Your textsentence / documentEncodermaps meaningVectorlist of numbersAn embedding model turns text into a vector, so similar meanings sit close together, which is the basis of search and RAG.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms