Model reference · open weights
tips-so400m14 is an open-weight embedding model from google, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
TIPSv2 — SO400m/14 TIPSv2 (Text-Image Pre-training with Spatial awareness) is a family of contrastive vision-language models that produce spatially rich image features aligned with text embeddings. This is the SO400m variant with 412M vision params and 448M text params. Try the code snippets below or check out the GitHub repo for more use cases and visualizations, including zero-shot segmentation. Usage Load the model Encode images Images should be tensors in [0, 1] range (just ToTensor(), no ImageNet normalization). Encode text Zero-shot classification Visualize spatial features GPU inference Model details - Architecture: ViT vision encoder (27 layers) + Transformer text encoder (27 layers) - Image preprocessing: resize to any resolution, convert to [0, 1] (no ImageNet normalization) - Text preprocessing: SentencePiece tokenizer, lowercased, max 64 tokens - Patch size: 14x14 pixels License Apache 2.0 Citation
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 862M |
| Variants | 1 |
| Runs with | transformers |
| Released | 2026-04-09 |
| Popularity | 267k downloads / month |
| Likes | 18 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| tipsv2-so400m14 | 862M | BF16 | ~2 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys tips-so400m14 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (tips-so400m14 below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"tips-so400m14","input":"text to embed"}'
Licence
Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore