Model reference · open weights
theia-tiny-patch16-224-cddsv is an open-weight embedding model from theaiinstitute. AxForge deploys and operates it for you on dedicated EU-owned hardware — with the licence handled where one is required.
Available as managed deployment — configured and operated for you on dedicated EU hardware, quoted per deployment.
What it is
| Released by | theaiinstitute |
|---|---|
| Type | Embedding models |
| Task | Embeddings |
| Parameters (lead) | 16M |
| Runs with | transformers |
| Released | 2024-07-29 |
| Popularity | 3k downloads / month |
| Licence | Commercial licence needed |
About
Theia is a vision foundation model for robot learning that distills multiple off-the-shelf vision foundation models trained on varied vision tasks. Theia’s rich visual representations encode diverse visual knowledge, enhancing downstream robot learning. It was introduced in the paper Theia: Distilling Diverse Vision Foundation Models for Robot Learning, which also includes experiments demonstrating that Theia outperforms its teacher models and prior robot learning models using less training data and smaller model sizes. Demo videos can be found on the project page.
The theia-tiny-patch16-224-cddsv model, uses DeiT-Tiny as a backbone, and simulatenously distills CLIP, Depth Anything, DINOv2, Segment Anything and ViT. For more information on usage, please visit the Theia repository.
If you use Theia in your research, please use the following BibTeX entry:
@article{shang2024theia,
author = {Shang, Jinghuan and Schmeckpeper, Karl and May, Brandon B. and Minniti, Maria Vittoria and Kelestemur, Tarik and Watkins, David and Herlant, Laura},
title = {Theia: Distilling Diverse Vision Foundation Models for Robot Learning},
journal = {arXiv},
year = {2024},
}
The pre-trained model weights and code released with Theia are available for use under The AI Institute License, reproduced in full below:
Copyright (c) 2024 Boston Dynamics AI Institute LLC
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions are met:
1. Redistributions of source code must retain the copyright notice included
with the software, this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the copyright notice, this
list of conditions and the following disclaimer in the documentation and/or
other materials provided with the distribution.
3. Modified versions of the software must be conspicuously marked as such.
4. The software may only be used for non-commercial research purposes.
For profit enterprises may use the software, subject to this limitation.
THIS SOFTWARE IS PROVIDED BY THE AI INSTITUTE AND CONTRIBUTORS "AS IS" AND
ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, NON-
INFRINGEMENT,TITLE, MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE AI INSTITUTE OR CONTRIBUTORS BE LIABLE FOR
ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, PUNITIVE OR CONSEQUENTIAL
DAMAGES (INCLUDING, BUT NOT LIMITED TO, DAMAGES ARISING OUT OF CLAIMS OF
INTELLECTUAL PROPERTY RIGHTS INFRINGEMENT; PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
From the published model card. Full card on the HuggingFace links in the sidebar.
Using it via the API
Once AxForge deploys theia-tiny-patch16-224-cddsv for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (theia-tiny-patch16-224-cddsv below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"theia-tiny-patch16-224-cddsv","input":"text to embed"}'
Create an account — your API key is available in the console. 3M free tokens every 30 days with every new account.