Model reference · open weights
bge-small-en is an open-weight embedding model from michaelfeil, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
This is the stable default model for infinity. More details about the infinity inference project please refer to the Github: Infinity. Usage for Embedding Model via infinity in Python To deploy files with the infinityemb pip package. Recommended is device="cuda", engine="torch" with flash attention on gpu, and device="cpu", engine="optimum" for onnx inference. CLI interface The same args Contact If you have any question or suggestion related to this project, feel free to open an issue or pull request. You also can email Michael Feil (infinity at michaelfeil.eu). Citation If you find this repository useful, please consider giving a star :star: and citation License Infinity is licensed under the MIT License.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | michaelfeil |
|---|---|
| Type | Embedding models |
| Parameters (lead) | 33M |
| Context | 512 tokens |
| Variants | 1 |
| Runs with | sentence-transformers |
| Released | 2024-03-12 |
| Popularity | 1.3M downloads / month |
| Likes | 3 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| bge-small-en-v1.5 | 33M | BF16 | ~0.1 GB | ✓ | Weights ↗ |
Using it via the API
Once AxForge deploys michaelfeil-bge-small-en for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (michaelfeil-bge-small-en below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/embeddings \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"michaelfeil-bge-small-en","input":"text to embed"}'
Details
Languages
Tags
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗
Explore