TheDrummer_Artemis

About

What TheDrummer_Artemis is

Llamacpp imatrix Quantizations of Artemis-31B-v1.1 by TheDrummer Using <a href="https://github.com/ggml-org/llama.cpp/"llama.cpp</a release <a href="https://github.com/ggml-org/llama.cpp/releases/tag/b10262"b10262</a for quantization. Original model: https://huggingface.co/TheDrummer/Artemis-31B-v1.1 Model details: - Parameter count: 31B - Input support: text, image and audio (with mmproj file) - details - MTP: no - imatrix: yes - details How to run Prompt format Don't know which to choose? Grab Q4KM (19.60GB) - usually a good mix of size and performance. Download instructions available here Available files: Download a specific file: Downloading using the Hugging Face CLI First, make sure you have the Hugging Face CLI installed: Download a specific file: The files marked true in the Split column above are stored as multiple parts in a folder. To download all the parts to a local folder, run: You can either specify a new local-dir (TheDrummerArtemis-31B-v1.1-bf16) or download them all in place (./) How to run These quants run with llama.cpp - installable in one line via llama.app: llama-server includes a built-in chat web UI, served at http://localhost:8080 by default. These quants were made with llama.cpp release b10262 - if this model's architecture is newly supported, you'll need that release or newer to run them. They also work in: LM Studio · koboldcpp · ramalama · Jan AI · Text Generation Web UI · LoLLMs · Atomic Chat Multimodal This model supports image and audio input. Alongside the quants, this repo includes the multimodal projector files mmproj-TheDrummerArtemis-31B-v1.1-f16.gguf and mmproj-TheDrummerArtemis-31B-v1.1-bf16.gguf, which pair with any quant above. llama.cpp downloads the mmproj automatically when using -hf as shown above; if you're loading files manually, pass it with --mmproj. imatrix All quants made using imatrix option with dataset from here. The imatrix is available here: TheDrummerArtemis-31B-v1.1-imatrix.gguf. Embed/output weights Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings and output weights quantized to Q80 instead of what they would normally default to. ARM/AVX information llama.c

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys thedrummer-artemis for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (thedrummer-artemis below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"thedrummer-artemis","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Licence

Commercial licence needed

Sources

Weights & code

Explore

More language models