Dirk-Qwen3.8

About

What Dirk-Qwen3.8 is

Dirk is the Qwen3.8-27B that gets straight to the point. With our Sharp chat template, MTP, and vision baked in, the model answers lean and stays on-task out of the box. No template wrangling: download, point llama.cpp at it, go. If you want it to think deeper, set the effort level through chattemplatekwargs: Levels: low, medium, xhigh — high is accepted but is an alias for xhigh, not a step below it. Omit it for Dirk's lean default (medium). Turn thinking off entirely with "enablethinking": false. What it is - Base: Qwen/Qwen3.8-27B, a dense 27B vision-language model (vision preserved). - Quant: Unsloth's Dynamic 3.0 UD GGUF quants — their current generation, not an older ladder — which keep the model's MTP (nextn) head: runtimes with multi-token-prediction speculative decoding can use it for faster generation. - Template: the Sharp chat template (Qwen 3.8-aware) — froggeric's fixed Qwen template plus a terseness system prompt, and turning off the xhigh thinking default. IQ4XS carries v22.3.2, which adds an opt-out (chattemplatekwargs: {"terse": false}); the older tiers carry v22.3.1 and render identically unless you use that opt-out. It is byte-swapped into the GGUF metadata; the weights and the MTP tensors are untouched. The only thing Dirk changes versus the stock quant is the template. Same weights, asked better. Proven on Nail and Dagger Dirk is new, but the template is not. The identical terseness edit, measured on Dagger's base (ThinkingCap-27B, same weights, only the template swapped): Roughly: the same answers in a bit over half the words, with accuracy moving up. That is what Dirk inherits — and its own SWE-bench-Live and MMLU-Pro numbers, shown above, bear it out. Thinking effort Stock Qwen3.8-27B forces reasoningeffort=xhigh on every call — always-on maximum-effort reasoning. Dirk removes that default, so it runs at the model's native medium effort: in both the official and Unsloth templates, medium is the setting that injects no reasoning instruction (only xhigh and low add one), and Dirk simply leaves it there. So Dirk thinks at the baseline and answers terse, instead of being pushed to the ceiling on every request. Set reasoningeffort yourself (l

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

How it works

How language models work

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys dirk-qwen3-8 for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (dirk-qwen3-8 below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"dirk-qwen3-8","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Licence

Open weights

Sources

Weights & code

Explore

More language models