Model reference · open weights
deepseek is an open-weight language model from antirez, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.
About
DeepSeek V4 Flash — GGUF for ds4 This quants are specific for the DS4 inference engine. They may work with other inference engines or not (they should, but not the MTP model which requires a specific loader). https://github.com/antirez/ds4 Files Use q2 on 128 GB Mac machines, q4 on machines with ≥ 256 GB RAM, pair either with MTP for optional speculative decoding. Quantization recipe The filename is the spec. In detail, for the q2 file: For the q4 file, only the three routed-expert classes change to Q4K. Everything else is byte-for-byte identical to the q2 recipe. The motivation behind the asymmetry: the routed experts are the majority of the parameter count but each individual expert handles only a fraction of tokens, so aggressive quantization on them costs less in average quality than the same treatment of router, projections, or shared experts. Keeping the decision-making components at Q80 preserves model behavior; crushing the experts buys the size. Usage The downloadmodel.sh script fetches from this repository, resumes partial downloads, and points ./ds4flash.gguf at the selected variant. License MIT. The base model copyright is held by DeepSeek; the GGUFs are redistributed under the base model's release terms.
Summarised from the published model card. Read the full card on the HuggingFace links below.
Specifications
| Maker | antirez |
|---|---|
| Type | Language models |
| Variants | 1 |
| Runs with | gguf |
| Based on | deepseek-ai/DeepSeek-V4-Flash |
| Released | 2026-04-26 |
| Popularity | 2.1M downloads / month |
| Likes | 465 |
| Licence | Open weights |
How it works
Variants
Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.
| Variant | Params | Precision | VRAM | Fits 16 GB | Weights |
|---|---|---|---|---|---|
| deepseek-v4-gguf | — | GGUF | — | — | Weights ↗ |
Using it via the API
Once AxForge deploys deepseek for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (deepseek below is illustrative; you get the exact model name on deployment.)
$ curl -sS https://api.axforge.ai/v1/chat/completions \
-H "Authorization: Bearer $AXFORGE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"deepseek","messages":[{"role":"user","content":"Hello"}]}'
Details
Languages
Tags
Licence
Open weights under mit — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗