Model reference · open weights

UI-Mate

UI-Mate is an open-weight language model from tencent, listed in the AxForge catalogue. AxForge can bring it up on EU-owned hardware for you on request — with the licence handled where one is required.

LLMs tencent 2 variants 723 downloads/mo
Request this model on EU hardware All served models Not on the shared API today — deployed on request.

About

What UI-Mate is

UI-Mate-9B UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations Show the workflow once. Let the agent adapt it to the task at hand. Tencent HY Frontier Project Page · GitHub · arXiv Overview UI-Mate-9B is an open-weight foundation GUI agent for long-horizon work across applications and operating systems. It observes live screenshots, reasons over the visible state, and produces structured keyboard and mouse actions for native desktop interaction. It executes a task from a natural-language instruction and live screenshots alone, planning from what is currently on screen and re-planning as the interface changes. Model Details - Parameters: 9B - Base model: Qwen3.5-9B - Input: task instruction, screenshots, and interaction history - Output: reasoning, a concise action description, and structured computer-use tool calls - Action space: mouse, keyboard, scrolling, waiting, user interaction, and task completion - Training: supervised fine-tuning followed by online reinforcement learning in executable GUI environments - License: Apache-2.0 UI-Mate is an agent checkpoint rather than a standalone visual-chat model. We recommend using the official prompt, response parser, and interaction harness from the UI-Mate repository. Highlights - Strong general computer-use performance at an efficient 9B scale. - Long-horizon execution across multiple applications. - Live-screen grounding instead of coordinate replay. - Structured actions compatible with pyautogui. - OpenAI-compatible serving and client interface. Evaluation See the project page for evaluation details and updates. Quick Start 1. Serve the model with vLLM vLLM automatically downloads the checkpoint from Hugging Face Hub on first launch. The default agent retains five screenshots in context. The server must therefore admit at least six images because the newest screenshot arrives before the oldest one is collapsed. Confirm that the endpoint exposes the expected model name: 2. Run the reference examples Run a complete recorded trajectory: Or provide your own screenshot: 3. Use the Python agent Intended Use and Limitations UI-Mate-9B is intended for research and development of screenshot-

Summarised from the published model card. Read the full card on the HuggingFace links below.

Specifications

What it is

Makertencent
TypeLanguage models
Parameters (lead)9.4B
Variants2
Runs withtransformers
Based onQwen/Qwen3.5-9B
Released2026-08-14
Popularity723 downloads / month
Likes85
LicenceOpen weights

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.

Variants

Sizes & precisions

Open weights ship in several sizes and precisions. One page, all the variants — pick the one that fits your GPU. VRAM figures are estimates from model size.

VariantParamsPrecisionVRAMFits 16 GBWeights
UI-Mate-9B9.4BBF16~21.6 GBWeights ↗
UI-Mate-27B27.4BBF16~62.9 GBWeights ↗

Using it via the API

Call it like any OpenAI endpoint

Once AxForge deploys ui-mate for you, it answers on the OpenAI-compatible API — the same base URL and keys as every other model. (ui-mate below is illustrative; you get the exact model name on deployment.)

$ curl -sS https://api.axforge.ai/v1/chat/completions \
  -H "Authorization: Bearer $AXFORGE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"ui-mate","messages":[{"role":"user","content":"Hello"}]}'

Details

Languages, data & research

Tags

transformers safetensors qwen3_5 image-text-to-text computer-use-agent gui-agent multimodal vision-language desktop-agent pyautogui osworld windowsagentarena conversational endpoints_compatible

Papers

Licence

Open weights

Open weights under apache-2.0 — commercial use is permitted. Deploy it on AxForge EU hardware on request. Read the licence ↗

Sources

Weights & code

Want UI-Mate on EU-owned hardware?

Request this model on EU hardware See what’s served now

Explore

More language models

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms