webbrain-compass-tiny

What improved

Only the ONNX graph's 211 MatMulNBits accuracy_level attributes changed from 4 to 2, disabling the dynamic INT8-activation path used in the pinned WebGPU runtime. Quantized weight shards, tokenizer, config and vendored runtime remain byte-identical to v23.

Generation smoke (8 cases), bounded 16,384-total-token context/cache checks, and a cold-browser restart with model downloads disabled passed. All three cold-cache native tool-call outputs were unchanged. Numerical tests cover three prompts, prefill plus three cached steps each, with identical token prefixes. They establish runtime parity in those probes—not BF16 equivalence, universal numerical accuracy, or a percentage loss in task accuracy. INT4 quality loss remains a separate issue; a Turkish smoke response remained awkward despite passing structural checks.

Fixed next-response routing results

This is not end-to-end browser-agent task success or an Online-Mind2Web result. One run: 100 first-turn cases, 89 scored scenarios and 11 predetermined skips; 194 raw responses including 5 smoke requests were retained locally. The 193 pinned input files match the BF16 reference, but precision, runtime and JS/Torch random generators differ. No output repair, model helper, fallback or result-based retry.

The full predeclared behavioral gate failed: 3 explicitly discouraged actions versus a limit of 1. These were retrying an access-blocked URL, continuing a listing before reporting available results, and inventing a pagination URL. Other declared gates passed, with zero transport errors, zero native-decoder parser errors and zero length-limited responses. The owner authorized this separate release with these findings disclosed; it is not certified for unattended consequential actions.

Exact package

• GPTQ asymmetric INT4 weights, group size 32; FP16 scales/activations/KV cache.
• Default graph: onnx/model_q4f16.onnx. Both external data files are required: model_q4f16.onnx_data and model_q4f16.onnx_data_1 (1,868,992,512 bytes combined).
• The inherited BF16 dtype and 131072 architecture field in config.json do not describe this quantized graph or establish a tested browser context limit.
• Exact tested runtime under runtime/: Transformers.js 4.2.0, ONNX Runtime Web 1.27.0, WebBrain worker/parser and dependency licences. Tested with Chrome 150.0.7871.187, NVIDIA RTX 5090. Other devices/runtimes are not verified here.
• Generation-only, last-token logits; thinking disabled. No cloud or visual model.
• Tests used a local model transport alias; this repository name is the release identifier. All 39 tested model/runtime files are mapped and hashed in provenance.
• validation/ contains results and compact audit summaries. Complete original local audit hashes are recorded; private training/calibration data, browser profiles, credentials and raw benchmark requests are not included.

Integration

1. Download the pinned commit returned with the release, using an HF account with private-repository access:

   hf download webbrain-one/webbrain-compass-tiny-v2.1 --revision  --local-dir ./compass-tiny-v2.1
   

   Keep onnx/, tokenizer/config files and both external shards together. Never embed a personal/write token in an extension, webpage, source file or log. Use a trusted authenticated asset proxy or a private local mirror pinned to that same commit. Anonymous HF downloads cannot access this private release.

2. In WebBrain, choose the custom model ID webbrain-one/webbrain-compass-tiny-v2.1, device webgpu, dtype q4f16, default filename stem model. Use the supplied runtime assets. The unchanged worker has no revision option: pin the asset proxy, or explicitly pass revision at pipeline initialization in your integration. The new model ID has a separate cache key; do not alias it onto v23's cached graph.

   Equivalent library initialization, with executable runtime assets served locally:

   import { env, pipeline } from './runtime/vendor/transformers.web.js';
   import { parseMiniCpmToolCalls } from './integration/minicpm5-tool-parser.mjs';
   
   env.backends.onnx.wasm.numThreads = 1;
   env.backends.onnx.wasm.wasmPaths = {
     mjs: new URL('./runtime/vendor/ort-wasm-simd-threaded.asyncify.mjs', import.meta.url).href,
     wasm: new URL('./runtime/vendor/ort-wasm-simd-threaded.asyncify.wasm', import.meta.url).href,
   };
   // Configure your trusted authenticated asset proxy before accessing this private repo.
   const generator = await pipeline('text-generation',
     'webbrain-one/webbrain-compass-tiny-v2.1', {
       revision: '', device: 'webgpu', dtype: 'q4f16',
       session_options: { extra: {
         'ep.webgpuexecutionprovider.storageBufferCacheMode': 'simple',
       } },
     });
   try {
     const result = await generator(messages, {
       tools, do_sample: false, max_new_tokens: 256,
       tokenizer_encode_kwargs: { enable_thinking: false },
     });
     const generated = result[0].generated_text;
     c