Skip to content

Qwen3.8 RTX 5090 quant bakeoff friction log

Time Category Command or stage Observation Workaround Durable follow-up
2026-09-03T18:37:23Z repeated-command control-plane discovery Repository-specific controller tools were not exposed in this session. Use the checkout-pinned local CLI for managed recipe lifecycle and retain exact envelopes. Revisit controller tool availability independently of model qualification.
2026-09-03T18:51:29Z unsafe-default Gittensor SGLang no-speculation startup at 320,960 SGLang refused a context above the checkpoint-derived 262,144-token native limit unless SGLANG_ALLOW_OVERWRITE_LONGER_CONTEXT_LEN=1 was set. The publisher's 320,960 figure describes maximum KV capacity, not a safe native model contract. Retain the failed startup and set the managed recipe to 262,144; measure spare KV independently. Keep model context and engine KV-pool capacity as separate fields in comparison docs.
2026-09-03T18:58:09Z compatibility Gittensor SGLang DSpark startup at advertised 165,169 tokens The exact pinned target and drafter loaded and allocated 142,219 KV tokens each, but draft CUDA-graph capture failed with mat1 and mat2 shapes cannot be multiplied (14x5120 and 2560x248320). Reject this exact target/drafter/SGLang v0.5.18 lane without a lower-memory retry; the failure is a hidden-width incompatibility, not OOM. Revisit only with a publisher-confirmed mutually compatible target, drafter, and runtime revision.
2026-09-03T19:47:00Z harness-control cometkim NInfer no-speculation preflight The recipe disables thinking globally at launch, while the first harness attempt also sent chat_template_kwargs.enable_thinking=false; NInfer correctly rejected the unsupported per-request option with HTTP 400. The accidentally continued timing calls failed identically and are retained as invalid-control artifacts. Declare thinking_mode=unsupported to the harness so it sends no per-request template option; retain launch-level --no-thinking as the effective control. Add endpoint capability discovery so a failed preflight cannot be followed by timing in the same shell sequence.
2026-09-03T20:30:00Z quality cometkim NInfer MTP3 bounded tool suite Coding and triage checks passed 3/3, but every strict tool call omitted the required string zip argument. Reject this arm as the general-purpose winner despite its 228.0 tok/s warm decode lead. Revisit only with a parser/template change treated as a new configuration and rerun the complete gate.
2026-09-03T20:45:00Z quality-risk Gittensor SGLang FP8 KV startup The runtime reported no calibrated FP8 KV scales and used 1.0 defaults. Functional and bounded quality checks passed, but broad fidelity equivalence is not established. Keep the target-only lane as a measured TTFT challenger, not a promotion candidate. Calibrate or validate FP8 KV scales and repeat broader quality/SWE gates.
2026-09-03T21:30:00Z restoration campaign teardown All challenger recipes were unloaded and the exact starting Unsloth revision and llama.cpp image were restored. Fresh smoke, JSON, and 20/20 shared-prefix tools passed. None. Keep promotion and routing changes behind the separate human gate.

The campaign is complete; later follow-ups should append new dated rows rather than rewriting these observations.