Qwen3.8 27B RTX 5090 quant bakeoff evidence¶
This directory contains the sanitized evidence bundle for the 2026-09-03 single-GPU RTX 5090 Qwen3.8 27B quantization and speculative-decoding bakeoff. Native benchmark artifacts are authoritative; the files here provide the campaign-level index.
Campaign boundary¶
- Campaign ID:
2026-09-03-qwen38-27b-rtx5090-quant-bakeoff - Capability: text LLM serving
- Repository revision:
aed0214e03d2fe0e8220e3249a12f90994fd89b5at campaign start; clean isolated worktree - Evidence labels:
functional,capacity,matched-performance,bounded-quality,compatibility-failure,exact-restoration - Decision labels:
challenger,no-promotion - Promotion boundary: benchmark evidence does not authorize a router or live-alias change
Common campaign artifacts¶
artifact-manifest.json- role ledger and explicit evidence gapssource-registry.json- dated source provenancesummary.json- bounded machine-readable decisionfriction-log.md- failures and operational frictionrestoration.json- starting state and final restoration proofconfiguration.json- sanitized starting identity and policy envelope
Workload and plan¶
run-plan.jsondeclares the candidate order, paired no-speculation/speculation controls, repetitions, context points, concurrency checks, gates, and ranking order.workload-manifest.jsondefines the deterministic smoke, timing, durable-context, and concurrency workloads.
Raw run evidence¶
- Every loaded arm has retained
*-preflight.json, warm/cold*-timing-4k-*.json, and*-capacity-*.jsonartifacts. - Gittensor and CometKim have repeated
*-quality.jsonartifacts. - The advertised Gittensor DSpark startup failure is retained in
gittensor-dspark-load-failure.json. - vLLM speculative acceptance counters are retained in the four
*-runtime-metrics.jsonfiles. - The invalid CometKim per-request thinking-control attempt remains labeled
*invalid-thinking-control.json; it is not included in performance claims.
Decision and publication¶
The Gittensor target-only SGLang arm won the primary TTFT metric at 50.9 ms warm median while passing repeated bounded checks and a 244,002-token actual- prompt request. CometKim MTP3 won decode at 228.0 tok/s but failed strict tools 0/3. The exact Unsloth incumbent was restored. See the decision summary, publication summary, and dated finding.