Skip to content

Diagnostic wave coverage and limits

This common ledger was consolidated during closure. The research plan, counter-arm plan, request fixtures, phase order and hashes were retained before their respective requests; this is not a retrospectively frozen serving comparison.

Request Status Evidence / limit
Research general serving stacks and vLLM/SGLang Complete research-and-plan.md and pinned source registry; analogies, not imported speed claims.
Refine and execute reverse/forward cache experiment Complete after final analyzer gate Two images, fresh forward/reverse pairs, exact bodies and per-request counters.
Identify internal bottleneck Measured structural constraint Counter-only image observes independent state-row pressure and page availability. Not an end-to-end speedup.
Add instrumentation and debugging Complete locally Ten host-pool metrics, CPU reproducer, 37 applicable tests, pinned managed build. Disk io_uring runtime tests remain unqualified.
Repeat trace off/on Complete, causal conclusion blocked Three C1 and three C4 pairs; all 15 request pairs differ in generated token sequence. Equal length/seed does not establish equal work.
Preserve monitoring across swaps Live verified locally Generation-specific Prometheus discovery; ten new series for each counter incarnation. Existing dashboard verification repeated after restoration.
Trace exact kernel limiter Not collected No new Nsight critical-path or hardware-counter capture. Scheduler samples are overlapping rank intervals.
Improve allocator or eviction policy Next experiment No policy change tested. Fixed-byte row/page repartition and protected workloads must precede gain claims.
Prove parity with incumbent Not measured in this wave Different checkpoints/stacks; no new matched incumbent performance matrix or semantic-quality qualification.
Reusable skill/plugin Skill refined Existing kernel-tuning skill covers pool counters, decoded-work matching and retained rollback. No new plugin needed.
Retain reports and easy conversion Retained Pinned source, recipe, patch/build, corpus, responses, counters, restoration, derived summary and bounded next test. No promotion or upstream submission.

All natural-output cache successes mean visible transport completion, not semantic correctness. Cache C1 means serial HTTP requests, while the serve permits C4. Host cache is configured 32 GiB; reported resident bytes and row/page capacities are separate measurements. Both GPUs retain 300 W limits.