You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
experiment: connect and profile Qwen3 RNGD ATOM serving #199
The validated Qwen3 RNGD prefill graph is only exercised by finite tensor fixtures, not the existing batched HTTP serving path. Its warm prefill latency remains roughly 719 ms without phase attribution.
Evidence
PR #198 validates Qwen3-0.6B host-mediated KV handoff and 3/3 output matches to ATOM. KV export currently follows all layers; there is no source overlap evidence.
Scope
Profile input, layer compute, host KV export and output head; connect the experimental Qwen3 worker to the existing subprocess/shared-memory and ATOM batched service interfaces. Validate bounded prompts, error handling, repeated HTTP requests and output parity on allocated hardware. Preserve model-family boundaries; no automatic production backend registration or DMA claim.
Done when
Reproducible measurements distinguish compute from transfer; actual HTTP requests exercise RNGD prefill and ATOM decode; supported capacity and remaining limitations are recorded.
Owner
Codex; maintainer review. Depends on #197 / #198 and the existing optimus-rm serving package.
Activity