Block a user
Serve Qwen3.8-27B
Runbook change: do NOT unpin Qwen3.6-27B
The issue body says the cold-swap requires removing pinned_on = ["beast"] from the 27B. That is no longer true, and doing it would now be wrong.
Bran…
grenade
created branch feat/residency-priority-displacement in helexa/helexa
2026-08-11 08:39:58 +00:00
Serve Qwen3.8-27B
The MoE branch of the decision tree
Qwen3.8-Max is a sparse MoE (2.4T/95B active), so the 27B may be too. Triaging Qwen/Qwen3-30B-A3B to exercise that path surfaces a case worth knowing…
Serve Qwen3.8-27B
Correction: beast serves the 27B at q6k, not bf16
The VRAM framing in the issue body used the bf16 checkpoint size. beast's default_models entry is actually:
model_id = "Qwen/Qwen3.6…