• Joined on 2026-02-17
grenade closed issue helexa/helexa#297 2026-08-27 09:25:45 +00:00
Document preserve_thinking for operators, and audit the ~31 other undocumented neuron toggles
grenade opened issue helexa/helexa#301 2026-08-27 09:25:42 +00:00
Fail CI when a new neuron config key has no mention in the operating docs
grenade commented on issue helexa/helexa#297 2026-08-27 09:25:22 +00:00
Document preserve_thinking for operators, and audit the ~31 other undocumented neuron toggles

Both halves done in 00acd283, merged.

Part 1 — preserve_thinking is written up in 03-neurons.md under a new Reasoning section: what it is (the model's own chat-template control,…

grenade closed issue helexa/helexa#291 2026-08-27 09:24:24 +00:00
beast reserves KV for eight tenants to serve one — max_in_flight is starving the single deep session it actually gets
grenade commented on issue helexa/helexa#291 2026-08-27 09:24:21 +00:00
beast reserves KV for eight tenants to serve one — max_in_flight is starving the single deep session it actually gets

Fixed in 43e873f8, deployed and verified (batch engine started max_slots=2 on beast). 00acd283 corrects the docs.

beast now runs max_in_flight = 2. Each slot gets ~59,000 tokens of…

grenade closed issue helexa/helexa#290 2026-08-27 09:24:13 +00:00
Reasoning effort: we invented a ladder the model rejects, never tell the model which rung was chosen, and guillotine its thinking at a budget it was told to exceed
grenade commented on issue helexa/helexa#290 2026-08-27 09:24:10 +00:00
Reasoning effort: we invented a ladder the model rejects, never tell the model which rung was chosen, and guillotine its thinking at a budget it was told to exceed

Fixed in 2c09f871, merged.

The invented ladder is gone. Rungs are now probed from the model's own chat template — for Qwen3.8-27B that is low, medium, xhigh, with xhigh as the…

grenade closed issue helexa/helexa#288 2026-08-27 09:24:04 +00:00
helexa-bench is anonymous, so since #262 it has measured the anonymous-yield policy instead of serving capacity — every number since 2026-08-18 understates the fleet
grenade commented on issue helexa/helexa#288 2026-08-27 09:24:01 +00:00
helexa-bench is anonymous, so since #262 it has measured the anonymous-yield policy instead of serving capacity — every number since 2026-08-18 understates the fleet

Fixed in b0da2d35, merged; 9fa3fcea handles the trend-line discontinuity.

Each concurrent stream now carries its own principal identity, so per-principal fair-share stops treating a single…

grenade closed issue helexa/helexa#286 2026-08-27 09:23:54 +00:00
CI clippy never lints test code — cargo clippy --workspace without --all-targets misses #[cfg(test)]
grenade commented on issue helexa/helexa#286 2026-08-27 09:23:51 +00:00
CI clippy never lints test code — cargo clippy --workspace without --all-targets misses #[cfg(test)]

Fixed in 03fe47e9, merged.

CI now runs cargo clippy --workspace --all-targets -- -D warnings, so test and bench targets are linted at the same severity as the library.

The gap was not…

grenade closed issue helexa/helexa#285 2026-08-27 09:23:45 +00:00
Non-streaming requests bypass the batch engine and serialize completely — 1.00× at every concurrency level
grenade commented on issue helexa/helexa#285 2026-08-27 09:23:42 +00:00
Non-streaming requests bypass the batch engine and serialize completely — 1.00× at every concurrency level

Fixed in 45e03893, merged.

Non-streaming completions now run through the batch engine, the same producer as the streaming path. Measured on beast:

grenade closed issue helexa/helexa#293 2026-08-27 09:21:43 +00:00
Responses API terminal frames were unreadable: truncation and crash both reported as success
grenade commented on issue helexa/helexa#293 2026-08-27 09:21:38 +00:00
Responses API terminal frames were unreadable: truncation and crash both reported as success

Fixed in b403a510 and a1b4584f, both merged.

All three defects closed:

  1. incomplete_details.reason is emitted on the streaming payload and the non-streaming body, for a Length…
grenade closed issue helexa/helexa#300 2026-08-27 09:21:20 +00:00
Three of five API surfaces silently discard the model's reasoning
grenade commented on issue helexa/helexa#300 2026-08-27 09:21:16 +00:00
Three of five API surfaces silently discard the model's reasoning

Fixed across all five surfaces — 039a353a and eb783c34.

grenade closed issue helexa/helexa#296 2026-08-27 09:20:56 +00:00
Deep-session stall: the model announces a tool call, then emits EOS instead of making it
grenade commented on issue helexa/helexa#296 2026-08-27 09:20:50 +00:00
Deep-session stall: the model announces a tool call, then emits EOS instead of making it

Fixed in 82a7b842 — and the cause was ours, not the model's.

What was actually happening

Responses splits one agentic step into several input items (reasoning, message, function_call)…

grenade closed issue helexa/helexa#292 2026-08-27 09:20:07 +00:00
Prefix cache reuse plateaus mid-session — deep agentic turns re-prefill ~23k tokens every turn