• Joined on 2026-02-17
grenade commented on issue helexa/helexa#7 2026-06-12 08:58:14 +00:00
Responses API: emit response.in_progress and built-in-tool event families

Scope-narrowing note (2026-06-12 positioning): split this issue's three parts. (1) response.in_progress — worth emitting; cheap, real clients key spinner state off it; part of the same…

grenade commented on issue helexa/helexa#11 2026-06-12 08:58:14 +00:00
feat(neuron): prefix KV caching across requests

Elevated by the 2026-06-12 reframing: adding this to the 7 → 8 milestone. For the agent workloads helexa actually serves (conversation N+1 = conversation N + a new turn), prefix reuse is the…

grenade commented on issue helexa/helexa#1 2026-06-12 08:58:13 +00:00
Reduce TP=2 Q6K cold-load time for Qwen3.6-27B (~5 min today)

Still in scope, and elevated by the 2026-06-12 reframing (README positioning + the 7→8 milestone): cold-load latency is one of the operator-felt metrics the benchmark harness (#22) will measure…

grenade commented on issue helexa/helexa#4 2026-06-12 08:58:13 +00:00
Responses API: implement previous_response_id chained conversations

Reframing note (2026-06-12 positioning): still relevant — Responses-API clients that chain via previous_response_id fall under the "point your tooling at it once and it keeps working" contract.…

grenade commented on issue helexa/helexa#10 2026-06-12 08:57:47 +00:00
feat(cortex-gateway): Rust-native context compressor for prompt token reduction

Closing as out-of-scope — counterproductive under the project's stability contract (README, 2026-06-12). cortex's value as the per-operator proxy is that it is transparent and predictable: what…

grenade closed issue helexa/helexa#10 2026-06-12 08:57:47 +00:00
feat(cortex-gateway): Rust-native context compressor for prompt token reduction
grenade commented on issue helexa/helexa#2 2026-06-12 08:57:46 +00:00
Research: Prototype a quantization kernel in pure Rust via cuda-oxide

Closing as out-of-scope under the sharpened project positioning (README, 2026-06-12): helexa's niche is near-frontier models on consumer hardware, served predictably — not stack purity. "First…

grenade closed issue helexa/helexa#2 2026-06-12 08:57:46 +00:00
Research: Prototype a quantization kernel in pure Rust via cuda-oxide
grenade closed issue helexa/helexa#17 2026-06-12 08:57:25 +00:00
TP-rank failure should abort the leader's NCCL collective instead of hanging the daemon
grenade commented on issue helexa/helexa#14 2026-06-12 08:57:24 +00:00
Vision: dynamic image resolution (Qwen-VL min/max pixels)

Closing as completed. Dynamic resolution landed on main: Qwen smart_resize with native-aspect buckets (c97a865), operator pixel-budget override + docs (d311c8c, C5), and the max_pixels cap…

grenade closed issue helexa/helexa#14 2026-06-12 08:57:24 +00:00
Vision: dynamic image resolution (Qwen-VL min/max pixels)
grenade commented on issue helexa/helexa#16 2026-06-12 08:57:24 +00:00
Vision Stage C: streaming SSE + Responses API + cortex-gateway capability propagation

Closing as completed — all three Stage C parts are on main: C1 streaming SSE chat completion with vision (766c20b), C2 Responses→chat image translation contract test (dd592d9), C3 vision-capa…

grenade closed issue helexa/helexa#16 2026-06-12 08:57:24 +00:00
Vision Stage C: streaming SSE + Responses API + cortex-gateway capability propagation
grenade commented on issue helexa/helexa#17 2026-06-12 08:57:24 +00:00
TP-rank failure should abort the leader's NCCL collective instead of hanging the daemon

Closing as implemented and deployed. Stage 1 (error-faults → poison → auto unload/reload) merged and was verified live on beast 2026-06-08. Stage 2 (hang case: bounded leader wait + `ncclCommAbor…

grenade commented on issue helexa/helexa#12 2026-06-12 08:57:23 +00:00
Vision: tensor-parallel implementation (Stage E)

Closing as completed. TP vision is on main: VisionTower is wired into tp/tp_qwen3_5.rs (replicated tower per the scope here), chunked TP-vision prefill landed in fa01350, interleaved M-RoPE…

grenade closed issue helexa/helexa#12 2026-06-12 08:57:23 +00:00
Vision: tensor-parallel implementation (Stage E)
grenade commented on issue helexa/helexa#13 2026-06-12 08:57:23 +00:00
Vision: deploy on Qwen3.6-27B (production validation)

Closing as completed. The code is in front of the real 27B in production: vision requests against Qwen/Qwen3.6-27B on beast (TP=2) were verified end-to-end through the gateway on 2026-06-04 (see…

grenade closed issue helexa/helexa#13 2026-06-12 08:57:23 +00:00
Vision: deploy on Qwen3.6-27B (production validation)
grenade commented on issue helexa/helexa#3 2026-06-12 08:57:22 +00:00
Image content (image_url) is dropped — multimodal chat requests are processed as text-only

Closing as completed. Stage B (24968e9) shipped end-to-end text+image chat; the reporter verified the fix from the consumer side on 2026-06-04 (prompt_tokens 62 → 225, accurate frame description…

grenade closed issue helexa/helexa#3 2026-06-12 08:57:22 +00:00
Image content (image_url) is dropped — multimodal chat requests are processed as text-only