grenade
0 Followers · 0 Following
  • Joined on 2026-02-17
Repositories
6
 Projects Packages Public Activity Starred Repositories
grenade opened issue helexa/helexa#269 2026-08-19 13:38:09 +00:00
Prefix cache savings are invisible: cached_tokens is never reported, so every client shows 0% cache hit
grenade opened issue helexa/helexa#268 2026-08-19 13:37:50 +00:00
A streamed turn logs nothing when it ends, so it cannot be diagnosed afterwards
grenade pushed to main at helexa/helexa 2026-08-19 13:35:49 +00:00
98d63cc3fd Merge branch 'fix/prometheus-histogram-buckets'
a26bd94f13 fix(metrics): export histograms as histograms, not summaries
Compare 2 commits »
grenade pushed to fix/prometheus-histogram-buckets at helexa/helexa 2026-08-19 13:14:49 +00:00
a26bd94f13 fix(metrics): export histograms as histograms, not summaries
grenade created branch fix/prometheus-histogram-buckets in helexa/helexa 2026-08-19 13:14:49 +00:00
grenade pushed to main at helexa/helexa 2026-08-19 11:52:34 +00:00
0fe7aa38b0 Merge branch 'fix/responses-reasoning-events'
b5e77148df fix(responses): stream reasoning as its own output item
Compare 2 commits »
grenade pushed to main at helexa/helexa 2026-08-19 11:46:17 +00:00
d1ea8d28d3 Merge branch 'fix/stream-reasoning-content'
ed1f535260 fix(neuron): stream reasoning as reasoning_content instead of dropping it
Compare 2 commits »
grenade pushed to fix/responses-reasoning-events at helexa/helexa 2026-08-19 11:31:59 +00:00
b5e77148df fix(responses): stream reasoning as its own output item
grenade created branch fix/responses-reasoning-events in helexa/helexa 2026-08-19 11:31:59 +00:00
grenade pushed to fix/stream-reasoning-content at helexa/helexa 2026-08-19 11:18:14 +00:00
ed1f535260 fix(neuron): stream reasoning as reasoning_content instead of dropping it
grenade created branch fix/stream-reasoning-content in helexa/helexa 2026-08-19 11:18:14 +00:00
grenade pushed to main at helexa/helexa 2026-08-19 10:48:48 +00:00
115076294f Merge branch 'fix/cortex-stream-read-timeout'
4cb383fbac fix(cortex): time out a stalled stream, not a long one
Compare 2 commits »
grenade pushed to fix/cortex-stream-read-timeout at helexa/helexa 2026-08-19 10:28:47 +00:00
4cb383fbac fix(cortex): time out a stalled stream, not a long one
grenade created branch fix/cortex-stream-read-timeout in helexa/helexa 2026-08-19 10:28:47 +00:00
grenade pushed to main at helexa/helexa 2026-08-19 09:46:48 +00:00
c5b759928b Merge branch 'fix/sse-keepalive-during-prefill'
31e64d5995 fix(neuron): keep the stream alive while a long prompt prefills
Compare 2 commits »
grenade commented on issue helexa/helexa#267 2026-08-19 09:26:04 +00:00
Streams go silent for the whole prefill, so clients drop them as dead — and an abandoned request keeps the pool lock

Correction — the diagnosis above is wrong, and the real cause is on the wire

The issue body describes a permanent cuMemAllocAsync wedge. It is not that. I took a single eu-stack…

grenade pushed to fix/sse-keepalive-during-prefill at helexa/helexa 2026-08-19 09:25:37 +00:00
31e64d5995 fix(neuron): keep the stream alive while a long prompt prefills
grenade created branch fix/sse-keepalive-during-prefill in helexa/helexa 2026-08-19 09:25:36 +00:00
grenade opened issue helexa/helexa#267 2026-08-19 09:10:29 +00:00
A batched decode step wedges forever inside cuMemAllocAsync, and the 120s watchdog never fires
grenade pushed to main at helexa/helexa 2026-08-18 10:48:56 +00:00
92dddc06b6 Merge branch 'fix/anonymous-yields-to-authenticated'
3241680bfd fix(admission): serve anonymous callers from leftover capacity
Compare 2 commits »