grenade
0 Followers · 0 Following
  • Joined on 2026-02-17
Repositories
8
 Projects Packages Public Activity Starred Repositories
grenade created branch fix/streaming-completion-log in helexa/helexa 2026-08-19 13:43:18 +00:00
grenade commented on issue helexa/helexa#223 2026-08-19 13:38:50 +00:00
/no_think is honoured on chat/completions but ignored on /v1/responses

Measured: with no working control, reasoning expands to fill any budget

This issue's third point — populate incomplete_details — is no longer the cosmetic half. Three runs today against…

grenade opened issue helexa/helexa#270 2026-08-19 13:38:29 +00:00
Prefix-cache reuse looks low on long agentic contexts — 2068 tokens reused against a 42K prompt
grenade opened issue helexa/helexa#269 2026-08-19 13:38:09 +00:00
Prefix cache savings are invisible: cached_tokens is never reported, so every client shows 0% cache hit
grenade opened issue helexa/helexa#268 2026-08-19 13:37:50 +00:00
A streamed turn logs nothing when it ends, so it cannot be diagnosed afterwards
grenade pushed to main at helexa/helexa 2026-08-19 13:35:49 +00:00
98d63cc3fd Merge branch 'fix/prometheus-histogram-buckets'
a26bd94f13 fix(metrics): export histograms as histograms, not summaries
Compare 2 commits »
grenade created branch fix/prometheus-histogram-buckets in helexa/helexa 2026-08-19 13:14:49 +00:00
grenade pushed to fix/prometheus-histogram-buckets at helexa/helexa 2026-08-19 13:14:49 +00:00
a26bd94f13 fix(metrics): export histograms as histograms, not summaries
grenade pushed to main at helexa/helexa 2026-08-19 11:52:34 +00:00
0fe7aa38b0 Merge branch 'fix/responses-reasoning-events'
b5e77148df fix(responses): stream reasoning as its own output item
Compare 2 commits »
grenade pushed to main at helexa/helexa 2026-08-19 11:46:17 +00:00
d1ea8d28d3 Merge branch 'fix/stream-reasoning-content'
ed1f535260 fix(neuron): stream reasoning as reasoning_content instead of dropping it
Compare 2 commits »
grenade created branch fix/responses-reasoning-events in helexa/helexa 2026-08-19 11:31:59 +00:00
grenade pushed to fix/responses-reasoning-events at helexa/helexa 2026-08-19 11:31:59 +00:00
b5e77148df fix(responses): stream reasoning as its own output item
grenade created branch fix/stream-reasoning-content in helexa/helexa 2026-08-19 11:18:14 +00:00
grenade pushed to fix/stream-reasoning-content at helexa/helexa 2026-08-19 11:18:14 +00:00
ed1f535260 fix(neuron): stream reasoning as reasoning_content instead of dropping it
grenade pushed to main at helexa/helexa 2026-08-19 10:48:48 +00:00
115076294f Merge branch 'fix/cortex-stream-read-timeout'
4cb383fbac fix(cortex): time out a stalled stream, not a long one
Compare 2 commits »
grenade created branch fix/cortex-stream-read-timeout in helexa/helexa 2026-08-19 10:28:47 +00:00
grenade pushed to fix/cortex-stream-read-timeout at helexa/helexa 2026-08-19 10:28:47 +00:00
4cb383fbac fix(cortex): time out a stalled stream, not a long one
grenade pushed to main at helexa/helexa 2026-08-19 09:46:48 +00:00
c5b759928b Merge branch 'fix/sse-keepalive-during-prefill'
31e64d5995 fix(neuron): keep the stream alive while a long prompt prefills
Compare 2 commits »
grenade commented on issue helexa/helexa#267 2026-08-19 09:26:04 +00:00
Streams go silent for the whole prefill, so clients drop them as dead — and an abandoned request keeps the pool lock

Correction — the diagnosis above is wrong, and the real cause is on the wire

The issue body describes a permanent cuMemAllocAsync wedge. It is not that. I took a single eu-stack…

grenade pushed to fix/sse-keepalive-during-prefill at helexa/helexa 2026-08-19 09:25:37 +00:00
31e64d5995 fix(neuron): keep the stream alive while a long prompt prefills