grenade
0 Followers · 0 Following
  • Joined on 2026-02-17
Repositories
6
 Projects Packages Public Activity Starred Repositories
grenade opened issue helexa/helexa#276 2026-08-19 17:09:30 +00:00
Per-account top-up overrides, so one workload's appetite doesn't set everyone's limits
grenade pushed to main at helexa/helexa 2026-08-19 16:19:11 +00:00
91255619b6 Merge branch 'feat/sampling-defaults'
d453d5deb8 feat(sampling): resolve from request, model config, then fallback
Compare 2 commits »
grenade closed issue helexa/helexa#272 2026-08-19 16:19:11 +00:00
S1 — sampling defaults from generation_config, plus top_k, seed and tunable repetition
grenade opened issue helexa/helexa#275 2026-08-19 16:05:24 +00:00
[epic] helexa.ai/games — nightly generative benchmark scored by people playing the results
grenade pushed to feat/sampling-defaults at helexa/helexa 2026-08-19 15:42:34 +00:00
d453d5deb8 feat(sampling): resolve from request, model config, then fallback
grenade created branch feat/sampling-defaults in helexa/helexa 2026-08-19 15:42:34 +00:00
grenade commented on issue helexa/helexa#271 2026-08-19 15:29:47 +00:00
[epic] Sampling correctness: honour the caller's parameters and the model's own generation_config

Converted to an epic — children filed

Sized against the code: 8 LogitsProcessor construction sites, 4 places extracting sampling fields from a request, 6 signatures threading them as loose…

grenade opened issue helexa/helexa#274 2026-08-19 15:29:25 +00:00
S3 — stop lying about unsupported parameters: reject, and advertise what we support
grenade opened issue helexa/helexa#273 2026-08-19 15:29:05 +00:00
S2 — stop sequences, and the penalties that need per-token logit work
grenade opened issue helexa/helexa#272 2026-08-19 15:28:48 +00:00
S1 — sampling defaults from generation_config, plus top_k, seed and tunable repetition
grenade opened issue helexa/helexa#271 2026-08-19 15:14:00 +00:00
Sampling correctness: standard inference parameters are silently ignored, and the model's own generation_config is never read
grenade pushed to main at helexa/helexa 2026-08-19 14:41:35 +00:00
01c604195d Merge branch 'fix/streaming-completion-log'
ea1e7f1997 fix(neuron): cover the CUDA-only streaming paths
e94633c3a3 feat(usage): report prefix-cache reuse as cached_tokens
7cc37ebf37 fix(neuron): a streamed turn now says how it ended
Compare 4 commits »
grenade closed issue helexa/helexa#269 2026-08-19 14:41:35 +00:00
Prefix cache savings are invisible: cached_tokens is never reported, so every client shows 0% cache hit
grenade closed issue helexa/helexa#268 2026-08-19 14:41:35 +00:00
A streamed turn logs nothing when it ends, so it cannot be diagnosed afterwards
grenade pushed to fix/streaming-completion-log at helexa/helexa 2026-08-19 14:21:18 +00:00
ea1e7f1997 fix(neuron): cover the CUDA-only streaming paths
grenade pushed to fix/streaming-completion-log at helexa/helexa 2026-08-19 13:55:52 +00:00
e94633c3a3 feat(usage): report prefix-cache reuse as cached_tokens
grenade pushed to fix/streaming-completion-log at helexa/helexa 2026-08-19 13:43:18 +00:00
7cc37ebf37 fix(neuron): a streamed turn now says how it ended
grenade created branch fix/streaming-completion-log in helexa/helexa 2026-08-19 13:43:18 +00:00
grenade commented on issue helexa/helexa#223 2026-08-19 13:38:50 +00:00
/no_think is honoured on chat/completions but ignored on /v1/responses

Measured: with no working control, reasoning expands to fill any budget

This issue's third point — populate incomplete_details — is no longer the cosmetic half. Three runs today against…

grenade opened issue helexa/helexa#270 2026-08-19 13:38:29 +00:00
Prefix-cache reuse looks low on long agentic contexts — 2068 tokens reused against a 42K prompt