grenade
0 Followers · 0 Following
  • Joined on 2026-02-17
Repositories
8
 Projects Packages Public Activity Starred Repositories
grenade pushed to main at helexa/helexa 2026-09-08 20:24:20 +00:00
230d243678 Merge branch 'fix/324-qsa-visible-set'
0086a5437c fix(qwen4_exp): cut QSA blocks from the visible set, not the position axis
Compare 2 commits »
grenade opened issue helexa/helexa#326 2026-09-08 20:04:01 +00:00
qwen4_exp takes one past_len for the whole batch, so ragged sequences cannot be batched
grenade pushed to fix/324-qsa-visible-set at helexa/helexa 2026-09-08 20:03:42 +00:00
0086a5437c fix(qwen4_exp): cut QSA blocks from the visible set, not the position axis
grenade created branch fix/324-qsa-visible-set in helexa/helexa 2026-09-08 20:03:41 +00:00
grenade closed issue helexa/helexa#310 2026-09-08 20:02:57 +00:00
qwen4_exp C: host- or disk-resident PLE table with a device-side gather
grenade commented on issue helexa/helexa#310 2026-09-08 20:02:53 +00:00
qwen4_exp C: host- or disk-resident PLE table with a device-side gather

Closing — the table is resident nowhere and the gather is no longer a cost

Both halves of this issue are delivered and measured on beast.

Residency (slice 1, 1ae3ba72). The 102.4 GB…

grenade closed issue helexa/helexa#323 2026-09-08 20:02:37 +00:00
qwen4_exp gate 6: full-model logits parity against the upstream reference — the port is unverified against anything but our own reading
grenade commented on issue helexa/helexa#323 2026-09-08 20:02:33 +00:00
qwen4_exp gate 6: full-model logits parity against the upstream reference — the port is unverified against anything but our own reading

Closing — gate 6 passed, and the harness runs on every push

crates/neuron/tests/numerical_reference.rs plus script/generate_qwen4_exp_fixture.py, with two committed fixtures of random…

grenade closed issue helexa/helexa#322 2026-09-08 20:02:19 +00:00
In-situ quantisation is redone on every load and discarded on unload — ~26 minutes per load for qwen4_exp
grenade commented on issue helexa/helexa#322 2026-09-08 20:02:15 +00:00
In-situ quantisation is redone on every load and discarded on unload — ~26 minutes per load for qwen4_exp

Closing — landed and measured

The per-layer ISQ cache is on main and has been exercised repeatedly since, including through every qwen4_exp window this week.

**Measured, same OOM point…

grenade commented on issue helexa/helexa#310 2026-09-08 19:15:05 +00:00
qwen4_exp C: host- or disk-resident PLE table with a device-side gather

Solved by MADV_RANDOM — 20 lines, 176× on the gather. Quantisation not needed.

eb403ef, measured on beast with three distinct prompts so every run gathers cold rows.

grenade pushed to main at helexa/helexa 2026-09-08 18:37:10 +00:00
eb403ef941 Merge branch 'feat/310-ple-random-advice'
f4b3379818 perf(qwen4_exp): tell the kernel the n-gram table is read randomly
Compare 2 commits »
grenade pushed to feat/310-ple-random-advice at helexa/helexa 2026-09-08 18:04:06 +00:00
f4b3379818 perf(qwen4_exp): tell the kernel the n-gram table is read randomly
grenade pushed to feat/310-ple-random-advice at helexa/helexa 2026-09-08 17:36:56 +00:00
8f304d33fa perf(qwen4_exp): tell the kernel the n-gram table is read randomly
grenade created branch feat/310-ple-random-advice in helexa/helexa 2026-09-08 17:36:55 +00:00
grenade commented on issue helexa/helexa#310 2026-09-08 15:21:09 +00:00
qwen4_exp C: host- or disk-resident PLE table with a device-side gather

Measured: the mmap gather is the dominant decode cost, and it contends with #318

Slice 1 (mmap the table instead of making it resident) is what made the model loadable at all. It also turns…

grenade pushed to main at helexa/helexa 2026-09-08 14:43:40 +00:00
0343ae08a1 Merge branch 'feat/neuron-phase-timing'
69cbfac6b8 fix(neuron): pass the model id into the worker streaming path
5458b285ab feat(neuron): serve /metrics, with the decode phases as histograms
0c1ddd38af feat(neuron): opt-in phase timing inside the forward pass
e129765918 feat(neuron): split the decode loop's wall-clock into phases
Compare 5 commits »
grenade pushed to feat/neuron-phase-timing at helexa/helexa 2026-09-08 14:22:10 +00:00
69cbfac6b8 fix(neuron): pass the model id into the worker streaming path
grenade pushed to feat/neuron-phase-timing at helexa/helexa 2026-09-08 13:58:26 +00:00
5458b285ab feat(neuron): serve /metrics, with the decode phases as histograms
grenade pushed to feat/neuron-phase-timing at helexa/helexa 2026-09-08 13:51:01 +00:00
0c1ddd38af feat(neuron): opt-in phase timing inside the forward pass