grenade

grenade commented on issue helexa/helexa#322

2026-09-07 16:15:08 +00:00

In-situ quantisation is redone on every load and discarded on unload — ~26 minutes per load for qwen4_exp

Landed and measured: 8m19s → 23s

d0e7f185 on main, validated on beast across three guarded windows. Every run hits the same OOM at decoder layer 15 — VRAM is the constraint, not time —…

grenade pushed to fix/322-cache-telemetry at helexa/helexa

2026-09-07 16:14:48 +00:00

e04091f37f fix(neuron): say what the isq cache actually did (#322)

grenade created branch fix/322-cache-telemetry in helexa/helexa

2026-09-07 16:14:47 +00:00

grenade pushed to main at helexa/helexa

2026-09-07 14:56:10 +00:00

d0e7f185b6 Merge branch 'feat/322-isq-cache'

bf72ce0ffc fix(neuron): keep the disk check off the path the tests exercise (#322)

22cb84d969 fix(neuron): bound the isq cache write, not the filesystem (#322)

de3f9584e2 feat(neuron): cache in-situ quantisation between loads (#322)

Compare 4 commits »

grenade pushed to feat/322-isq-cache at helexa/helexa

2026-09-07 14:33:55 +00:00

bf72ce0ffc fix(neuron): keep the disk check off the path the tests exercise (#322)

grenade pushed to feat/322-isq-cache at helexa/helexa

2026-09-07 14:12:24 +00:00

22cb84d969 fix(neuron): bound the isq cache write, not the filesystem (#322)

grenade pushed to feat/322-isq-cache at helexa/helexa

2026-09-07 13:53:21 +00:00

de3f9584e2 feat(neuron): cache in-situ quantisation between loads (#322)

grenade created branch feat/322-isq-cache in helexa/helexa

2026-09-07 13:53:20 +00:00

grenade pushed to main at helexa/helexa

2026-09-07 12:56:41 +00:00

17394ed8c5 Merge branch 'test/323-parity-long-prompt'

b3ed41c744 test(qwen4_exp): a second parity case, for the paths the first cannot reach

Compare 2 commits »

grenade closed issue helexa/helexa#312

2026-09-07 12:50:00 +00:00

qwen4_exp E: hyper-connections, PLE n-gram embeddings, interleaved M-RoPE

grenade closed issue helexa/helexa#311

2026-09-07 12:49:57 +00:00

qwen4_exp D: QSA sparse-attention indexer

grenade commented on issue helexa/helexa#312

2026-09-07 12:49:52 +00:00

qwen4_exp E: hyper-connections, PLE n-gram embeddings, interleaved M-RoPE

Closing: all three blocks implemented, and compared to the implementation they were ported from

This issue grouped the new maths in the decoder and asked that the riskiest piece be parity-teste…

grenade commented on issue helexa/helexa#311

2026-09-07 12:49:30 +00:00

qwen4_exp D: QSA sparse-attention indexer

Closing: implemented, audited against the reference, and numerically verified

All four gates this issue accumulated are now closed, and by different kinds of evidence rather than four runs of…

grenade opened issue helexa/helexa#324

2026-09-07 12:49:11 +00:00

qwen4_exp QSA assumes the visible set is contiguous — true today, false the moment it is batched

grenade created branch test/323-parity-long-prompt in helexa/helexa

2026-09-07 12:28:29 +00:00

grenade pushed to test/323-parity-long-prompt at helexa/helexa

2026-09-07 12:28:29 +00:00

b3ed41c744 test(qwen4_exp): a second parity case, for the paths the first cannot reach

grenade pushed to main at helexa/helexa

2026-09-07 12:24:12 +00:00

c44dec08d6 Merge branch 'fix/323-layer-type-alias'

e4961246d2 test(qwen4_exp): logits parity against the upstream reference (#323)

d96f4e8fa1 fix(qwen4_exp): read both of upstream's names for a full-attention layer

Compare 3 commits »

grenade pushed to fix/323-layer-type-alias at helexa/helexa

2026-09-07 12:04:01 +00:00

e4961246d2 test(qwen4_exp): logits parity against the upstream reference (#323)

grenade pushed to fix/323-layer-type-alias at helexa/helexa

2026-09-07 11:52:55 +00:00

d96f4e8fa1 fix(qwen4_exp): read both of upstream's names for a full-attention layer

grenade created branch fix/323-layer-type-alias in helexa/helexa

2026-09-07 11:52:54 +00:00