grenade
0 Followers · 0 Following
  • Joined on 2026-02-17
Repositories
8
 Projects Packages Public Activity Starred Repositories
grenade created branch feat/qwen4-exp-full-attn in helexa/helexa 2026-09-01 15:17:00 +00:00
grenade commented on issue helexa/helexa#311 2026-09-01 15:09:41 +00:00
qwen4_exp D: QSA sparse-attention indexer

The indexer is implemented; two findings need an answer before the layer is wired

On feat/qwen4-exp-qsa-indexer (CI running): the block selection (BlockSelector), the layer around it…

grenade pushed to feat/qwen4-exp-qsa-indexer at helexa/helexa 2026-09-01 15:09:19 +00:00
74c8647ec5 feat(qwen4_exp): the QSA mask, and where it must never be sent
grenade created branch feat/qwen4-exp-qsa-indexer in helexa/helexa 2026-09-01 15:06:31 +00:00
grenade pushed to feat/qwen4-exp-qsa-indexer at helexa/helexa 2026-09-01 15:06:31 +00:00
5745708e89 feat(qwen4_exp): the QSA indexer, and the second KV cache nobody counted
grenade pushed to main at helexa/helexa 2026-09-01 14:52:13 +00:00
41dd2c39b5 Merge branch 'feat/qwen4-exp-config'
366bfcbb47 feat(qwen4_exp): the checkpoint's config, and what it does not say
Compare 2 commits »
grenade pushed to main at helexa/helexa 2026-09-01 14:29:52 +00:00
0ace8f77bf Merge branch 'feat/qwen4-exp-qsa-selection'
5414fce1e8 feat(qwen4_exp): which blocks of the past a layer may look at
Compare 2 commits »
grenade created branch feat/qwen4-exp-config in helexa/helexa 2026-09-01 14:21:15 +00:00
grenade pushed to feat/qwen4-exp-config at helexa/helexa 2026-09-01 14:21:15 +00:00
366bfcbb47 feat(qwen4_exp): the checkpoint's config, and what it does not say
grenade pushed to main at helexa/helexa 2026-09-01 14:17:00 +00:00
37f6dc72a0 Merge branch 'feat/qwen4-exp-ple-consumption'
c1205a7b45 feat(qwen4_exp): the PLE gate, and the dilated conv behind it
Compare 2 commits »
grenade commented on issue helexa/helexa#312 2026-09-01 13:55:12 +00:00
qwen4_exp E: hyper-connections, PLE n-gram embeddings, interleaved M-RoPE

Progress: the new maths is in; what is left is wiring

Four of E's five items are on main or in review. None of them are reachable yet — there is no qwen4_exp config or decoder to call…

grenade pushed to feat/qwen4-exp-qsa-selection at helexa/helexa 2026-09-01 13:54:44 +00:00
5414fce1e8 feat(qwen4_exp): which blocks of the past a layer may look at
grenade created branch feat/qwen4-exp-qsa-selection in helexa/helexa 2026-09-01 13:54:43 +00:00
grenade pushed to feat/qwen4-exp-ple-consumption at helexa/helexa 2026-09-01 13:49:05 +00:00
c1205a7b45 feat(qwen4_exp): the PLE gate, and the dilated conv behind it
grenade created branch feat/qwen4-exp-ple-consumption in helexa/helexa 2026-09-01 13:49:04 +00:00
grenade pushed to main at helexa/helexa 2026-09-01 13:42:23 +00:00
08608262aa Merge branch 'feat/qwen4-exp-ple-hashing'
b87d24e2f6 Merge branch 'fix/seed-cutlass-anonymously'
7c45ce95b6 fix(ci): record which wire protocol was refused
cd8d5a7893 fix(ci): trace the real fetch, not a request of our own choosing
5d35b1326f fix(ci): probe the CUTLASS remote on every build, not only on failure
Compare 11 commits »
grenade pushed to fix/seed-cutlass-anonymously at helexa/helexa 2026-09-01 12:20:29 +00:00
7c45ce95b6 fix(ci): record which wire protocol was refused
grenade pushed to fix/seed-cutlass-anonymously at helexa/helexa 2026-09-01 12:12:07 +00:00
cd8d5a7893 fix(ci): trace the real fetch, not a request of our own choosing
grenade pushed to fix/seed-cutlass-anonymously at helexa/helexa 2026-09-01 12:04:25 +00:00
5d35b1326f fix(ci): probe the CUTLASS remote on every build, not only on failure
grenade pushed to fix/seed-cutlass-anonymously at helexa/helexa 2026-09-01 11:48:39 +00:00
8b19c7983c fix(ci): report who refused the CUTLASS fetch, instead of guessing