• Joined on 2026-02-17
grenade created branch feat/25-speculative-decoding in helexa/helexa 2026-06-13 05:30:26 +00:00
grenade pushed to feat/25-speculative-decoding at helexa/helexa 2026-06-13 05:30:26 +00:00
ec764a2cac feat(neuron): speculative decoding — acceptance core + config (#25, phase 1)
grenade commented on issue helexa/helexa#25 2026-06-13 05:26:20 +00:00
perf(neuron): speculative decoding with a small same-family drafter

Design (2026-06-13) — picking this up after #23

Feasibility gate and a drafter correction

Speculative decoding requires the drafter and target to share a tokenizer/vocabulary…

grenade deleted branch feat/18-single-gpu-vision-chunked from helexa/helexa 2026-06-13 05:23:10 +00:00
grenade closed issue helexa/helexa#18 2026-06-13 05:23:09 +00:00
Chunk the single-GPU vision prefill (parity with TP)
grenade pushed to main at helexa/helexa 2026-06-13 05:23:09 +00:00
4c1bdba31d Merge pull request 'feat(neuron): chunk the single-GPU vision prefill (parity with TP) (#18)' (#44) from feat/18-single-gpu-vision-chunked into main
988ef5afc2 feat(neuron): chunk the single-GPU vision prefill (parity with TP) (#18)
Compare 2 commits »
grenade merged pull request helexa/helexa#44 2026-06-13 05:23:07 +00:00
feat(neuron): chunk the single-GPU vision prefill (parity with TP) (#18)
grenade created pull request helexa/helexa#44 2026-06-13 05:17:33 +00:00
feat(neuron): chunk the single-GPU vision prefill (parity with TP) (#18)
grenade created branch feat/18-single-gpu-vision-chunked in helexa/helexa 2026-06-13 05:17:14 +00:00
grenade pushed to feat/18-single-gpu-vision-chunked at helexa/helexa 2026-06-13 05:17:14 +00:00
988ef5afc2 feat(neuron): chunk the single-GPU vision prefill (parity with TP) (#18)
grenade deleted branch docs/learnings-p1-p2 from helexa/helexa 2026-06-13 04:21:15 +00:00
grenade pushed to main at helexa/helexa 2026-06-13 04:21:13 +00:00
a1450789d2 Merge pull request 'docs(learnings): source-control P1 + P2 sprint learnings' (#43) from docs/learnings-p1-p2 into main
2eaa776d85 docs(learnings): source-control P1 + P2 sprint learnings
Compare 2 commits »
grenade merged pull request helexa/helexa#43 2026-06-13 04:21:12 +00:00
docs(learnings): source-control P1 + P2 sprint learnings
grenade created pull request helexa/helexa#43 2026-06-13 04:14:13 +00:00
docs(learnings): source-control P1 + P2 sprint learnings
grenade created branch docs/learnings-p1-p2 in helexa/helexa 2026-06-13 04:14:00 +00:00
grenade pushed to docs/learnings-p1-p2 at helexa/helexa 2026-06-13 04:14:00 +00:00
2eaa776d85 docs(learnings): source-control P1 + P2 sprint learnings
grenade closed issue helexa/helexa#1 2026-06-12 21:43:55 +00:00
Reduce TP=2 Q6K cold-load time for Qwen3.6-27B (~5 min today)
grenade commented on issue helexa/helexa#1 2026-06-12 21:43:48 +00:00
Reduce TP=2 Q6K cold-load time for Qwen3.6-27B (~5 min today)

Closing numbers. Landed via #40 (parallel in-situ quantization + the per-phase timing this issue asked for first).

Before/after — Qwen3.6-27B Q6K TP=2 cold load on beast (service start → `TP…

grenade opened issue helexa/helexa#42 2026-06-12 21:12:48 +00:00
ci: Build neuron-ampere intermittently fails — ptxas segfault in candle-flash-attn sm_86 kernels
grenade pushed to main at helexa/helexa 2026-06-12 21:12:28 +00:00
7918995e5a chore(ci): retrigger build-prerelease — ampere ptxas segfault (flash-attn sm_86, runner-side) on 538cc87