• Joined on 2026-02-17
grenade commented on issue helexa/helexa#53 2026-06-17 18:27:05 +00:00
neuron: admission control — bounded queue + backpressure, expose load in /health

Done — merged to main (core b2bd86b, /health exposure a60c9f1).

harness::admission::AdmissionController replaces the per-model unbounded, untimed lock-wait FIFO with a bounded batch-1…

grenade commented on issue helexa/helexa#52 2026-06-17 18:26:55 +00:00
cortex: budget enforcement — hard per-key caps, reserve→settle, 429 + Retry-After

Done — merged to main (cdf8728). The A0 seatbelt.

Before dispatch, cortex reserves prompt_estimate + max_output (max_output from max_completion_tokens/max_tokens, else the…

grenade commented on issue helexa/helexa#51 2026-06-17 18:26:50 +00:00
cortex: per-request token metering + per-key/account spend ledger

Done — merged to main (4f16b8c).

cortex-gateway::metering: real per-request usage is captured at completion and fed to the spend ledger + per-principal Prometheus counters (`cortex_spend_to…

grenade commented on issue helexa/helexa#49 2026-06-17 18:26:45 +00:00
cortex: API-key authentication + principal resolution

Done — merged to main (486d7e9).

cortex-gateway::auth::require_principal axum middleware: parses Authorization: Bearer <key> (Bearer only — no custom headers/body fields), resolves it…

grenade commented on issue helexa/helexa#50 2026-06-17 18:26:41 +00:00
cortex: EntitlementProvider trait + local/static provider

Done — merged to main (bc74e0e).

cortex_core::entitlements: EntitlementProvider trait (resolve / reserve / settle / release / snapshot) with Principal, CapWindow (Balance

grenade pushed to main at helexa/helexa 2026-06-17 17:57:59 +00:00
3b60dd7a31 Merge #56 (phase 3): fail-fast prompt pre-validation + advisory hints
057bc71e80 feat(#47 #56 phase 3): fail-fast prompt pre-validation + advisory hints
Compare 2 commits »
grenade pushed to main at helexa/helexa 2026-06-17 17:51:30 +00:00
4feaaf1cfb Merge #55 (phase 2d): cortex load-aware routing across replicas
dd31c3cd49 feat(#47 #55 phase 2d): cortex load-aware routing across replicas
Compare 2 commits »
grenade created branch feat/47-phase3-prompt-prevalidation in helexa/helexa 2026-06-17 17:50:43 +00:00
grenade pushed to feat/47-phase3-prompt-prevalidation at helexa/helexa 2026-06-17 17:50:43 +00:00
057bc71e80 feat(#47 #56 phase 3): fail-fast prompt pre-validation + advisory hints
grenade pushed to main at helexa/helexa 2026-06-17 17:46:12 +00:00
c83f1eb98c feat(#47 #54 phase 2c): neuron per-principal in-flight cap (fair-share)
grenade pushed to feat/47-phase2d-load-aware-routing at helexa/helexa 2026-06-17 17:45:55 +00:00
dd31c3cd49 feat(#47 #55 phase 2d): cortex load-aware routing across replicas
grenade created branch feat/47-phase2d-load-aware-routing in helexa/helexa 2026-06-17 17:45:54 +00:00
grenade created branch feat/47-phase2c-per-principal-cap in helexa/helexa 2026-06-17 17:40:29 +00:00
grenade pushed to feat/47-phase2c-per-principal-cap at helexa/helexa 2026-06-17 17:40:29 +00:00
c83f1eb98c feat(#47 #54 phase 2c): neuron per-principal in-flight cap (fair-share)
grenade pushed to main at helexa/helexa 2026-06-17 17:19:40 +00:00
a60c9f1075 feat(#47 #53 phase 2b): expose per-model admission load in GET /health
grenade pushed to feat/47-phase2b-health-load at helexa/helexa 2026-06-17 17:13:11 +00:00
a60c9f1075 feat(#47 #53 phase 2b): expose per-model admission load in GET /health
grenade created branch feat/47-phase2b-health-load in helexa/helexa 2026-06-17 17:13:10 +00:00
grenade pushed to main at helexa/helexa 2026-06-17 17:09:29 +00:00
b2bd86bfa5 feat(#47 #53 phase 2a): neuron admission control — bounded queue + backpressure
grenade created branch feat/47-phase2a-admission-control in helexa/helexa 2026-06-17 17:03:12 +00:00
grenade pushed to feat/47-phase2a-admission-control at helexa/helexa 2026-06-17 17:03:12 +00:00
b2bd86bfa5 feat(#47 #53 phase 2a): neuron admission control — bounded queue + backpressure