cortex: operator served-usage ledger + scheduled reconciliation + no-limit infra key #58

Open
opened 2026-06-13 15:18:44 +00:00 by grenade · 0 comments
Owner

Part of #47 · Stage 4 (federation / operator compensation)

Scope

  • Persist a per-request served-usage ledger (account, key, model, tokens, timestamp) — the operator's compensation receipt.
  • Scheduled reconciliation with upstream's authoritative record; surface discrepancies (operator can only claim what upstream authorized — authorize-before-serve is the anchor).
  • Operator no-limit infra key: the operator's own key bypasses budget caps (own fleet, own use) but is still metered for visibility.

Acceptance

  • Served usage is durably logged; a reconciliation run matches cortex's ledger against upstream and reports the operator's compensable total; the infra key serves without cap enforcement.

Depends on: metering, upstream client.

Part of #47 · Stage 4 (federation / operator compensation) **Scope** - Persist a per-request served-usage ledger (account, key, model, tokens, timestamp) — the operator's compensation receipt. - Scheduled reconciliation with upstream's authoritative record; surface discrepancies (operator can only claim what upstream authorized — authorize-before-serve is the anchor). - Operator **no-limit infra key**: the operator's own key bypasses budget caps (own fleet, own use) but is still metered for visibility. **Acceptance** - Served usage is durably logged; a reconciliation run matches cortex's ledger against upstream and reports the operator's compensable total; the infra key serves without cap enforcement. Depends on: metering, upstream client.
grenade added the p3-later label 2026-06-13 15:19:13 +00:00
grenade added this to the Multi-tenant governance milestone 2026-06-16 11:36:44 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Reference: helexa/helexa#58