mirror of
https://github.com/openai/codex.git
synced 2026-11-15 21:50:46 +00:00
Add response processing after completion and usage accounting (#61577)
## Why Streaming can dispatch tools before a response finishes and its usage is accounted for. Allow callers to wait for completion and synchronous post-hooks so budget enforcement can block tools from the response that exhausts the budget. ## What changed - Add `responses.process_mode = "after_complete_response"` to buffer response items and release them in order after completion, synchronous post-hooks, and usage accounting. Keep `streaming` as the default and deliver safety-buffering notifications immediately. - Track whether response usage has already been charged to avoid duplicate accounting, including during compaction. - Stop new tools across the agent tree when the rollout budget is exhausted. Coordinate steering with accounting and prevent buffered tool calls from dispatching after steering or cancellation. - Bound buffered responses to 65,535 events and reject overflow. ## Testing Add configuration coverage and extend integration tests for buffered output ordering, synchronous hooks, interrupted responses and resume, steering, invalid usage, and budget exhaustion preventing tool dispatch. GitOrigin-RevId: bd06811cfd50cb701babe6353465c57dfed2a37a
This commit is contained in:
@@ -421,6 +421,9 @@ pub struct ConfigToml {
|
||||
/// Optional product SKU forwarded on host-owned Codex Apps MCP requests.
|
||||
pub apps_mcp_product_sku: Option<String>,
|
||||
|
||||
/// Controls how Codex processes model responses.
|
||||
pub responses: Option<ResponsesToml>,
|
||||
|
||||
/// Bounded, product-owned metadata attached to every Responses API request.
|
||||
pub responses_api_metadata: Option<BTreeMap<String, String>>,
|
||||
|
||||
@@ -722,6 +725,24 @@ pub struct CodeModeToml {
|
||||
pub heartbeat_interval_s: Option<u32>,
|
||||
}
|
||||
|
||||
#[derive(Serialize, Deserialize, Debug, Clone, Default, PartialEq, Eq, JsonSchema)]
|
||||
#[schemars(deny_unknown_fields)]
|
||||
pub struct ResponsesToml {
|
||||
/// When to process response items, including text and tool calls. Defaults to `streaming`.
|
||||
pub process_mode: Option<ResponseProcessMode>,
|
||||
}
|
||||
|
||||
#[derive(Serialize, Deserialize, Debug, Clone, Copy, Default, PartialEq, Eq, JsonSchema)]
|
||||
#[serde(rename_all = "snake_case")]
|
||||
pub enum ResponseProcessMode {
|
||||
/// Process items as they arrive. A tool can start before its response is complete.
|
||||
#[default]
|
||||
Streaming,
|
||||
/// Process buffered items in order after the response completes, synchronous post-hooks
|
||||
/// finish, and any budget charges are posted.
|
||||
AfterCompleteResponse,
|
||||
}
|
||||
|
||||
#[derive(Serialize, Deserialize, Debug, Clone, PartialEq, Eq, JsonSchema)]
|
||||
#[schemars(deny_unknown_fields)]
|
||||
pub struct ExperimentalRequestUserInput {
|
||||
|
||||
Reference in New Issue
Block a user