Krish Chainani 5a66d460d3 Refactor image content to use a shared ImageReference type (#45543) ...

## What changed

Represent images in `ContentItem` and `FunctionCallOutputContentItem` with `ImageReference::Inline`, flattened to preserve the existing `image_url` wire format. Update image producers and consumers and regenerate app-server schemas and SDK artifacts.

Preserve the Python SDK's `InputImageContentItem` and `InputImageFunctionCallOutputContentItem` class names during generation.

## Testing

Add a regression test for stable Python image class names and adapt existing image tests to the shared representation.

GitOrigin-RevId: c38a780ac3314c2ac2deb3afc1b93b94b6f93fec

2026-09-14 23:25:09 +00:00

..

snapshots

Make context snapshot text rendering consistent (#44976)

2026-09-12 05:04:11 +00:00

step_settings

Preserve originating budgets for code mode notifications (#44867)

2026-09-11 17:03:21 +00:00

abort_tasks.rs

Route rollout reads through the canonical JSON decoder (#42378)

2026-09-02 22:45:19 +00:00

additional_context.rs

Unify context snapshots and group requests into windows (#44932)

2026-09-11 22:55:38 +00:00

agent_execution.rs

Preserve root turn attribution in turn-start events (#44611)

2026-09-10 18:24:13 +00:00

agent_websocket.rs

Expose session analytics state in Responses turn metadata (#44628)

2026-09-10 19:41:14 +00:00

agents_md_refresh.rs

Add a provider for thread-scoped instructions (#44701)

2026-09-11 01:57:54 +00:00

agents_md.rs

Add a provider for thread-scoped instructions (#44701)

2026-09-11 01:57:54 +00:00

apply_patch_cli.rs

Standardize shell execution on unified exec (#39757)

2026-08-20 17:46:05 +00:00

apply_patch_serialization.rs

Standardize shell execution on unified exec (#39757)

2026-08-20 17:46:05 +00:00

approvals.rs

Remove retired model entries while preserving migration prompts (#44250)

2026-09-09 17:56:33 +00:00

audio_truncation.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

auto_review.rs

Expose available access programs in model discovery (#44893)

2026-09-11 19:13:04 +00:00

catalog_permission_messages.rs

Source async user message descriptions from the model catalog (#41461)

2026-08-29 03:44:01 +00:00

cli_stream.rs

Sanitize credentials from Git remote metadata (#40713)

2026-08-25 21:34:05 +00:00

client_websockets.rs

Reset cached WebSocket state when auth ownership changes (#44489)

2026-09-10 10:23:20 +00:00

client.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

cloud_config.rs

Preserve target-native paths in command approvals (#42577)

2026-09-03 16:21:10 +00:00

code_mode_elicitation.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

code_mode.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

codex_apps_protocol.rs

Share Apps tool catalogs without retaining unused snapshots (#45440)

2026-09-14 15:06:28 +00:00

codex_delegate.rs

Preserve MCP tool output as content items (#40737)

2026-08-25 23:42:50 +00:00

collaboration_instructions.rs

Restore collaboration mode when resuming threads (#45519)

2026-09-14 21:33:45 +00:00

compact_remote_trimming.rs

Estimate history tokens from content instead of serialized envelopes (#45094)

2026-09-12 18:41:47 +00:00

compact_remote.rs

Preserve incoming prompts when pre-turn compaction fails (#44487)

2026-09-10 10:08:11 +00:00

compact_resume_fork.rs

Remove the deprecated thread/rollback API (#44915)

2026-09-11 21:32:04 +00:00

compact.rs

Unify context snapshots and group requests into windows (#44932)

2026-09-11 22:55:38 +00:00

context_annotations.rs

Attribute command and plugin analytics to the invoking model (#45445)

2026-09-14 15:30:22 +00:00

current_time_reminder.rs

Add configurable gating for the sleep tool (#41243)

2026-08-28 02:09:07 +00:00

cyber_access_program.rs

Remove the unused legacy remote compaction implementation (#44273)

2026-09-09 18:40:53 +00:00

cyber_exec_policy.rs

Standardize shell execution on unified exec (#39772)

2026-08-20 18:29:35 +00:00

daybreak_access.rs

Attach verified access context to eligible plugin MCP calls (#41005)

2026-08-27 00:02:26 +00:00

deprecation_notice.rs

Standardize shell execution on unified exec (#39772)

2026-08-20 18:29:35 +00:00

direct_tool_metadata.rs

Bind direct tool-call metadata to invocation outputs (#45185)

2026-09-13 06:53:20 +00:00

exec_policy.rs

Honor environment-resolved workspace roots (#40912)

2026-08-26 16:28:35 +00:00

exec.rs

Wire the Windows MXC sandbox into command execution (#45176)

2026-09-13 06:07:03 +00:00

extension_sandbox.rs

Expand extension permission regression coverage (#41946)

2026-09-01 00:42:19 +00:00

external_auth.rs

Add AWS credential export commands for Amazon Bedrock (#44028)

2026-09-09 03:17:48 +00:00

fork_thread.rs

Expose disabled plugin settings in the app-server API (#44905)

2026-09-11 20:27:37 +00:00

git_enrichment.rs

Establish root turn identity for independent tasks and memory requests (#42900)

2026-09-05 01:04:12 +00:00

guardian_authorization.rs

Remove the deprecated thread/rollback API (#44915)

2026-09-11 21:32:04 +00:00

guardian_context_budget.rs

Preserve Guardian authorization evidence until request budgeting (#44570)

2026-09-10 16:02:36 +00:00

guardian_history.rs

Remove the deprecated thread/rollback API (#44915)

2026-09-11 21:32:04 +00:00

guardian_mcp_elicitation.rs

Preserve originating context for yielded code-mode tool calls (#44866)

2026-09-11 17:01:17 +00:00

guardian_retained_context.rs

Remove the deprecated thread/rollback API (#44915)

2026-09-11 21:32:04 +00:00

guardian_retry.rs

Improve Guardian retries and review failure reporting (#44482)

2026-09-10 09:50:59 +00:00

guardian_review_cancellation.rs

Cancel Guardian reviews with their tool calls (#40021)

2026-08-21 21:51:12 +00:00

guardian_review.rs

Move Guardian reviewer lifecycle into the extension (#45537)

2026-09-14 22:58:51 +00:00

guardian_subagent_authorization.rs

Retain inherited Guardian instructions in standalone forks (#43478)

2026-09-07 13:58:57 +00:00

hooks_executor.rs

Honor thread-level plugin exclusions across runtime capabilities (#44655)

2026-09-10 21:51:34 +00:00

hooks_mcp.rs

Set working directories for environment MCP tests (#41683)

2026-08-30 14:04:06 +00:00

hooks.rs

Use captured step settings for request metadata and tool hooks (#45248)

2026-09-13 15:47:59 +00:00

image_rollout.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

injected_models_cache.rs

Scope model catalog caches to the current provider and auth identity (#43906)

2026-09-08 20:37:30 +00:00

interrupt_hooks.rs

Add hooks for interrupted turns (#40511)

2026-08-25 01:27:18 +00:00

items.rs

Route rollout reads through the canonical JSON decoder (#42378)

2026-09-02 22:45:19 +00:00

json_result.rs

Remove redundant test coverage (#42069)

2026-09-01 15:04:11 +00:00

live_cli.rs

[codex] Use expect in integration tests (#28441)

2026-06-15 21:53:47 -07:00

managed_threads_tests.rs

Add managed thread lifetimes with cancellation-safe startup (#45502)

2026-09-14 19:30:11 +00:00

mcp_auth_elicitation.rs

Preserve MCP tool output as content items (#40737)

2026-08-25 23:42:50 +00:00

mcp_auth_refresh.rs

Attach verified access context to eligible plugin MCP calls (#41005)

2026-08-27 00:02:26 +00:00

mcp_ema_config.rs

Resolve enterprise-managed MCP registrations in the catalog (#45459)

2026-09-14 16:30:00 +00:00

mcp_extension_protocol.rs

Allow extensions to select MCP protocol mode per HTTP server (#44571)

2026-09-10 16:02:59 +00:00

mcp_oauth_refresh_tests.rs

Preserve MCP authentication challenges on tool calls (#42552)

2026-09-03 15:12:02 +00:00

mcp_optional_startup_grace.rs

Make the optional MCP startup grace configurable (#41199)

2026-08-27 20:31:40 +00:00

mcp_refresh_cleanup.rs

Negotiate MCP extensions per app-server session (#36910)

2026-08-04 15:23:43 +00:00

mcp_startup_refresh_http_proxy.rs

Add trusted enterprise MCP auth configuration (#44832)

2026-09-11 14:25:56 +00:00

mcp_tool_cache.rs

Reuse MCP bindings while cached servers remain dormant (#44121)

2026-09-09 10:51:24 +00:00

mcp_tool_exposure.rs

Unify context snapshots and group requests into windows (#44932)

2026-09-11 22:55:38 +00:00

mcp_turn_metadata.rs

Add session and originating window IDs to MCP request metadata (#45409)

2026-09-14 11:03:22 +00:00

mcp_user_verification.rs

Restrict MCP user verification and add workspace-scoped identity (#43524)

2026-09-07 17:26:10 +00:00

mod.rs

Allow background persistence for steered user input (#45506)

2026-09-14 19:39:31 +00:00

model_overrides.rs

[5 of 7] Replace OverrideTurnContext with ThreadSettings (#22508)

2026-05-18 21:03:51 -07:00

model_provider_requirements_tests.rs

Enforce managed model provider selection and definitions (#44650)

2026-09-10 21:41:39 +00:00

model_runtime_selectors.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

model_switching.rs

Retire Friendly and Pragmatic personality selection (#44946)

2026-09-12 00:22:04 +00:00

model_visible_layout.rs

Unify context snapshots and group requests into windows (#44932)

2026-09-11 22:55:38 +00:00

models_cache_auth.rs

Add opt-in model discovery for OpenAI API keys (#44392)

2026-09-10 03:18:28 +00:00

models_cache_ttl.rs

Expose available access programs in model discovery (#44893)

2026-09-11 19:13:04 +00:00

models_etag_responses.rs

Standardize shell execution on unified exec (#39757)

2026-08-20 17:46:05 +00:00

multi_agent_mode.rs

Source proactive multi-agent instructions from the model catalog (#41457)

2026-08-29 03:28:19 +00:00

multi_agent_resume.rs

Include unloaded children in multi-agent v2 environment context (#43491)

2026-09-07 15:10:37 +00:00

multi_exec_server_sandbox.rs

Attach verified access context to eligible plugin MCP calls (#41005)

2026-08-27 00:02:26 +00:00

network_approval_completion.rs

Handle pending network reviews after process completion (#42746)

2026-09-04 12:08:02 +00:00

network_approval.rs

Move Guardian reviewer lifecycle into the extension (#45537)

2026-09-14 22:58:51 +00:00

openai_file_mcp.rs

Preserve MCP tool output as content items (#40737)

2026-08-25 23:42:50 +00:00

otel.rs

Remove selected core test cases (#42066)

2026-09-01 14:43:27 +00:00

override_updates.rs

Pair thread environment settings (#26687)

2026-06-08 13:55:15 -07:00

pending_input_persistence.rs

Allow background persistence for steered user input (#45506)

2026-09-14 19:39:31 +00:00

pending_input.rs

Unify context snapshots and group requests into windows (#44932)

2026-09-11 22:55:38 +00:00

permissions_messages.rs

Use StartThreadOptions across thread fork APIs (#44043)

2026-09-09 04:07:40 +00:00

personality.rs

Retire Friendly and Pragmatic personality selection (#44946)

2026-09-12 00:22:04 +00:00

plugins.rs

Honor thread-level plugin exclusions across runtime capabilities (#44655)

2026-09-10 21:51:34 +00:00

prompt_cache_key.rs

Preserve parent cache affinity for ephemeral forks (#44862)

2026-09-11 16:41:56 +00:00

prompt_caching.rs

Refresh global instructions at model-request boundaries (#44675)

2026-09-10 23:46:33 +00:00

prompt_debug_tests.rs

Enable git attribution across Codex entry points (#34819)

2026-07-22 20:23:35 +00:00

quota_exceeded.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

realtime_conversation.rs

Record realtime conversation history in Core (#41924)

2026-08-31 22:38:23 +00:00

realtime_initial_items.rs

Add a realtime delegation acknowledgement control (#36413)

2026-08-01 01:17:26 +00:00

realtime_misalignment.rs

Add live WebRTC voice conversations to the TUI (#43581)

2026-09-07 20:25:30 +00:00

realtime_sideband_endpoint.rs

Allow per-call sideband endpoints for existing realtime calls (#41923)

2026-08-31 22:29:40 +00:00

reasoning_effort_override.rs

Remove the deprecated thread/rollback API (#44915)

2026-09-11 21:32:04 +00:00

remote_env_failure_tests.rs

Surface environment startup failure reasons to the model (#44277)

2026-09-09 18:50:32 +00:00

remote_env.rs

Surface environment startup failure reasons to the model (#44277)

2026-09-09 18:50:32 +00:00

remote_models.rs

Expose available access programs in model discovery (#44893)

2026-09-11 19:13:04 +00:00

request_compression.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

request_permissions_tool.rs

Make permission transforms aware of executor path context (#41909)

2026-08-31 20:50:44 +00:00

request_permissions.rs

Make permission transforms aware of executor path context (#41909)

2026-08-31 20:50:44 +00:00

request_plugin_install.rs

Remove retired model entries while preserving migration prompts (#44250)

2026-09-09 17:56:33 +00:00

request_user_input_async.rs

Add a feature flag for asynchronous user messages (#45124)

2026-09-12 22:28:41 +00:00

request_user_input.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

responses_api_proxy_headers.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

responses_lite.rs

Always use streamed remote compaction for supported providers (#44255)

2026-09-09 18:04:04 +00:00

responses_system_proxy.rs

Add opt-in model discovery for OpenAI API keys (#44392)

2026-09-10 03:18:28 +00:00

resume_warning.rs

Preserve root turn attribution in turn-start events (#44611)

2026-09-10 18:24:13 +00:00

resume.rs

Use turn environment settings for sandbox execution (#40771)

2026-08-26 03:28:57 +00:00

retry_after.rs

Add opt-in model discovery for OpenAI API keys (#44392)

2026-09-10 03:18:28 +00:00

review.rs

Route rollout reads through the canonical JSON decoder (#42378)

2026-09-02 22:45:19 +00:00

rmcp_client.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

rollout_budget.rs

Remove the deprecated thread/rollback API (#44915)

2026-09-11 21:32:04 +00:00

rollout_compression.rs

Use StartThreadOptions across thread fork APIs (#44043)

2026-09-09 04:07:40 +00:00

rollout_list_find.rs

Honor the configured SQLite home across state consumers (#34994)

2026-07-23 19:19:35 +00:00

safety_buffering.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

safety_check_downgrade.rs

Remove retired model entries while preserving migration prompts (#44250)

2026-09-09 17:56:33 +00:00

scenarios.rs

Add context snapshots for async questions and plugin refresh (#44948)

2026-09-12 00:34:18 +00:00

search_tool.rs

Remove retired model entries while preserving migration prompts (#44250)

2026-09-09 17:56:33 +00:00

settings_commits.rs

Persist disabled plugin IDs in thread settings (#44332)

2026-09-09 23:23:59 +00:00

settings_constraints.rs

Validate step settings against proposed permissions (#40647)

2026-08-25 17:27:04 +00:00

shell_snapshot.rs

Protect shell snapshots when credential brokerage is enabled (#43909)

2026-09-08 20:59:50 +00:00

skill_approval.rs

Standardize shell execution on unified exec (#39757)

2026-08-20 17:46:05 +00:00

skills_extension.rs

Use captured step model settings for extension context (#44202)

2026-09-09 16:48:49 +00:00

skills.rs

Reduce skill catalog prompts with path aliases (#41011)

2026-08-27 01:22:23 +00:00

spawn_agent_description.rs

Expose available access programs in model discovery (#44893)

2026-09-11 19:13:04 +00:00

sqlite_state.rs

Preserve runtime workspace roots across thread resume (#43848)

2026-09-08 16:24:38 +00:00

startup_cancellation.rs

Release persistent writers when session startup is cancelled (#44183)

2026-09-09 15:54:07 +00:00

step_settings_compaction.rs

Always use streamed remote compaction for supported providers (#44255)

2026-09-09 18:04:04 +00:00

step_settings_snapshots.rs

Remove retired model entries while preserving migration prompts (#44250)

2026-09-09 17:56:33 +00:00

step_settings.rs

Use captured step settings for request metadata and tool hooks (#45248)

2026-09-13 15:47:59 +00:00

stream_error_allows_next_turn.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

stream_no_completed.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

subagent_notifications.rs

Bind direct tool-call metadata to invocation outputs (#45185)

2026-09-13 06:53:20 +00:00

subagent_service_tier.rs

Make subagents follow the root service tier (#41308)

2026-08-28 09:48:13 +00:00

token_budget.rs

Unify context snapshots and group requests into windows (#44932)

2026-09-11 22:55:38 +00:00

token_usage_rollout.rs

Route rollout reads through the canonical JSON decoder (#42378)

2026-09-02 22:45:19 +00:00

tool_harness.rs

Update tests for default-enabled update_plan (#41630)

2026-08-30 07:40:36 +00:00

tool_lifecycle.rs

Set working directories for environment MCP tests (#41683)

2026-08-30 14:04:06 +00:00

tool_parallelism.rs

Standardize shell execution on unified exec (#39757)

2026-08-20 17:46:05 +00:00

tools.rs

Bind direct tool-call metadata to invocation outputs (#45185)

2026-09-13 06:53:20 +00:00

truncation.rs

Set working directories for environment MCP tests (#41683)

2026-08-30 14:04:06 +00:00

turn_input_submission.rs

Gate new turn submissions on host shutdown admission (#43943)

2026-09-08 23:45:10 +00:00

turn_state.rs

Preserve Markdown formatting when copying TUI responses (#42847)

2026-09-04 20:38:08 +00:00

unified_exec_process_events.rs

Handle pending network reviews after process completion (#42746)

2026-09-04 12:08:02 +00:00

unified_exec_stdin_approval.rs

Discount an approval's own code-mode wrapper from Guardian score lag (#43527)

2026-09-07 17:35:23 +00:00

unified_exec_stdin_review_size.rs

Reject NUL bytes in reviewed terminal input (#41354)

2026-08-28 15:44:48 +00:00

unified_exec_zsh_fork_approvals.rs

Discount an approval's own code-mode wrapper from Guardian score lag (#43527)

2026-09-07 17:35:23 +00:00

unified_exec.rs

Stabilize subagent and unified exec test fixtures (#43936)

2026-09-08 22:31:49 +00:00

unstable_features_warning.rs

Extract persisted history types into a dedicated crate (#37871)

2026-08-10 19:26:52 +00:00

user_notification.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

user_shell_cmd.rs

Support configurable timeouts for thread shell commands (#41384)

2026-08-28 18:07:40 +00:00

view_image.rs

Expose available access programs in model discovery (#44893)

2026-09-11 19:13:04 +00:00

web_search.rs

Add an Amazon Bedrock Runtime provider (#38470)

2026-08-14 01:23:59 +00:00

websocket_fallback.rs

Unify turn input submission and routing (#38275)

2026-08-13 00:00:16 +00:00

window_headers.rs

Use StartThreadOptions across thread fork APIs (#44043)

2026-09-09 04:07:40 +00:00

windows_sandbox.rs

Wire the Windows MXC sandbox into command execution (#45176)

2026-09-13 06:07:03 +00:00

workspace_roots.rs

Authorize apply_patch in the executor path context (#42391)

2026-09-02 23:58:24 +00:00

worktree_trust.rs

Validate linked worktrees before inheriting project trust (#39616)

2026-08-20 06:29:32 +00:00