nhamidi-oai 643de86a19 Add audio output support to dynamic tools and code mode (#34080) ...

## What changed

- Add `inputAudio` content items to dynamic tool responses, app-server events, thread history, and generated protocol schemas.
- Add an `audio()` code-mode helper that accepts inline data URLs, audio URL objects, and MCP audio blocks.
- Convert MCP audio blocks into model input when audio is supported, and replace unsupported audio with an explanatory text item.
- Reject non-data audio URLs and track audio item counts in dynamic tool analytics.

## Testing

- Cover audio serialization, protocol round trips, thread-history conversion, MCP modality filtering, code-mode helper inputs, and invalid URL handling.

GitOrigin-RevId: 1ed52a8f9c62d4840fb71c5ec736b4a3566243d6

2026-07-18 23:22:13 +00:00

..

prompts/base_instructions

chore(core) rm AskForApproval::OnFailure (#28418)

2026-06-23 12:13:54 -07:00

account.rs

Support custom transports for Amazon Bedrock (#33695)

2026-07-16 21:41:00 +00:00

agent_path.rs

chore: morpheus to path (#18353)

2026-04-20 10:32:20 +01:00

approvals.rs

Support openai/form extended form elicitations (#27500)

2026-06-18 11:54:49 -07:00

auth.rs

[codex] Add externally provided Codex auth (#31274)

2026-07-07 17:43:19 -07:00

capabilities_tests.rs

Make selected plugin roots URI-native (#28918)

2026-06-23 22:51:19 +01:00

capabilities.rs

Make selected plugin roots URI-native (#28918)

2026-06-23 22:51:19 +01:00

compacted_item.rs

core: add context window lineage IDs (#29256)

2026-06-20 13:15:49 -07:00

config_types.rs

[codex] Add configurable multi-agent mode hint text (#30493)

2026-07-02 18:44:34 -07:00

dynamic_tools.rs

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

error_tests.rs

Honor workspace spend controls in rate-limit handling (#33187)

2026-07-14 22:43:26 +00:00

error.rs

[codex] rename rollout budget error to session budget error (#29744)

2026-06-23 16:49:13 -07:00

exec_output_tests.rs

extract models manager and related ownership from core (#16508)

2026-04-02 23:00:02 -07:00

exec_output.rs

extract models manager and related ownership from core (#16508)

2026-04-02 23:00:02 -07:00

items.rs

Forward audio inputs to the Responses API (#33932)

2026-07-18 00:26:24 +00:00

legacy_events.rs

Remove template IDs from MCP tool call metadata (#33467)

2026-07-16 01:23:52 +00:00

lib.rs

Require prefixes for outbound response item IDs (#32312)

2026-07-11 02:29:14 +00:00

mcp_approval_meta.rs

Route opted-in MCP elicitations through Guardian (#19431)

2026-05-06 19:42:45 +00:00

mcp.rs

Expose MCP server info as part of server status (#24698)

2026-05-28 09:38:34 -07:00

memory_citation.rs

feat: add memory citation to agent message (#14821)

2026-03-18 10:03:38 +00:00

models.rs

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

network_policy.rs

extract models manager and related ownership from core (#16508)

2026-04-02 23:00:02 -07:00

num_format.rs

…

openai_models.rs

Gate audio history by model input modalities (#33982)

2026-07-18 09:13:38 +00:00

parse_command.rs

…

permissions.rs

Remove generated-default filesystem path variants (#33632)

2026-07-16 16:13:53 +00:00

plan_tool.rs

…

protocol.rs

Seed realtime V3 sessions with initial text items (#34067)

2026-07-18 20:59:57 +00:00

request_permissions.rs

Let permission hooks resolve strict auto-review requests (#32232)

2026-07-10 18:12:27 +00:00

request_user_input.rs

Add request_user_input auto-resolution window contract (#27256)

2026-06-11 22:30:41 -07:00

response_item_id_tests.rs

Require prefixes for outbound response item IDs (#32312)

2026-07-11 02:29:14 +00:00

response_item_id.rs

Require prefixes for outbound response item IDs (#32312)

2026-07-11 02:29:14 +00:00

review_format.rs

feat(core): emit canonical review mode items (#31473)

2026-07-08 09:59:50 -07:00

session_id.rs

feat: add session_id (#20437)

2026-05-06 10:48:37 +02:00

shell_environment.rs

expand the set of core shell env vars for Windows. (#20089)

2026-04-29 19:23:46 +00:00

thread_id.rs

app-server: document thread and turn IDs are UUID7 (#27714)

2026-06-23 11:46:36 -07:00

tool_name.rs

Remove ToolName display helper (#21465)

2026-05-08 12:17:48 -07:00

user_input.rs

Forward audio inputs to the Responses API (#33932)

2026-07-18 00:26:24 +00:00