nhamidi-oai 643de86a19 Add audio output support to dynamic tools and code mode (#34080) ...

## What changed

- Add `inputAudio` content items to dynamic tool responses, app-server events, thread history, and generated protocol schemas.
- Add an `audio()` code-mode helper that accepts inline data URLs, audio URL objects, and MCP audio blocks.
- Convert MCP audio blocks into model input when audio is supported, and replace unsupported audio with an explanatory text item.
- Reject non-data audio URLs and track audio item counts in dynamic tool analytics.

## Testing

- Cover audio serialization, protocol round trips, thread-history conversion, MCP modality filtering, code-mode helper inputs, and invalid URL handling.

GitOrigin-RevId: 1ed52a8f9c62d4840fb71c5ec736b4a3566243d6

2026-07-18 23:22:13 +00:00

..

v1

Support openai/form extended form elicitations (#27500)

2026-06-18 11:54:49 -07:00

v2

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

ApplyPatchApprovalParams.json

chore: remove codex-core public protocol/shell re-exports (#12432)

2026-02-20 23:45:35 -08:00

ApplyPatchApprovalResponse.json

representing guardian review timeouts in protocol types (#17381)

2026-04-10 20:02:33 -07:00

AttestationGenerateParams.json

[codex] request desktop attestation from app (#20619)

2026-05-08 12:36:02 -07:00

AttestationGenerateResponse.json

[codex] request desktop attestation from app (#20619)

2026-05-08 12:36:02 -07:00

ChatgptAuthTokensRefreshParams.json

fix(app-server): for external auth, replace id_token with chatgpt_acc… (#11240)

2026-02-09 20:48:58 -08:00

ChatgptAuthTokensRefreshResponse.json

fix(app-server): for external auth, replace id_token with chatgpt_acc… (#11240)

2026-02-09 20:48:58 -08:00

ClientNotification.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

ClientRequest.json

Seed realtime V3 sessions with initial text items (#34067)

2026-07-18 20:59:57 +00:00

codex_app_server_protocol.schemas.json

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

codex_app_server_protocol.v2.schemas.json

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

CommandExecutionRequestApprovalParams.json

Preserve special filesystem subpaths as wire strings (#33107)

2026-07-14 16:40:13 +00:00

CommandExecutionRequestApprovalResponse.json

feat: include available decisions in command approval requests (#12758)

2026-02-26 01:10:46 +00:00

DynamicToolCallParams.json

app-server: define device key v2 protocol (#18428)

2026-04-21 10:08:42 -07:00

DynamicToolCallResponse.json

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

ExecCommandApprovalParams.json

chore: remove codex-core public protocol/shell re-exports (#12432)

2026-02-20 23:45:35 -08:00

ExecCommandApprovalResponse.json

representing guardian review timeouts in protocol types (#17381)

2026-04-10 20:02:33 -07:00

FileChangeRequestApprovalParams.json

[codex-analytics] plumb protocol-native review timing (#21434)

2026-05-07 20:31:41 -07:00

FileChangeRequestApprovalResponse.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

FuzzyFileSearchParams.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

FuzzyFileSearchResponse.json

Simple directory mentions (#14970)

2026-03-19 05:24:09 +00:00

FuzzyFileSearchSessionCompletedNotification.json

[app-server] add fuzzyFileSearch/sessionCompleted (#11773)

2026-02-13 15:08:14 -08:00

FuzzyFileSearchSessionUpdatedNotification.json

Simple directory mentions (#14970)

2026-03-19 05:24:09 +00:00

JSONRPCError.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

JSONRPCErrorError.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

JSONRPCMessage.json

feat(app-server): add tracing to all app-server APIs (#13285)

2026-03-02 16:01:41 -08:00

JSONRPCNotification.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

JSONRPCRequest.json

feat(app-server): add tracing to all app-server APIs (#13285)

2026-03-02 16:01:41 -08:00

JSONRPCResponse.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

McpServerElicitationRequestParams.json

Support openai/form extended form elicitations (#27500)

2026-06-18 11:54:49 -07:00

McpServerElicitationRequestResponse.json

[elicitations] Switch to use MCP style elicitation payload for mcp tool approvals. (#13621)

2026-03-06 01:50:26 -08:00

PermissionsRequestApprovalParams.json

Preserve special filesystem subpaths as wire strings (#33107)

2026-07-14 16:40:13 +00:00

PermissionsRequestApprovalResponse.json

Preserve special filesystem subpaths as wire strings (#33107)

2026-07-14 16:40:13 +00:00

RequestId.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00

ServerNotification.json

Add audio output support to dynamic tools and code mode (#34080)

2026-07-18 23:22:13 +00:00

ServerRequest.json

Preserve special filesystem subpaths as wire strings (#33107)

2026-07-14 16:40:13 +00:00

ToolRequestUserInputParams.json

Add request_user_input auto-resolution window contract (#27256)

2026-06-11 22:30:41 -07:00

ToolRequestUserInputResponse.json

feat: vendor app-server protocol schema fixtures (#10371)

2026-02-01 23:38:43 -08:00