Krish Chainani 7b8b17b97a Support image references by file ID in inputs and tool outputs (#45794) ...

## What changed

- Accept `fileId` alongside the existing `url` form for app-server image inputs, and forward file references to the Responses API as `file_id`. Update generated schemas and client types.
- Preserve file references, image detail hints, and mixed inline/file image ordering through user-message events, thread history, and rollout migration. Retain file images when truncating tool output.
- Pass file references through image preparation without resolving them, while keeping resize-notice numbering correct. Omit them from unsupported TUI display and Guardian image context.
- Reject image-edit requests whose recent-image window includes a file reference, preventing selection of an older inline image instead.

## Testing

Add coverage for serialization, request and rollout preservation, mixed-image history ordering, incomplete ordering metadata, tool-output truncation, and rejection of unsupported image-edit selections.

GitOrigin-RevId: 6ca20a8577155cc934b720803c3b7b3bffdf972a

2026-09-15 21:19:08 +00:00

..

profile

Preserve Guardian authorization evidence until request budgeting (#44570)

2026-09-10 16:02:36 +00:00

action.rs

Preserve complete actions in Guardian approval reviews (#44569)

2026-09-10 16:01:02 +00:00

authorization.rs

Preserve root authorization context in Guardian reviews (#42832)

2026-09-04 19:19:04 +00:00

budget_tests.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

budget.rs

Support image references by file ID in inputs and tool outputs (#45794)

2026-09-15 21:19:08 +00:00

composition_tests.rs

Preserve complete actions in Guardian approval reviews (#44569)

2026-09-10 16:01:02 +00:00

composition.rs

Support image references by file ID in inputs and tool outputs (#45794)

2026-09-15 21:19:08 +00:00

cursor_tests.rs

Extract guardian transcript selection into guardian-context (#45417)

2026-09-14 12:52:16 +00:00

cursor.rs

Extract guardian transcript selection into guardian-context (#45417)

2026-09-14 12:52:16 +00:00

enforcement_tests.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

enforcement.rs

Support image references by file ID in inputs and tool outputs (#45794)

2026-09-15 21:19:08 +00:00

entry.rs

Preserve Guardian authorization evidence until request budgeting (#44570)

2026-09-10 16:02:36 +00:00

history_tests.rs

Refactor image content to use a shared ImageReference type (#45543)

2026-09-14 23:25:09 +00:00

history.rs

Bind direct tool-call metadata to invocation outputs (#45185)

2026-09-13 06:53:20 +00:00

images_tests.rs

Support image references by file ID in inputs and tool outputs (#45794)

2026-09-15 21:19:08 +00:00

images.rs

Support image references by file ID in inputs and tool outputs (#45794)

2026-09-15 21:19:08 +00:00

lib.rs

Extract guardian transcript selection into guardian-context (#45417)

2026-09-14 12:52:16 +00:00

node_repl.rs

Support image references by file ID in inputs and tool outputs (#45794)

2026-09-15 21:19:08 +00:00

permissions.rs

Move Guardian permission context into the shared section registry (#43538)

2026-09-07 18:10:05 +00:00

profile_tests.rs

Preserve Guardian authorization evidence until request budgeting (#44570)

2026-09-10 16:02:36 +00:00

profile.rs

Preserve Guardian authorization evidence until request budgeting (#44570)

2026-09-10 16:02:36 +00:00

registry_tests.rs

Bound MCP descriptions separately from Guardian action JSON (#44493)

2026-09-10 10:38:10 +00:00

retained_instructions_tests.rs

Retain inherited Guardian instructions in standalone forks (#43478)

2026-09-07 13:58:57 +00:00

retained_instructions.rs

Recover missing Guardian root instructions in acceptance order (#43472)

2026-09-07 13:40:29 +00:00

reviews_tests.rs

Centralize bounded Guardian review evidence in guardian-context (#43595)

2026-09-07 21:20:31 +00:00

reviews.rs

Centralize bounded Guardian review evidence in guardian-context (#43595)

2026-09-07 21:20:31 +00:00

section.rs

Move Guardian REPL evidence rendering into the shared context registry (#43602)

2026-09-07 21:54:56 +00:00

transcript_tests.rs

Consolidate guardian transcript tests in guardian-context (#45683)

2026-09-15 12:14:59 +00:00

transcript.rs

Preserve Guardian authorization evidence until request budgeting (#44570)

2026-09-10 16:02:36 +00:00

truncation_tests.rs

Add shared Guardian context primitives (#41392)

2026-08-28 19:02:26 +00:00

truncation.rs

Add aggregate budget enforcement for Guardian context (#44166)

2026-09-09 14:55:36 +00:00

trusted_skills_tests.rs

Move trusted skill evidence into the Guardian context registry (#43599)

2026-09-07 21:38:25 +00:00

trusted_skills.rs

Move trusted skill evidence into the Guardian context registry (#43599)

2026-09-07 21:38:25 +00:00

trusted_tool_tests.rs

Move trusted tool metadata into shared Guardian context (#43597)

2026-09-07 21:29:31 +00:00

trusted_tool.rs

Move trusted tool metadata into shared Guardian context (#43597)

2026-09-07 21:29:31 +00:00

verified_answers.rs

Recover missing Guardian root instructions in acceptance order (#43472)

2026-09-07 13:40:29 +00:00