tongzhou wang
3b8bd2ee7e
Add request IDs and attempt numbers to model request hooks ( #61587 )
...
## Why
Model request hooks need to correlate attempts belonging to the same generation across retries and model fallback.
## What changed
Add `request_id` and one-based `attempt_number` fields to `PreModelRequest` and `PostModelRequest` inputs and their generated schema. Keep the request ID stable across retries and increment the attempt number for each call to open a response stream.
## Testing
Extend hook tests to verify matching request IDs and increasing attempt numbers across retries. Extend the background compaction scenario to verify that its pre/post hooks share an ID distinct from the ordinary sampling request.
GitOrigin-RevId: 2d85ad6fd630505a89a712cebab6ca0f731610c9
2026-11-15 00:39:00 +00:00
..
2026-11-13 18:46:13 +00:00
2026-11-12 23:51:52 +00:00
2026-11-12 22:41:50 +00:00
2026-11-13 21:51:53 +00:00
2026-11-13 04:51:06 +00:00
2026-11-14 15:44:38 +00:00
2026-11-14 08:47:48 +00:00
2026-11-10 01:31:19 +00:00
2026-11-14 07:09:26 +00:00
2026-11-14 02:23:37 +00:00
2026-11-07 10:41:36 +00:00
2026-11-07 10:41:36 +00:00
2026-11-13 04:48:28 +00:00
2026-11-05 22:03:29 +00:00
2026-11-14 02:23:37 +00:00
2026-11-14 08:47:48 +00:00
2026-11-13 22:31:23 +00:00
2026-11-05 05:09:32 +00:00
2026-11-05 05:09:32 +00:00
2026-11-13 21:53:25 +00:00
2026-11-13 21:53:25 +00:00
2026-11-13 21:53:25 +00:00
2026-11-12 23:51:52 +00:00
2026-11-14 15:44:38 +00:00
2026-11-14 23:52:50 +00:00
2026-11-14 23:50:12 +00:00
2026-11-10 03:02:25 +00:00
2026-11-13 01:08:55 +00:00
2026-11-07 05:59:44 +00:00
2026-11-15 00:39:00 +00:00
2026-11-12 22:43:14 +00:00
2026-11-14 02:45:51 +00:00
2026-11-12 23:51:52 +00:00
2026-11-13 20:23:24 +00:00
2026-11-14 02:23:37 +00:00
2026-11-13 20:24:37 +00:00
2026-11-13 20:24:37 +00:00
2026-11-13 18:53:14 +00:00
2026-11-05 00:55:46 +00:00
2026-11-14 15:44:38 +00:00
2026-11-12 23:51:52 +00:00
2026-11-14 23:53:23 +00:00
2026-11-14 02:45:51 +00:00
2026-11-06 00:37:27 +00:00
2026-11-10 08:52:35 +00:00
2026-11-14 08:26:47 +00:00
2026-11-13 18:47:46 +00:00
2026-11-14 06:14:36 +00:00
2026-11-15 00:39:00 +00:00
2026-11-13 05:16:33 +00:00
2026-11-12 04:32:34 +00:00
2026-11-13 20:24:37 +00:00
2026-11-12 23:53:50 +00:00
2026-11-14 00:32:02 +00:00
2026-11-12 22:41:50 +00:00
2026-11-13 21:52:54 +00:00
2026-11-06 04:24:04 +00:00
2026-11-13 21:52:54 +00:00
2026-11-13 01:43:44 +00:00
2026-11-14 01:11:17 +00:00
2026-11-14 01:21:54 +00:00
2026-11-13 00:29:24 +00:00
2026-11-14 23:53:53 +00:00
2026-11-11 18:58:21 +00:00
2026-11-14 01:21:54 +00:00
2026-11-14 06:14:36 +00:00
2026-11-14 01:32:55 +00:00
2026-11-07 10:41:36 +00:00
2026-11-13 20:24:37 +00:00
2026-11-12 23:51:52 +00:00
2026-11-13 23:15:54 +00:00
2026-11-12 23:51:52 +00:00
2026-11-06 17:47:31 +00:00
2026-11-14 07:09:26 +00:00
2026-11-14 00:57:54 +00:00
2026-11-14 23:50:12 +00:00
2026-11-14 07:09:26 +00:00
2026-11-14 23:52:50 +00:00
2026-11-14 08:47:48 +00:00
2026-11-12 00:44:27 +00:00
2026-11-14 05:00:21 +00:00
2026-11-13 18:51:30 +00:00
2026-11-12 23:51:52 +00:00
2026-11-12 23:51:52 +00:00
2026-11-12 05:21:30 +00:00
2026-11-13 22:31:23 +00:00
2026-11-12 23:53:50 +00:00
2026-11-13 22:18:01 +00:00
2026-11-14 23:53:53 +00:00
2026-11-13 21:50:24 +00:00
2026-11-13 20:24:37 +00:00
2026-11-12 23:51:52 +00:00