felixxia-oai ffc1402633 Interrupt and drain canceled classifier responses before socket reuse (#53698) ...

## Why

Canceled classifier requests need bounded cleanup that preserves received token usage and returns only safe WebSocket connections to the pool.

## What changed

- Own classifier response streams and connection leases together, interrupting dropped responses with a one-second cleanup deadline.
- Require a matching interruption acknowledgement and response completion before reusing a canceled response's socket. Retire sockets on rejection, invalid acknowledgements, or timeout while preserving any received completion and token usage.
- Skip requests canceled before dispatch and return their unused sockets to the pool.
- Distinguish cancellation from ordinary steering, which continues draining without requiring an interruption acknowledgement.

## Testing

Add regression coverage for cancellation, acknowledgement ordering and failures, cleanup timeouts, socket reuse, and token accounting under backpressure. Extend steering tests to cover rejected and missing acknowledgements.

GitOrigin-RevId: c4e7aac49d36cea2c2d0e9f2ba5f6147f67471dd

2026-10-13 15:24:00 +00:00

..

src

Interrupt and drain canceled classifier responses before socket reuse (#53698)

2026-10-13 15:24:00 +00:00

BUILD.bazel

Run Guardian conversation classifiers concurrently and preserve action order (#52061)

2026-10-08 10:42:28 +00:00

Cargo.toml

Run Guardian conversation classifiers concurrently and preserve action order (#52061)

2026-10-08 10:42:28 +00:00