-
Notifications
You must be signed in to change notification settings - Fork 8
Description
Summary
settings.auction.timeout_ms is passed to AuctionContext but the orchestrator uses select() which blocks until each pending request completes or hits the backend's first_byte_timeout (15s). There is no mechanism to abort remaining requests when the auction timeout is reached. Waits can extend to backend timeouts.
Refs
crates/common/src/auction/endpoints.rsline 51 —timeout_ms: settings.auction.timeout_mscrates/common/src/auction/provider.rsline 54 —fn timeout_ms(&self) -> u32crates/common/src/auction/orchestrator.rsline 287 —while !remaining.is_empty() { select(remaining) }crates/common/src/backend.rslines 118-119 — hardcoded 15s first_byte_timeout
Recommendation
Implement a deadline-based loop that drops remaining pending requests when timeout_ms elapses, returning partial results.
Context
Production readiness audit — see #396
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels