Project

General

Profile

Actions

Bug #21904

closed

Remove feature that rejects POST arvados/v1/logs immediately when any requests are queued

Added by Tom Clegg 2 months ago. Updated 25 days ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
API
Story points:
-
Release:
Release relationship:
Auto

Description

In #20602 we started rejecting "POST /arvados/v1/logs" requests instead of queueing them when all active request slots are full. The idea was to drop container-logging events outright during busy periods (i.e., when any requests are queued) -- otherwise, when lots of containers were running, these frequent requests would quickly fill up the queue and cause more important non-interactive requests, like saving container output collections, to fail.

This is no longer needed because crunch-run no longer sends POST /arvados/v1/logs requests at all.

Now, POST /arvados/v1/logs requests are more likely to come from the "log uploads and downloads" feature of keep-web, and the above rationale does not apply.

Instead, these should be queued the same way as other non-interactive requests.

(This has also caused an additional problem where keep-web's outgoing request throttle gets triggered by the premature 503s. That problem could be fixed on the client side, but a client-side fix wouldn't address the problem of upload/download logs being skipped whenever the controller is even moderately busy. So it makes more sense to just fix the server side.)


Subtasks 1 (0 open1 closed)

Task #22007: Review 21904-no-unqueueable-reqsResolvedTom Clegg07/30/2024Actions

Related issues

Related to Arvados - Bug #21748: awscli downloads from keep-web slowlyResolvedTom CleggActions
Actions

Also available in: Atom PDF