Project

General

Profile

Actions
Copy link

Feature #19984

closed

Go arvados.Client responds to 503 errors by limiting outgoing connection concurrency

Added by Tom Clegg about 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Tom Clegg
Category:
SDKs
Target version:
2023-03-01 sprint
Story points:
2.0

Description

Before starting an outgoing request, arvados.Client should wait until the number of concurrent outgoing connections would not exceed
  • 0, if a 503 response was received <1s ago
  • the outgoing connection concurrency limit specified by the caller, if any
  • an automatic outgoing concurrency limit which gets decreased by 50% on each 503 and increased by max(10%,1) on each 2xx

The caller should be able to retrieve the client's current connection limit. This will enable dispatchcloud, for example, to reduce the number of containers it attempts to run concurrently in #19973.

Subtasks 1 (0 open — 1 closed)

Task #20116: Review 19973-dispatch-throttleResolvedTom Clegg02/21/2023Actions

Related issues

Related to Arvados - Bug #19973: Dispatcher responds to 503 errors by limiting container concurrencyResolvedTom Clegg02/16/2023Actions
Related to Arvados - Feature #19972: Go arvados.Client retry with backoffResolvedTom Clegg03/08/2023Actions
Actions
Copy link
 #1

Updated by Tom Clegg about 1 year ago

  • Related to Bug #19973: Dispatcher responds to 503 errors by limiting container concurrency added
Actions
Copy link
 #2

Updated by Tom Clegg about 1 year ago

  • Story points set to 2.0
  • Target version set to Future
Actions
Copy link
 #3

Updated by Peter Amstutz about 1 year ago

  • Target version changed from Future to To be scheduled
Actions
Copy link
 #4

Updated by Peter Amstutz about 1 year ago

  • Target version changed from To be scheduled to 2023-02-15 sprint
Actions
Copy link
 #5

Updated by Peter Amstutz about 1 year ago

  • Assigned To set to Tom Clegg
Actions
Copy link
 #6

Updated by Peter Amstutz about 1 year ago

  • Target version changed from 2023-02-15 sprint to 2023-03-01 sprint
Actions
Copy link
 #7

Updated by Peter Amstutz about 1 year ago

  • Assigned To deleted (Tom Clegg)
Actions
Copy link
 #8

Updated by Tom Clegg about 1 year ago

  • Related to Feature #19972: Go arvados.Client retry with backoff added
Actions
Copy link
 #9

Updated by Tom Clegg about 1 year ago

  • Assigned To set to Tom Clegg
  • Status changed from New to In Progress
Actions
Copy link
 #10

Updated by Tom Clegg about 1 year ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF