Project

General

Profile

Actions
Copy link

Feature #19984

closed

Go arvados.Client responds to 503 errors by limiting outgoing connection concurrency

Added by Tom Clegg about 2 years ago. Updated about 2 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Tom Clegg
Category:
SDKs
Target version:
2023-03-01 sprint
Story points:
2.0

Description

Before starting an outgoing request, arvados.Client should wait until the number of concurrent outgoing connections would not exceed
  • 0, if a 503 response was received <1s ago
  • the outgoing connection concurrency limit specified by the caller, if any
  • an automatic outgoing concurrency limit which gets decreased by 50% on each 503 and increased by max(10%,1) on each 2xx

The caller should be able to retrieve the client's current connection limit. This will enable dispatchcloud, for example, to reduce the number of containers it attempts to run concurrently in #19973.

Subtasks 1 (0 open — 1 closed)

Task #20116: Review 19973-dispatch-throttleResolvedTom Clegg02/21/2023Actions

Related issues 2 (0 open — 2 closed)

Related to Arvados - Bug #19973: Dispatcher responds to 503 errors by limiting container concurrencyResolvedTom Clegg02/16/2023Actions
Related to Arvados - Feature #19972: Go arvados.Client retry with backoffResolvedTom Clegg03/08/2023Actions
Actions
Copy link
 #1

Updated by Tom Clegg about 2 years ago

  • Related to Bug #19973: Dispatcher responds to 503 errors by limiting container concurrency added
Actions
Copy link
 #2

Updated by Tom Clegg about 2 years ago

  • Story points set to 2.0
  • Target version set to Future
Actions
Copy link
 #3

Updated by Peter Amstutz about 2 years ago

  • Target version changed from Future to To be scheduled
Actions
Copy link
 #4

Updated by Peter Amstutz about 2 years ago

  • Target version changed from To be scheduled to 2023-02-15 sprint
Actions
Copy link
 #5

Updated by Peter Amstutz about 2 years ago

  • Assigned To set to Tom Clegg
Actions
Copy link
 #6

Updated by Peter Amstutz about 2 years ago

  • Target version changed from 2023-02-15 sprint to 2023-03-01 sprint
Actions
Copy link
 #7

Updated by Peter Amstutz about 2 years ago

  • Assigned To deleted (Tom Clegg)
Actions
Copy link
 #8

Updated by Tom Clegg about 2 years ago

  • Related to Feature #19972: Go arvados.Client retry with backoff added
Actions
Copy link
 #9

Updated by Tom Clegg about 2 years ago

  • Assigned To set to Tom Clegg
  • Status changed from New to In Progress
Actions
Copy link
 #10

Updated by Tom Clegg about 2 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF