Project

General

Profile

Actions

Story #16442

open

Scalable + reliable container logging

Added by Peter Amstutz about 2 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
12/01/2022
Due date:
03/31/2023 (Due in about 9 months)
% Done:

0%

Estimated time:
Story points:
-
Release:
Release relationship:
Auto

Description

Main things to address are
  • live logs do not scale well (lots of RailsAPI / database / network load when many containers are running, even if no clients are even looking at the logs)
  • when crunch-run or the compute instance dies, last few log entries are a good place to look for clues, and they are lost

Related issues

Related to Arvados - Story #16222: Handle container live logs in a more scalable wayNew

Actions
Related to Arvados - Feature #18790: Access live container logs through arvados-client and crunch-run container gatewayNew

Actions
Actions #1

Updated by Peter Amstutz about 2 years ago

  • Related to Story #16222: Handle container live logs in a more scalable way added
Actions #2

Updated by Peter Amstutz about 2 years ago

  • Start date set to 06/01/2021
  • Due date set to 09/01/2021
Actions #3

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 06/01/2021 to 01/01/2022
  • Due date changed from 09/01/2021 to 03/31/2022
Actions #4

Updated by Peter Amstutz 8 months ago

  • Start date changed from 01/01/2022 to 06/01/2022
  • Due date changed from 03/31/2022 to 09/30/2022
Actions #5

Updated by Peter Amstutz 5 months ago

  • Start date changed from 06/01/2022 to 09/01/2022
  • Due date changed from 09/30/2022 to 12/31/2022
Actions #6

Updated by Tom Clegg 4 months ago

  • Related to Feature #18790: Access live container logs through arvados-client and crunch-run container gateway added
Actions #7

Updated by Tom Clegg 4 months ago

  • Description updated (diff)
  • Subject changed from Redesign live container logs to Scalable + reliable container logging
Actions #8

Updated by Peter Amstutz about 2 months ago

  • Start date changed from 09/01/2022 to 12/01/2022
  • Due date changed from 12/31/2022 to 03/31/2023
Actions

Also available in: Atom PDF