Project

General

Profile

Actions

Feature #20219

open

Log panel on container view fetches live logs using periodic range request on new container log endpoint

Added by Peter Amstutz 24 days ago. Updated 18 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Workbench2
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
3.0

Description

https://dev.arvados.org/projects/arvados/wiki/Efficient_live_access_to_container_logs

Stop getting things from the log table.

Get the list of files in the container log collection (via WebDAV):

/arvados/v1/containers/{uuid}/log

Then for the logs the user wants to view, get the data for the individual logs:

/arvados/v1/containers/{uuid}/log/{file}.txt

If the amount of data exceeds some limit (eg 128kb) then only fetch the first 64kb and last 64kb and include a message that some logs were omitted.

Periodically poll to see if the file sizes get bigger and request more data when it is available.


Related issues

Related to Arvados Epics - Story #16442: Scalable + reliable container loggingNew03/15/202305/31/2023

Actions
Blocked by Arvados - Feature #19889: access current container logs at /arvados/v1/containers/{uuid}/log/{filename}In ProgressTom Clegg03/23/2023

Actions
Actions #1

Updated by Peter Amstutz 24 days ago

  • Description updated (diff)
  • Subject changed from Log panel fetches live logs using periodic range request on new WebDAV endpoint to Log panel on container view fetches live logs using periodic range request on new container log endpoint
Actions #2

Updated by Peter Amstutz 24 days ago

  • Related to Story #16442: Scalable + reliable container logging added
Actions #3

Updated by Peter Amstutz 18 days ago

  • Related to Feature #19889: access current container logs at /arvados/v1/containers/{uuid}/log/{filename} added
Actions #4

Updated by Peter Amstutz 18 days ago

  • Related to deleted (Feature #19889: access current container logs at /arvados/v1/containers/{uuid}/log/{filename})
Actions #5

Updated by Peter Amstutz 18 days ago

  • Blocked by Feature #19889: access current container logs at /arvados/v1/containers/{uuid}/log/{filename} added
Actions #6

Updated by Peter Amstutz 18 days ago

  • Story points set to 3.0
Actions #7

Updated by Peter Amstutz 18 days ago

  • Target version changed from To be groomed to To be scheduled
Actions

Also available in: Atom PDF