Project

General

Profile

Actions

Idea #16442

closed

Scalable + reliable container logging

Added by Peter Amstutz almost 4 years ago. Updated 7 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
03/15/2023
Due date:
08/31/2023
Story points:
-
Release:
Release relationship:
Auto

Description

Objectives, proposed architecture, and implementation notes: Efficient live access to container logs


Related issues

Related to Arvados - Feature #18790: Access live container logs through arvados-client and crunch-run container gatewayResolvedTom Clegg04/04/2023Actions
Related to Arvados - Feature #19889: access current container logs at /arvados/v1/containers/{uuid}/log/{filename}ResolvedTom Clegg03/23/2023Actions
Related to Arvados - Feature #20217: crunch-run WebDAV service providing access to latest logsDuplicateActions
Related to Arvados - Feature #20218: Container log endpoint in controller that routes to either crunch-run or keep-webDuplicateActions
Related to Arvados - Feature #20219: Log panel on container view fetches live logs using periodic range request on new container log endpointResolvedStephen Smith07/28/2023Actions
Related to Arvados - Feature #20220: Dispatcher uses live logs endpoint on crunch-run to fetch logs and store a backup locallyNewActions
Related to Arvados - Idea #20258: "Live" log view should show users the most recent logs, wherever those areResolved03/06/202303/06/2023Actions
Related to Arvados - Feature #20310: Add server-sent events stream at .../containers/{uuid}/log_eventsNewActions
Related to Arvados - Feature #20319: Move containers/{uuid}/log/ to container_requests/{uuid}/log/ResolvedTom Clegg04/21/2023Actions
Related to Arvados - Feature #20433: Config option to have crunch-run stop sending logs to logs tableResolvedBrett Smith05/31/2023Actions
Related to Arvados - Idea #20458: Document arvados-client logs commandNewActions
Related to Arvados - Bug #20804: crunchstat-summary should use container logs API, not CollectionReader and logs tableNewActions
Related to Arvados - Idea #20955: Crunch log transition documentation issuesResolvedPeter Amstutz09/15/2023Actions
Has duplicate Arvados - Idea #16222: Handle container live logs in a more scalable wayResolvedActions
Blocks Arvados Epics - Idea #20599: Scaling to 1000s of concurrent containersResolved06/01/202303/31/2024Actions
Actions

Also available in: Atom PDF