Project

General

Profile

Actions

Bug #15486

closed

[crunchstat-summary] error fetching container log collection for v1.4+

Added by Tom Morris over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Tom Morris
Category:
-
Target version:
Story points:
-
Release relationship:
Auto

Description

When attempting to analyze Arvados v1.4 container requests, crunchstat-summary attempts to load the collection specified by the log PDH in the Container record, but that collection never exists because it is deleted immediately. Also there is no longer a `log` field for the container_request record.

For Arvados v1.4 and up, crunchstat-summary needs to be modified so that:
  • for Containers, it first looks up the associated Container Request and uses the log from there
  • for Container Requests, remove the current logic which looks up the associated Container log and instead load the CR log by UUID from `log_uuid` (there is no `log` field)

Subtasks 1 (0 open1 closed)

Task #15513: Review 15486-crunchstat-summary-v1.4-supportResolvedEric Biagiotti08/13/2019Actions

Related issues

Blocks Arvados - Idea #14952: [crunchstat-summary] Add arv-mount FUSE ops timeNewActions
Actions #2

Updated by Tom Morris over 4 years ago

  • Description updated (diff)
Actions #3

Updated by Tom Morris over 4 years ago

I need to add some v1.4+ tests, but the code on branch 15486-crunchstat-summary-v1.4-support should be usable for those who need an immediate workaround.

Actions #4

Updated by Tom Morris over 4 years ago

  • Target version changed from 2019-07-31 Sprint to 2019-08-14 Sprint
Actions #5

Updated by Tom Morris over 4 years ago

  • Blocks Idea #14952: [crunchstat-summary] Add arv-mount FUSE ops time added
Actions #6

Updated by Eric Biagiotti over 4 years ago

Reviewing at d2393e33ce53554ebd271244bf988d92fdd5293e.

  • Might want to check if len(items) > 0 in the following:
    process = arv.container_requests().list(filters=[['container_uuid','=',uuid]],limit=1).execute()['items'][0]
    

Also please do a developer run on jerkins once you're done. Thanks!

Actions #7

Updated by Tom Morris over 4 years ago

  • Assigned To changed from Tom Morris to Eric Biagiotti

Both issues fixed at dce9a9c4800a79d357fd6a8400b81c9b7404dbd5

Developer tests running at https://ci.curoverse.com/view/Developer/job/developer-run-tests/1478/

Actions #8

Updated by Eric Biagiotti over 4 years ago

  • Assigned To changed from Eric Biagiotti to Tom Morris
Actions #9

Updated by Tom Morris over 4 years ago

  • Status changed from In Progress to Resolved

Merged at 86b7903116608ac3a8314437639cb61d774fb510

Actions #10

Updated by Tom Morris over 4 years ago

  • Release set to 26
Actions

Also available in: Atom PDF