Jiayong LiBug #15486
closed
[crunchstat-summary] error fetching container log collection for v1.4+
Description
When attempting to analyze Arvados v1.4 container requests, crunchstat-summary attempts to load the collection specified by the log PDH in the Container record, but that collection never exists because it is deleted immediately. Also there is no longer a `log` field for the container_request record.
For Arvados v1.4 and up, crunchstat-summary needs to be modified so that:- for Containers, it first looks up the associated Container Request and uses the log from there
- for Container Requests, remove the current logic which looks up the associated Container log and instead load the CR log by UUID from `log_uuid` (there is no `log` field)
Related issues
Updated by Tom Morris about 5 years ago
I need to add some v1.4+ tests, but the code on branch 15486-crunchstat-summary-v1.4-support should be usable for those who need an immediate workaround.
Updated by Tom Morris about 5 years ago
- Target version changed from 2019-07-31 Sprint to 2019-08-14 Sprint
Updated by Tom Morris about 5 years ago
- Blocks Idea #14952: [crunchstat-summary] Add arv-mount FUSE ops time added
Updated by Eric Biagiotti about 5 years ago
Reviewing at d2393e33ce53554ebd271244bf988d92fdd5293e.
- Looks like you forgot to add
container_request_9tee4-xvhdp-kk0ja1cl8b2kr1y-arv-mount.txt.gz.report
- Might want to check if len(items) > 0 in the following:
process = arv.container_requests().list(filters=[['container_uuid','=',uuid]],limit=1).execute()['items'][0]
Also please do a developer run on jerkins once you're done. Thanks!
Updated by Tom Morris about 5 years ago
- Assigned To changed from Tom Morris to Eric Biagiotti
Both issues fixed at dce9a9c4800a79d357fd6a8400b81c9b7404dbd5
Developer tests running at https://ci.curoverse.com/view/Developer/job/developer-run-tests/1478/
Updated by Eric Biagiotti about 5 years ago
- Assigned To changed from Eric Biagiotti to Tom Morris
Updated by Tom Morris about 5 years ago
- Status changed from In Progress to Resolved
Merged at 86b7903116608ac3a8314437639cb61d774fb510