Bug #11549

[CWL] Avoid mounting individual files

Added by Peter Amstutz over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
04/27/2017
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
0.5

Description

arvados-cwl-runner, trying to submit a container with about 200,000 individual files, created a separate entry in container request "mounts" entry for every.

It should only mount each collection once.


Subtasks

Task #11563: Consolidate mountsResolvedPeter Amstutz

Task #11574: Review 11549-cwl-smarter-mountsResolvedPeter Amstutz


Related issues

Related to Arvados - Bug #11547: [API] Excessive memory and time consumed by API and dispatch when container fields (like "mounts") are largeNew

Related to Arvados - Bug #11546: Expensive container lock/unlockResolved05/17/2017

Associated revisions

Revision e39a7d57
Added by Peter Amstutz over 4 years ago

Merge branch '11549-cwl-smarter-mounts' closes #11549

Revision fea486f9 (diff)
Added by Peter Amstutz over 4 years ago

Crunch script doesn't fail in file/directory literals that don't have a 'location'. refs #11549

History

#1 Updated by Peter Amstutz over 4 years ago

  • Description updated (diff)

#2 Updated by Peter Amstutz over 4 years ago

  • Target version set to 2017-05-10 sprint

#3 Updated by Peter Amstutz over 4 years ago

  • Assigned To set to Peter Amstutz

#4 Updated by Lucas Di Pentima over 4 years ago

This LGTM.
Local sdk/cwl tests ran succesfully.

#5 Updated by Peter Amstutz over 4 years ago

  • Status changed from New to Resolved

Applied in changeset arvados|commit:e39a7d5704932cbec606e85cdca50aa38a1ed053.

Also available in: Atom PDF