Feature #10313

[Crunch2] crunch-run config option to use arv-mount for output dir

Added by Tom Clegg over 2 years ago. Updated about 1 month ago.

Status:
Resolved
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Start date:
10/20/2016
Due date:
% Done:

0%

Estimated time:
Story points:
-

History

#1 Updated by Tom Clegg over 2 years ago

The current default (which is a local tempdir) has some shortcomings:
  • Depends on having sufficient disk space on the worker node's local filesystem (with no reason to assume that's true)
  • Unnecessary store-and-forward step

#2 Updated by Peter Amstutz over 2 years ago

This isn't the direct responsibility of crunch-run, the mounts (and output directory) are specified by the container request. It should already be possible to use arv-mount tmp as the output directory, it just requires tweaking arvados-cwl-runner.

#3 Updated by Tom Morris over 1 year ago

  • Target version set to Arvados Future Sprints

#4 Updated by Peter Amstutz over 1 year ago

  • Status changed from New to Resolved

A mentioned in #note-2 the container request submitter can do this with correct mount setup.

#5 Updated by Tom Morris about 1 month ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF