Bug #3097

[Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environment variables

Added by Peter Amstutz over 3 years ago. Updated 9 months ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
1.0

Description

Initial description: JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container.

However: Passing JOB_PARAMETER_* environment variables is already sketchy: total environment tends to be limited and this can effectively limit the size of script_parameters, producing weird results when the limit is reached.

Ability to access script_parameters from a crunch script without doing an additional API call seems worth preserving.

Making the entire script_parameters hash available through a pipe (stdin?) should be more reliable and nearly as convenient as environment variables.


Related issues

Related to Arvados - Bug #7404: [Crunch] crunch-job does not sufficiently sanitize job parameter names when putting them in the environmentNew2015-09-30

Has duplicate Arvados - Bug #3774: [Crunch] crunch-job tries to put non-scalar structures in the environmentClosed2014-08-29

History

#1 Updated by Peter Amstutz over 3 years ago

  • Subject changed from JOB_PARAMETER_INPUT environment variable set by crunch-job is not seralized to json correctly when running a docker container to JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container

#2 Updated by Tom Clegg over 3 years ago

  • Subject changed from JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container to [Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environment variables
  • Description updated (diff)
  • Category set to Crunch
  • Estimated time set to 1.00 h

#3 Updated by Tom Clegg over 3 years ago

  • Estimated time deleted (1.00 h)
  • Story points set to 1.0

#4 Updated by Tom Clegg over 3 years ago

  • Target version set to Arvados Future Sprints

#5 Updated by Tom Clegg 9 months ago

  • Status changed from New to Closed

#6 Updated by Tom Clegg 9 months ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF