Bug #3097

[Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environment variables

Added by Peter Amstutz about 3 years ago. Updated 4 months ago.

Status:ClosedStart date:
Priority:NormalDue date:
Assignee:-% Done:

0%

Category:Crunch
Target version:-
Story points1.0
Velocity based estimate-

Description

Initial description: JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container.

However: Passing JOB_PARAMETER_* environment variables is already sketchy: total environment tends to be limited and this can effectively limit the size of script_parameters, producing weird results when the limit is reached.

Ability to access script_parameters from a crunch script without doing an additional API call seems worth preserving.

Making the entire script_parameters hash available through a pipe (stdin?) should be more reliable and nearly as convenient as environment variables.


Related issues

Related to Arvados - Bug #7404: [Crunch] crunch-job does not sufficiently sanitize job pa... New 09/30/2015
Duplicated by Arvados - Bug #3774: [Crunch] crunch-job tries to put non-scalar structures in... Closed 08/29/2014

History

#1 Updated by Peter Amstutz about 3 years ago

  • Subject changed from JOB_PARAMETER_INPUT environment variable set by crunch-job is not seralized to json correctly when running a docker container to JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container

#2 Updated by Tom Clegg almost 3 years ago

  • Subject changed from JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container to [Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environment variables
  • Description updated (diff)
  • Category set to Crunch
  • Estimated time set to 1.00

#3 Updated by Tom Clegg almost 3 years ago

  • Estimated time deleted (1.00)
  • Story points set to 1.0

#4 Updated by Tom Clegg almost 3 years ago

  • Target version set to Arvados Future Sprints

#5 Updated by Tom Clegg 4 months ago

  • Status changed from New to Closed

#6 Updated by Tom Clegg 4 months ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF