Project

General

Profile

Actions

Bug #3097

closed

[Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environment variables

Added by Peter Amstutz almost 10 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Story points:
1.0

Description

Initial description: JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container.

However: Passing JOB_PARAMETER_* environment variables is already sketchy: total environment tends to be limited and this can effectively limit the size of script_parameters, producing weird results when the limit is reached.

Ability to access script_parameters from a crunch script without doing an additional API call seems worth preserving.

Making the entire script_parameters hash available through a pipe (stdin?) should be more reliable and nearly as convenient as environment variables.


Related issues

Related to Arvados - Bug #7404: [Crunch] crunch-job does not sufficiently sanitize job parameter names when putting them in the environmentClosed09/30/2015Actions
Has duplicate Arvados - Bug #3774: [Crunch] crunch-job tries to put non-scalar structures in the environmentClosed08/29/2014Actions
Actions #1

Updated by Peter Amstutz almost 10 years ago

  • Subject changed from JOB_PARAMETER_INPUT environment variable set by crunch-job is not seralized to json correctly when running a docker container to JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container
Actions #2

Updated by Tom Clegg over 9 years ago

  • Subject changed from JOB_PARAMETER_* environment variables set by crunch-job are not seralized to json correctly when running a docker container to [Crunch] Pass script_parameters on stdin instead of JOB_PARAMETER_* environment variables
  • Description updated (diff)
  • Category set to Crunch
  • Estimated time set to 1.00 h
Actions #3

Updated by Tom Clegg over 9 years ago

  • Estimated time deleted (1.00 h)
  • Story points set to 1.0
Actions #4

Updated by Tom Clegg over 9 years ago

  • Target version set to Arvados Future Sprints
Actions #5

Updated by Tom Clegg about 7 years ago

  • Status changed from New to Closed
Actions #6

Updated by Tom Clegg about 7 years ago

  • Target version deleted (Arvados Future Sprints)
Actions

Also available in: Atom PDF