Project

General

Profile

Actions

Idea #3347

closed

[Crunch] Run dev (and real) jobs using a syntax as close as possible to "python foo.py input.txt"

Added by Tom Clegg over 9 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Story points:
2.0

Description

See Python SDK design draft.

Running programs with Crunch should look more like this

python foo.py input.txt

and less like this

git commit -am -
git push
arv job create --job '{"script_name":"foo.py","script_parameters":{"input":"acbd18db4cc2f85cedef654fccc4a4d8+3/input.txt"},"script_version":"master"}'
This is easier to achieve when the following conditions are met:
  • foo.py is already in a git repository, committed and pushed to git@git.*.arvadosapi.com:waz.git
We will probably need to defer:
  • Automatically commit uncommitted changes
  • Automatically push to origin

Related issues

Follows Arvados - Idea #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jobs" and "reusable tasks" ideasClosed08/27/2014Actions
Actions

Also available in: Atom PDF