Story #3347

[Crunch] Run dev (and real) jobs using a syntax as close as possible to "python foo.py input.txt"

Added by Tom Clegg over 3 years ago. Updated 11 months ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Start date:
08/28/2014
Due date:
08/28/2014
% Done:

0%

Estimated time:
Story points:
2.0

Description

See Python SDK design draft.

Running programs with Crunch should look more like this

python foo.py input.txt

and less like this

git commit -am -
git push
arv job create --job '{"script_name":"foo.py","script_parameters":{"input":"acbd18db4cc2f85cedef654fccc4a4d8+3/input.txt"},"script_version":"master"}'
This is easier to achieve when the following conditions are met:
  • foo.py is already in a git repository, committed and pushed to git@git.*.arvadosapi.com:waz.git
We will probably need to defer:
  • Automatically commit uncommitted changes
  • Automatically push to origin

Related issues

Follows Arvados - Story #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jobs" and "reusable tasks" ideasClosed2014-08-27

History

#1 Updated by Peter Amstutz over 3 years ago

I don't understand what this story is saying at all.

#2 Updated by Tom Clegg over 3 years ago

  • Description updated (diff)

#3 Updated by Ward Vandewege over 3 years ago

  • Target version changed from Arvados Future Sprints to 2014-09-17 sprint

#4 Updated by Tom Clegg over 3 years ago

  • Description updated (diff)
  • Category set to Crunch

#5 Updated by Tom Clegg over 3 years ago

  • Target version changed from 2014-09-17 sprint to Arvados Future Sprints

#6 Updated by Tom Clegg 11 months ago

  • Status changed from New to Closed

#7 Updated by Tom Clegg 11 months ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF