Story #3347

[Crunch] Run dev (and real) jobs using a syntax as close as possible to "python foo.py input.txt"

Added by Tom Clegg over 2 years ago. Updated 16 days ago.

Status:ClosedStart date:08/28/2014
Priority:NormalDue date:08/28/2014
Assignee:-% Done:

0%

Category:Crunch
Target version:-
Story points2.0
Velocity based estimate-

Description

See Python SDK design draft.

Running programs with Crunch should look more like this

python foo.py input.txt

and less like this

git commit -am -
git push
arv job create --job '{"script_name":"foo.py","script_parameters":{"input":"acbd18db4cc2f85cedef654fccc4a4d8+3/input.txt"},"script_version":"master"}'
This is easier to achieve when the following conditions are met:
  • foo.py is already in a git repository, committed and pushed to git@git.*.arvadosapi.com:waz.git
We will probably need to defer:
  • Automatically commit uncommitted changes
  • Automatically push to origin

Related issues

Follows Arvados - Story #3603: [Crunch] Design good Crunch task API, including considera... Closed 08/27/2014

History

#1 Updated by Peter Amstutz over 2 years ago

I don't understand what this story is saying at all.

#2 Updated by Tom Clegg over 2 years ago

  • Description updated (diff)

#3 Updated by Ward Vandewege over 2 years ago

  • Target version changed from Arvados Future Sprints to 2014-09-17 sprint

#4 Updated by Tom Clegg over 2 years ago

  • Description updated (diff)
  • Category set to Crunch

#5 Updated by Tom Clegg over 2 years ago

  • Target version changed from 2014-09-17 sprint to Arvados Future Sprints

#6 Updated by Tom Clegg 18 days ago

  • Status changed from New to Closed

#7 Updated by Tom Clegg 16 days ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF