Project

General

Profile

Actions

Idea #3347

closed

[Crunch] Run dev (and real) jobs using a syntax as close as possible to "python foo.py input.txt"

Added by Tom Clegg over 10 years ago. Updated almost 8 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Start date:
08/28/2014
Due date:
08/28/2014
Story points:
2.0

Description

See Python SDK design draft.

Running programs with Crunch should look more like this

python foo.py input.txt

and less like this

git commit -am -
git push
arv job create --job '{"script_name":"foo.py","script_parameters":{"input":"acbd18db4cc2f85cedef654fccc4a4d8+3/input.txt"},"script_version":"master"}'
This is easier to achieve when the following conditions are met:
  • foo.py is already in a git repository, committed and pushed to git@git.*.arvadosapi.com:waz.git
We will probably need to defer:
  • Automatically commit uncommitted changes
  • Automatically push to origin

Related issues 1 (0 open1 closed)

Follows Arvados - Idea #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jobs" and "reusable tasks" ideasClosed08/27/2014Actions
Actions #1

Updated by Peter Amstutz over 10 years ago

I don't understand what this story is saying at all.

Actions #2

Updated by Tom Clegg over 10 years ago

  • Description updated (diff)
Actions #3

Updated by Ward Vandewege over 10 years ago

  • Target version changed from Arvados Future Sprints to 2014-09-17 sprint
Actions #4

Updated by Tom Clegg over 10 years ago

  • Description updated (diff)
  • Category set to Crunch
Actions #5

Updated by Tom Clegg over 10 years ago

  • Target version changed from 2014-09-17 sprint to Arvados Future Sprints
Actions #6

Updated by Tom Clegg almost 8 years ago

  • Status changed from New to Closed
Actions #7

Updated by Tom Clegg almost 8 years ago

  • Target version deleted (Arvados Future Sprints)
Actions

Also available in: Atom PDF