Story #3254

[Documentation] Add a "run one of the sample crunch scripts in local/development mode from your VM" tutorial

Added by Tom Clegg over 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
08/11/2014
Due date:
% Done:

100%

Estimated time:
(Total: 8.00 h)
Story points:
1.0

Description

No creating git repositories, pushing, etc. -- just log in to VM, clone the arvados repository, and use one of the crunch scripts already included there. arv-get the output to show it in the terminal (or cat it using the keep fuse mount). Then edit the script and run it again.

Goal is to show how to do quick iterations with a crunch job on small inputs, without a lot of git machinations and waiting for compute workers to be available.


Subtasks

Task #3275: Split "writing a crunch script" into before-push and after-push stagesResolvedPeter Amstutz

Associated revisions

Revision 872cf2e0
Added by Peter Amstutz about 5 years ago

Merge branch '3254-run-job-locally-docs' closes #3254 refs #3556

Revision 774a5d85 (diff)
Added by Peter Amstutz about 5 years ago

Fix broken links. refs #3254

Revision 7f4ff745 (diff)
Added by Peter Amstutz about 5 years ago

Fix broken link again. refs #3254

History

#1 Updated by Tom Clegg over 5 years ago

  • Subject changed from [Documentation] Wiki has the second tutorial: running one of the bundled crunch jobs in dev mode in a VM to [Documentation] Add a "run one of the sample crunch scripts in local/development mode from your VM" tutorial

#2 Updated by Tim Pierce over 5 years ago

  • Assigned To set to Tim Pierce

#3 Updated by Tom Clegg over 5 years ago

  • Description updated (diff)

#4 Updated by Peter Amstutz about 5 years ago

To some extent this already exists: http://doc.arvados.org/user/topics/tutorial-job-debug.html

However I see the benefit to reorganizing/refactoring http://doc.arvados.org/user/tutorials/tutorial-firstscript.html and http://doc.arvados.org/user/topics/tutorial-job-debug.html so that it presents how to write and run a script using arv-crunch-job first and then talks about how use git and submit jobs to the cluster.

#5 Updated by Tom Clegg about 5 years ago

  • Assigned To changed from Tim Pierce to Peter Amstutz

#6 Updated by Peter Amstutz about 5 years ago

  • Status changed from New to In Progress

#7 Updated by Tom Clegg about 5 years ago

Just two comments:

  • In /user/tutorials/tutorial-firstscript.html, a typo: reproducibilty → reproducibility
  • Perhaps out of scope but we really should stop saying "parallel" all over the place when we mean "concurrent".

#8 Updated by Ward Vandewege about 5 years ago

  • Target version changed from 2014-08-06 Sprint to 2014-08-27 Sprint

#9 Updated by Anonymous about 5 years ago

  • Status changed from In Progress to Resolved

Applied in changeset arvados|commit:872cf2e096a7b72722aa76040339a23e962cdf96.

Also available in: Atom PDF