Actions
Task #3309
open
Idea #3511: [Documentation] Present an efficient pattern for developing a pipeline template with multiple crunch scripts
[Documentation] Present an efficient pattern for developing a Python program as a Crunch job
Status:
New
Priority:
Normal
Assigned To:
-
Target version:
-
Description
Approximate outline:
- Find/make a small test dataset and put it in Keep
- Clone git repository to shell VM (or start a new one)
- Put crunch wrapper in
/crunch_scripts/foobar - Run on VM in terminal using crunch-job
- Repeat until this works
- Commit and push
- Run as a real job using small test dataset
- Repeat until this works
- Run as a real job using real data
- One task per job
Here, just present the minimum feature set. Refer to appropriate doc sections for related features, something like "Learn more about what scripts are expected to see/do/output on the {foobar doc page}" (link to outcome of #3044)
Related issues
Updated by Ward Vandewege over 9 years ago
- Subject changed from [Documentation] Present an efficient pattern for developing a Python program using Crunch to [Documentation] Present an efficient pattern for developing an existing program using Crunch
- Description updated (diff)
- Category set to Documentation
- Target version set to 2014-08-06 Sprint
Updated by Tom Clegg over 9 years ago
- Target version changed from 2014-08-06 Sprint to 2014-08-27 Sprint
Updated by Tom Clegg over 9 years ago
- Subject changed from [Documentation] Present an efficient pattern for developing an existing program using Crunch to [Documentation] Present an efficient pattern for developing a Python program as a Crunch job
- Description updated (diff)
Updated by Peter Amstutz over 9 years ago
- Description updated (diff)
- Assigned To set to Peter Amstutz
Updated by Peter Amstutz over 9 years ago
- Assigned To changed from Peter Amstutz to Brett Smith
Actions