Task #2953
closed
Feature #2886: Recurring: support beta users
crunch-job should save output manifests with permission hints stripped
Description
crunch-job is failing to save Job outputs right now because it doesn't handle permission hints correctly. Example error message from the log:
2014-06-03_17:29:47 qr1hi-8i9sb-huk6pcv7w376ru0 4413 Failed to register output manifest: API call /collections failed: 422 Unprocessable Entity 2014-06-03_17:29:47 qr1hi-8i9sb-huk6pcv7w376ru0 4413 {"errors":["Uuid does not match checksum of manifest_text"]} at /usr/local/arvados/src/sdk/cli/bin/crunch-job line 813
This happens because it sends along a manifest+UUID pair with permission hints in it. However, the API server refuses to store manifests with permission hints. It strips them out, then compares the result against the provided UUID.
After collating output, crunch-job should read back the data using arv-get; strip +A hints from it; compute hash of what's left; and use that hash as the uuid for collections.create(), and use whatever collections.create() returns as the job's output.
Updated by Brett Smith over 10 years ago
- Target version set to 2014-06-17 Curating and Crunch
- Parent task set to #2886
Updated by Brett Smith over 10 years ago
- Status changed from New to Resolved
- % Done changed from 0 to 100
- Remaining (hours) set to 0.0
Applied in changeset arvados|commit:a4378cd48648a9ca315713535f651d1bbace322f.