Task #2953

Feature #2886: Recurring: support beta users

crunch-job should save output manifests with permission hints stripped

Added by Brett Smith about 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Brett Smith
Category:
-
Start date:
06/03/2014
Due date:
% Done:

100%

Estimated time:

Description

crunch-job is failing to save Job outputs right now because it doesn't handle permission hints correctly. Example error message from the log:

2014-06-03_17:29:47 qr1hi-8i9sb-huk6pcv7w376ru0 4413  Failed to register output manifest: API call /collections failed: 422 Unprocessable Entity
2014-06-03_17:29:47 qr1hi-8i9sb-huk6pcv7w376ru0 4413  {"errors":["Uuid does not match checksum of manifest_text"]} at /usr/local/arvados/src/sdk/cli/bin/crunch-job line 813

This happens because it sends along a manifest+UUID pair with permission hints in it. However, the API server refuses to store manifests with permission hints. It strips them out, then compares the result against the provided UUID.

After collating output, crunch-job should read back the data using arv-get; strip +A hints from it; compute hash of what's left; and use that hash as the uuid for collections.create(), and use whatever collections.create() returns as the job's output.

Associated revisions

Revision a4378cd4 (diff)
Added by Brett Smith about 5 years ago

2953: crunch-job strips permission hints from output manifests.

The API server also strips permission hints from submitted
collections, and will reject it if the specified UUID doesn't match
that result. As a consequence, this is necessary for crunch-job to
register output with the API server.

Closes #2953.

History

#1 Updated by Brett Smith about 5 years ago

  • Target version set to 2014-06-17 Curating and Crunch
  • Parent task set to #2886

#2 Updated by Brett Smith about 5 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100
  • Remaining (hours) set to 0.0

Applied in changeset arvados|commit:a4378cd48648a9ca315713535f651d1bbace322f.

Also available in: Atom PDF