Project

General

Profile

Actions

Task #2953

closed

Feature #2886: Recurring: support beta users

crunch-job should save output manifests with permission hints stripped

Added by Brett Smith almost 10 years ago. Updated almost 10 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:

Description

crunch-job is failing to save Job outputs right now because it doesn't handle permission hints correctly. Example error message from the log:

2014-06-03_17:29:47 qr1hi-8i9sb-huk6pcv7w376ru0 4413  Failed to register output manifest: API call /collections failed: 422 Unprocessable Entity
2014-06-03_17:29:47 qr1hi-8i9sb-huk6pcv7w376ru0 4413  {"errors":["Uuid does not match checksum of manifest_text"]} at /usr/local/arvados/src/sdk/cli/bin/crunch-job line 813

This happens because it sends along a manifest+UUID pair with permission hints in it. However, the API server refuses to store manifests with permission hints. It strips them out, then compares the result against the provided UUID.

After collating output, crunch-job should read back the data using arv-get; strip +A hints from it; compute hash of what's left; and use that hash as the uuid for collections.create(), and use whatever collections.create() returns as the job's output.

Actions #1

Updated by Brett Smith almost 10 years ago

  • Target version set to 2014-06-17 Curating and Crunch
  • Parent task set to #2886
Actions #2

Updated by Brett Smith almost 10 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100
  • Remaining (hours) set to 0.0

Applied in changeset arvados|commit:a4378cd48648a9ca315713535f651d1bbace322f.

Actions

Also available in: Atom PDF