Bug #3482

[Crunch] crunch-job prints the wrong output hash in its log messages (hash of manifest with signatures)

Added by Peter Amstutz about 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Brett Smith
Category:
Crunch
Target version:
Start date:
Due date:
% Done:

100%

Estimated time:
Story points:
0.5

Description

When a job completes, crunch-job prints out the output for the job. This can include a manifest, which is automatically created as a collection. The output hash is (apparently) obtained by a naive hash of the contents of "output", rather than using arv-normalize or reporting the contents of "output" after actually creating the collection. This leads to misleading results where the output is logged as one hash, but is recorded in the database with a different (correct) hash.

Associated revisions

Revision 18651589 (diff)
Added by Brett Smith about 5 years ago

3482: crunch-job logs locator of job output sans permission hints.

This makes crunch-job log a locator that's consistent with the output
locator that it sets for the job in the database. Closes #3482.

History

#1 Updated by Peter Amstutz about 5 years ago

  • Description updated (diff)

#2 Updated by Peter Amstutz about 5 years ago

  • Subject changed from crunch-job logs misleading output collection hash to [Crunch] crunch-job discrepency in output collection hash between log and job record
  • Category set to Crunch

#3 Updated by Peter Amstutz about 5 years ago

This also leads to manifests getting stored in Keep that have Keep access tokens in them, which is wrong.

#4 Updated by Tom Clegg about 5 years ago

  • Target version set to 2014-08-27 Sprint

#5 Updated by Tom Clegg about 5 years ago

  • Subject changed from [Crunch] crunch-job discrepency in output collection hash between log and job record to [Crunch] crunch-job prints the wrong output hash in its log messages (hash of manifest with signatures)
  • Story points set to 0.5

#6 Updated by Brett Smith about 5 years ago

  • Assigned To set to Brett Smith

#7 Updated by Brett Smith about 5 years ago

  • Status changed from New to Resolved
  • % Done changed from 0 to 100

Applied in changeset arvados|commit:1865158987c87ef6e6b1c53db65615b17b6324af.

Also available in: Atom PDF