Project

General

Profile

Actions
Copy link

Feature #4248

closed

[Crunch] Collate task output (if any) even if the job failed.

Added by Brett Smith over 9 years ago. Updated over 8 years ago.

Status:
Duplicate
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Story points:
0.5

Description

qr1hi-8i9sb-h6ur26bp5gzd6am failed. But Bryan knows that even the failed command produces output, and it's much easier to diagnose that problem if he can see it.

In this specific case, run-command recorded a manifest in the task output, and we were able to use that to recreate a Collection. But this required a lot of manual futzing. It would speed up pipeline development if this information were more readily accessible.

This may require designing rules or conventions about how tasks record their output (which might be part of the larger reusable tasks discussion).

Actions
Copy link
 #1

Updated by Brett Smith over 9 years ago

  • Assigned To set to Brett Smith
  • Parent task set to #4133
Actions
Copy link
 #2

Updated by Brett Smith over 9 years ago

  • Category set to Crunch
  • Parent task deleted (#4133)
Actions
Copy link
 #3

Updated by Brett Smith over 9 years ago

  • Subject changed from Job failed by making an API request for a Collection including a permission hint to Better visibility into failed Job output
  • Description updated (diff)
  • Category deleted (Crunch)

I totally botched the diagnosis of this bug by misreading the Job log (mea culpa). The underlying command invoked by run-command did fail, so the bug is not ours. Instead this is a feature request. I've refiled it appropriately.

Actions
Copy link
 #4

Updated by Brett Smith over 9 years ago

  • Assigned To deleted (Brett Smith)
Actions
Copy link
 #5

Updated by Brett Smith over 9 years ago

  • Tracker changed from Task to Bug
Actions
Copy link
 #6

Updated by Brett Smith over 9 years ago

  • Target version deleted (2014-10-29 sprint)
Actions
Copy link
 #7

Updated by Brett Smith over 9 years ago

  • Tracker changed from Bug to Feature
Actions
Copy link
 #8

Updated by Ward Vandewege over 9 years ago

  • Target version set to Arvados Future Sprints
Actions
Copy link
 #9

Updated by Tom Clegg over 9 years ago

  • Subject changed from Better visibility into failed Job output to [Crunch] Collate task output (if any) even if the job failed.
  • Story points set to 0.5
Actions
Copy link
 #10

Updated by Brett Smith over 8 years ago

  • Status changed from New to Duplicate
  • Target version deleted (Arvados Future Sprints)

Done in #4472.

Actions
Copy link

Also available in: Atom PDF