Bug #9820

[CWL] Poll jobs instead of using events interface

Added by Peter Amstutz over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
08/19/2016
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
0.5

Description

Arvados-cwl-runner currently uses the events interface to get notifications when jobs finish. However, because the websockets server is unreliable, it uses log table polling, but log table polling is also unreliable, and also puts unnecessary strain on the API server.

arvados-cwl-runner should be modified to poll only job or container records that it is actively interested in.


Subtasks

Task #9822: Review 9820-cwl-poll-jobsResolvedPeter Amstutz

Associated revisions

Revision 7daef1e2
Added by Peter Amstutz over 4 years ago

Merge branch '9820-cwl-poll-jobs' closes #9820

History

#1 Updated by Peter Amstutz over 4 years ago

  • Description updated (diff)

#2 Updated by Tom Morris over 4 years ago

  • Assigned To set to Peter Amstutz
  • Target version set to 2016-08-31 sprint
  • Story points set to 0.5

#3 Updated by Tom Clegg over 4 years ago

  • Status changed from New to In Progress

Nice to get rid of those "get all events about any job/container in the world" filters. ;)

Commented-out logging statement in services/api/lib/eventbus.rb committed by mistake?

Typo "Runs is a separate thread."

LGTM.

#4 Updated by Peter Amstutz over 4 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

Applied in changeset arvados|commit:7daef1e224ee6fb8b03cd7b71773c5381c07324e.

Also available in: Atom PDF