Project

General

Profile

Actions

Bug #9820

closed

[CWL] Poll jobs instead of using events interface

Added by Peter Amstutz over 7 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Story points:
0.5

Description

Arvados-cwl-runner currently uses the events interface to get notifications when jobs finish. However, because the websockets server is unreliable, it uses log table polling, but log table polling is also unreliable, and also puts unnecessary strain on the API server.

arvados-cwl-runner should be modified to poll only job or container records that it is actively interested in.


Subtasks 1 (0 open1 closed)

Task #9822: Review 9820-cwl-poll-jobsResolvedPeter Amstutz08/19/2016Actions
Actions #1

Updated by Peter Amstutz over 7 years ago

  • Description updated (diff)
Actions #2

Updated by Tom Morris over 7 years ago

  • Assigned To set to Peter Amstutz
  • Target version set to 2016-08-31 sprint
  • Story points set to 0.5
Actions #3

Updated by Tom Clegg over 7 years ago

  • Status changed from New to In Progress

Nice to get rid of those "get all events about any job/container in the world" filters. ;)

Commented-out logging statement in services/api/lib/eventbus.rb committed by mistake?

Typo "Runs is a separate thread."

LGTM.

Actions #4

Updated by Peter Amstutz over 7 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

Applied in changeset arvados|commit:7daef1e224ee6fb8b03cd7b71773c5381c07324e.

Actions

Also available in: Atom PDF