Project

General

Profile

Actions

Bug #20184

closed

Do small batches and small commits in UpdatePriority.run_update_thread

Added by Tom Clegg about 1 year ago. Updated about 1 year ago.

Status:
Rejected
Priority:
Normal
Assigned To:
Category:
API
Target version:
Story points:
1.0

Description

Partial fix for #20183.

We are seeing a deadlock/starvation issue where a container, whose crunch-run process has ended, cannot be finalized even with repeated attempts by arvados-dispatch-cloud (5m postgresql statement timeout), because its "select for update" is blocked by an UpdatePriority thread doing CPU- and memory-intensive things while keeping a database transaction open with uncommitted updates.

The idea here is to reduce the duration of open transactions in UpdatePriority threads.

Actions #2

Updated by Tom Clegg about 1 year ago

So far, due to Rails/ActiveRecord transaction magic and extra magic during tests, this seems harder than #20183, not easier.

Actions #3

Updated by Tom Clegg about 1 year ago

  • Status changed from In Progress to Rejected
Actions

Also available in: Atom PDF