Project

General

Profile

Actions

Bug #20801

open

Crunch discountConfiguredRAMPercent math seems surprising, undesirable

Added by Brett Smith 4 months ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

discountConfiguredRAMPercent was added to a-d-c in #12199, 80da19707253af74bd78c374bfcab64b04d2dbde. The commit message says "Derate advertised node sizes by 5%." What it actually does is increase a container request's RAM requirement by 5% after ReserveExtraRAM and local keepstore requiprements have been rolled in. Neither seems like what we want: while it's true Crunch won't be able to use all the RAM on the system, the amount it can't use seems likely to be mostly constant based on what else runs from the compute node image rather than a percentage of node size.

We already have a configuration knob, Containers.ReserveExtraRAM, that lets the administrator tell Crunch that amount. I think we should rely on that exclusively for the goal we're trying to accomplish here, and eliminate discountConfiguredRAMPercent as a source of difficult-to-diagnose "why didn't my container request get the node size I expected" problems.


Related issues

Related to Arvados - Feature #14922: Run multiple containers concurrently on a single cloud VMNew

Actions
Actions #1

Updated by Brett Smith 4 months ago

  • Description updated (diff)
Actions #2

Updated by Peter Amstutz 3 months ago

  • Related to Feature #14922: Run multiple containers concurrently on a single cloud VM added
Actions

Also available in: Atom PDF