Bug #14451: crunchstat-summary recommends 563 TB Keep cache (or more!) - Arvados

Actions

Copy link

Bug #14451

closed

crunchstat-summary recommends 563 TB Keep cache (or more!)

Added by Tom Morris about 6 years ago. Updated over 5 years ago.

Status:

Resolved

Priority:

Normal

Assigned To:

Tom Morris

Category:

Target version:

2019-03-27 Sprint

Story points:

Release:

Arvados v1.4 - Q1/Q2 2019

Release relationship:

Auto

Description

Even given the low cache utilization, that seems like a lot

### Summary for make_examples_4 (e51c5-dz642-id66uhhem9viqk0)
# Keep cache miss rate 0.19%
# Keep cache utilization 52.15%
#!! make_examples_4 max RSS was 336 MiB -- try runtime_constraints "ram":1020054732
#!! make_examples_4 Keep cache utilization was 52.15% -- try runtime_constraints "keep_cache_ram":562949953421312 (or more)

Subtasks 1 (0 open — 1 closed)

Actions

Copy link

Updated by Tom Clegg about 6 years ago

source:tools/crunchstat-summary/crunchstat_summary/summarizer.py probably needs to multiply by self._runtime_constraint_mem_unit()/1048576 when computing asked_mib here:

    def _recommend_keep_cache(self):
...
        asked_mib = self.existing_constraints.get(constraint_key, 256)
...
                asked_mib*2*(2**20)/self._runtime_constraint_mem_unit())

Actions

Copy link