Feature #5459: [Crunch] Job logs include node-level resource usage statistics (cpu, ram, swap, etc) - Arvados

Actions

Copy link

Feature #5459

open

[Crunch] Job logs include node-level resource usage statistics (cpu, ram, swap, etc)

Added by Peter Amstutz almost 10 years ago. Updated 10 months ago.

Status:

New

Priority:

Normal

Assigned To:

Category:

Crunch

Target version:

Future

Story points:

Release:

Postponed

Release relationship:

Auto

Actions

Copy link

Updated by Peter Amstutz almost 10 years ago

Tracker changed from Bug to Feature

Actions

Copy link

Updated by Tom Clegg almost 10 years ago

Subject changed from [Crunch] Crunchstat records total load on compute nodes in addition to per-task load to [Crunch] Job logs include node-level resource usage statistics (cpu, ram, swap, etc)
Category set to Crunch
Target version changed from Bug Triage to Arvados Future Sprints

This is in addition to (and hopefully in the same format as) the per-task-container stats already provided by crunchstat.

Actions

Copy link

Updated by Tom Clegg almost 10 years ago

Could be done from crunch-job by running a "crunchstat ... sleep 2^30" process on each node at the beginning of the job, propagating its stats to the log, and killing it off at the end.

Actions

Copy link