Feature #5459

[Crunch] Job logs include node-level resource usage statistics (cpu, ram, swap, etc)

Added by Peter Amstutz over 4 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

History

#1 Updated by Peter Amstutz over 4 years ago

  • Tracker changed from Bug to Feature

#2 Updated by Tom Clegg over 4 years ago

  • Subject changed from [Crunch] Crunchstat records total load on compute nodes in addition to per-task load to [Crunch] Job logs include node-level resource usage statistics (cpu, ram, swap, etc)
  • Category set to Crunch
  • Target version changed from Bug Triage to Arvados Future Sprints

This is in addition to (and hopefully in the same format as) the per-task-container stats already provided by crunchstat.

#3 Updated by Tom Clegg over 4 years ago

Could be done from crunch-job by running a "crunchstat ... sleep 2^30" process on each node at the beginning of the job, propagating its stats to the log, and killing it off at the end.

Also available in: Atom PDF