Bug #12465
open
[crunchv2] Improve crunch-run environment reporting
Added by Peter Amstutz over 6 years ago.
Updated about 2 months ago.
Release relationship:
Auto
Description
Crunch-run should log its environment earlier in the startup process (before loading the Docker image or creating arv-mount)
It should also log some additional information:
- crunch-run version
- Docker version
- arv-mount version
- cloud instance id (/var/tmp/arv-node-data/meta-data/instance-id)
- cloud instance type (/var/tmp/arv-node-data/meta-data/instance-type)
- Description updated (diff)
- Description updated (diff)
- Target version set to To Be Groomed
Crunch v1 logs the following information:
runtime_constraints {"min_ram_mb_per_node":10000,"max_tasks_per_node":0,"min_cores_per_node":2,"docker_image":"foo/bar","min_scratch_mb_per_node":51024}
compute146 clustr-7ekkf-fe12d0nlvw3xa4b {"total_scratch_mb":102345,"total_ram_mb":14011,"total_cpu_cores":2,"cloud_node":{"price":0.149,"size":"Standard_D11_v2"}}
We should make sure that the Crunch v2 information is a superset of that (and Ideally in a compatible format)
While we're at it, we should fix the formatting of the existing logging. For example, the missing spaces after the "node-info" prefixes here:
2017-10-26T15:11:40.858866900Z Docker response: {"stream":"Loaded image ID: sha256:bf3a9bd0230a9f581d5a5c8f7816a529e9b84da644766b79bd926b7594fd52e4\n"}
2017-10-26T15:12:07.853864200Z Creating Docker container
node-infoHost Information
node-info Linux compute26.su92l.arvadosapi.com 4.10.0-37-generic #41~16.04.1-Ubuntu SMP Fri Oct 6 22:42:59 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
node-info
node-infoCPU Information
- Target version changed from To Be Groomed to 2017-12-20 Sprint
- Assigned To set to Peter Amstutz
- Assigned To deleted (
Peter Amstutz)
- Target version changed from 2017-12-20 Sprint to Arvados Future Sprints
- Related to Bug #12933: [crunch2] add equivalent of cloud_node line added
- Target version deleted (
Arvados Future Sprints)
- Target version set to Future
Also available in: Atom
PDF
Updated by 
Updated by Tom Morris