Project

General

Profile

Actions

Bug #12465

open

[crunchv2] Improve crunch-run environment reporting

Added by Peter Amstutz over 6 years ago. Updated 27 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

Crunch-run should log its environment earlier in the startup process (before loading the Docker image or creating arv-mount)

It should also log some additional information:

  • crunch-run version
  • Docker version
  • arv-mount version
  • cloud instance id (/var/tmp/arv-node-data/meta-data/instance-id)
  • cloud instance type (/var/tmp/arv-node-data/meta-data/instance-type)

Related issues

Related to Arvados - Bug #12933: [crunch2] add equivalent of cloud_node lineResolvedTom Clegg01/11/2018Actions
Actions #1

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #2

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #3

Updated by Tom Morris over 6 years ago

  • Target version set to To Be Groomed

Crunch v1 logs the following information:

 runtime_constraints {"min_ram_mb_per_node":10000,"max_tasks_per_node":0,"min_cores_per_node":2,"docker_image":"foo/bar","min_scratch_mb_per_node":51024}
 compute146 clustr-7ekkf-fe12d0nlvw3xa4b {"total_scratch_mb":102345,"total_ram_mb":14011,"total_cpu_cores":2,"cloud_node":{"price":0.149,"size":"Standard_D11_v2"}}

We should make sure that the Crunch v2 information is a superset of that (and Ideally in a compatible format)

Actions #4

Updated by Tom Morris over 6 years ago

While we're at it, we should fix the formatting of the existing logging. For example, the missing spaces after the "node-info" prefixes here:

2017-10-26T15:11:40.858866900Z Docker response: {"stream":"Loaded image ID: sha256:bf3a9bd0230a9f581d5a5c8f7816a529e9b84da644766b79bd926b7594fd52e4\n"}
2017-10-26T15:12:07.853864200Z Creating Docker container
node-infoHost Information
node-info  Linux compute26.su92l.arvadosapi.com 4.10.0-37-generic #41~16.04.1-Ubuntu SMP Fri Oct 6 22:42:59 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
node-info  
node-infoCPU Information
Actions #5

Updated by Tom Morris over 6 years ago

  • Target version changed from To Be Groomed to 2017-12-20 Sprint
Actions #6

Updated by Peter Amstutz over 6 years ago

  • Assigned To set to Peter Amstutz
Actions #7

Updated by Peter Amstutz over 6 years ago

  • Assigned To deleted (Peter Amstutz)
  • Target version changed from 2017-12-20 Sprint to Arvados Future Sprints
Actions #8

Updated by Peter Amstutz about 6 years ago

  • Related to Bug #12933: [crunch2] add equivalent of cloud_node line added
Actions #9

Updated by Peter Amstutz over 2 years ago

  • Target version deleted (Arvados Future Sprints)
Actions #10

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #11

Updated by Peter Amstutz 27 days ago

  • Target version set to Future
Actions

Also available in: Atom PDF