Project

General

Profile

Actions

Bug #21990

closed

Log files arv-mount.txt, crunchstat.txt, and hoststat.txt no longer show timestamps

Added by Zoë Ma 4 months ago. Updated 2 months ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
Crunch
Story points:
-
Release:
Release relationship:
Auto

Description

Symptom -- apparently related to issue #21834 - the process log files arv-mount.txt, crunchstat.txt, and hoststat.txt `are not showing the timestamps as they used to do in v2.7.3. This has cascading effect of making crunchstat_summary unable to parse the output, see source:tools/crunchstat-summary/crunchstat_summary/summarizer.py@7f01a21e3f250027510d16c32acd0c62173f1fec#L109 (I think at the end of the run the arv-mount.txt and crunchstat.txt files are used to generate the report). With the timestamp missing, the regular expression in L86 may match log lines by accident, but without capturing valid values for the groups, so we will hit that raise in the highlighted line. This will also be visible in WB2 as a warning message about failing to generate usage report.

The expected behavior (based on my understanding) is to consistently prefix each line in all of the applicable output logs with the timestamp, and the usage report can be created from them.

I've attached two output log collections, one with what I think is the "correct" behavior (from a run on v.2.7.3) and the other with missing timestamps (generated by the dev version).


Files

00incorrect log for container xlbrs-dz642-0v7mqrlf2tuajyo.tar.gz (9.95 KB) 00incorrect log for container xlbrs-dz642-0v7mqrlf2tuajyo.tar.gz log collection with timestamps missing in 3 files Zoë Ma, 07/09/2024 10:14 AM
01correct log for container xlbrs-dz642-t0s46rogec7zzy2.tar.gz (19.3 KB) 01correct log for container xlbrs-dz642-t0s46rogec7zzy2.tar.gz log collection from v2.7.3 showing timestamps in all relevant files Zoë Ma, 07/09/2024 10:15 AM

Subtasks 1 (0 open1 closed)

Task #22039: Review 21990-log-timestampsResolvedTom Clegg08/16/2024Actions
Actions #1

Updated by Peter Amstutz 4 months ago

You are using development packages, correct? Have you updated them recently? Because this sounds exactly like #21833 and #21834 which are fixed in main.

You need to update crunch-run.

Actions #2

Updated by Zoë Ma 4 months ago

Peter Amstutz wrote in #note-1:

You are using development packages, correct? Have you updated them recently? Because this sounds exactly like #21833 and #21834 which are fixed in main.

You need to update crunch-run.

I was using crunch-run 2.8.0~dev20240703133808 (go1.21.10), from the jammy-dev repo.

Actions #3

Updated by Tom Clegg 3 months ago

  • Target version set to Development 2024-08-28 sprint
  • Assigned To set to Tom Clegg
Actions #4

Updated by Peter Amstutz 2 months ago

  • Release set to 70
Actions #5

Updated by Tom Clegg 2 months ago

  • Status changed from New to In Progress
21990-log-timestamps @ 877540d5250bb8a5ace208f51eb5dde7ff33b157 -- developer-run-tests: #4389
  • restore timestamps to crunchstat.txt, hoststat.txt, arv-mount.txt and update tests to confirm
  • (unrelated/bonus) copy arv-mount's stdout to crunch-run's stderr (previously, although both stdout and stderr are preserved in the arv-mount.txt log file, only stderr was copied to crunch-run's stderr. I don't expect arv-mount to write anything on stdout, but if it ever comes up, I'm pretty sure we'll want this behavior to be consistent)
Actions #6

Updated by Brett Smith 2 months ago

Tom Clegg wrote in #note-5:

21990-log-timestamps @ 877540d5250bb8a5ace208f51eb5dde7ff33b157 -- developer-run-tests: #4389

LGTM, thanks.

Actions #7

Updated by Tom Clegg 2 months ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF