Bug #21990
closedLog files arv-mount.txt, crunchstat.txt, and hoststat.txt no longer show timestamps
Description
Symptom -- apparently related to issue #21834 - the process log files arv-mount.txt
, crunchstat.txt
, and hoststat.txt
`are not showing the timestamps as they used to do in v2.7.3. This has cascading effect of making crunchstat_summary
unable to parse the output, see source:tools/crunchstat-summary/crunchstat_summary/summarizer.py@7f01a21e3f250027510d16c32acd0c62173f1fec#L109 (I think at the end of the run the arv-mount.txt
and crunchstat.txt
files are used to generate the report). With the timestamp missing, the regular expression in L86 may match log lines by accident, but without capturing valid values for the groups, so we will hit that raise
in the highlighted line. This will also be visible in WB2 as a warning message about failing to generate usage report.
The expected behavior (based on my understanding) is to consistently prefix each line in all of the applicable output logs with the timestamp, and the usage report can be created from them.
I've attached two output log collections, one with what I think is the "correct" behavior (from a run on v.2.7.3) and the other with missing timestamps (generated by the dev version).
Files
Updated by Zoë Ma 5 months ago
Peter Amstutz wrote in #note-1:
You are using development packages, correct? Have you updated them recently? Because this sounds exactly like #21833 and #21834 which are fixed in main.
You need to update
crunch-run
.
I was using crunch-run 2.8.0~dev20240703133808 (go1.21.10)
, from the jammy-dev repo.
Updated by Tom Clegg 4 months ago
- Status changed from New to In Progress
- restore timestamps to crunchstat.txt, hoststat.txt, arv-mount.txt and update tests to confirm
- (unrelated/bonus) copy arv-mount's stdout to crunch-run's stderr (previously, although both stdout and stderr are preserved in the arv-mount.txt log file, only stderr was copied to crunch-run's stderr. I don't expect arv-mount to write anything on stdout, but if it ever comes up, I'm pretty sure we'll want this behavior to be consistent)
Updated by Brett Smith 4 months ago
Tom Clegg wrote in #note-5:
21990-log-timestamps @ 877540d5250bb8a5ace208f51eb5dde7ff33b157 -- developer-run-tests: #4389
LGTM, thanks.
Updated by Tom Clegg 4 months ago
- Status changed from In Progress to Resolved
Applied in changeset arvados|7020990f4dbf9fdbd60ae24283ba9a8659deadab.