Feature #20219
Updated by Peter Amstutz about 1 year ago
https://dev.arvados.org/projects/arvados/wiki/Efficient_live_access_to_container_logs
Stop getting things from the log table.
Get the list of files in the container log collection (via WebDAV):
/arvados/v1/containers/{uuid}/log
Then for the logs the user wants to view, get the data for the individual logs:
/arvados/v1/containers/{uuid}/log/{file}.txt
If the amount of data exceeds some limit (eg 128kb) then only fetch the first 64kb and last 64kb and include a message that some logs were omitted.
Periodically poll to see if the file sizes get bigger and request more data when it is available.