Project

General

Profile

Idea #2756

Updated by Tom Clegg almost 10 years ago

This page needs to be good at 
 * Monitoring progress while the pipeline is running 
 * Troubleshooting a failed pipeline 
 * Reviewing/investigating details of a finished pipeline 

 Features: 
 * If jobs are running, show log messages in real time using websockets 
 * If jobs are queued, show queue status 
 * If a job was created before pipeline itself, note "re-used existing job queued/finished at time X" 
 * Show job details (script, parameters, git commit, [first few] output filenames/sizes) 
 * Show job log messages, e.g., 
 ** Hover/pop-up to show latest+live logs for a single job that is running 
 ** Persistent "fake terminal window" above/below(?) with merged latest+live log messages from all jobs in this pipeline that happen to be running 

 Infrastructure: 
 * API server should have access to the last few lines of every recent/current job log (via redis) as well as live logs (also via redis) and old/finished jobs (via log collection stored in Keep). Might need some more API to make them accessible via websocket (redis) or workbench (keep)? pop-up 

Back