Feature #19961
Updated by Peter Amstutz about 1 year ago
When running on a spot instance, crunch-run should check for "spot instance interruption notices":https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-instance-termination-notices.html (AWS recommends checking every 5s) and, when an interruption notice is detected,
* mention it in the crunch-run.txt log file
* mention it in the runtime_status container field
* save the log collection
* update the container record with the new log pdh
* continue running (perhaps the container will finish before the instance gets shut down)
* should have an easy, documented way determining programmatically that this happened