Bug #8910
closed
[SDK] arv-put should save manifest text on API error
Added by Peter Amstutz about 8 years ago.
Updated about 7 years ago.
Description
If arv-put gets an API error when creating the collection record, the entire upload is for nothing because the once the manifest_text is lost it is necessary to re-upload the whole thing. Arv-put should save the manifest text somewhere to offer some way of recovering from error.
This should probably leverage the existing "resume" functionality.
- Description updated (diff)
Peter Amstutz wrote:
This should probably leverage the existing "resume" functionality.
Another approach would be for arv-put to start using the Collection class, start a new collection on upload, and periodically save it until the upload is finished.
This is a bigger change, but moving to the Collection class makes it easier to make a lot of other changes we want in arv-put: refreshing permission tokens as it goes along, smarter block splits, adding files to existing collections, etc.
- Target version set to Arvados Future Sprints
- Assigned To set to Lucas Di Pentima
Lucas - have the recent arv-put changes resolved this?
Tom Morris wrote:
Lucas - have the recent arv-put changes resolved this?
Now arv-put periodically (every 20 secs, IIRC) saves the manifest on its cache, so I would say: yes.
- Status changed from New to Resolved
- Target version deleted (
Arvados Future Sprints)
Also available in: Atom
PDF
Updated by 
Updated by 
Updated by Tom Morris 
Updated by 
Updated by