Actions
Feature #9136
open[Python SDK] Add a Collection method to efficiently concatenate files
Story points:
-
Release:
Release relationship:
Auto
Description
Concatenating N files together to create a new one can be accomplished with manifest text manipulation, without moving data.
- Add a method to the Arvados SDK that appends the segments of one ArvadosFile to another (a generalized version could replace a region of one ArvadosFile with a region from another one.)
- Provide example Python code (create a new ArvadosFile that is the combinations of two or more other files)
- Provide example CWL (requires passing in explicit keep references, talking to API server to create new output collection, and producing cwl.output.json with references to the new collection).
Updated by Brett Smith over 8 years ago
- Subject changed from [Python SDK] Add an ability to 'cat' multiple files in a collection together to [Python SDK] Add a Collection method to efficiently concatenate files
Updated by Brett Smith over 8 years ago
- Target version set to Arvados Future Sprints
Updated by Tom Morris almost 6 years ago
- Target version changed from Arvados Future Sprints to To Be Groomed
Updated by Peter Amstutz over 3 years ago
- Target version deleted (
To Be Groomed)
Actions