Project

General

Profile

Actions

Feature #9136

open

[Python SDK] Add a Collection method to efficiently concatenate files

Added by Sarah Guthrie almost 8 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

Concatenating N files together to create a new one can be accomplished with manifest text manipulation, without moving data.

  1. Add a method to the Arvados SDK that appends the segments of one ArvadosFile to another (a generalized version could replace a region of one ArvadosFile with a region from another one.)
  2. Provide example Python code (create a new ArvadosFile that is the combinations of two or more other files)
  3. Provide example CWL (requires passing in explicit keep references, talking to API server to create new output collection, and producing cwl.output.json with references to the new collection).
Actions #1

Updated by Brett Smith almost 8 years ago

  • Subject changed from [Python SDK] Add an ability to 'cat' multiple files in a collection together to [Python SDK] Add a Collection method to efficiently concatenate files
Actions #2

Updated by Brett Smith almost 8 years ago

  • Target version set to Arvados Future Sprints
Actions #3

Updated by Tom Morris over 5 years ago

  • Target version changed from Arvados Future Sprints to To Be Groomed
Actions #4

Updated by Peter Amstutz over 5 years ago

  • Description updated (diff)
Actions #5

Updated by Peter Amstutz almost 3 years ago

  • Target version deleted (To Be Groomed)
Actions #6

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #7

Updated by Peter Amstutz about 2 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF