Feature #8570
[Crunch2] Impure access to object store
Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:
0%
Estimated time:
Story points:
-
Description
As a transitional feature for deploying Crunch v2 into existing cloud environments, support staging files by downloading/uploading from/to object store such as S3 (alternately, use something like https://github.com/s3fs-fuse/s3fs-fuse). Will make container impure (not reusable/reproducible) since contents of files are not guaranteed to remain the same.
Related issues
History
#1
Updated by Peter Amstutz about 6 years ago
- Description updated (diff)
#2
Updated by Peter Amstutz about 6 years ago
- Subject changed from [Crunch2] Impure staging files from object store to [Crunch2] Impure access to object store
#3
Updated by Peter Amstutz about 6 years ago
- Description updated (diff)
#4
Updated by Peter Amstutz about 6 years ago
- Description updated (diff)
#5
Updated by Tom Morris about 4 years ago
- Release deleted (
11)
#6
Updated by Peter Amstutz over 2 years ago
- Related to Story #15960: Computing on external data added